JUnit version 4.13.2
.18:29:30.738 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783535370727
18:29:30.771 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783535370771
18:29:30.803 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
18:29:30.807 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
18:29:30.873 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
18:29:30.884 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskSwO0Je/test-tmp
18:29:30.888 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
18:29:30.890 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskSwO0Je/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
18:29:31.068 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

18:29:31.257 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:29:31.258 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

18:29:31.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:31.261883 28946 mini_oidc.cc:150] Starting JWKS server
18:29:31.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:31.265213 28946 webserver.cc:534] Webserver started at http://127.0.0.1:42567/ using document root <none> and password file <none>
18:29:31.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:31.265631 28946 mini_oidc.cc:186] Starting OIDC Discovery server
18:29:31.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:31.267534 28946 webserver.cc:534] Webserver started at http://127.0.0.1:39513/ using document root <none> and password file <none>
18:29:31.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:29:31Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
18:29:31.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:29:31Z Disabled control of system clock
18:29:31.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:31.331204 28946 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:31.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:31.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/wal
18:29:31.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/data
18:29:31.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:31.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:31.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:31.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:31.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:31.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:31.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/logs
18:29:31.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/data/info.pb
18:29:31.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:31.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:31.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:31.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:31.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:31.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:31.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:31.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:31.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:29:31.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:31.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:31.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:31.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.68.190:40429
18:29:31.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.68.190
18:29:31.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:31.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.68.148:33449
18:29:31.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:31.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:31.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:31.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:31.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393
18:29:31.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:31.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42567/jwks.json with env {}
18:29:31.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:31.627740 28958 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:31.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:31.628466 28958 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:31.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:31.629256 28958 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:31.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:31.660590 28958 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:29:31.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:31.660991 28958 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:31.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:31.661304 28958 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:29:31.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:31.661643 28958 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:29:31.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:31.661998 28958 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:29:31.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:31.662274 28958 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42567/jwks.json
18:29:31.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:31.697959 28958 master_runner.cc:387] Master server non-default flags:
18:29:31.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:31.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.68.148:33449
18:29:31.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:31.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:31.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/data
18:29:31.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/wal
18:29:31.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:31.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393
18:29:31.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:31.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:31.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:31.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.68.190:40429
18:29:31.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:31.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:31.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:31.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42567/jwks.json
18:29:31.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:31.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:31.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/data/info.pb
18:29:31.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.68.190
18:29:31.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:31.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:31.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:31.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:31.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:31.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:31.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/logs
18:29:31.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:31.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:31.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:31.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:29:31.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:31.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:31.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:31.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:29:31.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:29:31.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:29:31.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:31.699713 28958 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:31.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:31.701989 28958 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:31.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:31.715787 28964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:33.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:31.716042 28965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:33.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.035602 28966 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1318 milliseconds
18:29:33.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.037292 28967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:33.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.040405 28958 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.325s	user 0.000s	sys 0.006s
18:29:33.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.040789 28958 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.326s	user 0.000s	sys 0.006s
18:29:33.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.041095 28958 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:29:33.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.043188 28958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:33.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.045995 28958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:33.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.047398 28958 hybrid_clock.cc:648] HybridClock initialized: now 1783535373047344 us; error 63 us; skew 500 ppm
18:29:33.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.048808 28958 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:33.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.057411 28958 webserver.cc:534] Webserver started at http://127.28.68.190:34069/ using document root <none> and password file <none>
18:29:33.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.059494 28958 fs_manager.cc:362] Metadata directory not provided
18:29:33.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.059777 28958 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:33.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.060400 28958 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:33.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.064971 28958 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/data/instance:
18:29:33.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "01d9b43974db42368cec63cde2c84fea"
18:29:33.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:33 on dist-test-slave-dxnw"
18:29:33.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.066283 28958 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/wal/instance:
18:29:33.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "01d9b43974db42368cec63cde2c84fea"
18:29:33.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:33 on dist-test-slave-dxnw"
18:29:33.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.074985 28958 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.001s
18:29:33.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.081537 28974 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:33.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.083083 28958 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.006s	sys 0.000s
18:29:33.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.083501 28958 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/wal
18:29:33.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "01d9b43974db42368cec63cde2c84fea"
18:29:33.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:33 on dist-test-slave-dxnw"
18:29:33.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.083952 28958 fs_report.cc:389] FS layout report
18:29:33.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:33.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/wal
18:29:33.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/wal
18:29:33.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/data/data
18:29:33.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:33.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:33.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:33.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:33.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:33.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:33.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:33.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:33.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:33.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:33.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:33.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.163709 28958 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:33.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.165376 28958 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:33.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.165930 28958 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:33.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.237491 28958 rpc_server.cc:307] RPC server started. Bound to: 127.28.68.190:40429
18:29:33.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.237607 29025 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.68.190:40429 every 8 connection(s)
18:29:33.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.240505 28958 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/data/info.pb
18:29:33.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.244079 28946 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 28958
18:29:33.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.244951 28946 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-0/wal/instance
18:29:33.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.248327 29026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:33.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.250487 28946 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:33.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:33.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/wal
18:29:33.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/data
18:29:33.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:33.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:33.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:33.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:33.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:33.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:33.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/logs
18:29:33.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/data/info.pb
18:29:33.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:33.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:33.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:33.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:33.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:33.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:33.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:33.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:33.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:29:33.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:33.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:33.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:33.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.68.189:33753
18:29:33.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.68.189
18:29:33.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:33.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.68.148:33449
18:29:33.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:33.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:33.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:33.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:33.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393
18:29:33.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:33.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42567/jwks.json with env {}
18:29:33.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.263341 29026 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } has no permanent_uuid. Determining permanent_uuid...
18:29:33.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.297874 29026 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } has no permanent_uuid. Determining permanent_uuid...
18:29:33.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.300592 28978 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.68.189:33753: connect: Connection refused (error 111)
18:29:33.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.305553 29026 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.68.189:33753: Network error: Client connection negotiation failed: client connection to 127.28.68.189:33753: connect: Connection refused (error 111)
18:29:33.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.355125 29026 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } attempt: 1
18:29:33.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.360456 29026 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.68.189:33753: Network error: Client connection negotiation failed: client connection to 127.28.68.189:33753: connect: Connection refused (error 111)
18:29:33.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.428941 29026 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } attempt: 2
18:29:33.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.435673 29026 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.68.189:33753: Network error: Client connection negotiation failed: client connection to 127.28.68.189:33753: connect: Connection refused (error 111)
18:29:33.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.527127 29026 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } attempt: 3
18:29:33.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.531692 29026 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.68.189:33753: Network error: Client connection negotiation failed: client connection to 127.28.68.189:33753: connect: Connection refused (error 111)
18:29:33.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.571497 29028 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:33.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.572196 29028 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:33.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.572897 29028 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:33.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.604619 29028 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:29:33.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.605026 29028 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:33.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.605346 29028 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:29:33.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.605724 29028 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:29:33.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.606148 29028 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:29:33.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.606455 29028 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42567/jwks.json
18:29:33.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.644227 29028 master_runner.cc:387] Master server non-default flags:
18:29:33.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:33.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.68.148:33449
18:29:33.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:33.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:33.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/data
18:29:33.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/wal
18:29:33.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:33.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393
18:29:33.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:33.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:33.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:33.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.68.189:33753
18:29:33.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:33.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:33.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:33.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42567/jwks.json
18:29:33.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:33.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:33.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/data/info.pb
18:29:33.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.68.189
18:29:33.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:33.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:33.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:33.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:33.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:33.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:33.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/logs
18:29:33.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:33.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:33.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:33.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:29:33.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:33.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:33.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:33.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:29:33.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:29:33.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:29:33.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.645982 29028 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:33.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.648372 29028 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:33.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.660320 29037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:33.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.675163 29026 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } attempt: 4
18:29:33.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.682636 29026 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.68.189:33753: Network error: Client connection negotiation failed: client connection to 127.28.68.189:33753: connect: Connection refused (error 111)
18:29:33.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:33.982334 29026 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } attempt: 5
18:29:33.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.993093 29026 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.68.189:33753: Network error: Client connection negotiation failed: client connection to 127.28.68.189:33753: connect: Connection refused (error 111)
18:29:34.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:34.540688 29026 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } attempt: 6
18:29:34.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:34.569206 29026 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.68.189:33753: Network error: Client connection negotiation failed: client connection to 127.28.68.189:33753: connect: Connection refused (error 111)
18:29:35.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:35.064030 29036 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 29028
18:29:35.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:35.474665 29028 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.814s	user 0.592s	sys 1.219s
18:29:35.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:35.475144 29028 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.815s	user 0.593s	sys 1.219s
18:29:35.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:33.660538 29038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:35.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:35.476359 29039 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1815 milliseconds
18:29:35.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:35.477967 29040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:35.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.477910 29028 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:29:35.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.482257 29028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:35.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.484788 29028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:35.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.486202 29028 hybrid_clock.cc:648] HybridClock initialized: now 1783535375486171 us; error 33 us; skew 500 ppm
18:29:35.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.487232 29028 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:35.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.493212 29028 webserver.cc:534] Webserver started at http://127.28.68.189:42949/ using document root <none> and password file <none>
18:29:35.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.494215 29028 fs_manager.cc:362] Metadata directory not provided
18:29:35.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.494454 29028 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:35.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.495034 29028 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:35.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.499405 29028 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/data/instance:
18:29:35.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a977f76c47fd4597bcc8521be0b11d9a"
18:29:35.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:35 on dist-test-slave-dxnw"
18:29:35.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.500794 29028 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/wal/instance:
18:29:35.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a977f76c47fd4597bcc8521be0b11d9a"
18:29:35.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:35 on dist-test-slave-dxnw"
18:29:35.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.508167 29028 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.003s
18:29:35.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.514256 29049 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:35.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.515350 29028 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
18:29:35.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.515722 29028 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/wal
18:29:35.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a977f76c47fd4597bcc8521be0b11d9a"
18:29:35.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:35 on dist-test-slave-dxnw"
18:29:35.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.516196 29028 fs_report.cc:389] FS layout report
18:29:35.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:35.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/wal
18:29:35.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/wal
18:29:35.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/data/data
18:29:35.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:35.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:35.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:35.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:35.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:35.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:35.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:35.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:35.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:35.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:35.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:35.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.573977 29028 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:35.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.575621 29028 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:35.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.576030 29028 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:35.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.629832 29026 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } attempt: 7
18:29:35.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:35.638211 29026 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.68.189:33753: Network error: Client connection negotiation failed: client connection to 127.28.68.189:33753: connect: Connection refused (error 111)
18:29:35.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.648470 29028 rpc_server.cc:307] RPC server started. Bound to: 127.28.68.189:33753
18:29:35.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.648555 29102 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.68.189:33753 every 8 connection(s)
18:29:35.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.652428 29028 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/data/info.pb
18:29:35.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.658458 29103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:35.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.658752 28946 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 29028
18:29:35.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.659247 28946 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-1/wal/instance
18:29:35.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.662165 28946 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:35.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:35.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/wal
18:29:35.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/data
18:29:35.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:35.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:35.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:35.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:35.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:35.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:35.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/logs
18:29:35.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/data/info.pb
18:29:35.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:35.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:35.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:35.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:35.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:35.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:35.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:35.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:35.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:29:35.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:35.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:35.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:35.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.68.188:38393
18:29:35.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.68.188
18:29:35.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:35.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.68.148:33449
18:29:35.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:35.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:35.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:35.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:35.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393
18:29:35.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:35.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42567/jwks.json with env {}
18:29:35.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.672503 29103 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } has no permanent_uuid. Determining permanent_uuid...
18:29:35.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.694756 29103 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } has no permanent_uuid. Determining permanent_uuid...
18:29:35.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.710693 29103 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } has no permanent_uuid. Determining permanent_uuid...
18:29:35.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:35.713513 29052 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.68.188:38393: connect: Connection refused (error 111)
18:29:35.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:35.718053 29103 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.68.188:38393: Network error: Client connection negotiation failed: client connection to 127.28.68.188:38393: connect: Connection refused (error 111)
18:29:35.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.767526 29103 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } attempt: 1
18:29:35.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:35.773422 29103 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.68.188:38393: Network error: Client connection negotiation failed: client connection to 127.28.68.188:38393: connect: Connection refused (error 111)
18:29:35.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.841879 29103 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } attempt: 2
18:29:35.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:35.846527 29103 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.68.188:38393: Network error: Client connection negotiation failed: client connection to 127.28.68.188:38393: connect: Connection refused (error 111)
18:29:35.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:35.937945 29103 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } attempt: 3
18:29:35.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:35.942589 29103 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.68.188:38393: Network error: Client connection negotiation failed: client connection to 127.28.68.188:38393: connect: Connection refused (error 111)
18:29:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:35.993605 29105 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:35.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:35.994290 29105 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:35.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:35.995059 29105 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:36.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:36.028012 29105 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:29:36.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:36.028416 29105 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:36.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:36.028780 29105 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:29:36.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:36.029206 29105 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:29:36.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:36.029609 29105 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:29:36.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:36.029886 29105 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42567/jwks.json
18:29:36.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:36.066368 29105 master_runner.cc:387] Master server non-default flags:
18:29:36.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:36.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.68.148:33449
18:29:36.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:36.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:36.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/data
18:29:36.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/wal
18:29:36.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:36.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393
18:29:36.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:36.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:36.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:36.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.68.188:38393
18:29:36.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:36.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:36.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:36.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42567/jwks.json
18:29:36.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:36.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:36.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/data/info.pb
18:29:36.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.68.188
18:29:36.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:36.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:36.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:36.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:36.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:36.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:36.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/logs
18:29:36.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:36.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:36.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:36.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:29:36.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:36.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:36.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:36.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:29:36.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:29:36.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:29:36.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:36.068115 29105 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:36.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:36.070385 29105 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:36.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:36.082182 29115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:36.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:36.086087 29103 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } attempt: 4
18:29:36.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:36.094118 29103 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.68.188:38393: Network error: Client connection negotiation failed: client connection to 127.28.68.188:38393: connect: Connection refused (error 111)
18:29:36.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:36.393666 29103 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } attempt: 5
18:29:36.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:36.403158 29103 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.68.188:38393: Network error: Client connection negotiation failed: client connection to 127.28.68.188:38393: connect: Connection refused (error 111)
18:29:36.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:36.950752 29103 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } attempt: 6
18:29:36.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:36.991842 29103 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.68.188:38393: Network error: Client connection negotiation failed: client connection to 127.28.68.188:38393: connect: Connection refused (error 111)
18:29:37.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:37.486212 29114 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 29105
18:29:37.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:37.490629 29114 kernel_stack_watchdog.cc:198] Thread 29105 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
18:29:37.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:29:37.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:29:37.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:29:37.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:29:37.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:37.491814 29117 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1408 milliseconds
18:29:37.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:37.492630 29105 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.410s	user 0.457s	sys 0.943s
18:29:37.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:37.493283 29105 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.411s	user 0.457s	sys 0.944s
18:29:37.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:36.083501 29116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:37.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:37.494848 29118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:37.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.495326 29105 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:29:37.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.498294 29105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:37.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.500991 29105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:37.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.502415 29105 hybrid_clock.cc:648] HybridClock initialized: now 1783535377502359 us; error 55 us; skew 500 ppm
18:29:37.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.503381 29105 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:37.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.510839 29105 webserver.cc:534] Webserver started at http://127.28.68.188:46337/ using document root <none> and password file <none>
18:29:37.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.511795 29105 fs_manager.cc:362] Metadata directory not provided
18:29:37.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.511994 29105 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:37.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.512372 29105 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:37.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.516592 29105 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/data/instance:
18:29:37.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7c102057e4b74dd4bd62fd9cbde03293"
18:29:37.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:37 on dist-test-slave-dxnw"
18:29:37.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.517643 29105 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/wal/instance:
18:29:37.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7c102057e4b74dd4bd62fd9cbde03293"
18:29:37.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:37 on dist-test-slave-dxnw"
18:29:37.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.525440 29105 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.001s
18:29:37.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.532382 29127 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:37.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.533586 29105 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
18:29:37.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.533891 29105 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/wal
18:29:37.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7c102057e4b74dd4bd62fd9cbde03293"
18:29:37.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:37 on dist-test-slave-dxnw"
18:29:37.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.534250 29105 fs_report.cc:389] FS layout report
18:29:37.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:37.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/wal
18:29:37.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/wal
18:29:37.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/data/data
18:29:37.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:37.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:37.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:37.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:37.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:37.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:37.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:37.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:37.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:37.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:37.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:37.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.589880 29105 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:37.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.591488 29105 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:37.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.591910 29105 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:37.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.665779 29105 rpc_server.cc:307] RPC server started. Bound to: 127.28.68.188:38393
18:29:37.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.665906 29178 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.68.188:38393 every 8 connection(s)
18:29:37.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.668759 29105 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/data/info.pb
18:29:37.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.675419 29179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:37.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.677980 28946 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 29105
18:29:37.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.678467 28946 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/master-2/wal/instance
18:29:37.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.690410 29179 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } has no permanent_uuid. Determining permanent_uuid...
18:29:37.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.713536 29179 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } has no permanent_uuid. Determining permanent_uuid...
18:29:37.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.724778 29179 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } has no permanent_uuid. Determining permanent_uuid...
18:29:37.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.728766 29026 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } attempt: 8
18:29:37.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.743438 29026 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } has no permanent_uuid. Determining permanent_uuid...
18:29:37.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.744048 29179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293: Bootstrap starting.
18:29:37.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.751256 29179 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293: Neither blocks nor log segments found. Creating new log.
18:29:37.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.753490 29179 log.cc:826] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293: Log is configured to *not* fsync() on all Append() calls
18:29:37.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.759120 29179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293: No bootstrap required, opened a new log
18:29:37.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.761132 29026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea: Bootstrap starting.
18:29:37.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.769014 29026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea: Neither blocks nor log segments found. Creating new log.
18:29:37.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.771469 29026 log.cc:826] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea: Log is configured to *not* fsync() on all Append() calls
18:29:37.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.777478 29026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea: No bootstrap required, opened a new log
18:29:37.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.787459 29179 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } }
18:29:37.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.788312 29179 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:37.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.788594 29179 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c102057e4b74dd4bd62fd9cbde03293, State: Initialized, Role: FOLLOWER
18:29:37.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.789518 29179 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } }
18:29:37.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.792582 29190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } } }
18:29:37.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.793800 29190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293 [sys.catalog]: This master's current role is: FOLLOWER
18:29:37.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.794559 29179 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293 [sys.catalog]: configured and running, proceeding with master startup.
18:29:37.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.807605 29026 raft_consensus.cc:359] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } }
18:29:37.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.808449 29026 raft_consensus.cc:385] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:37.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.808722 29026 raft_consensus.cc:740] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01d9b43974db42368cec63cde2c84fea, State: Initialized, Role: FOLLOWER
18:29:37.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.809960 29026 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } }
18:29:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.816942 29198 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } } }
18:29:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.818336 29198 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [sys.catalog]: This master's current role is: FOLLOWER
18:29:37.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.819087 29026 sys_catalog.cc:565] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [sys.catalog]: configured and running, proceeding with master startup.
18:29:37.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:37.828449 29202 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:29:37.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:37.829103 29202 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:29:37.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:37.846948 29133 tablet.cc:2406] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:29:37.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.824158 29105 master_runner.cc:187] Error getting master registration for 127.28.68.190:40429: OK, instance_id { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" instance_seqno: 1783535373217788 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:29:37.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.867266 29105 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:29:37.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:37.873312 29214 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:29:37.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:37.873960 29214 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:29:37.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.889122 29198 raft_consensus.cc:493] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:29:37.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.889659 29198 raft_consensus.cc:515] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } }
18:29:37.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.862169 28958 master_runner.cc:187] Error getting master registration for 127.28.68.189:33753: OK, instance_id { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" instance_seqno: 1783535375626579 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:29:37.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.894996 28958 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:29:37.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.895478 29154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "01d9b43974db42368cec63cde2c84fea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c102057e4b74dd4bd62fd9cbde03293" is_pre_election: true
18:29:37.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.896323 29198 leader_election.cc:290] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a977f76c47fd4597bcc8521be0b11d9a (127.28.68.189:33753), 7c102057e4b74dd4bd62fd9cbde03293 (127.28.68.188:38393)
18:29:37.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.896456 29154 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01d9b43974db42368cec63cde2c84fea in term 0.
18:29:37.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.898054 28977 leader_election.cc:304] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01d9b43974db42368cec63cde2c84fea, 7c102057e4b74dd4bd62fd9cbde03293; no voters: 
18:29:37.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.899022 29198 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [term 0 FOLLOWER]: Leader pre-election won for term 1
18:29:37.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.899430 29198 raft_consensus.cc:493] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:29:37.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.899750 29198 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [term 0 FOLLOWER]: Advancing to term 1
18:29:37.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.908485 29198 raft_consensus.cc:515] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } }
18:29:37.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.913712 29154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "01d9b43974db42368cec63cde2c84fea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c102057e4b74dd4bd62fd9cbde03293"
18:29:37.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.914247 29154 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293 [term 0 FOLLOWER]: Advancing to term 1
18:29:37.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.923748 29154 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01d9b43974db42368cec63cde2c84fea in term 1.
18:29:37.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.924165 29198 leader_election.cc:290] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [CANDIDATE]: Term 1 election: Requested vote from peers a977f76c47fd4597bcc8521be0b11d9a (127.28.68.189:33753), 7c102057e4b74dd4bd62fd9cbde03293 (127.28.68.188:38393)
18:29:37.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.926090 28977 leader_election.cc:304] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01d9b43974db42368cec63cde2c84fea, 7c102057e4b74dd4bd62fd9cbde03293; no voters: 
18:29:37.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:37.926594 28980 tablet.cc:2406] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:29:37.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.927819 29198 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [term 1 FOLLOWER]: Leader election won for term 1
18:29:37.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.930660 29198 raft_consensus.cc:697] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [term 1 LEADER]: Becoming Leader. State: Replica: 01d9b43974db42368cec63cde2c84fea, State: Running, Role: LEADER
18:29:37.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.934219 29198 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } }
18:29:37.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.952157 29216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01d9b43974db42368cec63cde2c84fea. Latest consensus state: current_term: 1 leader_uuid: "01d9b43974db42368cec63cde2c84fea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } } }
18:29:37.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.953044 29216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [sys.catalog]: This master's current role is: LEADER
18:29:37.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.959174 29218 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:29:37.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:37.984632 29218 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:29:38.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.008522 29154 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293 [term 1 FOLLOWER]: Refusing update from remote peer 01d9b43974db42368cec63cde2c84fea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:29:38.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.010731 29216 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:29:38.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.052450 29103 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } attempt: 7
18:29:38.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.062371 29190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01d9b43974db42368cec63cde2c84fea. Latest consensus state: current_term: 1 leader_uuid: "01d9b43974db42368cec63cde2c84fea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } } }
18:29:38.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.064718 29190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293 [sys.catalog]: This master's current role is: FOLLOWER
18:29:38.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.085984 29216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "01d9b43974db42368cec63cde2c84fea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } } }
18:29:38.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.086762 29216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [sys.catalog]: This master's current role is: LEADER
18:29:38.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.090804 29218 catalog_manager.cc:1382] Generated new cluster ID: f3cdf1f57e9946b6867e83b05048fe01
18:29:38.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.091114 29218 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:29:38.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.101630 29190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "01d9b43974db42368cec63cde2c84fea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } } }
18:29:38.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.104131 29190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293 [sys.catalog]: This master's current role is: FOLLOWER
18:29:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.108129 29103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a: Bootstrap starting.
18:29:38.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.116045 29103 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a: Neither blocks nor log segments found. Creating new log.
18:29:38.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.118736 29103 log.cc:826] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a: Log is configured to *not* fsync() on all Append() calls
18:29:38.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.129081 29218 catalog_manager.cc:1405] Generated new certificate authority record
18:29:38.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.131028 29218 catalog_manager.cc:1539] Loading token signing keys...
18:29:38.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.131793 29103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a: No bootstrap required, opened a new log
18:29:38.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.159369 29218 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea: Generated new TSK 0
18:29:38.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.160408 29218 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:29:38.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.175496 28946 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:38.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:38.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/wal
18:29:38.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/data
18:29:38.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:38.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:38.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:38.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:38.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:38.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:38.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/logs
18:29:38.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/data/info.pb
18:29:38.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:38.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:38.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:38.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:38.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:38.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:38.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:38.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:38.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:29:38.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:38.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.68.129:0
18:29:38.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.68.129
18:29:38.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.68.129
18:29:38.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:38.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393
18:29:38.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.68.148:33449
18:29:38.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:38.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:38.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:29:38.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.195470 29103 raft_consensus.cc:359] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } }
18:29:38.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.196427 29103 raft_consensus.cc:385] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:38.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.196782 29103 raft_consensus.cc:740] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a977f76c47fd4597bcc8521be0b11d9a, State: Initialized, Role: FOLLOWER
18:29:38.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.197938 29103 consensus_queue.cc:260] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } }
18:29:38.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.211915 29228 sys_catalog.cc:455] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } } }
18:29:38.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.212752 29228 sys_catalog.cc:458] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a [sys.catalog]: This master's current role is: FOLLOWER
18:29:38.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.217984 29103 sys_catalog.cc:565] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a [sys.catalog]: configured and running, proceeding with master startup.
18:29:38.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.218184 29075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "01d9b43974db42368cec63cde2c84fea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a977f76c47fd4597bcc8521be0b11d9a"
18:29:38.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.218983 29075 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a [term 0 FOLLOWER]: Advancing to term 1
18:29:38.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.223237 29076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "01d9b43974db42368cec63cde2c84fea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a977f76c47fd4597bcc8521be0b11d9a" is_pre_election: true
18:29:38.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.228641 29075 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01d9b43974db42368cec63cde2c84fea in term 1.
18:29:38.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.230067 29074 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a [term 1 FOLLOWER]: Refusing update from remote peer 01d9b43974db42368cec63cde2c84fea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:29:38.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.239153 29198 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:29:38.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.317070 29228 sys_catalog.cc:455] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01d9b43974db42368cec63cde2c84fea. Latest consensus state: current_term: 1 leader_uuid: "01d9b43974db42368cec63cde2c84fea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } } }
18:29:38.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.317816 29228 sys_catalog.cc:458] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a [sys.catalog]: This master's current role is: FOLLOWER
18:29:38.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.317494 29236 sys_catalog.cc:455] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "01d9b43974db42368cec63cde2c84fea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } } }
18:29:38.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.318311 29236 sys_catalog.cc:458] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a [sys.catalog]: This master's current role is: FOLLOWER
18:29:38.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.374581 29245 catalog_manager.cc:1294] Loaded cluster ID: f3cdf1f57e9946b6867e83b05048fe01
18:29:38.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.374846 29245 catalog_manager.cc:1587] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a: loading cluster ID for follower catalog manager: success
18:29:38.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.389859 29245 catalog_manager.cc:1609] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a: acquiring CA information for follower catalog manager: success
18:29:38.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.401598 29245 catalog_manager.cc:1637] T 00000000000000000000000000000000 P a977f76c47fd4597bcc8521be0b11d9a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:29:38.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:38.797688 29227 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:38.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:38.798341 29227 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:38.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:38.799077 29227 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:38.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.820899 29198 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "01d9b43974db42368cec63cde2c84fea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01d9b43974db42368cec63cde2c84fea" member_type: VOTER last_known_addr { host: "127.28.68.190" port: 40429 } } peers { permanent_uuid: "a977f76c47fd4597bcc8521be0b11d9a" member_type: VOTER last_known_addr { host: "127.28.68.189" port: 33753 } } peers { permanent_uuid: "7c102057e4b74dd4bd62fd9cbde03293" member_type: VOTER last_known_addr { host: "127.28.68.188" port: 38393 } } }
18:29:38.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.821633 29198 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01d9b43974db42368cec63cde2c84fea [sys.catalog]: This master's current role is: LEADER
18:29:38.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.834774 29202 catalog_manager.cc:1294] Loaded cluster ID: f3cdf1f57e9946b6867e83b05048fe01
18:29:38.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.835600 29202 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293: loading cluster ID for follower catalog manager: success
18:29:38.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:38.859030 29227 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.860231 29202 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293: acquiring CA information for follower catalog manager: success
18:29:38.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:38.860628 29227 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.68.129
18:29:38.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.870042 29202 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 7c102057e4b74dd4bd62fd9cbde03293: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:29:38.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.935096 29227 tablet_server_runner.cc:78] Tablet server non-default flags:
18:29:38.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:38.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.68.148:33449
18:29:38.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:38.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:38.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/data
18:29:38.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/wal
18:29:38.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:38.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:38.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.68.129:0
18:29:38.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:38.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:38.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/data/info.pb
18:29:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.68.129
18:29:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393
18:29:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.68.129
18:29:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/logs
18:29:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:38.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:29:38.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:38.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:38.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:38.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:29:38.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:29:38.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:29:38.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.936928 29227 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:38.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:38.939239 29227 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:38.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:38.969986 29254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:40.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:40.168470 29099 debug-util.cc:398] Leaking SignalData structure 0x7b08000aa180 after lost signal to thread 29032
18:29:40.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:40.169108 29099 debug-util.cc:398] Leaking SignalData structure 0x7b0800074ea0 after lost signal to thread 29102
18:29:41.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:40.364933 29253 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 29227
18:29:41.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:38.979244 29255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:41.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:41.819339 29227 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.841s	user 0.351s	sys 0.842s
18:29:41.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:41.822683 29227 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.844s	user 0.351s	sys 0.842s
18:29:41.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:41.823036 29258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:41.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:41.826200 29256 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2844 milliseconds
18:29:41.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.826205 29227 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:29:41.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.827565 29227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:41.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.830299 29227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:41.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.831772 29227 hybrid_clock.cc:648] HybridClock initialized: now 1783535381831630 us; error 143 us; skew 500 ppm
18:29:41.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.832849 29227 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:41.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.840040 29227 webserver.cc:534] Webserver started at http://127.28.68.129:43997/ using document root <none> and password file <none>
18:29:41.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.841007 29227 fs_manager.cc:362] Metadata directory not provided
18:29:41.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.841357 29227 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:41.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.841955 29227 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:41.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.846292 29227 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/data/instance:
18:29:41.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f5e509cee0a748839c3450b407f2fc73"
18:29:41.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:41 on dist-test-slave-dxnw"
18:29:41.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.847720 29227 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/wal/instance:
18:29:41.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f5e509cee0a748839c3450b407f2fc73"
18:29:41.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:41 on dist-test-slave-dxnw"
18:29:41.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.855733 29227 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.002s
18:29:41.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.861975 29266 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:41.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.863226 29227 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
18:29:41.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.863585 29227 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/wal
18:29:41.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f5e509cee0a748839c3450b407f2fc73"
18:29:41.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:41 on dist-test-slave-dxnw"
18:29:41.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.863966 29227 fs_report.cc:389] FS layout report
18:29:41.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:41.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/wal
18:29:41.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/wal
18:29:41.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/data/data
18:29:41.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:41.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:41.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:41.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:41.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:41.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:41.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:41.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:41.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:41.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:41.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.918730 29227 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:41.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.920437 29227 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:41.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.920955 29227 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:41.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.924324 29227 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:29:41.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.929159 29227 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:29:41.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.929397 29227 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:29:41.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.929720 29227 ts_tablet_manager.cc:616] Registered 0 tablets
18:29:41.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:41.929948 29227 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:29:42.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.119490 29227 rpc_server.cc:307] RPC server started. Bound to: 127.28.68.129:46603
18:29:42.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.119616 29378 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.68.129:46603 every 8 connection(s)
18:29:42.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.123670 29227 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/data/info.pb
18:29:42.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.127833 28946 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 29227
18:29:42.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.128435 28946 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-0/wal/instance
18:29:42.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.140453 28946 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:42.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:42.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/wal
18:29:42.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/data
18:29:42.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:42.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:42.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:42.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:42.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:42.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:42.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/logs
18:29:42.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/data/info.pb
18:29:42.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:42.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.68.130:0
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.68.130
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.68.130
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.68.148:33449
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:42.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:29:42.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.229461 29381 heartbeater.cc:344] Connected to a master server at 127.28.68.189:33753
18:29:42.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.229979 29381 heartbeater.cc:461] Registering TS with master...
18:29:42.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.232220 29381 heartbeater.cc:507] Master 127.28.68.189:33753 requested a full tablet report, sending...
18:29:42.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.233263 29379 heartbeater.cc:344] Connected to a master server at 127.28.68.188:38393
18:29:42.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.233619 29379 heartbeater.cc:461] Registering TS with master...
18:29:42.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.235323 29386 heartbeater.cc:344] Connected to a master server at 127.28.68.190:40429
18:29:42.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.235671 29386 heartbeater.cc:461] Registering TS with master...
18:29:42.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.237313 29379 heartbeater.cc:507] Master 127.28.68.188:38393 requested a full tablet report, sending...
18:29:42.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.240439 29066 ts_manager.cc:194] Registered new tserver with Master: f5e509cee0a748839c3450b407f2fc73 (127.28.68.129:46603)
18:29:42.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.242619 29144 ts_manager.cc:194] Registered new tserver with Master: f5e509cee0a748839c3450b407f2fc73 (127.28.68.129:46603)
18:29:42.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.243289 29386 heartbeater.cc:507] Master 127.28.68.190:40429 requested a full tablet report, sending...
18:29:42.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.247035 28991 ts_manager.cc:194] Registered new tserver with Master: f5e509cee0a748839c3450b407f2fc73 (127.28.68.129:46603)
18:29:42.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.250080 28991 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.68.129:38283
18:29:42.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:42.699551 29380 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:42.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:42.700882 29380 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:42.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:42.701962 29380 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:42.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:42.776893 29380 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:42.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:42.778505 29380 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.68.130
18:29:42.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.821851 29380 tablet_server_runner.cc:78] Tablet server non-default flags:
18:29:42.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:42.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.68.148:33449
18:29:42.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:42.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:42.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/data
18:29:42.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/wal
18:29:42.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:42.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:42.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.68.130:0
18:29:42.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:42.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:42.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:42.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/data/info.pb
18:29:42.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.68.130
18:29:42.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:42.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393
18:29:42.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:42.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:42.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:42.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:42.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:42.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.68.130
18:29:42.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/logs
18:29:42.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:42.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:42.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:42.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:29:42.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:42.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:42.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:42.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:29:42.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:29:42.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:29:42.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.823184 29380 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:42.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:42.825158 29380 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:42.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:42.841030 29395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:43.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:43.254527 29386 heartbeater.cc:499] Master 127.28.68.190:40429 was elected leader, sending a full tablet report...
18:29:44.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:42.845615 29398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:44.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:42.844080 29396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:44.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:44.187741 29397 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1340 milliseconds
18:29:44.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.187881 29380 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:29:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.189213 29380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:44.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.192180 29380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:44.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.193676 29380 hybrid_clock.cc:648] HybridClock initialized: now 1783535384193616 us; error 74 us; skew 500 ppm
18:29:44.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.194670 29380 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:44.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.203052 29380 webserver.cc:534] Webserver started at http://127.28.68.130:40351/ using document root <none> and password file <none>
18:29:44.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.204118 29380 fs_manager.cc:362] Metadata directory not provided
18:29:44.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.204360 29380 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:44.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.204967 29380 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:44.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.212248 29380 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/data/instance:
18:29:44.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "104f3d7826d9407c93f3ba4a65872a8b"
18:29:44.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:44 on dist-test-slave-dxnw"
18:29:44.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.213680 29380 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/wal/instance:
18:29:44.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "104f3d7826d9407c93f3ba4a65872a8b"
18:29:44.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:44 on dist-test-slave-dxnw"
18:29:44.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.221484 29380 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
18:29:44.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.227700 29409 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:44.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.228999 29380 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
18:29:44.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.229307 29380 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/wal
18:29:44.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "104f3d7826d9407c93f3ba4a65872a8b"
18:29:44.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:44 on dist-test-slave-dxnw"
18:29:44.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.229627 29380 fs_report.cc:389] FS layout report
18:29:44.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:44.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/wal
18:29:44.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/wal
18:29:44.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/data/data
18:29:44.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:44.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:44.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:44.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:44.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:44.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:44.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:44.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:44.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:44.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:44.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:44.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.325338 29380 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:44.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.327569 29380 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:44.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.328195 29380 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:44.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.332190 29380 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:29:44.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.337445 29380 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:29:44.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.337679 29380 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:29:44.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.337896 29380 ts_tablet_manager.cc:616] Registered 0 tablets
18:29:44.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.338033 29380 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:29:44.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.537272 29380 rpc_server.cc:307] RPC server started. Bound to: 127.28.68.130:42897
18:29:44.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.537369 29521 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.68.130:42897 every 8 connection(s)
18:29:44.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.540071 29380 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/data/info.pb
18:29:44.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.549772 28946 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 29380
18:29:44.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.550403 28946 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-1/wal/instance
18:29:44.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.560945 28946 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:44.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:44.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/wal
18:29:44.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/data
18:29:44.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:44.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:44.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:44.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:44.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:44.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:44.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/logs
18:29:44.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/data/info.pb
18:29:44.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:44.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:44.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:44.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:44.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:44.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:44.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:44.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:44.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:29:44.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:44.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.68.131:0
18:29:44.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.68.131
18:29:44.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.68.131
18:29:44.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:44.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393
18:29:44.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.68.148:33449
18:29:44.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:44.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:44.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:29:44.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.588692 29524 heartbeater.cc:344] Connected to a master server at 127.28.68.190:40429
18:29:44.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.589260 29524 heartbeater.cc:461] Registering TS with master...
18:29:44.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.590590 29523 heartbeater.cc:344] Connected to a master server at 127.28.68.189:33753
18:29:44.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.590637 29524 heartbeater.cc:507] Master 127.28.68.190:40429 requested a full tablet report, sending...
18:29:44.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.591048 29523 heartbeater.cc:461] Registering TS with master...
18:29:44.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.592046 29523 heartbeater.cc:507] Master 127.28.68.189:33753 requested a full tablet report, sending...
18:29:44.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.592875 29522 heartbeater.cc:344] Connected to a master server at 127.28.68.188:38393
18:29:44.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.593169 29522 heartbeater.cc:461] Registering TS with master...
18:29:44.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.593532 28991 ts_manager.cc:194] Registered new tserver with Master: 104f3d7826d9407c93f3ba4a65872a8b (127.28.68.130:42897)
18:29:44.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.594023 29522 heartbeater.cc:507] Master 127.28.68.188:38393 requested a full tablet report, sending...
18:29:44.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.595302 28991 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.68.130:57489
18:29:44.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.596938 29066 ts_manager.cc:194] Registered new tserver with Master: 104f3d7826d9407c93f3ba4a65872a8b (127.28.68.130:42897)
18:29:44.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.597021 29144 ts_manager.cc:194] Registered new tserver with Master: 104f3d7826d9407c93f3ba4a65872a8b (127.28.68.130:42897)
18:29:44.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:44.888403 29532 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:44.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:44.888953 29532 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:44.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:44.889575 29532 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:44.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:44.921793 29532 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:44.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:44.922554 29532 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.68.131
18:29:44.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.957321 29532 tablet_server_runner.cc:78] Tablet server non-default flags:
18:29:44.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:44.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.68.148:33449
18:29:44.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:44.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:44.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/data
18:29:44.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/wal
18:29:44.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:44.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:44.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.68.131:0
18:29:44.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:44.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:44.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:44.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/data/info.pb
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.68.131
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.68.131
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/logs
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:29:44.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.958840 29532 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:44.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:44.961035 29532 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:44.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:44.973747 29538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:45.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:45.599370 29524 heartbeater.cc:499] Master 127.28.68.190:40429 was elected leader, sending a full tablet report...
18:29:46.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:44.975569 29539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:46.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:46.296427 29541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:46.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:46.299042 29540 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1318 milliseconds
18:29:46.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.299180 29532 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:29:46.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.300486 29532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:46.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.303916 29532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:46.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.305354 29532 hybrid_clock.cc:648] HybridClock initialized: now 1783535386305277 us; error 79 us; skew 500 ppm
18:29:46.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.306174 29532 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:46.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.312654 29532 webserver.cc:534] Webserver started at http://127.28.68.131:40127/ using document root <none> and password file <none>
18:29:46.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.313570 29532 fs_manager.cc:362] Metadata directory not provided
18:29:46.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.313767 29532 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:46.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.314208 29532 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:46.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.318843 29532 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/data/instance:
18:29:46.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5fd2094d56804459b8ca000192a7372f"
18:29:46.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:46 on dist-test-slave-dxnw"
18:29:46.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.320151 29532 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/wal/instance:
18:29:46.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5fd2094d56804459b8ca000192a7372f"
18:29:46.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:46 on dist-test-slave-dxnw"
18:29:46.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.328064 29532 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
18:29:46.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.334018 29549 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:46.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.335187 29532 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
18:29:46.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.335580 29532 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/wal
18:29:46.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5fd2094d56804459b8ca000192a7372f"
18:29:46.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:46 on dist-test-slave-dxnw"
18:29:46.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.335974 29532 fs_report.cc:389] FS layout report
18:29:46.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:46.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/wal
18:29:46.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/wal
18:29:46.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/data/data
18:29:46.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:46.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:46.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:46.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:46.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:46.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:46.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:46.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:46.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:46.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:46.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:46.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.400286 29532 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:46.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.401883 29532 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:46.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.402436 29532 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:46.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.405321 29532 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:29:46.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.410211 29532 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:29:46.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.410447 29532 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:29:46.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.410794 29532 ts_tablet_manager.cc:616] Registered 0 tablets
18:29:46.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.411057 29532 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
18:29:46.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.572091 29532 rpc_server.cc:307] RPC server started. Bound to: 127.28.68.131:36413
18:29:46.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.572213 29661 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.68.131:36413 every 8 connection(s)
18:29:46.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.575028 29532 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/data/info.pb
18:29:46.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.583693 28946 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 29532
18:29:46.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.584323 28946 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3630908449905767370/ts-2/wal/instance
18:29:46.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.622023 29662 heartbeater.cc:344] Connected to a master server at 127.28.68.188:38393
18:29:46.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.622520 29662 heartbeater.cc:461] Registering TS with master...
18:29:46.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.623492 29663 heartbeater.cc:344] Connected to a master server at 127.28.68.189:33753
18:29:46.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.623857 29663 heartbeater.cc:461] Registering TS with master...
18:29:46.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.623899 29662 heartbeater.cc:507] Master 127.28.68.188:38393 requested a full tablet report, sending...
18:29:46.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.624759 29663 heartbeater.cc:507] Master 127.28.68.189:33753 requested a full tablet report, sending...
18:29:46.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.625151 29664 heartbeater.cc:344] Connected to a master server at 127.28.68.190:40429
18:29:46.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.625545 29664 heartbeater.cc:461] Registering TS with master...
18:29:46.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.626479 29664 heartbeater.cc:507] Master 127.28.68.190:40429 requested a full tablet report, sending...
18:29:46.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.627385 29144 ts_manager.cc:194] Registered new tserver with Master: 5fd2094d56804459b8ca000192a7372f (127.28.68.131:36413)
18:29:46.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.627759 29066 ts_manager.cc:194] Registered new tserver with Master: 5fd2094d56804459b8ca000192a7372f (127.28.68.131:36413)
18:29:46.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.629070 28991 ts_manager.cc:194] Registered new tserver with Master: 5fd2094d56804459b8ca000192a7372f (127.28.68.131:36413)
18:29:46.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.630373 28991 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.68.131:47677
18:29:46.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:46.643313 28946 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
18:29:46.655 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:29:46.656 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

18:29:46.665 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.28.68.190"
      port: 40429
    }
    bound_http_address {
      host: "127.28.68.190"
      port: 34069
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.28.68.189"
      port: 33753
    }
    bound_http_address {
      host: "127.28.68.189"
      port: 42949
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.28.68.188"
      port: 38393
    }
    bound_http_address {
      host: "127.28.68.188"
      port: 46337
    }
  }
}

18:29:46.669 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

18:29:46.671 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.28.68.129"
      port: 46603
    }
    bound_http_address {
      host: "127.28.68.129"
      port: 43997
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.28.68.130"
      port: 42897
    }
    bound_http_address {
      host: "127.28.68.130"
      port: 40351
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.28.68.131"
      port: 36413
    }
    bound_http_address {
      host: "127.28.68.131"
      port: 40127
    }
  }
}

18:29:46.671 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
18:29:46.685 [DEBUG - main] (InternalLoggerFactory.java:63) Using SLF4J as the default logging framework
18:29:46.689 [DEBUG - main] (ResourceLeakDetector.java:129) -Dorg.apache.kudu.shaded.io.netty.leakDetection.level: simple
18:29:46.689 [DEBUG - main] (ResourceLeakDetector.java:130) -Dorg.apache.kudu.shaded.io.netty.leakDetection.targetRecords: 4
18:29:46.694 [DEBUG - main] (ResourceLeakDetectorFactory.java:196) Loaded default ResourceLeakDetector: org.apache.kudu.shaded.io.netty.util.ResourceLeakDetector@403f0a22
18:29:46.719 [DEBUG - main] (PlatformDependent0.java:1138) Java version: 17
18:29:46.719 [DEBUG - main] (PlatformDependent0.java:616) -Dio.netty.noUnsafe: false
18:29:46.720 [DEBUG - main] (PlatformDependent0.java:559) Thread.isVirtual() is not available: 
18:29:46.720 [DEBUG - main] (PlatformDependent0.java:572) java.lang.BaseVirtualThread is not available: 
18:29:46.721 [DEBUG - main] (PlatformDependent0.java:145) sun.misc.Unsafe.theUnsafe: available
18:29:46.722 [DEBUG - main] (PlatformDependent0.java:208) sun.misc.Unsafe base methods: all available
18:29:46.722 [DEBUG - main] (PlatformDependent0.java:240) sun.misc.Unsafe.storeFence: available
18:29:46.722 [DEBUG - main] (PlatformDependent0.java:283) java.nio.Buffer.address: available
18:29:46.723 [DEBUG - main] (PlatformDependent0.java:369) direct buffer constructor: unavailable: Reflective setAccessible(true) disabled
18:29:46.724 [DEBUG - main] (PlatformDependent0.java:447) java.nio.Bits.unaligned: available, true
18:29:46.725 [DEBUG - main] (PlatformDependent0.java:515) jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable: class org.apache.kudu.shaded.io.netty.util.internal.PlatformDependent0$7 cannot access class jdk.internal.misc.Unsafe (in module java.base) because module java.base does not export jdk.internal.misc to unnamed module @589b3632
18:29:46.726 [DEBUG - main] (PlatformDependent0.java:545) java.nio.DirectByteBuffer.<init>(long, {int,long}): unavailable
18:29:46.726 [DEBUG - main] (PlatformDependent.java:1214) sun.misc.Unsafe: available
18:29:46.726 [DEBUG - main] (PlatformDependent.java:1360) -Dio.netty.tmpdir: /tmp (java.io.tmpdir)
18:29:46.726 [DEBUG - main] (PlatformDependent.java:1439) -Dio.netty.bitMode: 64 (sun.arch.data.model)
18:29:46.727 [DEBUG - main] (PlatformDependent.java:181) -Dio.netty.maxDirectMemory: -1 bytes
18:29:46.727 [DEBUG - main] (PlatformDependent.java:188) -Dio.netty.uninitializedArrayAllocationThreshold: -1
18:29:46.729 [DEBUG - main] (CleanerJava9.java:71) java.nio.ByteBuffer.cleaner(): available
18:29:46.729 [DEBUG - main] (PlatformDependent.java:209) -Dio.netty.noPreferDirect: false
18:29:46.741 [DEBUG - main] (PlatformDependent.java:1048) org.jctools-core.MpscChunkedArrayQueue: available
18:29:46.782 [DEBUG - main] (MultithreadEventLoopGroup.java:44) -Dio.netty.eventLoopThreads: 8
18:29:46.792 [DEBUG - main] (GlobalEventExecutor.java:54) -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1
18:29:46.797 [DEBUG - main] (InternalThreadLocalMap.java:100) -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024
18:29:46.798 [DEBUG - main] (InternalThreadLocalMap.java:101) -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096
18:29:46.805 [DEBUG - main] (NioEventLoop.java:110) -Dio.netty.noKeySetOptimization: false
18:29:46.805 [DEBUG - main] (NioEventLoop.java:111) -Dio.netty.selectorAutoRebuildThreshold: 512
18:29:46.849 [DEBUG - main] (PooledByteBufAllocator.java:161) -Dio.netty.allocator.numHeapArenas: 8
18:29:46.849 [DEBUG - main] (PooledByteBufAllocator.java:162) -Dio.netty.allocator.numDirectArenas: 8
18:29:46.849 [DEBUG - main] (PooledByteBufAllocator.java:164) -Dio.netty.allocator.pageSize: 8192
18:29:46.849 [DEBUG - main] (PooledByteBufAllocator.java:169) -Dio.netty.allocator.maxOrder: 9
18:29:46.849 [DEBUG - main] (PooledByteBufAllocator.java:173) -Dio.netty.allocator.chunkSize: 4194304
18:29:46.849 [DEBUG - main] (PooledByteBufAllocator.java:174) -Dio.netty.allocator.smallCacheSize: 256
18:29:46.849 [DEBUG - main] (PooledByteBufAllocator.java:175) -Dio.netty.allocator.normalCacheSize: 64
18:29:46.849 [DEBUG - main] (PooledByteBufAllocator.java:176) -Dio.netty.allocator.maxCachedBufferCapacity: 32768
18:29:46.849 [DEBUG - main] (PooledByteBufAllocator.java:177) -Dio.netty.allocator.cacheTrimInterval: 8192
18:29:46.849 [DEBUG - main] (PooledByteBufAllocator.java:178) -Dio.netty.allocator.cacheTrimIntervalMillis: 0
18:29:46.849 [DEBUG - main] (PooledByteBufAllocator.java:179) -Dio.netty.allocator.useCacheForAllThreads: false
18:29:46.849 [DEBUG - main] (PooledByteBufAllocator.java:180) -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023
18:29:46.849 [DEBUG - main] (PooledByteBufAllocator.java:182) -Dio.netty.allocator.disableCacheFinalizersForFastThreadLocalThreads: false
18:29:46.866 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttempt(RetryRule.java:225)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:246)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
18:29:46.930 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:29:47.023 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
18:29:47.024 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskSwO0Je/test-tmp
18:29:47.024 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
18:29:47.024 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskSwO0Je/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
18:29:47.031 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

18:29:47.380 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:29:47.381 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

18:29:47.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:47.385012 29673 mini_oidc.cc:150] Starting JWKS server
18:29:47.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:47.388592 29673 webserver.cc:534] Webserver started at http://127.0.0.1:37589/ using document root <none> and password file <none>
18:29:47.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:47.389024 29673 mini_oidc.cc:186] Starting OIDC Discovery server
18:29:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:47.390738 29673 webserver.cc:534] Webserver started at http://127.0.0.1:40365/ using document root <none> and password file <none>
18:29:47.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:29:47Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
18:29:47.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:29:47Z Disabled control of system clock
18:29:47.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:47.464283 29673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/wal
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/data
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/logs
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/data/info.pb
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:47.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:29:47.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:47.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:47.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:47.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.250.126:43415
18:29:47.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.250.126
18:29:47.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:47.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.250.84:34595
18:29:47.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:47.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:47.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:47.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:47.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.250.126:43415,127.28.250.125:38957,127.28.250.124:38123
18:29:47.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:47.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37589/jwks.json with env {}
18:29:47.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:47.633361 29664 heartbeater.cc:499] Master 127.28.68.190:40429 was elected leader, sending a full tablet report...
18:29:47.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:47.796864 29687 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:47.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:47.797435 29687 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:47.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:47.798005 29687 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:47.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:47.832862 29687 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:29:47.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:47.833148 29687 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:47.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:47.833345 29687 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:29:47.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:47.833642 29687 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:29:47.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:47.833847 29687 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:29:47.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:47.833992 29687 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37589/jwks.json
18:29:47.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:47.874094 29687 master_runner.cc:387] Master server non-default flags:
18:29:47.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:47.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.250.84:34595
18:29:47.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:47.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:47.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/data
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/wal
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.250.126:43415,127.28.250.125:38957,127.28.250.124:38123
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.250.126:43415
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37589/jwks.json
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/data/info.pb
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.250.126
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/logs
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:29:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:47.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:47.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:47.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:29:47.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:29:47.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:29:47.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:47.875533 29687 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:47.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:47.877221 29687 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:47.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:47.890079 29693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:47.892640 29694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:49.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.243849 29695 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1351 milliseconds
18:29:49.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.244024 29696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:49.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.243952 29687 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:29:49.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.252203 29687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:49.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.255530 29687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:49.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.257225 29687 hybrid_clock.cc:648] HybridClock initialized: now 1783535389257177 us; error 40 us; skew 500 ppm
18:29:49.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.258584 29687 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:49.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.267416 29687 webserver.cc:534] Webserver started at http://127.28.250.126:40779/ using document root <none> and password file <none>
18:29:49.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.268754 29687 fs_manager.cc:362] Metadata directory not provided
18:29:49.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.269246 29687 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:49.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.272579 29687 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:49.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.280361 29687 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/data/instance:
18:29:49.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60"
18:29:49.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:49 on dist-test-slave-dxnw"
18:29:49.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.281482 29687 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/wal/instance:
18:29:49.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60"
18:29:49.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:49 on dist-test-slave-dxnw"
18:29:49.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.289423 29687 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
18:29:49.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.295686 29705 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:49.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.297077 29687 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
18:29:49.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.297451 29687 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/wal
18:29:49.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60"
18:29:49.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:49 on dist-test-slave-dxnw"
18:29:49.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.298192 29687 fs_report.cc:389] FS layout report
18:29:49.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:49.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/wal
18:29:49.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/wal
18:29:49.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/data/data
18:29:49.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:49.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:49.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:49.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:49.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:49.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:49.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:49.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:49.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:49.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:49.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:49.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.361027 29687 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:49.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.362632 29687 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:49.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.363149 29687 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:49.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.441702 29687 rpc_server.cc:307] RPC server started. Bound to: 127.28.250.126:43415
18:29:49.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.441772 29756 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.250.126:43415 every 8 connection(s)
18:29:49.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.444521 29687 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/data/info.pb
18:29:49.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.451606 29757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:49.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.451802 29673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 29687
18:29:49.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.452279 29673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-0/wal/instance
18:29:49.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.457160 29673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:49.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:49.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/wal
18:29:49.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/data
18:29:49.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:49.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:49.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:49.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/logs
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/data/info.pb
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.250.125:38957
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.250.125
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.250.84:34595
18:29:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:49.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:49.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:49.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:49.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.250.126:43415,127.28.250.125:38957,127.28.250.124:38123
18:29:49.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:49.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37589/jwks.json with env {}
18:29:49.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.465651 29757 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } has no permanent_uuid. Determining permanent_uuid...
18:29:49.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.491571 29757 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } has no permanent_uuid. Determining permanent_uuid...
18:29:49.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.493989 29706 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.250.125:38957: connect: Connection refused (error 111)
18:29:49.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.498922 29757 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.250.125:38957: Network error: Client connection negotiation failed: client connection to 127.28.250.125:38957: connect: Connection refused (error 111)
18:29:49.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.548478 29757 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } attempt: 1
18:29:49.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.552896 29757 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.250.125:38957: Network error: Client connection negotiation failed: client connection to 127.28.250.125:38957: connect: Connection refused (error 111)
18:29:49.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.621419 29757 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } attempt: 2
18:29:49.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.628605 29757 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.250.125:38957: Network error: Client connection negotiation failed: client connection to 127.28.250.125:38957: connect: Connection refused (error 111)
18:29:49.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.720057 29757 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } attempt: 3
18:29:49.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.724910 29757 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.250.125:38957: Network error: Client connection negotiation failed: client connection to 127.28.250.125:38957: connect: Connection refused (error 111)
18:29:49.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.799865 29759 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:49.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.800587 29759 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:49.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.801203 29759 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:49.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.834767 29759 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:29:49.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.835186 29759 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:49.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.835534 29759 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:29:49.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.835980 29759 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:29:49.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.836302 29759 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:29:49.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.836578 29759 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37589/jwks.json
18:29:49.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.868356 29757 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } attempt: 4
18:29:49.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.873529 29757 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.250.125:38957: Network error: Client connection negotiation failed: client connection to 127.28.250.125:38957: connect: Connection refused (error 111)
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.874732 29759 master_runner.cc:387] Master server non-default flags:
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.250.84:34595
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/data
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/wal
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.250.126:43415,127.28.250.125:38957,127.28.250.124:38123
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.250.125:38957
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37589/jwks.json
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/data/info.pb
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.250.125
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/logs
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:29:49.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:29:49.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.876629 29759 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:49.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:49.878628 29759 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.892597 29768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:50.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:50.172966 29757 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } attempt: 5
18:29:50.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:50.181969 29757 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.250.125:38957: Network error: Client connection negotiation failed: client connection to 127.28.250.125:38957: connect: Connection refused (error 111)
18:29:50.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:50.729506 29757 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } attempt: 6
18:29:50.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:50.762063 29757 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.250.125:38957: Network error: Client connection negotiation failed: client connection to 127.28.250.125:38957: connect: Connection refused (error 111)
18:29:51.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:51.295821 29767 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 29759
18:29:51.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:49.893049 29769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:51.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:51.647177 29770 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1753 milliseconds
18:29:51.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:51.645046 29759 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.753s	user 0.643s	sys 1.053s
18:29:51.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:51.648079 29771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:51.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:51.648677 29759 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.757s	user 0.643s	sys 1.053s
18:29:51.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.649083 29759 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:29:51.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.653060 29759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:51.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.655710 29759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:51.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.657089 29759 hybrid_clock.cc:648] HybridClock initialized: now 1783535391657052 us; error 36 us; skew 500 ppm
18:29:51.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.657958 29759 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:51.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.665387 29759 webserver.cc:534] Webserver started at http://127.28.250.125:43541/ using document root <none> and password file <none>
18:29:51.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.666344 29759 fs_manager.cc:362] Metadata directory not provided
18:29:51.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.666621 29759 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.667150 29759 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:51.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.672634 29759 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/data/instance:
18:29:51.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5a095aecc80a40bd9972be552cbc25ae"
18:29:51.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:51 on dist-test-slave-dxnw"
18:29:51.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.673771 29759 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/wal/instance:
18:29:51.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5a095aecc80a40bd9972be552cbc25ae"
18:29:51.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:51 on dist-test-slave-dxnw"
18:29:51.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.682204 29759 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.001s
18:29:51.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.689055 29781 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.690572 29759 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.002s
18:29:51.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.691018 29759 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/wal
18:29:51.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5a095aecc80a40bd9972be552cbc25ae"
18:29:51.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:51 on dist-test-slave-dxnw"
18:29:51.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.691468 29759 fs_report.cc:389] FS layout report
18:29:51.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:51.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/wal
18:29:51.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/wal
18:29:51.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/data/data
18:29:51.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:51.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:51.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:51.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:51.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:51.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:51.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:51.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:51.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:51.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:51.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:51.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.750718 29759 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:51.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.752341 29759 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:51.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.752801 29759 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:51.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.822654 29757 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } attempt: 7
18:29:51.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:51.831897 29757 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.250.125:38957: Network error: Client connection negotiation failed: client connection to 127.28.250.125:38957: connect: Connection refused (error 111)
18:29:51.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.832931 29759 rpc_server.cc:307] RPC server started. Bound to: 127.28.250.125:38957
18:29:51.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.833025 29835 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.250.125:38957 every 8 connection(s)
18:29:51.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.836015 29759 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/data/info.pb
18:29:51.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.840623 29673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 29759
18:29:51.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.841128 29673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-1/wal/instance
18:29:51.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.843357 29836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:51.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.844303 29673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:51.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:51.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/wal
18:29:51.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/data
18:29:51.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:51.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:51.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/logs
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/data/info.pb
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.250.124:38123
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.250.124
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.250.84:34595
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.250.126:43415,127.28.250.125:38957,127.28.250.124:38123
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37589/jwks.json with env {}
18:29:51.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.857349 29836 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } has no permanent_uuid. Determining permanent_uuid...
18:29:51.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.879864 29836 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } has no permanent_uuid. Determining permanent_uuid...
18:29:51.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.894412 29836 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } has no permanent_uuid. Determining permanent_uuid...
18:29:51.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:51.897289 29785 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.250.124:38123: connect: Connection refused (error 111)
18:29:51.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:51.902485 29836 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.250.124:38123: Network error: Client connection negotiation failed: client connection to 127.28.250.124:38123: connect: Connection refused (error 111)
18:29:51.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:51.952078 29836 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } attempt: 1
18:29:51.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:51.956977 29836 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.250.124:38123: Network error: Client connection negotiation failed: client connection to 127.28.250.124:38123: connect: Connection refused (error 111)
18:29:52.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:52.025440 29836 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } attempt: 2
18:29:52.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:52.030354 29836 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.250.124:38123: Network error: Client connection negotiation failed: client connection to 127.28.250.124:38123: connect: Connection refused (error 111)
18:29:52.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:52.121793 29836 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } attempt: 3
18:29:52.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:52.127082 29836 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.250.124:38123: Network error: Client connection negotiation failed: client connection to 127.28.250.124:38123: connect: Connection refused (error 111)
18:29:52.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:52.176600 29838 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:52.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:52.177356 29838 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:52.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:52.178175 29838 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:52.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:52.215802 29838 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:29:52.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:52.216068 29838 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:52.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:52.216262 29838 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:29:52.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:52.216472 29838 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:29:52.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:52.216666 29838 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:29:52.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:52.216814 29838 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37589/jwks.json
18:29:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:52.253787 29838 master_runner.cc:387] Master server non-default flags:
18:29:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.250.84:34595
18:29:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/data
18:29:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/wal
18:29:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.250.126:43415,127.28.250.125:38957,127.28.250.124:38123
18:29:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.250.124:38123
18:29:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37589/jwks.json
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/data/info.pb
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.250.124
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/logs
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:29:52.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:29:52.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:52.256263 29838 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:52.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:52.258260 29838 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:52.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:52.270522 29836 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } attempt: 4
18:29:52.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:52.271445 29848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:52.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:52.276257 29836 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.250.124:38123: Network error: Client connection negotiation failed: client connection to 127.28.250.124:38123: connect: Connection refused (error 111)
18:29:52.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:52.575685 29836 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } attempt: 5
18:29:52.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:52.584364 29836 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.250.124:38123: Network error: Client connection negotiation failed: client connection to 127.28.250.124:38123: connect: Connection refused (error 111)
18:29:53.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.132020 29836 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } attempt: 6
18:29:53.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:53.151644 29836 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.250.124:38123: Network error: Client connection negotiation failed: client connection to 127.28.250.124:38123: connect: Connection refused (error 111)
18:29:53.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:52.272347 29849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:53.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:53.665441 29851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:53.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:53.667517 29838 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.394s	user 0.000s	sys 0.010s
18:29:53.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:53.667912 29838 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.395s	user 0.000s	sys 0.010s
18:29:53.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.668203 29838 server_base.cc:1061] running on GCE node
18:29:53.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.669927 29838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:53.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.674777 29838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:53.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.676399 29838 hybrid_clock.cc:648] HybridClock initialized: now 1783535393676315 us; error 72 us; skew 500 ppm
18:29:53.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.677664 29838 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:53.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.694212 29838 webserver.cc:534] Webserver started at http://127.28.250.124:43471/ using document root <none> and password file <none>
18:29:53.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.695426 29838 fs_manager.cc:362] Metadata directory not provided
18:29:53.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.695683 29838 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:53.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.696250 29838 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:53.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.702409 29838 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/data/instance:
18:29:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2eb7e23909224ab5bb4f558343528dd9"
18:29:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:53 on dist-test-slave-dxnw"
18:29:53.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.703805 29838 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/wal/instance:
18:29:53.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2eb7e23909224ab5bb4f558343528dd9"
18:29:53.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:53 on dist-test-slave-dxnw"
18:29:53.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.713665 29838 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.008s	sys 0.000s
18:29:53.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:53.719523 29022 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7ac0 after lost signal to thread 28959
18:29:53.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.720042 29862 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:53.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:53.720283 29022 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8c00 after lost signal to thread 29025
18:29:53.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.721834 29838 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
18:29:53.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.722147 29838 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/wal
18:29:53.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2eb7e23909224ab5bb4f558343528dd9"
18:29:53.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:53 on dist-test-slave-dxnw"
18:29:53.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.722479 29838 fs_report.cc:389] FS layout report
18:29:53.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:53.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/wal
18:29:53.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/wal
18:29:53.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/data/data
18:29:53.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:53.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:53.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:53.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:53.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:53.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:53.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:53.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:53.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:53.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:53.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:53.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.822199 29838 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:53.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.823830 29838 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:53.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.824365 29838 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:53.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.913859 29838 rpc_server.cc:307] RPC server started. Bound to: 127.28.250.124:38123
18:29:53.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.913897 29913 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.250.124:38123 every 8 connection(s)
18:29:53.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.917958 29838 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/data/info.pb
18:29:53.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.920629 29673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 29838
18:29:53.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.921066 29673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/master-2/wal/instance
18:29:53.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.926076 29757 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } attempt: 8
18:29:53.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.943832 29914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:53.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.984303 29757 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } has no permanent_uuid. Determining permanent_uuid...
18:29:54.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:53.989266 29914 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } has no permanent_uuid. Determining permanent_uuid...
18:29:54.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.022970 29914 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } has no permanent_uuid. Determining permanent_uuid...
18:29:54.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.034869 29757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60: Bootstrap starting.
18:29:54.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.036440 29914 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } has no permanent_uuid. Determining permanent_uuid...
18:29:54.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.045959 29757 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60: Neither blocks nor log segments found. Creating new log.
18:29:54.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.050769 29757 log.cc:826] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60: Log is configured to *not* fsync() on all Append() calls
18:29:54.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.056511 29757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60: No bootstrap required, opened a new log
18:29:54.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.058662 29914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9: Bootstrap starting.
18:29:54.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.067168 29914 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9: Neither blocks nor log segments found. Creating new log.
18:29:54.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.069020 29914 log.cc:826] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9: Log is configured to *not* fsync() on all Append() calls
18:29:54.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.078517 29914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9: No bootstrap required, opened a new log
18:29:54.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.089174 29757 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } }
18:29:54.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.090462 29757 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:54.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.090796 29757 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d4deb5d04bb4c2b8a738dbd4b7c4d60, State: Initialized, Role: FOLLOWER
18:29:54.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.091804 29757 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } }
18:29:54.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.094595 29926 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } } }
18:29:54.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.095625 29926 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [sys.catalog]: This master's current role is: FOLLOWER
18:29:54.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.096513 29757 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [sys.catalog]: configured and running, proceeding with master startup.
18:29:54.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.102946 29914 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } }
18:29:54.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.103801 29914 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:54.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.104275 29914 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2eb7e23909224ab5bb4f558343528dd9, State: Initialized, Role: FOLLOWER
18:29:54.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.105386 29914 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } }
18:29:54.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.111100 29929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } } }
18:29:54.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.113341 29929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9 [sys.catalog]: This master's current role is: FOLLOWER
18:29:54.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.112987 29914 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9 [sys.catalog]: configured and running, proceeding with master startup.
18:29:54.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:54.123234 29711 tablet.cc:2406] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:29:54.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.176967 29940 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
18:29:54.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.211082 29949 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
18:29:54.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.212244 29836 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } attempt: 7
18:29:54.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.189097 29687 master_runner.cc:187] Error getting master registration for 127.28.250.125:38957: OK, instance_id { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" instance_seqno: 1783535391809239 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:29:54.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.236032 29687 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:29:54.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.247881 29836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae: Bootstrap starting.
18:29:54.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.255247 29836 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae: Neither blocks nor log segments found. Creating new log.
18:29:54.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.225757 29838 master_runner.cc:187] Error getting master registration for 127.28.250.125:38957: OK, instance_id { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" instance_seqno: 1783535391809239 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:29:54.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.256654 29838 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:29:54.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.257372 29836 log.cc:826] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae: Log is configured to *not* fsync() on all Append() calls
18:29:54.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.262137 29836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae: No bootstrap required, opened a new log
18:29:54.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.282413 29836 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } }
18:29:54.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.283136 29836 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:54.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.283407 29836 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a095aecc80a40bd9972be552cbc25ae, State: Initialized, Role: FOLLOWER
18:29:54.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.284461 29836 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } }
18:29:54.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.290063 29952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } } }
18:29:54.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.291078 29952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae [sys.catalog]: This master's current role is: FOLLOWER
18:29:54.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.292011 29836 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae [sys.catalog]: configured and running, proceeding with master startup.
18:29:54.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:54.324163 29963 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:29:54.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:54.324819 29963 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:29:54.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:54.331032 29868 tablet.cc:2406] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:29:54.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.339196 29759 master_runner.cc:264] No leader master found from master 5a095aecc80a40bd9972be552cbc25ae
18:29:54.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.339496 29759 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:29:54.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.466846 29926 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:29:54.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.467460 29926 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } }
18:29:54.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.471848 29809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a095aecc80a40bd9972be552cbc25ae" is_pre_election: true
18:29:54.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.472826 29809 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d4deb5d04bb4c2b8a738dbd4b7c4d60 in term 0.
18:29:54.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.474628 29706 leader_election.cc:304] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a095aecc80a40bd9972be552cbc25ae, 5d4deb5d04bb4c2b8a738dbd4b7c4d60; no voters: 
18:29:54.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.478689 29889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2eb7e23909224ab5bb4f558343528dd9" is_pre_election: true
18:29:54.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.479580 29889 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d4deb5d04bb4c2b8a738dbd4b7c4d60 in term 0.
18:29:54.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.481333 29926 leader_election.cc:290] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a095aecc80a40bd9972be552cbc25ae (127.28.250.125:38957), 2eb7e23909224ab5bb4f558343528dd9 (127.28.250.124:38123)
18:29:54.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.481877 29926 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:29:54.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.482218 29926 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:29:54.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.482568 29926 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [term 0 FOLLOWER]: Advancing to term 1
18:29:54.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.499454 29926 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } }
18:29:54.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.510006 29809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a095aecc80a40bd9972be552cbc25ae"
18:29:54.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.510591 29809 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae [term 0 FOLLOWER]: Advancing to term 1
18:29:54.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:54.511547 29788 tablet.cc:2406] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:29:54.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.522822 29809 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d4deb5d04bb4c2b8a738dbd4b7c4d60 in term 1.
18:29:54.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.524356 29706 leader_election.cc:304] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a095aecc80a40bd9972be552cbc25ae, 5d4deb5d04bb4c2b8a738dbd4b7c4d60; no voters: 
18:29:54.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.525561 29965 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [term 1 FOLLOWER]: Leader election won for term 1
18:29:54.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.530148 29889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2eb7e23909224ab5bb4f558343528dd9"
18:29:54.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.530720 29889 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9 [term 0 FOLLOWER]: Advancing to term 1
18:29:54.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.550473 29889 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d4deb5d04bb4c2b8a738dbd4b7c4d60 in term 1.
18:29:54.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.551200 29926 leader_election.cc:290] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [CANDIDATE]: Term 1 election: Requested vote from peers 5a095aecc80a40bd9972be552cbc25ae (127.28.250.125:38957), 2eb7e23909224ab5bb4f558343528dd9 (127.28.250.124:38123)
18:29:54.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.559805 29965 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [term 1 LEADER]: Becoming Leader. State: Replica: 5d4deb5d04bb4c2b8a738dbd4b7c4d60, State: Running, Role: LEADER
18:29:54.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.561024 29965 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } }
18:29:54.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.567569 29926 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d4deb5d04bb4c2b8a738dbd4b7c4d60. Latest consensus state: current_term: 1 leader_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } } }
18:29:54.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.568466 29926 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [sys.catalog]: This master's current role is: LEADER
18:29:54.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.581832 29968 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:29:54.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.594146 29968 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:29:54.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.623862 29889 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9 [term 1 FOLLOWER]: Refusing update from remote peer 5d4deb5d04bb4c2b8a738dbd4b7c4d60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:29:54.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.626694 29926 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:29:54.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.648679 29809 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae [term 1 FOLLOWER]: Refusing update from remote peer 5d4deb5d04bb4c2b8a738dbd4b7c4d60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:29:54.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.650600 29926 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:29:54.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.685994 29971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d4deb5d04bb4c2b8a738dbd4b7c4d60. Latest consensus state: current_term: 1 leader_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } } }
18:29:54.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.686761 29971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9 [sys.catalog]: This master's current role is: FOLLOWER
18:29:54.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.700963 29952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d4deb5d04bb4c2b8a738dbd4b7c4d60. Latest consensus state: current_term: 1 leader_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } } }
18:29:54.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.701668 29952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae [sys.catalog]: This master's current role is: FOLLOWER
18:29:54.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.706882 29970 mvcc.cc:204] Tried to move back new op lower bound from 7305360976361598976 to 7305360976133627904. Current Snapshot: MvccSnapshot[applied={T|T < 7305360976361598976}]
18:29:54.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.714716 29973 mvcc.cc:204] Tried to move back new op lower bound from 7305360976361598976 to 7305360976133627904. Current Snapshot: MvccSnapshot[applied={T|T < 7305360976361598976}]
18:29:54.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.715806 29926 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } } }
18:29:54.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.716522 29926 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [sys.catalog]: This master's current role is: LEADER
18:29:54.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.717130 29926 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } } }
18:29:54.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.717774 29926 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60 [sys.catalog]: This master's current role is: LEADER
18:29:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.721314 29968 catalog_manager.cc:1382] Generated new cluster ID: 13839d86c1144f8d93d201c95094afa0
18:29:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.721611 29968 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:29:54.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.737334 29971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } } }
18:29:54.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.738097 29971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9 [sys.catalog]: This master's current role is: FOLLOWER
18:29:54.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.738971 29952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4deb5d04bb4c2b8a738dbd4b7c4d60" member_type: VOTER last_known_addr { host: "127.28.250.126" port: 43415 } } peers { permanent_uuid: "5a095aecc80a40bd9972be552cbc25ae" member_type: VOTER last_known_addr { host: "127.28.250.125" port: 38957 } } peers { permanent_uuid: "2eb7e23909224ab5bb4f558343528dd9" member_type: VOTER last_known_addr { host: "127.28.250.124" port: 38123 } } }
18:29:54.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.739634 29952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae [sys.catalog]: This master's current role is: FOLLOWER
18:29:54.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.779314 29968 catalog_manager.cc:1405] Generated new certificate authority record
18:29:54.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.781610 29968 catalog_manager.cc:1539] Loading token signing keys...
18:29:54.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.827025 29968 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60: Generated new TSK 0
18:29:54.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.838779 29968 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:29:54.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:54.876266 29673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:54.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:54.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/wal
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/data
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/logs
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/data/info.pb
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.250.65:0
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.250.65
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.250.65
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.250.126:43415,127.28.250.125:38957,127.28.250.124:38123
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.250.84:34595
18:29:54.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:54.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:54.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:29:55.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:55.239231 29949 catalog_manager.cc:1294] Loaded cluster ID: 13839d86c1144f8d93d201c95094afa0
18:29:55.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:55.239507 29949 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9: loading cluster ID for follower catalog manager: success
18:29:55.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:55.257233 29949 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9: acquiring CA information for follower catalog manager: success
18:29:55.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:55.262454 29949 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 2eb7e23909224ab5bb4f558343528dd9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:29:55.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:55.330372 29963 catalog_manager.cc:1294] Loaded cluster ID: 13839d86c1144f8d93d201c95094afa0
18:29:55.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:55.330667 29963 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae: loading cluster ID for follower catalog manager: success
18:29:55.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:55.347609 29963 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae: acquiring CA information for follower catalog manager: success
18:29:55.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:55.353390 29963 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 5a095aecc80a40bd9972be552cbc25ae: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:29:55.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:55.632633 29980 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:55.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:55.633414 29980 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:55.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:55.634219 29980 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:55.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:55.719516 29980 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:55.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:55.720836 29980 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.250.65
18:29:55.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:55.791922 29980 tablet_server_runner.cc:78] Tablet server non-default flags:
18:29:55.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:55.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.250.84:34595
18:29:55.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:55.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:55.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/data
18:29:55.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/wal
18:29:55.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:55.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:55.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.250.65:0
18:29:55.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/data/info.pb
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.250.65
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.250.126:43415,127.28.250.125:38957,127.28.250.124:38123
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.250.65
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/logs
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:29:55.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:29:55.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:55.793748 29980 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:55.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:55.796046 29980 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:55.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:55.833077 29987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:57.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:55.869575 29991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:57.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:55.861665 29980 server_base.cc:1061] running on GCE node
18:29:57.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:55.858960 29988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:57.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:57.845486 29980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:57.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:57.863468 29980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:57.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:57.865382 29980 hybrid_clock.cc:648] HybridClock initialized: now 1783535397865318 us; error 52 us; skew 500 ppm
18:29:57.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:57.866576 29980 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:57.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:57.894111 29980 webserver.cc:534] Webserver started at http://127.28.250.65:37043/ using document root <none> and password file <none>
18:29:57.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:57.895398 29980 fs_manager.cc:362] Metadata directory not provided
18:29:57.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:57.895689 29980 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:57.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:57.896292 29980 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:57.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:57.903404 29980 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/data/instance:
18:29:57.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e0daef4de5564bcda67a7642c8fda8d1"
18:29:57.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:57 on dist-test-slave-dxnw"
18:29:57.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:57.904817 29980 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/wal/instance:
18:29:57.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e0daef4de5564bcda67a7642c8fda8d1"
18:29:57.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:57 on dist-test-slave-dxnw"
18:29:57.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:57.928774 29980 fs_manager.cc:696] Time spent creating directory manager: real 0.023s	user 0.003s	sys 0.006s
18:29:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:57.956295 30000 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:57.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:57.967043 29980 fs_manager.cc:730] Time spent opening block manager: real 0.034s	user 0.005s	sys 0.006s
18:29:57.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:57.967491 29980 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/wal
18:29:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e0daef4de5564bcda67a7642c8fda8d1"
18:29:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:57 on dist-test-slave-dxnw"
18:29:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:57.967921 29980 fs_report.cc:389] FS layout report
18:29:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/wal
18:29:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/wal
18:29:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/data/data
18:29:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:57.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:57.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:57.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:57.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:57.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:57.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:58.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.067238 29980 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:58.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.069262 29980 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:58.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.069849 29980 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:58.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.079555 29980 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:29:58.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.091986 29980 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:29:58.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.092337 29980 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:29:58.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.092657 29980 ts_tablet_manager.cc:616] Registered 0 tablets
18:29:58.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.092888 29980 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:29:58.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.824398 29980 rpc_server.cc:307] RPC server started. Bound to: 127.28.250.65:39837
18:29:58.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.824474 30113 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.250.65:39837 every 8 connection(s)
18:29:58.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.827831 29980 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/data/info.pb
18:29:58.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.833587 29673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 29980
18:29:58.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.834277 29673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-0/wal/instance
18:29:58.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.852015 29673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:58.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:29:58.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/wal
18:29:58.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/data
18:29:58.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:58.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/logs
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/data/info.pb
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.250.66:0
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.250.66
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.250.66
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.250.126:43415,127.28.250.125:38957,127.28.250.124:38123
18:29:58.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.250.84:34595
18:29:58.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:58.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:58.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:29:58.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.951445 30115 heartbeater.cc:344] Connected to a master server at 127.28.250.125:38957
18:29:58.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.951858 30115 heartbeater.cc:461] Registering TS with master...
18:29:58.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.953090 30115 heartbeater.cc:507] Master 127.28.250.125:38957 requested a full tablet report, sending...
18:29:58.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.956857 29799 ts_manager.cc:194] Registered new tserver with Master: e0daef4de5564bcda67a7642c8fda8d1 (127.28.250.65:39837)
18:29:58.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.960584 30118 heartbeater.cc:344] Connected to a master server at 127.28.250.126:43415
18:29:58.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.960937 30118 heartbeater.cc:461] Registering TS with master...
18:29:58.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.961764 30118 heartbeater.cc:507] Master 127.28.250.126:43415 requested a full tablet report, sending...
18:29:58.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.964159 29721 ts_manager.cc:194] Registered new tserver with Master: e0daef4de5564bcda67a7642c8fda8d1 (127.28.250.65:39837)
18:29:58.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.966917 29721 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.250.65:45835
18:29:58.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.969694 30114 heartbeater.cc:344] Connected to a master server at 127.28.250.124:38123
18:29:58.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.970175 30114 heartbeater.cc:461] Registering TS with master...
18:29:58.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.971071 30114 heartbeater.cc:507] Master 127.28.250.124:38123 requested a full tablet report, sending...
18:29:58.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:58.974056 29879 ts_manager.cc:194] Registered new tserver with Master: e0daef4de5564bcda67a7642c8fda8d1 (127.28.250.65:39837)
18:29:59.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:59.255766 30119 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:59.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:59.256202 30119 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:59.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:59.256608 30119 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:59.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:59.290940 30119 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:59.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:59.291688 30119 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.250.66
18:29:59.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:59.335029 30119 tablet_server_runner.cc:78] Tablet server non-default flags:
18:29:59.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:59.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.250.84:34595
18:29:59.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:59.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:59.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/data
18:29:59.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/wal
18:29:59.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.250.66:0
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/data/info.pb
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.250.66
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.250.126:43415,127.28.250.125:38957,127.28.250.124:38123
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.250.66
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/logs
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:29:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:59.336625 30119 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:59.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:59.338459 30119 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:59.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:59.352833 30130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:59.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:59.979004 30118 heartbeater.cc:499] Master 127.28.250.126:43415 was elected leader, sending a full tablet report...
18:30:01.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:00.756671 30129 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 30119
18:30:01.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:01.226225 30119 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.872s	user 0.667s	sys 1.066s
18:30:01.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:01.226596 30119 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.872s	user 0.667s	sys 1.066s
18:30:01.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:59.354401 30131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:01.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:01.228998 30133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:01.232177 30132 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1872 milliseconds
18:30:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.232316 30119 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:30:01.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.233693 30119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:30:01.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.235967 30119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:30:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.237526 30119 hybrid_clock.cc:648] HybridClock initialized: now 1783535401237439 us; error 37 us; skew 500 ppm
18:30:01.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.238525 30119 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:30:01.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.244822 30119 webserver.cc:534] Webserver started at http://127.28.250.66:35417/ using document root <none> and password file <none>
18:30:01.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.245641 30119 fs_manager.cc:362] Metadata directory not provided
18:30:01.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.245826 30119 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:30:01.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.246189 30119 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:30:01.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.250784 30119 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/data/instance:
18:30:01.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2c0ac04628354392ab4087c1289fd5b0"
18:30:01.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:01 on dist-test-slave-dxnw"
18:30:01.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.252127 30119 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/wal/instance:
18:30:01.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2c0ac04628354392ab4087c1289fd5b0"
18:30:01.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:01 on dist-test-slave-dxnw"
18:30:01.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.260097 30119 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
18:30:01.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.265591 30142 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:30:01.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.267156 30119 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.267572 30119 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/wal
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2c0ac04628354392ab4087c1289fd5b0"
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:01 on dist-test-slave-dxnw"
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.267976 30119 fs_report.cc:389] FS layout report
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/wal
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/wal
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/data/data
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:30:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:30:01.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.338220 30119 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:30:01.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.339957 30119 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:30:01.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.340512 30119 kserver.cc:163] Server-wide thread pool size limit: 3276
18:30:01.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.343459 30119 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:30:01.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.348084 30119 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:30:01.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.348268 30119 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:30:01.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.348457 30119 ts_tablet_manager.cc:616] Registered 0 tablets
18:30:01.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.348592 30119 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:30:01.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.521432 30119 rpc_server.cc:307] RPC server started. Bound to: 127.28.250.66:43259
18:30:01.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.521556 30256 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.250.66:43259 every 8 connection(s)
18:30:01.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.524118 30119 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/data/info.pb
18:30:01.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.526511 29673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 30119
18:30:01.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.527078 29673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-1/wal/instance
18:30:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.545091 29673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/wal
18:30:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/data
18:30:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:30:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:30:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:30:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/logs
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/data/info.pb
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.250.67:0
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.250.67
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.250.67
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.250.126:43415,127.28.250.125:38957,127.28.250.124:38123
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.250.84:34595
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:01.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:30:01.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.612591 30257 heartbeater.cc:344] Connected to a master server at 127.28.250.124:38123
18:30:01.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.613065 30257 heartbeater.cc:461] Registering TS with master...
18:30:01.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.613839 30258 heartbeater.cc:344] Connected to a master server at 127.28.250.125:38957
18:30:01.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.614153 30258 heartbeater.cc:461] Registering TS with master...
18:30:01.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.614523 30257 heartbeater.cc:507] Master 127.28.250.124:38123 requested a full tablet report, sending...
18:30:01.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.615382 30258 heartbeater.cc:507] Master 127.28.250.125:38957 requested a full tablet report, sending...
18:30:01.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.617957 29879 ts_manager.cc:194] Registered new tserver with Master: 2c0ac04628354392ab4087c1289fd5b0 (127.28.250.66:43259)
18:30:01.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.618121 30259 heartbeater.cc:344] Connected to a master server at 127.28.250.126:43415
18:30:01.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.618227 29799 ts_manager.cc:194] Registered new tserver with Master: 2c0ac04628354392ab4087c1289fd5b0 (127.28.250.66:43259)
18:30:01.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.618468 30259 heartbeater.cc:461] Registering TS with master...
18:30:01.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.619418 30259 heartbeater.cc:507] Master 127.28.250.126:43415 requested a full tablet report, sending...
18:30:01.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.621562 29721 ts_manager.cc:194] Registered new tserver with Master: 2c0ac04628354392ab4087c1289fd5b0 (127.28.250.66:43259)
18:30:01.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:01.622803 29721 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.250.66:52773
18:30:01.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:01.927816 30264 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:30:01.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:01.928458 30264 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:30:01.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:01.929067 30264 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:30:01.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:01.964691 30264 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:30:01.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:01.965669 30264 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.250.67
18:30:02.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:02.004492 30264 tablet_server_runner.cc:78] Tablet server non-default flags:
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.250.84:34595
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/data
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/wal
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.250.67:0
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/data/info.pb
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.250.67
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.250.126:43415,127.28.250.125:38957,127.28.250.124:38123
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.250.67
18:30:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/logs
18:30:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:30:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:30:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:30:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:30:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:30:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:30:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:30:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:30:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:30:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:02.006198 30264 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:30:02.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:02.008118 30264 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:30:02.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:02.020160 30274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:02.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:02.626044 30259 heartbeater.cc:499] Master 127.28.250.126:43415 was elected leader, sending a full tablet report...
18:30:04.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:03.423143 30273 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 30264
18:30:04.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:04.007282 30273 kernel_stack_watchdog.cc:198] Thread 30264 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 399ms:
18:30:04.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:30:04.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:30:04.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:30:04.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:30:04.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:02.021519 30275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:04.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:04.016619 30264 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.995s	user 0.002s	sys 0.000s
18:30:04.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:04.017027 30264 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.996s	user 0.002s	sys 0.001s
18:30:04.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:04.017204 30276 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1995 milliseconds
18:30:04.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:04.018963 30277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:04.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.018963 30264 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:30:04.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.020547 30264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:30:04.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.023401 30264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:30:04.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.024900 30264 hybrid_clock.cc:648] HybridClock initialized: now 1783535404024743 us; error 145 us; skew 500 ppm
18:30:04.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.025906 30264 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:30:04.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.032898 30264 webserver.cc:534] Webserver started at http://127.28.250.67:37499/ using document root <none> and password file <none>
18:30:04.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.033727 30264 fs_manager.cc:362] Metadata directory not provided
18:30:04.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.033946 30264 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:30:04.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.034322 30264 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:30:04.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.038936 30264 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/data/instance:
18:30:04.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a47a8e581a3b425f85a5c443a726f9b9"
18:30:04.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:04 on dist-test-slave-dxnw"
18:30:04.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.040045 30264 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/wal/instance:
18:30:04.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a47a8e581a3b425f85a5c443a726f9b9"
18:30:04.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:04 on dist-test-slave-dxnw"
18:30:04.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.047597 30264 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
18:30:04.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.053045 30287 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:30:04.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.054445 30264 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
18:30:04.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.054782 30264 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/wal
18:30:04.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a47a8e581a3b425f85a5c443a726f9b9"
18:30:04.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:04 on dist-test-slave-dxnw"
18:30:04.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.055208 30264 fs_report.cc:389] FS layout report
18:30:04.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:30:04.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/wal
18:30:04.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/wal
18:30:04.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/data/data
18:30:04.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:30:04.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:30:04.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:30:04.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:30:04.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:30:04.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:30:04.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:30:04.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:30:04.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:30:04.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:30:04.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:30:04.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.110118 30264 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:30:04.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.111758 30264 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:30:04.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.112205 30264 kserver.cc:163] Server-wide thread pool size limit: 3276
18:30:04.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.115396 30264 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:30:04.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.119997 30264 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:30:04.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.120229 30264 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:30:04.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.120445 30264 ts_tablet_manager.cc:616] Registered 0 tablets
18:30:04.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.120591 30264 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:30:04.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:04.199276 29375 debug-util.cc:398] Leaking SignalData structure 0x7b08000b8720 after lost signal to thread 29247
18:30:04.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:04.200743 29375 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7ce0 after lost signal to thread 29378
18:30:04.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.379129 30264 rpc_server.cc:307] RPC server started. Bound to: 127.28.250.67:46725
18:30:04.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.379318 30399 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.250.67:46725 every 8 connection(s)
18:30:04.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.382445 30264 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/data/info.pb
18:30:04.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.389560 29673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 30264
18:30:04.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.390161 29673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5216414247407091744/ts-2/wal/instance
18:30:04.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.535780 30400 heartbeater.cc:344] Connected to a master server at 127.28.250.124:38123
18:30:04.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.536264 30400 heartbeater.cc:461] Registering TS with master...
18:30:04.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.537609 30400 heartbeater.cc:507] Master 127.28.250.124:38123 requested a full tablet report, sending...
18:30:04.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.547608 29879 ts_manager.cc:194] Registered new tserver with Master: a47a8e581a3b425f85a5c443a726f9b9 (127.28.250.67:46725)
18:30:04.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.587373 30401 heartbeater.cc:344] Connected to a master server at 127.28.250.125:38957
18:30:04.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.587720 30401 heartbeater.cc:461] Registering TS with master...
18:30:04.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.588539 30401 heartbeater.cc:507] Master 127.28.250.125:38957 requested a full tablet report, sending...
18:30:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.596593 29799 ts_manager.cc:194] Registered new tserver with Master: a47a8e581a3b425f85a5c443a726f9b9 (127.28.250.67:46725)
18:30:04.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.611922 30402 heartbeater.cc:344] Connected to a master server at 127.28.250.126:43415
18:30:04.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.612365 30402 heartbeater.cc:461] Registering TS with master...
18:30:04.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.613416 30402 heartbeater.cc:507] Master 127.28.250.126:43415 requested a full tablet report, sending...
18:30:04.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.617233 29721 ts_manager.cc:194] Registered new tserver with Master: a47a8e581a3b425f85a5c443a726f9b9 (127.28.250.67:46725)
18:30:04.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.619288 29721 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.250.67:49801
18:30:04.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:04.624979 29673 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
18:30:04.639 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:30:04.639 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

18:30:04.646 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.28.250.126"
      port: 43415
    }
    bound_http_address {
      host: "127.28.250.126"
      port: 40779
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.28.250.125"
      port: 38957
    }
    bound_http_address {
      host: "127.28.250.125"
      port: 43541
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.28.250.124"
      port: 38123
    }
    bound_http_address {
      host: "127.28.250.124"
      port: 43471
    }
  }
}

18:30:04.647 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

18:30:04.649 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.28.250.65"
      port: 39837
    }
    bound_http_address {
      host: "127.28.250.65"
      port: 37043
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.28.250.66"
      port: 43259
    }
    bound_http_address {
      host: "127.28.250.66"
      port: 35417
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.28.250.67"
      port: 46725
    }
    bound_http_address {
      host: "127.28.250.67"
      port: 37499
    }
  }
}

18:30:04.649 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
18:30:04.652 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:04.760 [DEBUG - main] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:04.772 [DEBUG - main] (DefaultChannelId.java:84) -Dio.netty.processId: 28920 (auto-detected)
18:30:04.775 [DEBUG - main] (NetUtil.java:149) -Djava.net.preferIPv4Stack: true
18:30:04.775 [DEBUG - main] (NetUtil.java:150) -Djava.net.preferIPv6Addresses: false
18:30:04.778 [DEBUG - main] (NetUtilInitializations.java:145) Loopback interface: lo (lo, 127.0.0.1)
18:30:04.780 [DEBUG - main] (NetUtil.java:198) /proc/sys/net/core/somaxconn: 4096
18:30:04.781 [DEBUG - main] (DefaultChannelId.java:106) -Dio.netty.machineId: 02:42:99:ff:fe:a0:43:a2 (auto-detected)
18:30:04.815 [DEBUG - main] (ByteBufUtil.java:89) -Dio.netty.allocator.type: pooled
18:30:04.815 [DEBUG - main] (ByteBufUtil.java:101) -Dio.netty.threadLocalDirectBufferSize: 0
18:30:04.815 [DEBUG - main] (ByteBufUtil.java:104) -Dio.netty.maxThreadLocalCharBufferSize: 16384
18:30:04.823 [DEBUG - main] (ChannelInitializerExtensions.java:54) -Dio.netty.bootstrap.extensions: null
18:30:04.831 [DEBUG - main] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:04.839 [DEBUG - main] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:04.866 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.28.68.188:38393(127.28.68.188:38393)] Successfully connected to peer
18:30:04.869 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.28.68.190:40429(127.28.68.190:40429)] Successfully connected to peer
18:30:04.881 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.28.68.189:33753(127.28.68.189:33753)] Successfully connected to peer
18:30:04.920 [DEBUG - kudu-nio-1] (AbstractByteBuf.java:63) -Dorg.apache.kudu.shaded.io.netty.buffer.checkAccessible: true
18:30:04.920 [DEBUG - kudu-nio-1] (AbstractByteBuf.java:64) -Dorg.apache.kudu.shaded.io.netty.buffer.checkBounds: true
18:30:04.920 [DEBUG - kudu-nio-1] (ResourceLeakDetectorFactory.java:196) Loaded default ResourceLeakDetector: org.apache.kudu.shaded.io.netty.util.ResourceLeakDetector@750f87f8
18:30:04.932 [DEBUG - kudu-nio-1] (Recycler.java:96) -Dio.netty.recycler.maxCapacityPerThread: 4096
18:30:04.932 [DEBUG - kudu-nio-1] (Recycler.java:97) -Dio.netty.recycler.ratio: 8
18:30:04.932 [DEBUG - kudu-nio-1] (Recycler.java:98) -Dio.netty.recycler.chunkSize: 32
18:30:04.932 [DEBUG - kudu-nio-1] (Recycler.java:99) -Dio.netty.recycler.blocking: false
18:30:04.932 [DEBUG - kudu-nio-1] (Recycler.java:100) -Dio.netty.recycler.batchFastThreadLocalOnly: true
18:30:05.062 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.68.189
18:30:05.062 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.68.188
18:30:05.063 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.68.190
18:30:05.302 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:05.303 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:05.307 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:05.345 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd83739f3, L:/127.0.0.1:51408 - R:/127.28.68.190:40429] using SASL/PLAIN
18:30:05.345 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd0ca3038, L:/127.0.0.1:32894 - R:/127.28.68.188:38393] using SASL/PLAIN
18:30:05.345 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x24b1159b, L:/127.0.0.1:45410 - R:/127.28.68.189:33753] using SASL/PLAIN
18:30:05.392 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:30:05.394 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=688), Traces: [0ms] refreshing cache from master, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [649ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: OK, [650ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: OK, [650ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: OK, deferred=null) after lookup
18:30:05.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.457819 28991 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51408:
18:30:05.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
18:30:05.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
18:30:05.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:30:05.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
18:30:05.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:30:05.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:30:05.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:30:05.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:30:05.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:30:05.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:30:05.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:05.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:30:05.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
18:30:05.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:30:05.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:30:05.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:30:05.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:30:05.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:30:05.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:30:05.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:05.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:30:05.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
18:30:05.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:30:05.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:30:05.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:30:05.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:30:05.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:30:05.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\001\000\000\000\000\007\0012\000\000\000\006\001d\000\000\000\007\001\310\000\000\000"
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:30:05.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
18:30:05.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:30:05.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:05.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:30:05.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:05.469758 28991 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
18:30:05.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.627283 30402 heartbeater.cc:499] Master 127.28.250.126:43415 was elected leader, sending a full tablet report...
18:30:05.651 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 12c1a20abe1e4b48b36cbc025d18d078
18:30:05.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.706933 29314 tablet_service.cc:1511] Processing CreateTablet for tablet 4710c9625c5745b09120e62bbb97a6b8 (DEFAULT_TABLE table=replication_test_table [id=12c1a20abe1e4b48b36cbc025d18d078]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
18:30:05.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.708535 29314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4710c9625c5745b09120e62bbb97a6b8. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:05.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.704540 29313 tablet_service.cc:1511] Processing CreateTablet for tablet 5582c55b8b0d4936acfd446a0499d077 (DEFAULT_TABLE table=replication_test_table [id=12c1a20abe1e4b48b36cbc025d18d078]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:05.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.712148 29313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5582c55b8b0d4936acfd446a0499d077. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.723470 29596 tablet_service.cc:1511] Processing CreateTablet for tablet 5582c55b8b0d4936acfd446a0499d077 (DEFAULT_TABLE table=replication_test_table [id=12c1a20abe1e4b48b36cbc025d18d078]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:05.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.726480 29597 tablet_service.cc:1511] Processing CreateTablet for tablet 4710c9625c5745b09120e62bbb97a6b8 (DEFAULT_TABLE table=replication_test_table [id=12c1a20abe1e4b48b36cbc025d18d078]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
18:30:05.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.728116 29597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4710c9625c5745b09120e62bbb97a6b8. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:05.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.735603 29596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5582c55b8b0d4936acfd446a0499d077. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:05.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.755631 29457 tablet_service.cc:1511] Processing CreateTablet for tablet 4710c9625c5745b09120e62bbb97a6b8 (DEFAULT_TABLE table=replication_test_table [id=12c1a20abe1e4b48b36cbc025d18d078]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
18:30:05.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.759634 29457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4710c9625c5745b09120e62bbb97a6b8. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:05.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.752987 29456 tablet_service.cc:1511] Processing CreateTablet for tablet 5582c55b8b0d4936acfd446a0499d077 (DEFAULT_TABLE table=replication_test_table [id=12c1a20abe1e4b48b36cbc025d18d078]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:05.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.764271 29456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5582c55b8b0d4936acfd446a0499d077. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:05.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.788371 30440 tablet_bootstrap.cc:492] T 5582c55b8b0d4936acfd446a0499d077 P f5e509cee0a748839c3450b407f2fc73: Bootstrap starting.
18:30:05.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.788928 30441 tablet_bootstrap.cc:492] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f: Bootstrap starting.
18:30:05.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.802744 30441 tablet_bootstrap.cc:654] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f: Neither blocks nor log segments found. Creating new log.
18:30:05.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.805450 30441 log.cc:826] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f: Log is configured to *not* fsync() on all Append() calls
18:30:05.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.811947 30440 tablet_bootstrap.cc:654] T 5582c55b8b0d4936acfd446a0499d077 P f5e509cee0a748839c3450b407f2fc73: Neither blocks nor log segments found. Creating new log.
18:30:05.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.820032 30441 tablet_bootstrap.cc:492] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f: No bootstrap required, opened a new log
18:30:05.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.819445 30440 log.cc:826] T 5582c55b8b0d4936acfd446a0499d077 P f5e509cee0a748839c3450b407f2fc73: Log is configured to *not* fsync() on all Append() calls
18:30:05.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.820574 30441 ts_tablet_manager.cc:1403] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.008s
18:30:05.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.837155 30440 tablet_bootstrap.cc:492] T 5582c55b8b0d4936acfd446a0499d077 P f5e509cee0a748839c3450b407f2fc73: No bootstrap required, opened a new log
18:30:05.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.838047 30440 ts_tablet_manager.cc:1403] T 5582c55b8b0d4936acfd446a0499d077 P f5e509cee0a748839c3450b407f2fc73: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.007s
18:30:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.862403 30441 raft_consensus.cc:359] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.864329 30441 raft_consensus.cc:385] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:05.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.864645 30441 raft_consensus.cc:740] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fd2094d56804459b8ca000192a7372f, State: Initialized, Role: FOLLOWER
18:30:05.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.865793 30441 consensus_queue.cc:260] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:05.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.878355 30441 ts_tablet_manager.cc:1434] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f: Time spent starting tablet: real 0.057s	user 0.023s	sys 0.020s
18:30:05.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.892078 30440 raft_consensus.cc:359] T 5582c55b8b0d4936acfd446a0499d077 P f5e509cee0a748839c3450b407f2fc73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:05.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.893671 30440 raft_consensus.cc:385] T 5582c55b8b0d4936acfd446a0499d077 P f5e509cee0a748839c3450b407f2fc73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:05.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.894632 30440 raft_consensus.cc:740] T 5582c55b8b0d4936acfd446a0499d077 P f5e509cee0a748839c3450b407f2fc73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5e509cee0a748839c3450b407f2fc73, State: Initialized, Role: FOLLOWER
18:30:05.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.896741 30440 consensus_queue.cc:260] T 5582c55b8b0d4936acfd446a0499d077 P f5e509cee0a748839c3450b407f2fc73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:05.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.908128 30441 tablet_bootstrap.cc:492] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f: Bootstrap starting.
18:30:05.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.927804 30441 tablet_bootstrap.cc:654] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f: Neither blocks nor log segments found. Creating new log.
18:30:05.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.945293 30447 tablet_bootstrap.cc:492] T 5582c55b8b0d4936acfd446a0499d077 P 104f3d7826d9407c93f3ba4a65872a8b: Bootstrap starting.
18:30:05.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.954911 30440 ts_tablet_manager.cc:1434] T 5582c55b8b0d4936acfd446a0499d077 P f5e509cee0a748839c3450b407f2fc73: Time spent starting tablet: real 0.116s	user 0.059s	sys 0.033s
18:30:05.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.957456 30440 tablet_bootstrap.cc:492] T 4710c9625c5745b09120e62bbb97a6b8 P f5e509cee0a748839c3450b407f2fc73: Bootstrap starting.
18:30:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.978904 30447 tablet_bootstrap.cc:654] T 5582c55b8b0d4936acfd446a0499d077 P 104f3d7826d9407c93f3ba4a65872a8b: Neither blocks nor log segments found. Creating new log.
18:30:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.979228 30440 tablet_bootstrap.cc:654] T 4710c9625c5745b09120e62bbb97a6b8 P f5e509cee0a748839c3450b407f2fc73: Neither blocks nor log segments found. Creating new log.
18:30:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.979344 30441 tablet_bootstrap.cc:492] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f: No bootstrap required, opened a new log
18:30:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.980082 30441 ts_tablet_manager.cc:1403] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.044s
18:30:05.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.981859 30447 log.cc:826] T 5582c55b8b0d4936acfd446a0499d077 P 104f3d7826d9407c93f3ba4a65872a8b: Log is configured to *not* fsync() on all Append() calls
18:30:05.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.983544 30441 raft_consensus.cc:359] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:05.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.984594 30441 raft_consensus.cc:385] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:05.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.985117 30441 raft_consensus.cc:740] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fd2094d56804459b8ca000192a7372f, State: Initialized, Role: FOLLOWER
18:30:05.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.986442 30441 consensus_queue.cc:260] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:05.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:05.991225 30441 ts_tablet_manager.cc:1434] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
18:30:06.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.000641 30440 tablet_bootstrap.cc:492] T 4710c9625c5745b09120e62bbb97a6b8 P f5e509cee0a748839c3450b407f2fc73: No bootstrap required, opened a new log
18:30:06.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.004479 30440 ts_tablet_manager.cc:1403] T 4710c9625c5745b09120e62bbb97a6b8 P f5e509cee0a748839c3450b407f2fc73: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.005s
18:30:06.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:06.006119 29387 tablet.cc:2406] T 5582c55b8b0d4936acfd446a0499d077 P f5e509cee0a748839c3450b407f2fc73: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:30:06.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.011418 30447 tablet_bootstrap.cc:492] T 5582c55b8b0d4936acfd446a0499d077 P 104f3d7826d9407c93f3ba4a65872a8b: No bootstrap required, opened a new log
18:30:06.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.012228 30447 ts_tablet_manager.cc:1403] T 5582c55b8b0d4936acfd446a0499d077 P 104f3d7826d9407c93f3ba4a65872a8b: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.009s
18:30:06.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.021081 30440 raft_consensus.cc:359] T 4710c9625c5745b09120e62bbb97a6b8 P f5e509cee0a748839c3450b407f2fc73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:06.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.022298 30440 raft_consensus.cc:385] T 4710c9625c5745b09120e62bbb97a6b8 P f5e509cee0a748839c3450b407f2fc73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:06.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.022590 30440 raft_consensus.cc:740] T 4710c9625c5745b09120e62bbb97a6b8 P f5e509cee0a748839c3450b407f2fc73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5e509cee0a748839c3450b407f2fc73, State: Initialized, Role: FOLLOWER
18:30:06.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.023737 30440 consensus_queue.cc:260] T 4710c9625c5745b09120e62bbb97a6b8 P f5e509cee0a748839c3450b407f2fc73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:06.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.027262 30440 ts_tablet_manager.cc:1434] T 4710c9625c5745b09120e62bbb97a6b8 P f5e509cee0a748839c3450b407f2fc73: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
18:30:06.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.071293 30447 raft_consensus.cc:359] T 5582c55b8b0d4936acfd446a0499d077 P 104f3d7826d9407c93f3ba4a65872a8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:06.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.072777 30447 raft_consensus.cc:385] T 5582c55b8b0d4936acfd446a0499d077 P 104f3d7826d9407c93f3ba4a65872a8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:06.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.073355 30447 raft_consensus.cc:740] T 5582c55b8b0d4936acfd446a0499d077 P 104f3d7826d9407c93f3ba4a65872a8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104f3d7826d9407c93f3ba4a65872a8b, State: Initialized, Role: FOLLOWER
18:30:06.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.074605 30447 consensus_queue.cc:260] T 5582c55b8b0d4936acfd446a0499d077 P 104f3d7826d9407c93f3ba4a65872a8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:06.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.080061 30447 ts_tablet_manager.cc:1434] T 5582c55b8b0d4936acfd446a0499d077 P 104f3d7826d9407c93f3ba4a65872a8b: Time spent starting tablet: real 0.067s	user 0.040s	sys 0.000s
18:30:06.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.081383 30447 tablet_bootstrap.cc:492] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b: Bootstrap starting.
18:30:06.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.089730 30447 tablet_bootstrap.cc:654] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b: Neither blocks nor log segments found. Creating new log.
18:30:06.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.096984 30447 tablet_bootstrap.cc:492] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b: No bootstrap required, opened a new log
18:30:06.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.097813 30447 ts_tablet_manager.cc:1403] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
18:30:06.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.101258 30447 raft_consensus.cc:359] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:06.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.102165 30447 raft_consensus.cc:385] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:06.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.102626 30447 raft_consensus.cc:740] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104f3d7826d9407c93f3ba4a65872a8b, State: Initialized, Role: FOLLOWER
18:30:06.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.103650 30447 consensus_queue.cc:260] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:06.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.106547 30447 ts_tablet_manager.cc:1434] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
18:30:06.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.108273 30445 raft_consensus.cc:493] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:30:06.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.108891 30445 raft_consensus.cc:515] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:06.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:06.110896 29529 tablet.cc:2406] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:30:06.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:06.119534 29669 tablet.cc:2406] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:30:06.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.127530 30445 leader_election.cc:290] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5e509cee0a748839c3450b407f2fc73 (127.28.68.129:46603), 104f3d7826d9407c93f3ba4a65872a8b (127.28.68.130:42897)
18:30:06.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.145171 30452 raft_consensus.cc:493] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:30:06.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.145778 30452 raft_consensus.cc:515] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:06.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.146379 29334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4710c9625c5745b09120e62bbb97a6b8" candidate_uuid: "5fd2094d56804459b8ca000192a7372f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e509cee0a748839c3450b407f2fc73" is_pre_election: true
18:30:06.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.147338 29334 raft_consensus.cc:2468] T 4710c9625c5745b09120e62bbb97a6b8 P f5e509cee0a748839c3450b407f2fc73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fd2094d56804459b8ca000192a7372f in term 0.
18:30:06.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.149235 29551 leader_election.cc:304] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fd2094d56804459b8ca000192a7372f, f5e509cee0a748839c3450b407f2fc73; no voters: 
18:30:06.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.150213 30445 raft_consensus.cc:2804] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [term 0 FOLLOWER]: Leader pre-election won for term 1
18:30:06.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.150775 30445 raft_consensus.cc:493] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:30:06.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.151453 30445 raft_consensus.cc:3060] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [term 0 FOLLOWER]: Advancing to term 1
18:30:06.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.153759 30452 leader_election.cc:290] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5e509cee0a748839c3450b407f2fc73 (127.28.68.129:46603), 5fd2094d56804459b8ca000192a7372f (127.28.68.131:36413)
18:30:06.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.163230 30445 raft_consensus.cc:515] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:06.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.166517 29334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4710c9625c5745b09120e62bbb97a6b8" candidate_uuid: "5fd2094d56804459b8ca000192a7372f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e509cee0a748839c3450b407f2fc73"
18:30:06.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.167249 29334 raft_consensus.cc:3060] T 4710c9625c5745b09120e62bbb97a6b8 P f5e509cee0a748839c3450b407f2fc73 [term 0 FOLLOWER]: Advancing to term 1
18:30:06.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.184587 29334 raft_consensus.cc:2468] T 4710c9625c5745b09120e62bbb97a6b8 P f5e509cee0a748839c3450b407f2fc73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fd2094d56804459b8ca000192a7372f in term 1.
18:30:06.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.187103 29551 leader_election.cc:304] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fd2094d56804459b8ca000192a7372f, f5e509cee0a748839c3450b407f2fc73; no voters: 
18:30:06.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.191814 30445 leader_election.cc:290] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [CANDIDATE]: Term 1 election: Requested vote from peers f5e509cee0a748839c3450b407f2fc73 (127.28.68.129:46603), 104f3d7826d9407c93f3ba4a65872a8b (127.28.68.130:42897)
18:30:06.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.192654 30445 raft_consensus.cc:2804] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [term 1 FOLLOWER]: Leader election won for term 1
18:30:06.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.200356 29477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4710c9625c5745b09120e62bbb97a6b8" candidate_uuid: "5fd2094d56804459b8ca000192a7372f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104f3d7826d9407c93f3ba4a65872a8b" is_pre_election: true
18:30:06.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.201223 29477 raft_consensus.cc:2468] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fd2094d56804459b8ca000192a7372f in term 0.
18:30:06.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.193284 30445 raft_consensus.cc:697] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [term 1 LEADER]: Becoming Leader. State: Replica: 5fd2094d56804459b8ca000192a7372f, State: Running, Role: LEADER
18:30:06.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.204373 29617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4710c9625c5745b09120e62bbb97a6b8" candidate_uuid: "104f3d7826d9407c93f3ba4a65872a8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fd2094d56804459b8ca000192a7372f" is_pre_election: true
18:30:06.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.205439 29477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4710c9625c5745b09120e62bbb97a6b8" candidate_uuid: "5fd2094d56804459b8ca000192a7372f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104f3d7826d9407c93f3ba4a65872a8b"
18:30:06.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.205962 29477 raft_consensus.cc:3060] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b [term 0 FOLLOWER]: Advancing to term 1
18:30:06.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.206197 30445 consensus_queue.cc:237] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:06.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.215869 29477 raft_consensus.cc:2468] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fd2094d56804459b8ca000192a7372f in term 1.
18:30:06.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.217048 29334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4710c9625c5745b09120e62bbb97a6b8" candidate_uuid: "104f3d7826d9407c93f3ba4a65872a8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e509cee0a748839c3450b407f2fc73" is_pre_election: true
18:30:06.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.218171 29334 raft_consensus.cc:2393] T 4710c9625c5745b09120e62bbb97a6b8 P f5e509cee0a748839c3450b407f2fc73 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 104f3d7826d9407c93f3ba4a65872a8b in current term 1: Already voted for candidate 5fd2094d56804459b8ca000192a7372f in this term.
18:30:06.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.220453 29411 leader_election.cc:304] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 104f3d7826d9407c93f3ba4a65872a8b; no voters: 5fd2094d56804459b8ca000192a7372f, f5e509cee0a748839c3450b407f2fc73
18:30:06.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.222182 30452 raft_consensus.cc:2749] T 4710c9625c5745b09120e62bbb97a6b8 P 104f3d7826d9407c93f3ba4a65872a8b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:30:06.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.231550 28991 catalog_manager.cc:5696] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fd2094d56804459b8ca000192a7372f (127.28.68.131). New cstate: current_term: 1 leader_uuid: "5fd2094d56804459b8ca000192a7372f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } health_report { overall_health: HEALTHY } } }
18:30:06.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.341719 30445 raft_consensus.cc:493] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:30:06.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.342207 30445 raft_consensus.cc:515] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:06.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.343734 30445 leader_election.cc:290] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5e509cee0a748839c3450b407f2fc73 (127.28.68.129:46603), 104f3d7826d9407c93f3ba4a65872a8b (127.28.68.130:42897)
18:30:06.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.345430 29334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5582c55b8b0d4936acfd446a0499d077" candidate_uuid: "5fd2094d56804459b8ca000192a7372f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e509cee0a748839c3450b407f2fc73" is_pre_election: true
18:30:06.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.345958 29477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5582c55b8b0d4936acfd446a0499d077" candidate_uuid: "5fd2094d56804459b8ca000192a7372f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104f3d7826d9407c93f3ba4a65872a8b" is_pre_election: true
18:30:06.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.346150 29334 raft_consensus.cc:2468] T 5582c55b8b0d4936acfd446a0499d077 P f5e509cee0a748839c3450b407f2fc73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fd2094d56804459b8ca000192a7372f in term 0.
18:30:06.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.346832 29477 raft_consensus.cc:2468] T 5582c55b8b0d4936acfd446a0499d077 P 104f3d7826d9407c93f3ba4a65872a8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fd2094d56804459b8ca000192a7372f in term 0.
18:30:06.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.347381 29551 leader_election.cc:304] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fd2094d56804459b8ca000192a7372f, f5e509cee0a748839c3450b407f2fc73; no voters: 
18:30:06.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.348310 30445 raft_consensus.cc:2804] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [term 0 FOLLOWER]: Leader pre-election won for term 1
18:30:06.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.348639 30445 raft_consensus.cc:493] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:30:06.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.348999 30445 raft_consensus.cc:3060] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [term 0 FOLLOWER]: Advancing to term 1
18:30:06.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.354220 30445 raft_consensus.cc:515] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:06.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.355871 30445 leader_election.cc:290] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [CANDIDATE]: Term 1 election: Requested vote from peers f5e509cee0a748839c3450b407f2fc73 (127.28.68.129:46603), 104f3d7826d9407c93f3ba4a65872a8b (127.28.68.130:42897)
18:30:06.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.356844 29334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5582c55b8b0d4936acfd446a0499d077" candidate_uuid: "5fd2094d56804459b8ca000192a7372f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e509cee0a748839c3450b407f2fc73"
18:30:06.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.357191 29477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5582c55b8b0d4936acfd446a0499d077" candidate_uuid: "5fd2094d56804459b8ca000192a7372f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104f3d7826d9407c93f3ba4a65872a8b"
18:30:06.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.357446 29334 raft_consensus.cc:3060] T 5582c55b8b0d4936acfd446a0499d077 P f5e509cee0a748839c3450b407f2fc73 [term 0 FOLLOWER]: Advancing to term 1
18:30:06.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.357769 29477 raft_consensus.cc:3060] T 5582c55b8b0d4936acfd446a0499d077 P 104f3d7826d9407c93f3ba4a65872a8b [term 0 FOLLOWER]: Advancing to term 1
18:30:06.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.364538 29334 raft_consensus.cc:2468] T 5582c55b8b0d4936acfd446a0499d077 P f5e509cee0a748839c3450b407f2fc73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fd2094d56804459b8ca000192a7372f in term 1.
18:30:06.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.364511 29477 raft_consensus.cc:2468] T 5582c55b8b0d4936acfd446a0499d077 P 104f3d7826d9407c93f3ba4a65872a8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fd2094d56804459b8ca000192a7372f in term 1.
18:30:06.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.365741 29551 leader_election.cc:304] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104f3d7826d9407c93f3ba4a65872a8b, 5fd2094d56804459b8ca000192a7372f; no voters: 
18:30:06.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.366480 30445 raft_consensus.cc:2804] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [term 1 FOLLOWER]: Leader election won for term 1
18:30:06.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.367002 30445 raft_consensus.cc:697] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [term 1 LEADER]: Becoming Leader. State: Replica: 5fd2094d56804459b8ca000192a7372f, State: Running, Role: LEADER
18:30:06.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.368093 30445 consensus_queue.cc:237] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } }
18:30:06.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.377645 28991 catalog_manager.cc:5696] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fd2094d56804459b8ca000192a7372f (127.28.68.131). New cstate: current_term: 1 leader_uuid: "5fd2094d56804459b8ca000192a7372f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fd2094d56804459b8ca000192a7372f" member_type: VOTER last_known_addr { host: "127.28.68.131" port: 36413 } health_report { overall_health: HEALTHY } } }
18:30:06.556 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 12c1a20abe1e4b48b36cbc025d18d078
18:30:06.614 [DEBUG - main] (AsyncKuduClient.java:2538) Learned about tablet 4710c9625c5745b09120e62bbb97a6b8 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
18:30:06.615 [DEBUG - main] (AsyncKuduClient.java:2538) Learned about tablet 5582c55b8b0d4936acfd446a0499d077 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:30:06.618 [DEBUG - main] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299998, tablet=4710c9625c5745b09120e62bbb97a6b8@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897),5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)[L],f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299997}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299997, tablet=5582c55b8b0d4936acfd446a0499d077@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897),5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)[L],f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299996}]
18:30:06.620 [DEBUG - main] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=55), Traces: [0ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.68.190:40429, [35ms] Sub RPC GetTableLocations: received response from server master-127.28.68.190:40429: OK, deferred=null) after lookup
18:30:06.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.628278 30445 consensus_queue.cc:1048] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:30:06.630 [DEBUG - main] (Connection.java:748) [peer 5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)] connecting to peer
18:30:06.659 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)] Successfully connected to peer
18:30:06.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:06.718554 30445 consensus_queue.cc:1048] T 4710c9625c5745b09120e62bbb97a6b8 P 5fd2094d56804459b8ca000192a7372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:30:06.843 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:06.849 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xfc4db793, L:/127.0.0.1:46980 - R:/127.28.68.131:36413] using TOKEN/null
18:30:07.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.006630 30458 consensus_queue.cc:1048] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5e509cee0a748839c3450b407f2fc73" member_type: VOTER last_known_addr { host: "127.28.68.129" port: 46603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:30:07.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.009415 30445 consensus_queue.cc:1048] T 5582c55b8b0d4936acfd446a0499d077 P 5fd2094d56804459b8ca000192a7372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "104f3d7826d9407c93f3ba4a65872a8b" member_type: VOTER last_known_addr { host: "127.28.68.130" port: 42897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:30:07.150 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 12c1a20abe1e4b48b36cbc025d18d078
18:30:07.318 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:07.322 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:07.324 [DEBUG - main] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:07.327 [DEBUG - main] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:07.328 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.28.250.125:38957(127.28.250.125:38957)] Successfully connected to peer
18:30:07.339 [DEBUG - main] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:07.341 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.28.250.124:38123(127.28.250.124:38123)] Successfully connected to peer
18:30:07.344 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.28.250.126:43415(127.28.250.126:43415)] Successfully connected to peer
18:30:07.364 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.125
18:30:07.402 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.124
18:30:07.404 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.126
18:30:07.428 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:07.439 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:07.445 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:07.447 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4aa7f92c, L:/127.0.0.1:44690 - R:/127.28.250.125:38957] using SASL/PLAIN
18:30:07.456 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xcb0bbb33, L:/127.0.0.1:58682 - R:/127.28.250.126:43415] using SASL/PLAIN
18:30:07.457 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xe6c87b33, L:/127.0.0.1:43156 - R:/127.28.250.124:38123] using SASL/PLAIN
18:30:07.461 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:30:07.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=138), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [127ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: OK, deferred=null) after lookup
18:30:07.476 [DEBUG - main] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:07.479 [DEBUG - main] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:07.486 [DEBUG - main] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:07.488 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.28.68.190:40429(127.28.68.190:40429)] Successfully connected to peer
18:30:07.496 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.28.68.189:33753(127.28.68.189:33753)] Successfully connected to peer
18:30:07.504 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.28.68.188:38393(127.28.68.188:38393)] Successfully connected to peer
18:30:07.510 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.68.190
18:30:07.511 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.68.189
18:30:07.512 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.68.188
18:30:07.534 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:07.540 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:07.542 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xcd1119fc, L:/127.0.0.1:45412 - R:/127.28.68.189:33753] using SASL/PLAIN
18:30:07.549 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5747395e, L:/127.0.0.1:32896 - R:/127.28.68.188:38393] using SASL/PLAIN
18:30:07.642 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:07.653 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x64badfa5, L:/127.0.0.1:51418 - R:/127.28.68.190:40429] using SASL/PLAIN
18:30:07.657 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:30:07.658 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=186), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [69ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: OK, [115ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: OK, [180ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: OK, deferred=null) after lookup
18:30:07.662 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 12c1a20abe1e4b48b36cbc025d18d078
18:30:07.692 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4710c9625c5745b09120e62bbb97a6b8 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
18:30:07.693 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 5582c55b8b0d4936acfd446a0499d077 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:30:07.693 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=4710c9625c5745b09120e62bbb97a6b8@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897),5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)[L],f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=5582c55b8b0d4936acfd446a0499d077@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897),5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)[L],f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.707687 29721 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58682:
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:30:07.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\001\000\000\000\000\007\0012\000\000\000"
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:30:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
18:30:07.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:07.711305 29721 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
18:30:07.747 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 5b7ad4573492423d9b61b2a95fb51f3c
18:30:07.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.789738 30335 tablet_service.cc:1511] Processing CreateTablet for tablet 48044963b1654d50aab0e0ac5f36d0e5 (DEFAULT_TABLE table=replication_test_table [id=5b7ad4573492423d9b61b2a95fb51f3c]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
18:30:07.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.792080 30335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48044963b1654d50aab0e0ac5f36d0e5. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:07.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.820214 30191 tablet_service.cc:1511] Processing CreateTablet for tablet 48044963b1654d50aab0e0ac5f36d0e5 (DEFAULT_TABLE table=replication_test_table [id=5b7ad4573492423d9b61b2a95fb51f3c]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
18:30:07.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.820935 30048 tablet_service.cc:1511] Processing CreateTablet for tablet 48044963b1654d50aab0e0ac5f36d0e5 (DEFAULT_TABLE table=replication_test_table [id=5b7ad4573492423d9b61b2a95fb51f3c]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
18:30:07.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.822553 30191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48044963b1654d50aab0e0ac5f36d0e5. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:07.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.823643 30048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48044963b1654d50aab0e0ac5f36d0e5. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:07.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.838310 30516 tablet_bootstrap.cc:492] T 48044963b1654d50aab0e0ac5f36d0e5 P a47a8e581a3b425f85a5c443a726f9b9: Bootstrap starting.
18:30:07.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.855069 30516 tablet_bootstrap.cc:654] T 48044963b1654d50aab0e0ac5f36d0e5 P a47a8e581a3b425f85a5c443a726f9b9: Neither blocks nor log segments found. Creating new log.
18:30:07.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.858263 30516 log.cc:826] T 48044963b1654d50aab0e0ac5f36d0e5 P a47a8e581a3b425f85a5c443a726f9b9: Log is configured to *not* fsync() on all Append() calls
18:30:07.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.874545 30519 tablet_bootstrap.cc:492] T 48044963b1654d50aab0e0ac5f36d0e5 P 2c0ac04628354392ab4087c1289fd5b0: Bootstrap starting.
18:30:07.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.878440 30518 tablet_bootstrap.cc:492] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1: Bootstrap starting.
18:30:07.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.886528 30519 tablet_bootstrap.cc:654] T 48044963b1654d50aab0e0ac5f36d0e5 P 2c0ac04628354392ab4087c1289fd5b0: Neither blocks nor log segments found. Creating new log.
18:30:07.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.889019 30519 log.cc:826] T 48044963b1654d50aab0e0ac5f36d0e5 P 2c0ac04628354392ab4087c1289fd5b0: Log is configured to *not* fsync() on all Append() calls
18:30:07.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.893445 30516 tablet_bootstrap.cc:492] T 48044963b1654d50aab0e0ac5f36d0e5 P a47a8e581a3b425f85a5c443a726f9b9: No bootstrap required, opened a new log
18:30:07.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.895952 30516 ts_tablet_manager.cc:1403] T 48044963b1654d50aab0e0ac5f36d0e5 P a47a8e581a3b425f85a5c443a726f9b9: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.012s
18:30:07.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.900928 30519 tablet_bootstrap.cc:492] T 48044963b1654d50aab0e0ac5f36d0e5 P 2c0ac04628354392ab4087c1289fd5b0: No bootstrap required, opened a new log
18:30:07.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.901649 30519 ts_tablet_manager.cc:1403] T 48044963b1654d50aab0e0ac5f36d0e5 P 2c0ac04628354392ab4087c1289fd5b0: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.010s
18:30:07.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.910012 30518 tablet_bootstrap.cc:654] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1: Neither blocks nor log segments found. Creating new log.
18:30:07.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.917626 30518 log.cc:826] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1: Log is configured to *not* fsync() on all Append() calls
18:30:07.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.942257 30518 tablet_bootstrap.cc:492] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1: No bootstrap required, opened a new log
18:30:07.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.943176 30518 ts_tablet_manager.cc:1403] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.020s
18:30:07.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.952543 30516 raft_consensus.cc:359] T 48044963b1654d50aab0e0ac5f36d0e5 P a47a8e581a3b425f85a5c443a726f9b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } }
18:30:07.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.959436 30516 raft_consensus.cc:385] T 48044963b1654d50aab0e0ac5f36d0e5 P a47a8e581a3b425f85a5c443a726f9b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:07.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.959745 30516 raft_consensus.cc:740] T 48044963b1654d50aab0e0ac5f36d0e5 P a47a8e581a3b425f85a5c443a726f9b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a47a8e581a3b425f85a5c443a726f9b9, State: Initialized, Role: FOLLOWER
18:30:07.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.960785 30516 consensus_queue.cc:260] T 48044963b1654d50aab0e0ac5f36d0e5 P a47a8e581a3b425f85a5c443a726f9b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } }
18:30:07.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.966198 30519 raft_consensus.cc:359] T 48044963b1654d50aab0e0ac5f36d0e5 P 2c0ac04628354392ab4087c1289fd5b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } }
18:30:07.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.967098 30519 raft_consensus.cc:385] T 48044963b1654d50aab0e0ac5f36d0e5 P 2c0ac04628354392ab4087c1289fd5b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:07.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.967408 30519 raft_consensus.cc:740] T 48044963b1654d50aab0e0ac5f36d0e5 P 2c0ac04628354392ab4087c1289fd5b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0ac04628354392ab4087c1289fd5b0, State: Initialized, Role: FOLLOWER
18:30:07.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.968503 30519 consensus_queue.cc:260] T 48044963b1654d50aab0e0ac5f36d0e5 P 2c0ac04628354392ab4087c1289fd5b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } }
18:30:07.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.971105 30516 ts_tablet_manager.cc:1434] T 48044963b1654d50aab0e0ac5f36d0e5 P a47a8e581a3b425f85a5c443a726f9b9: Time spent starting tablet: real 0.073s	user 0.040s	sys 0.003s
18:30:07.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.985249 30518 raft_consensus.cc:359] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } }
18:30:07.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.986523 30518 raft_consensus.cc:385] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:07.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.987042 30518 raft_consensus.cc:740] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0daef4de5564bcda67a7642c8fda8d1, State: Initialized, Role: FOLLOWER
18:30:07.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:07.988435 30518 consensus_queue.cc:260] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } }
18:30:08.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.001256 30525 raft_consensus.cc:493] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:30:08.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:08.001284 29175 debug-util.cc:398] Leaking SignalData structure 0x7b08000adbc0 after lost signal to thread 29110
18:30:08.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.017308 30518 ts_tablet_manager.cc:1434] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1: Time spent starting tablet: real 0.074s	user 0.034s	sys 0.003s
18:30:08.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.001884 30525 raft_consensus.cc:515] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } }
18:30:08.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.027784 30525 leader_election.cc:290] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a47a8e581a3b425f85a5c443a726f9b9 (127.28.250.67:46725), 2c0ac04628354392ab4087c1289fd5b0 (127.28.250.66:43259)
18:30:08.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.043208 30519 ts_tablet_manager.cc:1434] T 48044963b1654d50aab0e0ac5f36d0e5 P 2c0ac04628354392ab4087c1289fd5b0: Time spent starting tablet: real 0.141s	user 0.054s	sys 0.040s
18:30:08.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:08.045101 30407 tablet.cc:2406] T 48044963b1654d50aab0e0ac5f36d0e5 P a47a8e581a3b425f85a5c443a726f9b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:30:08.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.057953 30355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48044963b1654d50aab0e0ac5f36d0e5" candidate_uuid: "e0daef4de5564bcda67a7642c8fda8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a47a8e581a3b425f85a5c443a726f9b9" is_pre_election: true
18:30:08.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.058866 30355 raft_consensus.cc:2468] T 48044963b1654d50aab0e0ac5f36d0e5 P a47a8e581a3b425f85a5c443a726f9b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0daef4de5564bcda67a7642c8fda8d1 in term 0.
18:30:08.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.061355 30003 leader_election.cc:304] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a47a8e581a3b425f85a5c443a726f9b9, e0daef4de5564bcda67a7642c8fda8d1; no voters: 
18:30:08.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.062350 30525 raft_consensus.cc:2804] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:30:08.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.062691 30525 raft_consensus.cc:493] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:30:08.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.063058 30525 raft_consensus.cc:3060] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [term 0 FOLLOWER]: Advancing to term 1
18:30:08.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.067480 30211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48044963b1654d50aab0e0ac5f36d0e5" candidate_uuid: "e0daef4de5564bcda67a7642c8fda8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0ac04628354392ab4087c1289fd5b0" is_pre_election: true
18:30:08.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.068408 30211 raft_consensus.cc:2468] T 48044963b1654d50aab0e0ac5f36d0e5 P 2c0ac04628354392ab4087c1289fd5b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0daef4de5564bcda67a7642c8fda8d1 in term 0.
18:30:08.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.070919 30525 raft_consensus.cc:515] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } }
18:30:08.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.073526 30525 leader_election.cc:290] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [CANDIDATE]: Term 1 election: Requested vote from peers a47a8e581a3b425f85a5c443a726f9b9 (127.28.250.67:46725), 2c0ac04628354392ab4087c1289fd5b0 (127.28.250.66:43259)
18:30:08.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.073658 30355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48044963b1654d50aab0e0ac5f36d0e5" candidate_uuid: "e0daef4de5564bcda67a7642c8fda8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a47a8e581a3b425f85a5c443a726f9b9"
18:30:08.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.073772 30211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48044963b1654d50aab0e0ac5f36d0e5" candidate_uuid: "e0daef4de5564bcda67a7642c8fda8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0ac04628354392ab4087c1289fd5b0"
18:30:08.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.074167 30355 raft_consensus.cc:3060] T 48044963b1654d50aab0e0ac5f36d0e5 P a47a8e581a3b425f85a5c443a726f9b9 [term 0 FOLLOWER]: Advancing to term 1
18:30:08.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.074322 30211 raft_consensus.cc:3060] T 48044963b1654d50aab0e0ac5f36d0e5 P 2c0ac04628354392ab4087c1289fd5b0 [term 0 FOLLOWER]: Advancing to term 1
18:30:08.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.081285 30355 raft_consensus.cc:2468] T 48044963b1654d50aab0e0ac5f36d0e5 P a47a8e581a3b425f85a5c443a726f9b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0daef4de5564bcda67a7642c8fda8d1 in term 1.
18:30:08.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.082463 30003 leader_election.cc:304] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a47a8e581a3b425f85a5c443a726f9b9, e0daef4de5564bcda67a7642c8fda8d1; no voters: 
18:30:08.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.083235 30525 raft_consensus.cc:2804] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [term 1 FOLLOWER]: Leader election won for term 1
18:30:08.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.083737 30525 raft_consensus.cc:697] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [term 1 LEADER]: Becoming Leader. State: Replica: e0daef4de5564bcda67a7642c8fda8d1, State: Running, Role: LEADER
18:30:08.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.084755 30525 consensus_queue.cc:237] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } }
18:30:08.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.085112 30211 raft_consensus.cc:2468] T 48044963b1654d50aab0e0ac5f36d0e5 P 2c0ac04628354392ab4087c1289fd5b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0daef4de5564bcda67a7642c8fda8d1 in term 1.
18:30:08.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:08.094672 30265 tablet.cc:2406] T 48044963b1654d50aab0e0ac5f36d0e5 P 2c0ac04628354392ab4087c1289fd5b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:30:08.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.113157 29721 catalog_manager.cc:5696] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0daef4de5564bcda67a7642c8fda8d1 (127.28.250.65). New cstate: current_term: 1 leader_uuid: "e0daef4de5564bcda67a7642c8fda8d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } health_report { overall_health: HEALTHY } } }
18:30:08.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.174682 29721 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58682:
18:30:08.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
18:30:08.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:08.185226 30122 tablet.cc:2406] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:30:08.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:08.201702 29721 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b2c27463a88c4279a43c0b747bb2e812 has no consensus state
18:30:08.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.232304 30048 tablet_service.cc:1511] Processing CreateTablet for tablet b2c27463a88c4279a43c0b747bb2e812 (DEFAULT_TABLE table=replication_test_table [id=5b7ad4573492423d9b61b2a95fb51f3c]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:08.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.233497 30048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2c27463a88c4279a43c0b747bb2e812. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:08.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.244349 30335 tablet_service.cc:1511] Processing CreateTablet for tablet b2c27463a88c4279a43c0b747bb2e812 (DEFAULT_TABLE table=replication_test_table [id=5b7ad4573492423d9b61b2a95fb51f3c]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:08.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.244870 30191 tablet_service.cc:1511] Processing CreateTablet for tablet b2c27463a88c4279a43c0b747bb2e812 (DEFAULT_TABLE table=replication_test_table [id=5b7ad4573492423d9b61b2a95fb51f3c]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:08.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.245642 30335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2c27463a88c4279a43c0b747bb2e812. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:08.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.246027 30191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2c27463a88c4279a43c0b747bb2e812. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:08.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:08.253003 29708 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet b2c27463a88c4279a43c0b747bb2e812 (table replication_test_table [id=5b7ad4573492423d9b61b2a95fb51f3c], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet b2c27463a88c4279a43c0b747bb2e812 consensus state has no leader
18:30:08.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.255502 30518 tablet_bootstrap.cc:492] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1: Bootstrap starting.
18:30:08.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.270144 30518 tablet_bootstrap.cc:654] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1: Neither blocks nor log segments found. Creating new log.
18:30:08.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.271723 30516 tablet_bootstrap.cc:492] T b2c27463a88c4279a43c0b747bb2e812 P a47a8e581a3b425f85a5c443a726f9b9: Bootstrap starting.
18:30:08.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.281291 30516 tablet_bootstrap.cc:654] T b2c27463a88c4279a43c0b747bb2e812 P a47a8e581a3b425f85a5c443a726f9b9: Neither blocks nor log segments found. Creating new log.
18:30:08.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.294745 30518 tablet_bootstrap.cc:492] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1: No bootstrap required, opened a new log
18:30:08.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.295665 30518 ts_tablet_manager.cc:1403] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.018s
18:30:08.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.300271 30519 tablet_bootstrap.cc:492] T b2c27463a88c4279a43c0b747bb2e812 P 2c0ac04628354392ab4087c1289fd5b0: Bootstrap starting.
18:30:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.307520 30519 tablet_bootstrap.cc:654] T b2c27463a88c4279a43c0b747bb2e812 P 2c0ac04628354392ab4087c1289fd5b0: Neither blocks nor log segments found. Creating new log.
18:30:08.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.312945 30516 tablet_bootstrap.cc:492] T b2c27463a88c4279a43c0b747bb2e812 P a47a8e581a3b425f85a5c443a726f9b9: No bootstrap required, opened a new log
18:30:08.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.313413 30516 ts_tablet_manager.cc:1403] T b2c27463a88c4279a43c0b747bb2e812 P a47a8e581a3b425f85a5c443a726f9b9: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.011s
18:30:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.313055 30518 raft_consensus.cc:359] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } }
18:30:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.314620 30518 raft_consensus.cc:385] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:08.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.315070 30518 raft_consensus.cc:740] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0daef4de5564bcda67a7642c8fda8d1, State: Initialized, Role: FOLLOWER
18:30:08.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.317062 30516 raft_consensus.cc:359] T b2c27463a88c4279a43c0b747bb2e812 P a47a8e581a3b425f85a5c443a726f9b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } }
18:30:08.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.317124 30518 consensus_queue.cc:260] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } }
18:30:08.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.317838 30516 raft_consensus.cc:385] T b2c27463a88c4279a43c0b747bb2e812 P a47a8e581a3b425f85a5c443a726f9b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:08.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.319139 30516 raft_consensus.cc:740] T b2c27463a88c4279a43c0b747bb2e812 P a47a8e581a3b425f85a5c443a726f9b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a47a8e581a3b425f85a5c443a726f9b9, State: Initialized, Role: FOLLOWER
18:30:08.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.319998 30516 consensus_queue.cc:260] T b2c27463a88c4279a43c0b747bb2e812 P a47a8e581a3b425f85a5c443a726f9b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } }
18:30:08.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.323333 30516 ts_tablet_manager.cc:1434] T b2c27463a88c4279a43c0b747bb2e812 P a47a8e581a3b425f85a5c443a726f9b9: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
18:30:08.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.332894 30518 ts_tablet_manager.cc:1434] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.002s
18:30:08.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.343142 30525 raft_consensus.cc:493] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:30:08.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.352336 30525 raft_consensus.cc:515] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } }
18:30:08.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.354439 30525 leader_election.cc:290] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c0ac04628354392ab4087c1289fd5b0 (127.28.250.66:43259), a47a8e581a3b425f85a5c443a726f9b9 (127.28.250.67:46725)
18:30:08.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.357754 30211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c27463a88c4279a43c0b747bb2e812" candidate_uuid: "e0daef4de5564bcda67a7642c8fda8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0ac04628354392ab4087c1289fd5b0" is_pre_election: true
18:30:08.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.359598 30355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c27463a88c4279a43c0b747bb2e812" candidate_uuid: "e0daef4de5564bcda67a7642c8fda8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a47a8e581a3b425f85a5c443a726f9b9" is_pre_election: true
18:30:08.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.360292 30355 raft_consensus.cc:2468] T b2c27463a88c4279a43c0b747bb2e812 P a47a8e581a3b425f85a5c443a726f9b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0daef4de5564bcda67a7642c8fda8d1 in term 0.
18:30:08.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.362264 29721 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 5d4deb5d04bb4c2b8a738dbd4b7c4d60: replication_test_table [id=5b7ad4573492423d9b61b2a95fb51f3c] alter complete (version 0)
18:30:08.370 [DEBUG - main] (Connection.java:575) [peer master-127.28.68.190:40429(127.28.68.190:40429)] disconnecting while in state READY
18:30:08.371 [DEBUG - main] (Connection.java:575) [peer master-127.28.68.188:38393(127.28.68.188:38393)] disconnecting while in state READY
18:30:08.372 [DEBUG - main] (Connection.java:575) [peer master-127.28.68.189:33753(127.28.68.189:33753)] disconnecting while in state READY
18:30:08.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.363611 30003 leader_election.cc:304] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a47a8e581a3b425f85a5c443a726f9b9, e0daef4de5564bcda67a7642c8fda8d1; no voters: 
18:30:08.376 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.28.68.188:38393(127.28.68.188:38393)] handling channelInactive
18:30:08.377 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state READY due to: connection closed
18:30:08.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:08.370448 30004 leader_election.cc:343] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c0ac04628354392ab4087c1289fd5b0 (127.28.250.66:43259): Illegal state: must be running to vote when last-logged opid is not known
18:30:08.379 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:30:08.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.378774 30525 raft_consensus.cc:2804] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:30:08.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.379441 30525 raft_consensus.cc:493] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:30:08.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.379788 30525 raft_consensus.cc:3060] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [term 0 FOLLOWER]: Advancing to term 1
18:30:08.381 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
18:30:08.383 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.28.68.189:33753(127.28.68.189:33753)] handling channelInactive
18:30:08.383 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state READY due to: connection closed
18:30:08.383 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
18:30:08.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.395064 30525 raft_consensus.cc:515] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } }
18:30:08.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.396690 30519 tablet_bootstrap.cc:492] T b2c27463a88c4279a43c0b747bb2e812 P 2c0ac04628354392ab4087c1289fd5b0: No bootstrap required, opened a new log
18:30:08.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.397133 30519 ts_tablet_manager.cc:1403] T b2c27463a88c4279a43c0b747bb2e812 P 2c0ac04628354392ab4087c1289fd5b0: Time spent bootstrapping tablet: real 0.097s	user 0.014s	sys 0.000s
18:30:08.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.401706 30519 raft_consensus.cc:359] T b2c27463a88c4279a43c0b747bb2e812 P 2c0ac04628354392ab4087c1289fd5b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } }
18:30:08.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.402431 30519 raft_consensus.cc:385] T b2c27463a88c4279a43c0b747bb2e812 P 2c0ac04628354392ab4087c1289fd5b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:08.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.402690 30519 raft_consensus.cc:740] T b2c27463a88c4279a43c0b747bb2e812 P 2c0ac04628354392ab4087c1289fd5b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0ac04628354392ab4087c1289fd5b0, State: Initialized, Role: FOLLOWER
18:30:08.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.403468 30519 consensus_queue.cc:260] T b2c27463a88c4279a43c0b747bb2e812 P 2c0ac04628354392ab4087c1289fd5b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } }
18:30:08.411 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.28.68.190:40429(127.28.68.190:40429)] handling channelInactive
18:30:08.411 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state READY due to: connection closed
18:30:08.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.410566 30525 leader_election.cc:290] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [CANDIDATE]: Term 1 election: Requested vote from peers 2c0ac04628354392ab4087c1289fd5b0 (127.28.250.66:43259), a47a8e581a3b425f85a5c443a726f9b9 (127.28.250.67:46725)
18:30:08.412 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
18:30:08.413 [DEBUG - main] (Connection.java:575) [peer master-127.28.250.125:38957(127.28.250.125:38957)] disconnecting while in state READY
18:30:08.413 [DEBUG - main] (Connection.java:575) [peer master-127.28.250.126:43415(127.28.250.126:43415)] disconnecting while in state READY
18:30:08.413 [DEBUG - main] (Connection.java:575) [peer master-127.28.250.124:38123(127.28.250.124:38123)] disconnecting while in state READY
18:30:08.414 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.28.250.125:38957(127.28.250.125:38957)] handling channelInactive
18:30:08.414 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state READY due to: connection closed
18:30:08.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.411588 30355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c27463a88c4279a43c0b747bb2e812" candidate_uuid: "e0daef4de5564bcda67a7642c8fda8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a47a8e581a3b425f85a5c443a726f9b9"
18:30:08.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.412195 30355 raft_consensus.cc:3060] T b2c27463a88c4279a43c0b747bb2e812 P a47a8e581a3b425f85a5c443a726f9b9 [term 0 FOLLOWER]: Advancing to term 1
18:30:08.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.415546 30211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c27463a88c4279a43c0b747bb2e812" candidate_uuid: "e0daef4de5564bcda67a7642c8fda8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0ac04628354392ab4087c1289fd5b0"
18:30:08.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.416462 30211 raft_consensus.cc:3060] T b2c27463a88c4279a43c0b747bb2e812 P 2c0ac04628354392ab4087c1289fd5b0 [term 0 FOLLOWER]: Advancing to term 1
18:30:08.419 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.28.250.126:43415(127.28.250.126:43415)] handling channelInactive
18:30:08.419 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state READY due to: connection closed
18:30:08.420 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:30:08.423 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
18:30:08.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.424602 30211 raft_consensus.cc:2468] T b2c27463a88c4279a43c0b747bb2e812 P 2c0ac04628354392ab4087c1289fd5b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0daef4de5564bcda67a7642c8fda8d1 in term 1.
18:30:08.425 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:30:08.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.426369 30004 leader_election.cc:304] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0ac04628354392ab4087c1289fd5b0, e0daef4de5564bcda67a7642c8fda8d1; no voters: 
18:30:08.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.427565 30525 raft_consensus.cc:2804] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [term 1 FOLLOWER]: Leader election won for term 1
18:30:08.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.428051 30525 raft_consensus.cc:697] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [term 1 LEADER]: Becoming Leader. State: Replica: e0daef4de5564bcda67a7642c8fda8d1, State: Running, Role: LEADER
18:30:08.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.428969 30525 consensus_queue.cc:237] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } } peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } }
18:30:08.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.433781 30519 ts_tablet_manager.cc:1434] T b2c27463a88c4279a43c0b747bb2e812 P 2c0ac04628354392ab4087c1289fd5b0: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
18:30:08.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.447860 30355 raft_consensus.cc:2468] T b2c27463a88c4279a43c0b747bb2e812 P a47a8e581a3b425f85a5c443a726f9b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0daef4de5564bcda67a7642c8fda8d1 in term 1.
18:30:08.455 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.28.250.124:38123(127.28.250.124:38123)] handling channelInactive
18:30:08.456 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state READY due to: connection closed
18:30:08.457 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
18:30:08.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.470570 29721 catalog_manager.cc:5696] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0daef4de5564bcda67a7642c8fda8d1 (127.28.250.65). New cstate: current_term: 1 leader_uuid: "e0daef4de5564bcda67a7642c8fda8d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0daef4de5564bcda67a7642c8fda8d1" member_type: VOTER last_known_addr { host: "127.28.250.65" port: 39837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 } health_report { overall_health: UNKNOWN } } }
18:30:08.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.509239 30525 consensus_queue.cc:1048] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:30:08.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.604880 30525 consensus_queue.cc:1048] T 48044963b1654d50aab0e0ac5f36d0e5 P e0daef4de5564bcda67a7642c8fda8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:30:08.878 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:30:08.880 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
18:30:08.881 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
18:30:08.881 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:30:08.881 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:30:08.885 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:30:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:08.994823 30543 consensus_queue.cc:1048] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a47a8e581a3b425f85a5c443a726f9b9" member_type: VOTER last_known_addr { host: "127.28.250.67" port: 46725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:30:09.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:09.019918 30526 consensus_queue.cc:1048] T b2c27463a88c4279a43c0b747bb2e812 P e0daef4de5564bcda67a7642c8fda8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c0ac04628354392ab4087c1289fd5b0" member_type: VOTER last_known_addr { host: "127.28.250.66" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:30:09.214 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
18:30:09.215 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
18:30:09.215 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
18:30:09.216 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
18:30:09.216 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
18:30:09.216 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
18:30:09.218 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
18:30:09.557 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
18:30:09.686 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
18:30:09.686 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
18:30:09.686 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
18:30:09.720 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
18:30:10.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:10.538535 30253 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad240 after lost signal to thread 30125
18:30:10.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:10.539759 30253 debug-util.cc:398] Leaking SignalData structure 0x7b08000cc860 after lost signal to thread 30256
18:30:10.629 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
18:30:10.944 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
18:30:10.998 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
18:30:11.054 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
18:30:11.079 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
18:30:11.140 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
18:30:11.338 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
18:30:11.357 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
18:30:11.357 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
18:30:11.364 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
18:30:11.367 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
18:30:11.368 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
18:30:11.368 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
18:30:11.369 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
18:30:11.371 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
18:30:11.372 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
18:30:11.373 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
18:30:11.374 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
18:30:11.374 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
18:30:11.375 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
18:30:11.375 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
18:30:11.375 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
18:30:11.382 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
18:30:11.383 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
18:30:11.383 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
18:30:11.396 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
18:30:11.397 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
18:30:11.399 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
18:30:11.399 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
18:30:11.399 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
18:30:11.417 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_3937ffd580f7089b03988f626fe57cc3/blobStorage
18:30:11.423 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:33513 - max concurrent requests: 50 - max backlog: 1000
18:30:11.432 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_3937ffd580f7089b03988f626fe57cc3/blobStorage
18:30:11.435 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_3937ffd580f7089b03988f626fe57cc3/blobStorage
18:30:11.437 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
18:30:11.441 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: f1f388f3-5c60-48a0-b809-2d78ad8f082e
18:30:11.477 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 32 GB (66.67% usable)
18:30:11.482 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-73220d93-0007-4744-8559-4cb70a8f6b0e
18:30:11.502 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-cb93e1d4-68e0-449c-8378-872cb743bc14
18:30:11.652 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
18:30:11.674 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
18:30:11.675 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
18:30:11.677 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
18:30:11.725 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
18:30:11.744 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_0 .
18:30:11.821 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
18:30:11.824 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-1b689f62-6bbf-4187-95c9-956da254e8c8
18:30:11.942 [INFO - main] (RestServerEndpoint.java:567) Upload directory /tmp/flink-web-upload does not exist. 
18:30:11.942 [INFO - main] (RestServerEndpoint.java:592) Created directory /tmp/flink-web-upload for file uploads.
18:30:11.948 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
18:30:11.955 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
18:30:12.348 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
18:30:12.348 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
18:30:12.639 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:37211
18:30:12.639 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
18:30:12.663 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:37211 was granted leadership with leaderSessionID=50aad94f-c8b4-4a12-866d-0764a7544d27
18:30:12.664 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:37211 , session=50aad94f-c8b4-4a12-866d-0764a7544d27
18:30:12.676 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
18:30:12.677 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
18:30:12.677 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
18:30:12.677 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 17950f52-267a-43b0-a6e9-3f63ddb6549c. Creating new DispatcherLeaderProcess.
18:30:12.683 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
18:30:12.684 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
18:30:12.689 [INFO - mini-cluster-io-thread-2] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
18:30:12.689 [INFO - mini-cluster-io-thread-2] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
18:30:12.696 [INFO - pool-11-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 7b72e1ab-9f41-4783-b576-134a2f079eb9.
18:30:12.716 [INFO - mini-cluster-io-thread-2] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_1 .
18:30:12.719 [INFO - pool-11-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_2 .
18:30:12.734 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:253) Starting the resource manager.
18:30:12.745 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:212) Starting the slot manager.
18:30:12.747 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:308) Starting tokens update task
18:30:12.747 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
18:30:12.747 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
18:30:12.748 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_2 , session=7b72e1ab-9f41-4783-b576-134a2f079eb9
18:30:12.750 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_2(b576134a2f079eb97b72e1ab9f414783).
18:30:12.758 [INFO - mini-cluster-io-thread-2] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_1 , session=17950f52-267a-43b0-a6e9-3f63ddb6549c
18:30:12.798 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
18:30:12.813 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:1080) Registering TaskManager with ResourceID f1f388f3-5c60-48a0-b809-2d78ad8f082e (pekko://flink/user/rpc/taskmanager_0) at ResourceManager
18:30:12.822 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_2 under registration id e094c836e2d59cb4208bf0ef431f7a41.
18:30:12.823 [INFO - flink-pekko.actor.default-dispatcher-8] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (fa73e37017778341a79e5b3ef3d55eb9).
18:30:12.825 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:344) Registering task executor f1f388f3-5c60-48a0-b809-2d78ad8f082e under e094c836e2d59cb4208bf0ef431f7a41 at the slot manager.
18:30:12.825 [INFO - flink-pekko.actor.default-dispatcher-8] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (fa73e37017778341a79e5b3ef3d55eb9).
18:30:12.840 [INFO - flink-pekko.actor.default-dispatcher-8] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-fa73e37017778341a79e5b3ef3d55eb9'.
18:30:12.843 [INFO - mini-cluster-io-thread-3] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job fa73e37017778341a79e5b3ef3d55eb9 was granted leadership with leader id 222b6a43-0281-4fa6-9a5b-fa655c596f66. Creating new JobMasterServiceProcess.
18:30:12.873 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_3 .
18:30:12.889 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (fa73e37017778341a79e5b3ef3d55eb9).
18:30:12.936 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9).
18:30:12.991 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 1db490f2f195494a299cf69ae106c36d for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:13.025 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9).
18:30:13.025 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
18:30:13.081 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 3 ms, total 4 pipelined regions currently.
18:30:13.092 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1d66776f
18:30:13.092 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:30:13.094 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:30:13.161 [INFO - jobmanager-io-thread-1] (FileSystem.java:1139) Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
18:30:13.202 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
18:30:13.214 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@300cacdd for Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9).
18:30:13.232 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_3 , session=222b6a43-0281-4fa6-9a5b-fa655c596f66
18:30:13.235 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (fa73e37017778341a79e5b3ef3d55eb9) under job master id 9a5bfa655c596f66222b6a4302814fa6.
18:30:13.244 [INFO - flink-pekko.actor.default-dispatcher-7] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:30:13.255 [DEBUG - flink-pekko.actor.default-dispatcher-7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:13.259 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
18:30:13.259 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state CREATED to RUNNING.
18:30:13.265 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:13.279 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
18:30:13.287 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:13.316 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.28.68.190:40429(127.28.68.190:40429)] Successfully connected to peer
18:30:13.325 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:13.332 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.28.68.189:33753(127.28.68.189:33753)] Successfully connected to peer
18:30:13.336 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.28.68.188:38393(127.28.68.188:38393)] Successfully connected to peer
18:30:13.354 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.68.189
18:30:13.357 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.68.188
18:30:13.363 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.68.190
18:30:13.379 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:13.386 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x240a9501, L:/127.0.0.1:49662 - R:/127.28.68.189:33753] using SASL/PLAIN
18:30:13.405 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
18:30:13.409 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:13.412 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:13.416 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
18:30:13.417 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
18:30:13.418 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_2(b576134a2f079eb97b72e1ab9f414783)
18:30:13.425 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xa7d2de39, L:/127.0.0.1:48106 - R:/127.28.68.188:38393] using SASL/PLAIN
18:30:13.428 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x28750c2b, L:/127.0.0.1:52414 - R:/127.28.68.190:40429] using SASL/PLAIN
18:30:13.429 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
18:30:13.431 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:390) Registering job manager 9a5bfa655c596f66222b6a4302814fa6@pekko://flink/user/rpc/jobmanager_3 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:13.433 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:30:13.434 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=170), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [129ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: OK, [164ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: OK, [168ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: OK, deferred=null) after lookup
18:30:13.439 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 12c1a20abe1e4b48b36cbc025d18d078
18:30:13.444 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4710c9625c5745b09120e62bbb97a6b8 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
18:30:13.444 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 5582c55b8b0d4936acfd446a0499d077 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:30:13.445 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=4710c9625c5745b09120e62bbb97a6b8@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897),5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)[L],f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=5582c55b8b0d4936acfd446a0499d077@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897),5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)[L],f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:30:13.453 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:13.462 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:1015) Registered job manager 9a5bfa655c596f66222b6a4302814fa6@pekko://flink/user/rpc/jobmanager_3 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:13.468 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: b576134a2f079eb97b72e1ab9f414783.
18:30:13.470 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:30:13.541 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job fa73e37017778341a79e5b3ef3d55eb9
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager f1f388f3-5c60-48a0-b809-2d78ad8f082e
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
18:30:13.549 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 120c9de24dd4d7d83c84cb1a65b36252 from f1f388f3-5c60-48a0-b809-2d78ad8f082e for job fa73e37017778341a79e5b3ef3d55eb9 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:30:13.552 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 120c9de24dd4d7d83c84cb1a65b36252 for job fa73e37017778341a79e5b3ef3d55eb9 from resource manager with leader id b576134a2f079eb97b72e1ab9f414783.
18:30:13.553 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 120c9de24dd4d7d83c84cb1a65b36252 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:30:13.553 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 409256c48f07c3602c01f545df4e7b3c from f1f388f3-5c60-48a0-b809-2d78ad8f082e for job fa73e37017778341a79e5b3ef3d55eb9 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:30:13.557 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:192) Add job fa73e37017778341a79e5b3ef3d55eb9 for job leader monitoring.
18:30:13.559 [INFO - mini-cluster-io-thread-3] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_3 with leader id 222b6a43-0281-4fa6-9a5b-fa655c596f66.
18:30:13.559 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 1623ba59e704d1676486c6f13d60068c from f1f388f3-5c60-48a0-b809-2d78ad8f082e for job fa73e37017778341a79e5b3ef3d55eb9 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:30:13.560 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot fe2a3c24d55fce5c8d5a55c4e880b53d from f1f388f3-5c60-48a0-b809-2d78ad8f082e for job fa73e37017778341a79e5b3ef3d55eb9 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:30:13.561 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
18:30:13.562 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 409256c48f07c3602c01f545df4e7b3c for job fa73e37017778341a79e5b3ef3d55eb9 from resource manager with leader id b576134a2f079eb97b72e1ab9f414783.
18:30:13.563 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 409256c48f07c3602c01f545df4e7b3c with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:30:13.563 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 1623ba59e704d1676486c6f13d60068c for job fa73e37017778341a79e5b3ef3d55eb9 from resource manager with leader id b576134a2f079eb97b72e1ab9f414783.
18:30:13.563 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 1623ba59e704d1676486c6f13d60068c with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:30:13.564 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request fe2a3c24d55fce5c8d5a55c4e880b53d for job fa73e37017778341a79e5b3ef3d55eb9 from resource manager with leader id b576134a2f079eb97b72e1ab9f414783.
18:30:13.564 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for fe2a3c24d55fce5c8d5a55c4e880b53d with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:30:13.568 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_3 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:13.569 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1783) Establish JobManager connection for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:13.572 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1633) Offer reserved slots to the leader of job fa73e37017778341a79e5b3ef3d55eb9.
18:30:13.585 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
18:30:13.585 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 1623ba59e704d1676486c6f13d60068c
18:30:13.590 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
18:30:13.590 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 120c9de24dd4d7d83c84cb1a65b36252
18:30:13.592 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 1623ba59e704d1676486c6f13d60068c.
18:30:13.608 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
18:30:13.608 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d
18:30:13.612 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
18:30:13.612 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 409256c48f07c3602c01f545df4e7b3c
18:30:13.616 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:13.622 [INFO - flink-pekko.actor.default-dispatcher-5] (StateChangelogStorageLoader.java:84) StateChangelogStorageLoader initialized with shortcut names {memory,filesystem}.
18:30:13.622 [INFO - flink-pekko.actor.default-dispatcher-5] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
18:30:13.640 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id fa73e37017778341a79e5b3ef3d55eb9
18:30:13.643 [DEBUG - main] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:13.646 [DEBUG - main] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:13.648 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.28.250.125:38957(127.28.250.125:38957)] Successfully connected to peer
18:30:13.653 [DEBUG - main] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:13.656 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.28.250.124:38123(127.28.250.124:38123)] Successfully connected to peer
18:30:13.661 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 1623ba59e704d1676486c6f13d60068c.
18:30:13.666 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.125
18:30:13.667 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.124
18:30:13.667 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
18:30:13.673 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.28.250.126:43415(127.28.250.126:43415)] Successfully connected to peer
18:30:13.689 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 120c9de24dd4d7d83c84cb1a65b36252.
18:30:13.691 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:13.694 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:13.694 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.126
18:30:13.700 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x8fc181c1, L:/127.0.0.1:45574 - R:/127.28.250.124:38123] using SASL/PLAIN
18:30:13.701 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x22f81706, L:/127.0.0.1:33032 - R:/127.28.250.125:38957] using SASL/PLAIN
18:30:13.706 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 120c9de24dd4d7d83c84cb1a65b36252.
18:30:13.714 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:13.715 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
18:30:13.721 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot fe2a3c24d55fce5c8d5a55c4e880b53d.
18:30:13.722 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x0b87e962, L:/127.0.0.1:49984 - R:/127.28.250.126:43415] using SASL/PLAIN
18:30:13.723 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
18:30:13.723 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
18:30:13.727 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:30:13.736 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=90), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [66ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: OK, deferred=null) after lookup
18:30:13.738 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d.
18:30:13.742 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 5b7ad4573492423d9b61b2a95fb51f3c
18:30:13.749 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 1623ba59e704d1676486c6f13d60068c.
18:30:13.749 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 120c9de24dd4d7d83c84cb1a65b36252.
18:30:13.749 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot fe2a3c24d55fce5c8d5a55c4e880b53d.
18:30:13.749 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 409256c48f07c3602c01f545df4e7b3c.
18:30:13.749 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 409256c48f07c3602c01f545df4e7b3c.
18:30:13.753 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id 409256c48f07c3602c01f545df4e7b3c.
18:30:13.754 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7256c9d5
18:30:13.755 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:30:13.755 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
18:30:13.755 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:30:13.755 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
18:30:13.757 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
18:30:13.758 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
18:30:13.759 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@27e1fc69
18:30:13.759 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:30:13.759 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:30:13.760 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@483d4859
18:30:13.760 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:30:13.761 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6474b362
18:30:13.761 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:30:13.761 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:30:13.761 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:30:13.769 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
18:30:13.771 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
18:30:13.774 [DEBUG - main] (AsyncKuduClient.java:2538) Learned about tablet 48044963b1654d50aab0e0ac5f36d0e5 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
18:30:13.774 [DEBUG - main] (AsyncKuduClient.java:2538) Learned about tablet b2c27463a88c4279a43c0b747bb2e812 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:30:13.774 [DEBUG - main] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=48044963b1654d50aab0e0ac5f36d0e5@[2c0ac04628354392ab4087c1289fd5b0(127.28.250.66:43259),a47a8e581a3b425f85a5c443a726f9b9(127.28.250.67:46725),e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=b2c27463a88c4279a43c0b747bb2e812@[2c0ac04628354392ab4087c1289fd5b0(127.28.250.66:43259),a47a8e581a3b425f85a5c443a726f9b9(127.28.250.67:46725),e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:30:13.775 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
18:30:13.775 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
18:30:13.778 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
18:30:13.778 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
18:30:13.779 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
18:30:13.780 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
18:30:13.811 [DEBUG - main] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=8), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.250.126:43415, [7ms] Sub RPC GetTableLocations: received response from server master-127.28.250.126:43415: OK, deferred=null)) after lookup
18:30:13.826 [DEBUG - main] (Connection.java:748) [peer e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)] connecting to peer
18:30:13.838 [DEBUG - kudu-nio-3] (Connection.java:757) [peer e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)] Successfully connected to peer
18:30:13.864 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:13.872 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x99c23ef7, L:/127.0.0.1:38646 - R:/127.28.250.65:39837] using TOKEN/null
18:30:13.906 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@74b6af4a
18:30:13.906 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1822e9d9
18:30:13.906 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@49d8c942
18:30:13.910 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:13.918 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@111ed36d
18:30:13.946 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:13.947 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:13.957 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:13.957 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:13.974 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:13.977 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:13.983 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:13.986 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:13.989 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:13.995 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:13.998 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.28.250.125:38957(127.28.250.125:38957)] Successfully connected to peer
18:30:14.001 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.125
18:30:14.003 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:14.006 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.28.250.125:38957(127.28.250.125:38957)] Successfully connected to peer
18:30:14.008 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:14.013 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:14.018 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.125
18:30:14.018 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.018 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:14.027 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.027 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:14.028 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:14.031 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.28.250.124:38123(127.28.250.124:38123)] Successfully connected to peer
18:30:14.033 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.28.250.126:43415(127.28.250.126:43415)] Successfully connected to peer
18:30:14.037 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.124
18:30:14.039 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:14.043 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:14.046 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1a7bc0d7, L:/127.0.0.1:33048 - R:/127.28.250.125:38957] using SASL/PLAIN
18:30:14.048 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.126
18:30:14.049 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:14.052 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.28.250.125:38957(127.28.250.125:38957)] Successfully connected to peer
18:30:14.054 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:14.056 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.28.250.124:38123(127.28.250.124:38123)] Successfully connected to peer
18:30:14.060 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.125
18:30:14.064 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:14.065 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe0430a83, L:/127.0.0.1:33036 - R:/127.28.250.125:38957] using SASL/PLAIN
18:30:14.074 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.124
18:30:14.085 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:14.089 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:14.093 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.094 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:14.094 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.28.250.124:38123(127.28.250.124:38123)] Successfully connected to peer
18:30:14.101 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:14.103 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.112 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x636045f3, L:/127.0.0.1:45590 - R:/127.28.250.124:38123] using SASL/PLAIN
18:30:14.112 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x18d431ff, L:/127.0.0.1:49994 - R:/127.28.250.126:43415] using SASL/PLAIN
18:30:14.117 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.124
18:30:14.139 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.28.250.126:43415(127.28.250.126:43415)] Successfully connected to peer
18:30:14.141 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:14.146 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:30:14.146 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=171), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [100ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: OK, [147ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: OK, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: OK, deferred=null) after lookup
18:30:14.146 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd9de7de4, L:/127.0.0.1:33058 - R:/127.28.250.125:38957] using SASL/PLAIN
18:30:14.148 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:14.150 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.126
18:30:14.152 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 5b7ad4573492423d9b61b2a95fb51f3c
18:30:14.153 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:14.161 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:14.163 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 5b7ad4573492423d9b61b2a95fb51f3c
18:30:14.163 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x29c86d4e, L:/127.0.0.1:45600 - R:/127.28.250.124:38123] using SASL/PLAIN
18:30:14.163 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@994f00
18:30:14.167 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:14.169 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:14.171 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.28.250.124:38123(127.28.250.124:38123)] Successfully connected to peer
18:30:14.174 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.28.250.125:38957(127.28.250.125:38957)] Successfully connected to peer
18:30:14.176 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.124
18:30:14.178 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x1adfe734, L:/127.0.0.1:45610 - R:/127.28.250.124:38123] using SASL/PLAIN
18:30:14.179 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.125
18:30:14.183 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:14.189 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
18:30:14.193 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
18:30:14.199 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.28.250.126:43415(127.28.250.126:43415)] Successfully connected to peer
18:30:14.201 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.28.250.126:43415(127.28.250.126:43415)] Successfully connected to peer
18:30:14.204 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.126
18:30:14.207 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xda32ce00, L:/127.0.0.1:50010 - R:/127.28.250.126:43415] using SASL/PLAIN
18:30:14.214 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.250.126
18:30:14.220 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:30:14.221 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=238), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: OK, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: OK, [228ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: OK, deferred=null) after lookup
18:30:14.224 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.225 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:14.238 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.238 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 5b7ad4573492423d9b61b2a95fb51f3c
18:30:14.238 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:14.246 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:14.246 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
18:30:14.246 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:14.248 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='868b7abba1c68fdd8354a0a17a55e6d8ec3b303b4050b457d704fb2da8283035'}]
18:30:14.252 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x8ae76083, L:/127.0.0.1:50024 - R:/127.28.250.126:43415] using SASL/PLAIN
18:30:14.260 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:14.262 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:14.264 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:30:14.265 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=250), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [200ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: OK, deferred=null) after lookup
18:30:14.265 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 5b7ad4573492423d9b61b2a95fb51f3c
18:30:14.265 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3d3cf6e4
18:30:14.268 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 5b7ad4573492423d9b61b2a95fb51f3c
18:30:14.270 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
18:30:14.271 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
18:30:14.271 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
18:30:14.274 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 5b7ad4573492423d9b61b2a95fb51f3c
18:30:14.275 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x8a212c3e, L:/127.0.0.1:50034 - R:/127.28.250.126:43415] using SASL/PLAIN
18:30:14.278 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd9cf8fe1, L:/127.0.0.1:33060 - R:/127.28.250.125:38957] using SASL/PLAIN
18:30:14.279 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@60a5e849
18:30:14.279 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:30:14.280 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=286), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [149ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: OK, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: OK, [272ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: OK, deferred=null) after lookup
18:30:14.282 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
18:30:14.282 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
18:30:14.284 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 5b7ad4573492423d9b61b2a95fb51f3c
18:30:14.284 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:14.295 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 5b7ad4573492423d9b61b2a95fb51f3c
18:30:14.295 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xab37f98c, L:/127.0.0.1:45616 - R:/127.28.250.124:38123] using SASL/PLAIN
18:30:14.297 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@45c44022
18:30:14.299 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
18:30:14.299 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
18:30:14.300 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
18:30:14.301 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='b2820b264129e31ef6fa61f69c3ddcd4cd89548e023be5bd6e54bbc92c859ae1'}]
18:30:14.301 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.302 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:14.304 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:14.311 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.311 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:14.337 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:30:14.346 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
18:30:14.349 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:30:14.351 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299997, tablet=5582c55b8b0d4936acfd446a0499d077@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)[L],5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413),f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}]
18:30:14.356 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299998, tablet=4710c9625c5745b09120e62bbb97a6b8@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)[L],5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413),f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}]
18:30:14.361 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
18:30:14.365 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
18:30:14.367 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] connecting to peer
18:30:14.369 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.369 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] connecting to peer
18:30:14.369 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:14.371 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
18:30:14.372 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
18:30:14.383 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.385 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] Successfully connected to peer
18:30:14.385 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:14.396 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] Successfully connected to peer
18:30:14.404 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.68.130
18:30:14.415 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.68.130
18:30:14.428 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:14.433 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535414410 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:14.437 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:14.439 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3b73a559, L:/127.0.0.1:37220 - R:/127.28.68.130:42897] using SASL/PLAIN
18:30:14.444 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.444 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:14.448 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8d0a53fe, L:/127.0.0.1:37228 - R:/127.28.68.130:42897] using SASL/PLAIN
18:30:14.456 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.457 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:14.475 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false, responseScanTimestamp = 7305361052725248001) for scanner KuduScanner(table=replication_test_table, tablet=5582c55b8b0d4936acfd446a0499d077, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.480 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [b2820b264129e31ef6fa61f69c3ddcd4cd89548e023be5bd6e54bbc92c859ae1]
18:30:14.486 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
18:30:14.503 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false, responseScanTimestamp = 7305361052725248001) for scanner KuduScanner(table=replication_test_table, tablet=4710c9625c5745b09120e62bbb97a6b8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.514 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.517 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [868b7abba1c68fdd8354a0a17a55e6d8ec3b303b4050b457d704fb2da8283035]
18:30:14.517 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:14.525 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.525 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:14.532 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
18:30:14.583 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.584 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:14.597 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.598 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:14.655 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.656 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:14.664 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.665 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:14.683 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 48044963b1654d50aab0e0ac5f36d0e5 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
18:30:14.683 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b2c27463a88c4279a43c0b747bb2e812 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:30:14.683 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=48044963b1654d50aab0e0ac5f36d0e5@[2c0ac04628354392ab4087c1289fd5b0(127.28.250.66:43259),a47a8e581a3b425f85a5c443a726f9b9(127.28.250.67:46725),e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=b2c27463a88c4279a43c0b747bb2e812@[2c0ac04628354392ab4087c1289fd5b0(127.28.250.66:43259),a47a8e581a3b425f85a5c443a726f9b9(127.28.250.67:46725),e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:30:14.684 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [868b7abba1c68fdd8354a0a17a55e6d8ec3b303b4050b457d704fb2da8283035]
18:30:14.690 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 48044963b1654d50aab0e0ac5f36d0e5 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
18:30:14.690 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b2c27463a88c4279a43c0b747bb2e812 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:30:14.691 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=48044963b1654d50aab0e0ac5f36d0e5@[2c0ac04628354392ab4087c1289fd5b0(127.28.250.66:43259),a47a8e581a3b425f85a5c443a726f9b9(127.28.250.67:46725),e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=b2c27463a88c4279a43c0b747bb2e812@[2c0ac04628354392ab4087c1289fd5b0(127.28.250.66:43259),a47a8e581a3b425f85a5c443a726f9b9(127.28.250.67:46725),e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:30:14.692 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 48044963b1654d50aab0e0ac5f36d0e5 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
18:30:14.692 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b2c27463a88c4279a43c0b747bb2e812 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:30:14.692 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=48044963b1654d50aab0e0ac5f36d0e5@[2c0ac04628354392ab4087c1289fd5b0(127.28.250.66:43259),a47a8e581a3b425f85a5c443a726f9b9(127.28.250.67:46725),e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=b2c27463a88c4279a43c0b747bb2e812@[2c0ac04628354392ab4087c1289fd5b0(127.28.250.66:43259),a47a8e581a3b425f85a5c443a726f9b9(127.28.250.67:46725),e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:30:14.697 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=65, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7fe56ca2, flushNotification=Deferred@885478042(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:30:14.701 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b2c27463a88c4279a43c0b747bb2e812 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:30:14.701 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=b2c27463a88c4279a43c0b747bb2e812@[2c0ac04628354392ab4087c1289fd5b0(127.28.250.66:43259),a47a8e581a3b425f85a5c443a726f9b9(127.28.250.67:46725),e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:30:14.706 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 868b7abba1c68fdd8354a0a17a55e6d8ec3b303b4050b457d704fb2da8283035 finished by subtask 2; deferring removal (restored in pending)
18:30:14.707 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:30:14.707 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:30:14.707 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] disconnecting while in state READY
18:30:14.711 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:30:14.727 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)] connecting to peer
18:30:14.727 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.727 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:14.735 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.737 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:14.760 [DEBUG - kudu-nio-3] (Connection.java:757) [peer e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)] Successfully connected to peer
18:30:14.766 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:30:14.766 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] handling channelInactive
18:30:14.767 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] cleaning up while in state READY due to: connection closed
18:30:14.767 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:30:14.796 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:14.796 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.797 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:14.806 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xd6c5febe, L:/127.0.0.1:38658 - R:/127.28.250.65:39837] using TOKEN/null
18:30:14.807 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.807 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:14.876 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.877 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:14.893 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.893 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:14.952 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.952 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:14.963 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:14.963 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:15.002 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [b2820b264129e31ef6fa61f69c3ddcd4cd89548e023be5bd6e54bbc92c859ae1]
18:30:15.005 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split b2820b264129e31ef6fa61f69c3ddcd4cd89548e023be5bd6e54bbc92c859ae1 finished by subtask 3; deferring removal (restored in pending)
18:30:15.005 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:30:15.005 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:30:15.006 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] disconnecting while in state READY
18:30:15.007 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:30:15.021 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.022 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:15.040 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.041 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:15.067 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] handling channelInactive
18:30:15.067 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] cleaning up while in state READY due to: connection closed
18:30:15.067 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:30:15.067 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:30:15.081 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job fa73e37017778341a79e5b3ef3d55eb9 (2244 bytes, checkpointDuration=665 ms, finalizationTime=5 ms).
18:30:15.085 [INFO - Checkpoint Timer] (CheckpointRequestDecider.java:220) checkpoint request time in queue: 176
18:30:15.088 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
18:30:15.089 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535415085 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:15.089 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split b2820b264129e31ef6fa61f69c3ddcd4cd89548e023be5bd6e54bbc92c859ae1 from pending
18:30:15.089 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 868b7abba1c68fdd8354a0a17a55e6d8ec3b303b4050b457d704fb2da8283035 from pending
18:30:15.089 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 2 finished splits from enumerator state
18:30:15.093 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=5, operationSize=315, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1d602ca, flushNotification=Deferred@2017294414(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:30:15.094 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)] connecting to peer
18:30:15.099 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.100 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:15.100 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=4, operationSize=260, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@49527e45, flushNotification=Deferred@1690843799(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:30:15.119 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.120 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:15.122 [DEBUG - kudu-nio-3] (Connection.java:757) [peer e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)] Successfully connected to peer
18:30:15.179 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.179 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:15.191 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.191 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:15.206 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:15.225 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x86db03a0, L:/127.0.0.1:38672 - R:/127.28.250.65:39837] using TOKEN/null
18:30:15.251 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.252 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:15.270 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 12c1a20abe1e4b48b36cbc025d18d078
18:30:15.275 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.275 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4710c9625c5745b09120e62bbb97a6b8 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
18:30:15.275 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:15.275 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 5582c55b8b0d4936acfd446a0499d077 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:30:15.276 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=4710c9625c5745b09120e62bbb97a6b8@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897),5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)[L],f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=5582c55b8b0d4936acfd446a0499d077@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897),5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)[L],f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:30:15.279 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='b8f56f799d9d34f443845a8b8ee12416fbc29d2c947e85b2f0fd2da9f97b3696'}]
18:30:15.282 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:15.282 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='2ba8ec208178801b244220bf3639e684b7b606604da6038b88d6a0b5419d5ac6'}]
18:30:15.284 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:15.286 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:30:15.288 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:30:15.289 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299996, tablet=4710c9625c5745b09120e62bbb97a6b8@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)[L],5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413),f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}]
18:30:15.294 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299993, tablet=5582c55b8b0d4936acfd446a0499d077@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)[L],5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413),f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}]
18:30:15.319 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] connecting to peer
18:30:15.320 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] connecting to peer
18:30:15.342 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.342 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:15.352 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=255 ms, finalizationTime=12 ms).
18:30:15.359 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
18:30:15.360 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] Successfully connected to peer
18:30:15.374 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.374 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:15.386 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 12c1a20abe1e4b48b36cbc025d18d078
18:30:15.391 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 5b7ad4573492423d9b61b2a95fb51f3c
18:30:15.399 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 12c1a20abe1e4b48b36cbc025d18d078
18:30:15.403 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 5b7ad4573492423d9b61b2a95fb51f3c
18:30:15.406 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] Successfully connected to peer
18:30:15.409 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4710c9625c5745b09120e62bbb97a6b8 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
18:30:15.409 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 5582c55b8b0d4936acfd446a0499d077 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:30:15.409 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=4710c9625c5745b09120e62bbb97a6b8@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897),5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)[L],f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=5582c55b8b0d4936acfd446a0499d077@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897),5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)[L],f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:30:15.411 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535415409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:15.410 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.68.130
18:30:15.413 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.68.130
18:30:15.434 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job fa73e37017778341a79e5b3ef3d55eb9 (2264 bytes, checkpointDuration=24 ms, finalizationTime=1 ms).
18:30:15.437 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:15.440 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 48044963b1654d50aab0e0ac5f36d0e5 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
18:30:15.441 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x752a8761, L:/127.0.0.1:37246 - R:/127.28.68.130:42897] using SASL/PLAIN
18:30:15.449 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
18:30:15.450 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b2c27463a88c4279a43c0b747bb2e812 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:30:15.450 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=48044963b1654d50aab0e0ac5f36d0e5@[2c0ac04628354392ab4087c1289fd5b0(127.28.250.66:43259),a47a8e581a3b425f85a5c443a726f9b9(127.28.250.67:46725),e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=b2c27463a88c4279a43c0b747bb2e812@[2c0ac04628354392ab4087c1289fd5b0(127.28.250.66:43259),a47a8e581a3b425f85a5c443a726f9b9(127.28.250.67:46725),e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:30:15.461 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 12c1a20abe1e4b48b36cbc025d18d078
18:30:15.466 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 5b7ad4573492423d9b61b2a95fb51f3c
18:30:15.470 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:15.471 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4710c9625c5745b09120e62bbb97a6b8 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
18:30:15.472 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 5582c55b8b0d4936acfd446a0499d077 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:30:15.472 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=4710c9625c5745b09120e62bbb97a6b8@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897),5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)[L],f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=5582c55b8b0d4936acfd446a0499d077@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897),5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)[L],f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:30:15.472 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.68.190:40429, [4ms] Sub RPC GetTableLocations: received response from server master-127.28.68.190:40429: OK, deferred=null)) after lookup
18:30:15.487 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0ca9dd5e, L:/127.0.0.1:37238 - R:/127.28.68.130:42897] using SASL/PLAIN
18:30:15.508 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4710c9625c5745b09120e62bbb97a6b8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.508 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4710c9625c5745b09120e62bbb97a6b8 for partition [0x80000000, 0x80000032) with scanner id null
18:30:15.519 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5582c55b8b0d4936acfd446a0499d077, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.520 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5582c55b8b0d4936acfd446a0499d077 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:15.529 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 48044963b1654d50aab0e0ac5f36d0e5 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
18:30:15.530 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b2c27463a88c4279a43c0b747bb2e812 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:30:15.530 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=48044963b1654d50aab0e0ac5f36d0e5@[2c0ac04628354392ab4087c1289fd5b0(127.28.250.66:43259),a47a8e581a3b425f85a5c443a726f9b9(127.28.250.67:46725),e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=b2c27463a88c4279a43c0b747bb2e812@[2c0ac04628354392ab4087c1289fd5b0(127.28.250.66:43259),a47a8e581a3b425f85a5c443a726f9b9(127.28.250.67:46725),e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:30:15.531 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=10), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.250.126:43415, [9ms] Sub RPC GetTableLocations: received response from server master-127.28.250.126:43415: OK, deferred=null)) after lookup
18:30:15.569 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.570 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:15.593 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.594 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:15.620 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4710c9625c5745b09120e62bbb97a6b8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.620 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4710c9625c5745b09120e62bbb97a6b8 for partition [0x80000000, 0x80000032) with scanner id null
18:30:15.637 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5582c55b8b0d4936acfd446a0499d077, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.637 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5582c55b8b0d4936acfd446a0499d077 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:15.651 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361060917248001) for scanner KuduScanner(table=replication_test_table, tablet=5582c55b8b0d4936acfd446a0499d077, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.654 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [2ba8ec208178801b244220bf3639e684b7b606604da6038b88d6a0b5419d5ac6]
18:30:15.654 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [2ba8ec208178801b244220bf3639e684b7b606604da6038b88d6a0b5419d5ac6]
18:30:15.655 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:30:15.655 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:30:15.656 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 2ba8ec208178801b244220bf3639e684b7b606604da6038b88d6a0b5419d5ac6 finished by subtask 0; deferring removal (restored in pending)
18:30:15.661 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] disconnecting while in state READY
18:30:15.663 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:30:15.700 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] handling channelInactive
18:30:15.700 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] cleaning up while in state READY due to: connection closed
18:30:15.701 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:30:15.701 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:30:15.714 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=48044963b1654d50aab0e0ac5f36d0e5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.714 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 48044963b1654d50aab0e0ac5f36d0e5 for partition [0x80000000, 0x80000032) with scanner id null
18:30:15.752 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b2c27463a88c4279a43c0b747bb2e812, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.753 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b2c27463a88c4279a43c0b747bb2e812 for partition [0x80000064, 0x800000C8) with scanner id null
18:30:15.758 [DEBUG - main] (Connection.java:575) [peer e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)] disconnecting while in state READY
18:30:15.758 [DEBUG - main] (Connection.java:575) [peer master-127.28.250.125:38957(127.28.250.125:38957)] disconnecting while in state READY
18:30:15.758 [DEBUG - main] (Connection.java:575) [peer master-127.28.250.126:43415(127.28.250.126:43415)] disconnecting while in state READY
18:30:15.758 [DEBUG - main] (Connection.java:575) [peer master-127.28.250.124:38123(127.28.250.124:38123)] disconnecting while in state READY
18:30:15.760 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.28.250.126:43415(127.28.250.126:43415)] handling channelInactive
18:30:15.760 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state READY due to: connection closed
18:30:15.760 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.28.250.125:38957(127.28.250.125:38957)] handling channelInactive
18:30:15.760 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state READY due to: connection closed
18:30:15.761 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.28.250.124:38123(127.28.250.124:38123)] handling channelInactive
18:30:15.761 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state READY due to: connection closed
18:30:15.763 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361060917248001) for scanner KuduScanner(table=replication_test_table, tablet=4710c9625c5745b09120e62bbb97a6b8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:15.763 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [b8f56f799d9d34f443845a8b8ee12416fbc29d2c947e85b2f0fd2da9f97b3696]
18:30:15.765 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [b8f56f799d9d34f443845a8b8ee12416fbc29d2c947e85b2f0fd2da9f97b3696]
18:30:15.765 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:30:15.766 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:30:15.767 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split b8f56f799d9d34f443845a8b8ee12416fbc29d2c947e85b2f0fd2da9f97b3696 finished by subtask 1; deferring removal (restored in pending)
18:30:15.769 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] disconnecting while in state READY
18:30:15.770 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:30:15.772 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:30:15.774 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
18:30:15.775 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
18:30:15.775 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:30:15.809 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] handling channelInactive
18:30:15.809 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] cleaning up while in state READY due to: connection closed
18:30:15.810 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:30:15.810 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:30:15.824 [DEBUG - kudu-nio-3] (Connection.java:239) [peer e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)] handling channelInactive
18:30:15.824 [DEBUG - kudu-nio-3] (Connection.java:709) [peer e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)] cleaning up while in state READY due to: connection closed
18:30:15.824 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 28 thread-local buffer(s) from thread: kudu-nio-3
18:30:15.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:15.827651 29673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 29980
18:30:15.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535415909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:15.916 [DEBUG - kudu-nio-3] (Connection.java:239) [peer e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)] handling channelInactive
18:30:15.917 [DEBUG - kudu-nio-3] (Connection.java:709) [peer e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)] cleaning up while in state READY due to: connection closed
18:30:15.918 [DEBUG - kudu-nio-3] (Connection.java:239) [peer e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)] handling channelInactive
18:30:15.918 [DEBUG - kudu-nio-3] (Connection.java:709) [peer e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)] cleaning up while in state READY due to: connection closed
18:30:15.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:15.935412 29673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 30119
18:30:15.939 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job fa73e37017778341a79e5b3ef3d55eb9 (2264 bytes, checkpointDuration=29 ms, finalizationTime=1 ms).
18:30:15.942 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
18:30:15.942 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split 2ba8ec208178801b244220bf3639e684b7b606604da6038b88d6a0b5419d5ac6 from pending
18:30:15.943 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split b8f56f799d9d34f443845a8b8ee12416fbc29d2c947e85b2f0fd2da9f97b3696 from pending
18:30:15.943 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 4 complete: removed 2 finished splits from enumerator state
18:30:16.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:16.034622 29673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 30264
18:30:16.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:16.086043 29673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 29687
18:30:16.136 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.28.250.126:43415(127.28.250.126:43415)] handling channelInactive
18:30:16.136 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.28.250.126:43415(127.28.250.126:43415)] handling channelInactive
18:30:16.136 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state READY due to: connection closed
18:30:16.137 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state READY due to: connection closed
18:30:16.137 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.28.250.126:43415(127.28.250.126:43415)] handling channelInactive
18:30:16.137 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state READY due to: connection closed
18:30:16.137 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.28.250.126:43415(127.28.250.126:43415)] handling channelInactive
18:30:16.137 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state READY due to: connection closed
18:30:16.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:16.143564 29673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 29759
18:30:16.199 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.28.250.125:38957(127.28.250.125:38957)] handling channelInactive
18:30:16.200 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state READY due to: connection closed
18:30:16.200 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.28.250.125:38957(127.28.250.125:38957)] handling channelInactive
18:30:16.200 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state READY due to: connection closed
18:30:16.204 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.28.250.125:38957(127.28.250.125:38957)] handling channelInactive
18:30:16.205 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state READY due to: connection closed
18:30:16.199 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.28.250.125:38957(127.28.250.125:38957)] handling channelInactive
18:30:16.205 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state READY due to: connection closed
18:30:16.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:16.220566 29673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 29838
18:30:16.341 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.28.250.124:38123(127.28.250.124:38123)] handling channelInactive
18:30:16.341 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.28.250.124:38123(127.28.250.124:38123)] handling channelInactive
18:30:16.341 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state READY due to: connection closed
18:30:16.341 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state READY due to: connection closed
18:30:16.343 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.28.250.124:38123(127.28.250.124:38123)] handling channelInactive
18:30:16.343 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state READY due to: connection closed
18:30:16.345 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.28.250.124:38123(127.28.250.124:38123)] handling channelInactive
18:30:16.345 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state READY due to: connection closed
18:30:16.411 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535416409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:16.454 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=44 ms, finalizationTime=1 ms).
18:30:16.456 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
18:30:16.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535416909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:16.937 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=27 ms, finalizationTime=1 ms).
18:30:16.940 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
18:30:17.271 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 12c1a20abe1e4b48b36cbc025d18d078
18:30:17.277 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4710c9625c5745b09120e62bbb97a6b8 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
18:30:17.278 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 5582c55b8b0d4936acfd446a0499d077 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:30:17.278 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=4710c9625c5745b09120e62bbb97a6b8@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897),5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)[L],f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=5582c55b8b0d4936acfd446a0499d077@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897),5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)[L],f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:30:17.283 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8c1c01145cee44489f14abef9cfacc84b2c4b156538a62eebc2fcbe3c9ad4303'}]
18:30:17.285 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:17.286 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='fb47851d7881334bd4d70c76ca80a47f69f32cf3c2aa1391e1dddd4ffbce176e'}]
18:30:17.288 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:17.289 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:30:17.289 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299996, tablet=4710c9625c5745b09120e62bbb97a6b8@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)[L],5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413),f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}]
18:30:17.290 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:30:17.291 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299996, tablet=5582c55b8b0d4936acfd446a0499d077@[104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)[L],5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413),f5e509cee0a748839c3450b407f2fc73(127.28.68.129:46603)]}]
18:30:17.296 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] connecting to peer
18:30:17.297 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] connecting to peer
18:30:17.303 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] Successfully connected to peer
18:30:17.306 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] Successfully connected to peer
18:30:17.317 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.68.130
18:30:17.321 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.28.68.130
18:30:17.346 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:17.347 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:17.357 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9ab499c9, L:/127.0.0.1:37254 - R:/127.28.68.130:42897] using SASL/PLAIN
18:30:17.371 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x438bd927, L:/127.0.0.1:37250 - R:/127.28.68.130:42897] using SASL/PLAIN
18:30:17.413 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535417410 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:17.449 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job fa73e37017778341a79e5b3ef3d55eb9 (2264 bytes, checkpointDuration=38 ms, finalizationTime=1 ms).
18:30:17.456 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
18:30:17.480 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361069109248001) for scanner KuduScanner(table=replication_test_table, tablet=4710c9625c5745b09120e62bbb97a6b8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:17.480 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [8c1c01145cee44489f14abef9cfacc84b2c4b156538a62eebc2fcbe3c9ad4303]
18:30:17.483 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8c1c01145cee44489f14abef9cfacc84b2c4b156538a62eebc2fcbe3c9ad4303]
18:30:17.484 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:30:17.484 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:30:17.484 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] disconnecting while in state READY
18:30:17.486 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:30:17.487 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8c1c01145cee44489f14abef9cfacc84b2c4b156538a62eebc2fcbe3c9ad4303 finished by subtask 2; deferring removal (restored in pending)
18:30:17.548 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] handling channelInactive
18:30:17.548 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:30:17.549 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] cleaning up while in state READY due to: connection closed
18:30:17.549 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:30:17.668 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361069109248001) for scanner KuduScanner(table=replication_test_table, tablet=5582c55b8b0d4936acfd446a0499d077, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:30:17.669 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [fb47851d7881334bd4d70c76ca80a47f69f32cf3c2aa1391e1dddd4ffbce176e]
18:30:17.669 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [fb47851d7881334bd4d70c76ca80a47f69f32cf3c2aa1391e1dddd4ffbce176e]
18:30:17.670 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:30:17.670 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:30:17.670 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] disconnecting while in state READY
18:30:17.671 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:30:17.672 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split fb47851d7881334bd4d70c76ca80a47f69f32cf3c2aa1391e1dddd4ffbce176e finished by subtask 3; deferring removal (restored in pending)
18:30:17.693 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] handling channelInactive
18:30:17.693 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 104f3d7826d9407c93f3ba4a65872a8b(127.28.68.130:42897)] cleaning up while in state READY due to: connection closed
18:30:17.694 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:30:17.694 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:30:17.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:30:17Z chronyd exiting
18:30:17.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535417909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:17.926 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job fa73e37017778341a79e5b3ef3d55eb9 (2264 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
18:30:17.929 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
18:30:17.930 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split fb47851d7881334bd4d70c76ca80a47f69f32cf3c2aa1391e1dddd4ffbce176e from pending
18:30:17.930 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 8c1c01145cee44489f14abef9cfacc84b2c4b156538a62eebc2fcbe3c9ad4303 from pending
18:30:17.930 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 2 finished splits from enumerator state
18:30:18.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535418409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:18.427 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
18:30:18.429 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
18:30:18.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535418909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:18.931 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
18:30:18.933 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
18:30:18.963 [DEBUG - main] (Connection.java:575) [peer master-127.28.68.190:40429(127.28.68.190:40429)] disconnecting while in state READY
18:30:18.963 [DEBUG - main] (Connection.java:575) [peer master-127.28.68.188:38393(127.28.68.188:38393)] disconnecting while in state READY
18:30:18.963 [DEBUG - main] (Connection.java:575) [peer master-127.28.68.189:33753(127.28.68.189:33753)] disconnecting while in state READY
18:30:18.963 [DEBUG - main] (Connection.java:575) [peer 5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)] disconnecting while in state READY
18:30:18.964 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)] handling channelInactive
18:30:18.966 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.28.68.188:38393(127.28.68.188:38393)] handling channelInactive
18:30:18.966 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state READY due to: connection closed
18:30:18.967 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:30:18.964 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.28.68.190:40429(127.28.68.190:40429)] handling channelInactive
18:30:18.968 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state READY due to: connection closed
18:30:18.968 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-0
18:30:18.969 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
18:30:18.967 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 5fd2094d56804459b8ca000192a7372f(127.28.68.131:36413)] cleaning up while in state READY due to: connection closed
18:30:18.970 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-3
18:30:18.972 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.28.68.189:33753(127.28.68.189:33753)] handling channelInactive
18:30:18.972 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state READY due to: connection closed
18:30:18.972 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
18:30:18.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:18.972872 28946 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 29227
18:30:19.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:19.023821 28946 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 29380
18:30:19.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:19.057895 28946 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 29532
18:30:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:19.094242 28946 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 28958
18:30:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:19.127131 28946 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 29028
18:30:19.129 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.28.68.190:40429(127.28.68.190:40429)] handling channelInactive
18:30:19.129 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state READY due to: connection closed
18:30:19.160 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.28.68.189:33753(127.28.68.189:33753)] handling channelInactive
18:30:19.161 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state READY due to: connection closed
18:30:19.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:19.160742 28946 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 29105
18:30:19.194 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.28.68.188:38393(127.28.68.188:38393)] handling channelInactive
18:30:19.194 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state READY due to: connection closed
18:30:19.263 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:19.266 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.266 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.266 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.28.68.190:40429(127.28.68.190:40429) for tablet Kudu Master: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.286 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:19.287 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:19.288 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.288 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.288 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:19.288 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.289 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.289 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.289 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.290 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.291 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.291 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.295 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:19.305 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:19.307 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:19.308 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.308 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:19.308 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.308 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.309 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.309 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.309 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.311 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.311 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.311 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.312 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:19.325 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:19.326 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:19.326 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.327 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.327 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.328 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:19.328 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.328 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.328 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.329 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.329 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.329 [INFO - pool-12-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.329 [WARN - pool-12-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:19.345 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:19.346 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:19.347 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.347 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:19.347 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.347 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.348 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.348 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.348 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.348 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.348 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.348 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.348 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:19.385 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:19.386 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:19.387 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.387 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.387 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.387 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.387 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:19.387 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.388 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.388 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.388 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.388 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.388 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:19.411 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535419409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:19.424 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
18:30:19.425 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:19.426 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
18:30:19.426 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:19.427 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:19.428 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.428 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.428 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.428 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.428 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.428 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.428 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.428 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.429 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.429 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:19.545 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:19.546 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:19.547 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.547 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.547 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.547 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.547 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.547 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.547 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:19.548 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.549 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.549 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.549 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:19.605 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:19.606 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:19.607 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:19.607 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.607 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.607 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.607 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.607 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.607 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.624 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.625 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.625 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.626 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:19.911 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535419909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:19.928 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
18:30:19.935 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
18:30:19.985 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:19.986 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:19.986 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:19.987 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.987 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.987 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:19.988 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.988 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.988 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:19.989 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.989 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.989 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:19.989 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:20.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:30:20Z chronyd exiting
18:30:20.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535420409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:20.424 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
18:30:20.426 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
18:30:20.605 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:20.606 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:20.606 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:20.607 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:20.607 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:20.607 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:20.607 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:20.607 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:20.607 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:20.607 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:20.607 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:20.608 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:20.608 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:20.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535420909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:20.923 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
18:30:20.923 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
18:30:21.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535421409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:21.421 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:30:21.422 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
.18:30:21.453 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783535421453
18:30:21.453 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783535421453
18:30:21.456 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
18:30:21.459 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
18:30:21.460 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
18:30:21.460 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskSwO0Je/test-tmp
18:30:21.460 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
18:30:21.460 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskSwO0Je/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
18:30:21.463 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

18:30:21.800 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:30:21.801 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

18:30:21.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:21.804455 30767 mini_oidc.cc:150] Starting JWKS server
18:30:21.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:21.808131 30767 webserver.cc:534] Webserver started at http://127.0.0.1:45545/ using document root <none> and password file <none>
18:30:21.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:21.808655 30767 mini_oidc.cc:186] Starting OIDC Discovery server
18:30:21.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:21.810585 30767 webserver.cc:534] Webserver started at http://127.0.0.1:44727/ using document root <none> and password file <none>
18:30:21.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:30:21Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
18:30:21.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:30:21Z Disabled control of system clock
18:30:21.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:21.876255 30767 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:21.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:21.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/wal
18:30:21.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/data
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/logs
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/data/info.pb
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.11.254:41811
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.11.254
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.11.212:37791
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:21.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:30:21.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.11.254:41811,127.30.11.253:35677,127.30.11.252:39405
18:30:21.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:30:21.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45545/jwks.json with env {}
18:30:21.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535421909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:21.922 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:30:21.923 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
18:30:22.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:22.193660 30779 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:30:22.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:22.194396 30779 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:30:22.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:22.195076 30779 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:30:22.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:22.231720 30779 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:30:22.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:22.232095 30779 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:30:22.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:22.232494 30779 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:30:22.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:22.232816 30779 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:30:22.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:22.233134 30779 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:30:22.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:22.233378 30779 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:45545/jwks.json
18:30:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:22.270125 30779 master_runner.cc:387] Master server non-default flags:
18:30:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.11.212:37791
18:30:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/data
18:30:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/wal
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.11.254:41811,127.30.11.253:35677,127.30.11.252:39405
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.11.254:41811
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45545/jwks.json
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/data/info.pb
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.11.254
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/logs
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:30:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:30:22.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:30:22.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:22.271893 30779 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:30:22.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:22.273818 30779 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:30:22.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:22.285306 30785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:22.306 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:22.307 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:22.307 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:22.307 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:22.308 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:22.308 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:22.308 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:22.308 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:22.307 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:22.310 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:22.310 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:22.310 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:22.311 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:22.411 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535422410 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:22.441 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=30 ms, finalizationTime=1 ms).
18:30:22.443 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
18:30:22.911 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535422909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:22.944 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=33 ms, finalizationTime=1 ms).
18:30:22.947 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
18:30:23.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535423409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:23.438 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=28 ms, finalizationTime=1 ms).
18:30:23.439 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
18:30:23.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:22.286203 30786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:23.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:23.607910 30787 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1316 milliseconds
18:30:23.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:23.608994 30779 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.323s	user 0.006s	sys 0.000s
18:30:23.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:23.609630 30779 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.324s	user 0.006s	sys 0.000s
18:30:23.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:23.610116 30788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:23.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.610179 30779 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:30:23.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.611752 30779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:30:23.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.614341 30779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:30:23.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.615864 30779 hybrid_clock.cc:648] HybridClock initialized: now 1783535423615787 us; error 56 us; skew 500 ppm
18:30:23.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.617235 30779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:30:23.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.628378 30779 webserver.cc:534] Webserver started at http://127.30.11.254:45275/ using document root <none> and password file <none>
18:30:23.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.629483 30779 fs_manager.cc:362] Metadata directory not provided
18:30:23.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.629755 30779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:30:23.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.630329 30779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:30:23.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.634770 30779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/data/instance:
18:30:23.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "37dded28ceb842a3976024e1d3f85192"
18:30:23.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:23 on dist-test-slave-dxnw"
18:30:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.636019 30779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/wal/instance:
18:30:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "37dded28ceb842a3976024e1d3f85192"
18:30:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:23 on dist-test-slave-dxnw"
18:30:23.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.644308 30779 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.004s
18:30:23.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.651073 30795 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:30:23.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.652379 30779 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
18:30:23.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.652778 30779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/wal
18:30:23.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "37dded28ceb842a3976024e1d3f85192"
18:30:23.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:23 on dist-test-slave-dxnw"
18:30:23.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.653154 30779 fs_report.cc:389] FS layout report
18:30:23.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:30:23.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/wal
18:30:23.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/wal
18:30:23.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/data/data
18:30:23.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:30:23.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:30:23.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:30:23.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:30:23.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:30:23.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:30:23.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:30:23.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:30:23.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:30:23.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:30:23.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:30:23.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.732528 30779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:30:23.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.733982 30779 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:30:23.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.734392 30779 kserver.cc:163] Server-wide thread pool size limit: 3276
18:30:23.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.805965 30779 rpc_server.cc:307] RPC server started. Bound to: 127.30.11.254:41811
18:30:23.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.806180 30846 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.11.254:41811 every 8 connection(s)
18:30:23.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.808898 30779 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/data/info.pb
18:30:23.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.811527 30767 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 30779
18:30:23.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.812107 30767 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-0/wal/instance
18:30:23.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.816363 30847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:23.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.816586 30767 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:23.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/wal
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/data
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/logs
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/data/info.pb
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.11.253:35677
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.11.253
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.11.212:37791
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:23.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:23.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:30:23.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.11.254:41811,127.30.11.253:35677,127.30.11.252:39405
18:30:23.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:30:23.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45545/jwks.json with env {}
18:30:23.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.829370 30847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } has no permanent_uuid. Determining permanent_uuid...
18:30:23.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.856335 30847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } has no permanent_uuid. Determining permanent_uuid...
18:30:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:23.859344 30799 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.11.253:35677: connect: Connection refused (error 111)
18:30:23.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:23.864368 30847 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.253:35677: Network error: Client connection negotiation failed: client connection to 127.30.11.253:35677: connect: Connection refused (error 111)
18:30:23.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535423909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:23.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.915490 30847 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } attempt: 1
18:30:23.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:23.923187 30847 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.253:35677: Network error: Client connection negotiation failed: client connection to 127.30.11.253:35677: connect: Connection refused (error 111)
18:30:23.923 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
18:30:23.924 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
18:30:23.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:23.991609 30847 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } attempt: 2
18:30:23.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:23.995781 30847 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.253:35677: Network error: Client connection negotiation failed: client connection to 127.30.11.253:35677: connect: Connection refused (error 111)
18:30:24.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:24.087249 30847 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } attempt: 3
18:30:24.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:24.091990 30847 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.253:35677: Network error: Client connection negotiation failed: client connection to 127.30.11.253:35677: connect: Connection refused (error 111)
18:30:24.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:24.146595 30849 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:30:24.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:24.147166 30849 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:30:24.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:24.147600 30849 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:30:24.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:24.179654 30849 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:30:24.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:24.179960 30849 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:30:24.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:24.180156 30849 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:30:24.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:24.180361 30849 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:30:24.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:24.180558 30849 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:30:24.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:24.180698 30849 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:45545/jwks.json
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:24.220817 30849 master_runner.cc:387] Master server non-default flags:
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.11.212:37791
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/data
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/wal
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.11.254:41811,127.30.11.253:35677,127.30.11.252:39405
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.11.253:35677
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45545/jwks.json
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/data/info.pb
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.11.253
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/logs
18:30:24.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:24.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:30:24.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:30:24.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:30:24.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:30:24.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:30:24.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:30:24.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:30:24.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:30:24.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:30:24.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:24.222100 30849 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:30:24.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:24.223692 30849 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:30:24.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:24.234685 30858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:24.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:24.235450 30847 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } attempt: 4
18:30:24.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:24.242602 30847 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.253:35677: Network error: Client connection negotiation failed: client connection to 127.30.11.253:35677: connect: Connection refused (error 111)
18:30:24.411 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535424409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:24.444 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=33 ms, finalizationTime=2 ms).
18:30:24.448 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
18:30:24.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:24.542140 30847 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } attempt: 5
18:30:24.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:24.550947 30847 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.253:35677: Network error: Client connection negotiation failed: client connection to 127.30.11.253:35677: connect: Connection refused (error 111)
18:30:24.911 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535424910 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:24.939 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=28 ms, finalizationTime=1 ms).
18:30:24.942 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
18:30:25.086 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:25.087 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:25.087 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:25.087 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:25.087 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:25.088 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:25.088 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:25.088 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:25.089 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:25.091 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:25.091 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:25.091 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:25.092 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:25.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:25.098518 30847 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } attempt: 6
18:30:25.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:25.126559 30847 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.253:35677: Network error: Client connection negotiation failed: client connection to 127.30.11.253:35677: connect: Connection refused (error 111)
18:30:25.411 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535425409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:25.439 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=27 ms, finalizationTime=3 ms).
18:30:25.442 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
18:30:25.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535425909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:25.927 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
18:30:25.929 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
18:30:25.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:25.637775 30857 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 30849
18:30:25.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:25.966580 30849 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.731s	user 0.633s	sys 1.076s
18:30:25.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:24.236552 30859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:25.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:25.967109 30849 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.732s	user 0.634s	sys 1.076s
18:30:25.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:25.969126 30861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:25.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:25.972229 30860 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1732 milliseconds
18:30:25.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:25.972281 30849 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:30:25.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:25.973757 30849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:30:25.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:25.976598 30849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:30:25.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:25.978018 30849 hybrid_clock.cc:648] HybridClock initialized: now 1783535425977985 us; error 34 us; skew 500 ppm
18:30:25.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:25.979041 30849 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:30:25.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:25.989991 30849 webserver.cc:534] Webserver started at http://127.30.11.253:44447/ using document root <none> and password file <none>
18:30:25.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:25.991086 30849 fs_manager.cc:362] Metadata directory not provided
18:30:25.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:25.991330 30849 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:30:25.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:25.991858 30849 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:30:25.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:25.996359 30849 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/data/instance:
18:30:25.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f341bb1122054e45927274e6993f3567"
18:30:25.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:25 on dist-test-slave-dxnw"
18:30:25.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:25.997607 30849 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/wal/instance:
18:30:25.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f341bb1122054e45927274e6993f3567"
18:30:25.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:25 on dist-test-slave-dxnw"
18:30:26.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.005014 30849 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
18:30:26.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.011665 30872 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:30:26.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.012889 30849 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
18:30:26.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.013350 30849 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/wal
18:30:26.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f341bb1122054e45927274e6993f3567"
18:30:26.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:25 on dist-test-slave-dxnw"
18:30:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.013726 30849 fs_report.cc:389] FS layout report
18:30:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:30:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/wal
18:30:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/wal
18:30:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/data/data
18:30:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:30:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:30:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:30:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:30:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:30:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:30:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:30:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:30:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:30:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:30:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:30:26.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.061769 30849 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:30:26.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.063329 30849 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:30:26.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.063870 30849 kserver.cc:163] Server-wide thread pool size limit: 3276
18:30:26.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.136204 30849 rpc_server.cc:307] RPC server started. Bound to: 127.30.11.253:35677
18:30:26.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.136292 30923 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.11.253:35677 every 8 connection(s)
18:30:26.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.139031 30849 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/data/info.pb
18:30:26.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.144855 30924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:26.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.149117 30767 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 30849
18:30:26.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.149586 30767 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-1/wal/instance
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.152618 30767 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/wal
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/data
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/logs
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/data/info.pb
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.11.252:39405
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.11.252
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.11.212:37791
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.11.254:41811,127.30.11.253:35677,127.30.11.252:39405
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:30:26.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45545/jwks.json with env {}
18:30:26.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.160039 30924 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } has no permanent_uuid. Determining permanent_uuid...
18:30:26.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.183640 30924 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } has no permanent_uuid. Determining permanent_uuid...
18:30:26.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.190490 30847 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } attempt: 7
18:30:26.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.202201 30924 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } has no permanent_uuid. Determining permanent_uuid...
18:30:26.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.206483 30873 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.11.252:39405: connect: Connection refused (error 111)
18:30:26.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.216168 30924 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.252:39405: Network error: Client connection negotiation failed: client connection to 127.30.11.252:39405: connect: Connection refused (error 111)
18:30:26.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.221379 30847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } has no permanent_uuid. Determining permanent_uuid...
18:30:26.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.226961 30847 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.252:39405: Network error: Client connection negotiation failed: client connection to 127.30.11.252:39405: connect: Connection refused (error 111)
18:30:26.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.265799 30924 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } attempt: 1
18:30:26.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.270401 30924 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.252:39405: Network error: Client connection negotiation failed: client connection to 127.30.11.252:39405: connect: Connection refused (error 111)
18:30:26.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.285403 30847 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } attempt: 1
18:30:26.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.289804 30847 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.252:39405: Network error: Client connection negotiation failed: client connection to 127.30.11.252:39405: connect: Connection refused (error 111)
18:30:26.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.338900 30924 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } attempt: 2
18:30:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.343732 30924 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.252:39405: Network error: Client connection negotiation failed: client connection to 127.30.11.252:39405: connect: Connection refused (error 111)
18:30:26.366 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:26.366 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:26.367 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:26.367 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:26.367 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:26.367 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:26.368 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:26.368 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:26.367 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:26.368 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:26.368 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:26.368 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:26.368 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:26.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.371243 30847 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } attempt: 2
18:30:26.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.375656 30847 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.252:39405: Network error: Client connection negotiation failed: client connection to 127.30.11.252:39405: connect: Connection refused (error 111)
18:30:26.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535426409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:26.434 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=23 ms, finalizationTime=1 ms).
18:30:26.435 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
18:30:26.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.435124 30924 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } attempt: 3
18:30:26.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.440616 30924 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.252:39405: Network error: Client connection negotiation failed: client connection to 127.30.11.252:39405: connect: Connection refused (error 111)
18:30:26.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.461007 30847 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } attempt: 3
18:30:26.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.465575 30847 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.252:39405: Network error: Client connection negotiation failed: client connection to 127.30.11.252:39405: connect: Connection refused (error 111)
18:30:26.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.514950 30926 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:30:26.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.515643 30926 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:30:26.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.516215 30926 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:30:26.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.548216 30926 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:30:26.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.548604 30926 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:30:26.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.549000 30926 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:30:26.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.549355 30926 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:30:26.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.549693 30926 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:30:26.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.549940 30926 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:45545/jwks.json
18:30:26.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.584138 30924 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } attempt: 4
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.587893 30926 master_runner.cc:387] Master server non-default flags:
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.11.212:37791
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/data
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/wal
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.11.254:41811,127.30.11.253:35677,127.30.11.252:39405
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.11.252:39405
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45545/jwks.json
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/data/info.pb
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.11.252
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/logs
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.589301 30924 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.252:39405: Network error: Client connection negotiation failed: client connection to 127.30.11.252:39405: connect: Connection refused (error 111)
18:30:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.589608 30926 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:30:26.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.591387 30926 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:30:26.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.602067 30939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:26.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.606077 30847 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } attempt: 4
18:30:26.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.611804 30847 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.252:39405: Network error: Client connection negotiation failed: client connection to 127.30.11.252:39405: connect: Connection refused (error 111)
18:30:26.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.627586 30843 debug-util.cc:398] Leaking SignalData structure 0x7b0800070060 after lost signal to thread 30780
18:30:26.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.888778 30924 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } attempt: 5
18:30:26.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:26.895236 30847 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } attempt: 5
18:30:26.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.896944 30924 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.252:39405: Network error: Client connection negotiation failed: client connection to 127.30.11.252:39405: connect: Connection refused (error 111)
18:30:26.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.901507 30847 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.252:39405: Network error: Client connection negotiation failed: client connection to 127.30.11.252:39405: connect: Connection refused (error 111)
18:30:26.911 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535426909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:26.938 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=27 ms, finalizationTime=2 ms).
18:30:26.939 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
18:30:27.105 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:27.106 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:27.111 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:27.111 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:27.111 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:27.112 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:27.113 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:27.113 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:27.113 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:27.114 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:27.114 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:27.114 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:27.115 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:27.411 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535427410 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:27.438 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=27 ms, finalizationTime=0 ms).
18:30:27.441 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
18:30:27.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:27.444471 30924 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } attempt: 6
18:30:27.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:27.453928 30847 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } attempt: 6
18:30:27.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:27.488690 30924 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.252:39405: Network error: Client connection negotiation failed: client connection to 127.30.11.252:39405: connect: Connection refused (error 111)
18:30:27.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:27.493800 30847 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.11.252:39405: Network error: Client connection negotiation failed: client connection to 127.30.11.252:39405: connect: Connection refused (error 111)
18:30:27.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535427909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:27.924 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
18:30:27.925 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
18:30:28.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:26.603868 30940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:28.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:28.056612 30942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:28.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:28.059111 30941 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1451 milliseconds
18:30:28.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.059302 30926 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:30:28.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.061132 30926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:30:28.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.064754 30926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:30:28.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.066529 30926 hybrid_clock.cc:648] HybridClock initialized: now 1783535428066472 us; error 36 us; skew 500 ppm
18:30:28.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.067833 30926 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:30:28.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.077045 30926 webserver.cc:534] Webserver started at http://127.30.11.252:45417/ using document root <none> and password file <none>
18:30:28.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.078538 30926 fs_manager.cc:362] Metadata directory not provided
18:30:28.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.078886 30926 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:30:28.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.079548 30926 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:30:28.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.087512 30926 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/data/instance:
18:30:28.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3ca8ef01ddcf435495645505077ee1b4"
18:30:28.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:28 on dist-test-slave-dxnw"
18:30:28.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.089185 30926 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/wal/instance:
18:30:28.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3ca8ef01ddcf435495645505077ee1b4"
18:30:28.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:28 on dist-test-slave-dxnw"
18:30:28.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.099371 30926 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.004s
18:30:28.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.105661 30953 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:30:28.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.106792 30926 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.004s
18:30:28.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.107141 30926 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/wal
18:30:28.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3ca8ef01ddcf435495645505077ee1b4"
18:30:28.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:28 on dist-test-slave-dxnw"
18:30:28.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.107445 30926 fs_report.cc:389] FS layout report
18:30:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:30:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/wal
18:30:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/wal
18:30:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/data/data
18:30:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:30:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:30:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:30:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:30:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:30:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:30:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:30:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:30:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:30:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:30:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:30:28.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.216521 30926 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:30:28.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.218873 30926 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:30:28.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.219549 30926 kserver.cc:163] Server-wide thread pool size limit: 3276
18:30:28.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.313789 30926 rpc_server.cc:307] RPC server started. Bound to: 127.30.11.252:39405
18:30:28.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.313869 31004 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.11.252:39405 every 8 connection(s)
18:30:28.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.318019 30926 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/data/info.pb
18:30:28.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.325176 30767 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 30926
18:30:28.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.325511 31005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:28.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.325713 30767 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/master-2/wal/instance
18:30:28.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.346045 31005 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } has no permanent_uuid. Determining permanent_uuid...
18:30:28.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.394464 31005 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } has no permanent_uuid. Determining permanent_uuid...
18:30:28.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.407342 31005 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } has no permanent_uuid. Determining permanent_uuid...
18:30:28.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535428409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:28.422 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:30:28.423 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
18:30:28.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.443280 31005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4: Bootstrap starting.
18:30:28.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.451967 31005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4: Neither blocks nor log segments found. Creating new log.
18:30:28.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.454267 31005 log.cc:826] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4: Log is configured to *not* fsync() on all Append() calls
18:30:28.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.459878 31005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4: No bootstrap required, opened a new log
18:30:28.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.490185 31005 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } }
18:30:28.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.491146 31005 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:28.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.491441 31005 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ca8ef01ddcf435495645505077ee1b4, State: Initialized, Role: FOLLOWER
18:30:28.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.492446 31005 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } }
18:30:28.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.495343 31014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } } }
18:30:28.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.496163 31014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [sys.catalog]: This master's current role is: FOLLOWER
18:30:28.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.497368 31005 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [sys.catalog]: configured and running, proceeding with master startup.
18:30:28.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.527258 30847 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } attempt: 7
18:30:28.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:28.532838 31025 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:30:28.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:28.533174 31025 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:30:28.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.549269 30924 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } attempt: 7
18:30:28.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.521638 30926 master_runner.cc:187] Error getting master registration for 127.30.11.254:41811: OK, instance_id { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" instance_seqno: 1783535423787051 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:30:28.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.571723 30847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192: Bootstrap starting.
18:30:28.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.573170 30926 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:30:28.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.580121 30847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192: Neither blocks nor log segments found. Creating new log.
18:30:28.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.590582 30847 log.cc:826] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192: Log is configured to *not* fsync() on all Append() calls
18:30:28.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.597843 30924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567: Bootstrap starting.
18:30:28.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.605952 30924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567: Neither blocks nor log segments found. Creating new log.
18:30:28.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.606536 30847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192: No bootstrap required, opened a new log
18:30:28.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.608716 30924 log.cc:826] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567: Log is configured to *not* fsync() on all Append() calls
18:30:28.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.621354 30924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567: No bootstrap required, opened a new log
18:30:28.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.636680 30847 raft_consensus.cc:359] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } }
18:30:28.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.637995 30847 raft_consensus.cc:385] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:28.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.638950 30847 raft_consensus.cc:740] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37dded28ceb842a3976024e1d3f85192, State: Initialized, Role: FOLLOWER
18:30:28.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.640564 30847 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } }
18:30:28.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.661091 30847 sys_catalog.cc:565] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192 [sys.catalog]: configured and running, proceeding with master startup.
18:30:28.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.661540 30924 raft_consensus.cc:359] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } }
18:30:28.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.658699 31032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } } }
18:30:28.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.662967 31032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192 [sys.catalog]: This master's current role is: FOLLOWER
18:30:28.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.663914 30924 raft_consensus.cc:385] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:28.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.664366 30924 raft_consensus.cc:740] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f341bb1122054e45927274e6993f3567, State: Initialized, Role: FOLLOWER
18:30:28.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.665710 30924 consensus_queue.cc:260] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } }
18:30:28.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.674007 31034 sys_catalog.cc:455] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } } }
18:30:28.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.678016 31034 sys_catalog.cc:458] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567 [sys.catalog]: This master's current role is: FOLLOWER
18:30:28.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.677608 30924 sys_catalog.cc:565] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567 [sys.catalog]: configured and running, proceeding with master startup.
18:30:28.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:28.726950 30959 tablet.cc:2406] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:30:28.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:28.747157 30801 tablet.cc:2406] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:30:28.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.750140 31053 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
18:30:28.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.765164 31055 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
18:30:28.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.784905 30849 master_runner.cc:264] No leader master found from master f341bb1122054e45927274e6993f3567
18:30:28.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.785552 30849 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:30:28.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.758212 30779 master_runner.cc:187] Error getting master registration for 127.30.11.253:35677: OK, instance_id { permanent_uuid: "f341bb1122054e45927274e6993f3567" instance_seqno: 1783535426116494 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:30:28.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.790131 30779 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:30:28.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:28.822108 30878 tablet.cc:2406] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:30:28.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535428909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:28.926 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
18:30:28.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.926994 31014 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:30:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.927588 31014 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } }
18:30:28.930 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
18:30:28.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.931432 31014 leader_election.cc:290] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37dded28ceb842a3976024e1d3f85192 (127.30.11.254:41811), f341bb1122054e45927274e6993f3567 (127.30.11.253:35677)
18:30:28.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.931840 30822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ca8ef01ddcf435495645505077ee1b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37dded28ceb842a3976024e1d3f85192" is_pre_election: true
18:30:28.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.932684 30822 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ca8ef01ddcf435495645505077ee1b4 in term 0.
18:30:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.933414 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ca8ef01ddcf435495645505077ee1b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f341bb1122054e45927274e6993f3567" is_pre_election: true
18:30:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.934172 30899 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ca8ef01ddcf435495645505077ee1b4 in term 0.
18:30:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.934451 30956 leader_election.cc:304] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37dded28ceb842a3976024e1d3f85192, 3ca8ef01ddcf435495645505077ee1b4; no voters: 
18:30:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.935415 31014 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:30:28.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.935774 31014 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:30:28.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.936117 31014 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [term 0 FOLLOWER]: Advancing to term 1
18:30:28.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.943658 31014 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } }
18:30:28.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.946628 30822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ca8ef01ddcf435495645505077ee1b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37dded28ceb842a3976024e1d3f85192"
18:30:28.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.946942 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ca8ef01ddcf435495645505077ee1b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f341bb1122054e45927274e6993f3567"
18:30:28.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.947252 30822 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192 [term 0 FOLLOWER]: Advancing to term 1
18:30:28.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.947518 30899 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567 [term 0 FOLLOWER]: Advancing to term 1
18:30:28.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.954125 30899 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ca8ef01ddcf435495645505077ee1b4 in term 1.
18:30:28.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.954299 30822 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ca8ef01ddcf435495645505077ee1b4 in term 1.
18:30:28.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.955413 30956 leader_election.cc:304] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37dded28ceb842a3976024e1d3f85192, 3ca8ef01ddcf435495645505077ee1b4; no voters: 
18:30:28.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.957597 31056 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [term 1 FOLLOWER]: Leader election won for term 1
18:30:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.966332 31014 leader_election.cc:290] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [CANDIDATE]: Term 1 election: Requested vote from peers 37dded28ceb842a3976024e1d3f85192 (127.30.11.254:41811), f341bb1122054e45927274e6993f3567 (127.30.11.253:35677)
18:30:28.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.967552 31056 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [term 1 LEADER]: Becoming Leader. State: Replica: 3ca8ef01ddcf435495645505077ee1b4, State: Running, Role: LEADER
18:30:28.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.968611 31056 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } }
18:30:28.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.980127 31014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ca8ef01ddcf435495645505077ee1b4. Latest consensus state: current_term: 1 leader_uuid: "3ca8ef01ddcf435495645505077ee1b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } } }
18:30:28.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.981187 31014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [sys.catalog]: This master's current role is: LEADER
18:30:28.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.988018 31059 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:30:28.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:28.994822 31059 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:30:29.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.011852 30822 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192 [term 1 FOLLOWER]: Refusing update from remote peer 3ca8ef01ddcf435495645505077ee1b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:30:29.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.012769 30899 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567 [term 1 FOLLOWER]: Refusing update from remote peer 3ca8ef01ddcf435495645505077ee1b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:30:29.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.016068 31056 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:30:29.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.016964 31014 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:30:29.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.033442 31034 sys_catalog.cc:455] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ca8ef01ddcf435495645505077ee1b4. Latest consensus state: current_term: 1 leader_uuid: "3ca8ef01ddcf435495645505077ee1b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } } }
18:30:29.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.034423 31034 sys_catalog.cc:458] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567 [sys.catalog]: This master's current role is: FOLLOWER
18:30:29.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.034711 31060 mvcc.cc:204] Tried to move back new op lower bound from 7305361117211566080 to 7305361117065490432. Current Snapshot: MvccSnapshot[applied={T|T < 7305361117211566080}]
18:30:29.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.037248 31056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3ca8ef01ddcf435495645505077ee1b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } } }
18:30:29.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.037974 31056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [sys.catalog]: This master's current role is: LEADER
18:30:29.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.040904 31059 catalog_manager.cc:1382] Generated new cluster ID: 1432a12abc154e90b80cad9a54150723
18:30:29.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.041229 31059 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:30:29.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.043398 31034 sys_catalog.cc:455] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3ca8ef01ddcf435495645505077ee1b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } } }
18:30:29.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.044200 31034 sys_catalog.cc:458] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567 [sys.catalog]: This master's current role is: FOLLOWER
18:30:29.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.050582 31032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ca8ef01ddcf435495645505077ee1b4. Latest consensus state: current_term: 1 leader_uuid: "3ca8ef01ddcf435495645505077ee1b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } } }
18:30:29.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.051276 31032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192 [sys.catalog]: This master's current role is: FOLLOWER
18:30:29.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.056027 31014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3ca8ef01ddcf435495645505077ee1b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } } }
18:30:29.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.056650 31014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4 [sys.catalog]: This master's current role is: LEADER
18:30:29.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.064103 31032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3ca8ef01ddcf435495645505077ee1b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37dded28ceb842a3976024e1d3f85192" member_type: VOTER last_known_addr { host: "127.30.11.254" port: 41811 } } peers { permanent_uuid: "f341bb1122054e45927274e6993f3567" member_type: VOTER last_known_addr { host: "127.30.11.253" port: 35677 } } peers { permanent_uuid: "3ca8ef01ddcf435495645505077ee1b4" member_type: VOTER last_known_addr { host: "127.30.11.252" port: 39405 } } }
18:30:29.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.065060 31032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192 [sys.catalog]: This master's current role is: FOLLOWER
18:30:29.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.070262 31059 catalog_manager.cc:1405] Generated new certificate authority record
18:30:29.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.072322 31059 catalog_manager.cc:1539] Loading token signing keys...
18:30:29.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.097783 31059 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 3ca8ef01ddcf435495645505077ee1b4: Generated new TSK 0
18:30:29.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.100045 31059 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:30:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.132404 30767 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/wal
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/data
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/logs
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/data/info.pb
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.11.193:0
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.11.193
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.11.193
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.11.254:41811,127.30.11.253:35677,127.30.11.252:39405
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.11.212:37791
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:30:29.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535429409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:29.426 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
18:30:29.430 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
18:30:29.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:29.515727 31068 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:30:29.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:29.516717 31068 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:30:29.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:29.517669 31068 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:30:29.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:29.574832 31068 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:30:29.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:29.576671 31068 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.11.193
18:30:29.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.640336 31068 tablet_server_runner.cc:78] Tablet server non-default flags:
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.11.212:37791
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/data
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/wal
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.11.193:0
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/data/info.pb
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.11.193
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.11.254:41811,127.30.11.253:35677,127.30.11.252:39405
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.11.193
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/logs
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:30:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:30:29.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.643519 31068 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:30:29.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.645975 31068 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:30:29.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:29.663569 31074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:29.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.804141 31053 catalog_manager.cc:1294] Loaded cluster ID: 1432a12abc154e90b80cad9a54150723
18:30:29.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.815022 31053 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192: loading cluster ID for follower catalog manager: success
18:30:29.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.832701 31055 catalog_manager.cc:1294] Loaded cluster ID: 1432a12abc154e90b80cad9a54150723
18:30:29.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.833524 31055 catalog_manager.cc:1587] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567: loading cluster ID for follower catalog manager: success
18:30:29.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.862273 31053 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192: acquiring CA information for follower catalog manager: success
18:30:29.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.874120 31055 catalog_manager.cc:1609] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567: acquiring CA information for follower catalog manager: success
18:30:29.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.898344 31053 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 37dded28ceb842a3976024e1d3f85192: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:30:29.911 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535429910 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:29.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:29.913604 31055 catalog_manager.cc:1637] T 00000000000000000000000000000000 P f341bb1122054e45927274e6993f3567: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:30:29.937 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=26 ms, finalizationTime=1 ms).
18:30:29.939 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
18:30:30.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:30.249553 30957 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.11.253:35677, user_credentials={real_user=slave}} blocked reactor thread for 90572.3us
18:30:30.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535430409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:30.431 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
18:30:30.433 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
18:30:30.725 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:30.726 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:30.726 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:30.727 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:30.728 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:30.728 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:30.732 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:30.732 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:30.732 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:30.733 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:30.733 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:30.733 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:30.733 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:30.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535430909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:30.930 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=21 ms, finalizationTime=0 ms).
18:30:30.932 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
18:30:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:31.231671 31001 debug-util.cc:398] Leaking SignalData structure 0x7b0800070140 after lost signal to thread 30934
18:30:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:31.232378 31001 debug-util.cc:398] Leaking SignalData structure 0x7b08000b9820 after lost signal to thread 31004
18:30:31.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535431409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:31.428 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
18:30:31.430 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
18:30:31.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:31.063637 31073 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 31068
18:30:31.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:31.696722 31073 kernel_stack_watchdog.cc:198] Thread 31068 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 399ms:
18:30:31.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:30:31.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:30:31.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:30:31.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:30:31.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:29.665088 31075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:31.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:31.698350 31068 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.035s	user 0.331s	sys 0.585s
18:30:31.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:31.699142 31077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:31.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:31.699575 31068 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.036s	user 0.331s	sys 0.586s
18:30:31.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:31.704178 31076 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2038 milliseconds
18:30:31.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:31.704245 31068 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:30:31.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:31.707291 31068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:30:31.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:31.716249 31068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:30:31.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:31.732133 31068 hybrid_clock.cc:648] HybridClock initialized: now 1783535431732066 us; error 55 us; skew 500 ppm
18:30:31.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:31.733496 31068 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:30:31.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:31.780364 31068 webserver.cc:534] Webserver started at http://127.30.11.193:45605/ using document root <none> and password file <none>
18:30:31.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:31.783250 31068 fs_manager.cc:362] Metadata directory not provided
18:30:31.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:31.784585 31068 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:30:31.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:31.787937 31068 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:30:31.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:31.819207 31068 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/data/instance:
18:30:31.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "65f318326a6a4a469ec95434167d0082"
18:30:31.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:31 on dist-test-slave-dxnw"
18:30:31.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:31.820888 31068 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/wal/instance:
18:30:31.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "65f318326a6a4a469ec95434167d0082"
18:30:31.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:31 on dist-test-slave-dxnw"
18:30:31.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:31.870550 31068 fs_manager.cc:696] Time spent creating directory manager: real 0.049s	user 0.009s	sys 0.003s
18:30:31.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:31.900828 31090 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:30:31.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:31.904940 31068 fs_manager.cc:730] Time spent opening block manager: real 0.025s	user 0.002s	sys 0.002s
18:30:31.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:31.905418 31068 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/wal
18:30:31.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "65f318326a6a4a469ec95434167d0082"
18:30:31.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:31 on dist-test-slave-dxnw"
18:30:31.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:31.906062 31068 fs_report.cc:389] FS layout report
18:30:31.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:30:31.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/wal
18:30:31.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/wal
18:30:31.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/data/data
18:30:31.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:30:31.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:30:31.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:30:31.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:30:31.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:30:31.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:30:31.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:30:31.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:30:31.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:30:31.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:30:31.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:30:31.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535431909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:31.930 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
18:30:31.931 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
18:30:32.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:32.265619 31068 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:30:32.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:32.270291 31068 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:30:32.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:32.270926 31068 kserver.cc:163] Server-wide thread pool size limit: 3276
18:30:32.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:32.287683 31068 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:30:32.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:32.308722 31068 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:30:32.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:32.309122 31068 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:30:32.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:32.310477 31068 ts_tablet_manager.cc:616] Registered 0 tablets
18:30:32.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:32.310745 31068 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:30:32.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535432409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:32.429 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
18:30:32.431 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
18:30:32.746 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:32.746 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:32.747 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:32.747 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:32.747 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:32.747 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:32.747 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:32.747 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:32.747 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:32.748 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:32.748 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:32.748 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:32.748 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:32.911 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535432909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:32.926 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
18:30:32.928 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
18:30:33.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.333976 31208 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.11.193:33411 every 8 connection(s)
18:30:33.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.334573 31068 rpc_server.cc:307] RPC server started. Bound to: 127.30.11.193:33411
18:30:33.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.339731 31068 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/data/info.pb
18:30:33.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.345825 30767 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 31068
18:30:33.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.346480 30767 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-0/wal/instance
18:30:33.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.362426 30767 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/wal
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/data
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/logs
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/data/info.pb
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.11.194:0
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.11.194
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.11.194
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.11.254:41811,127.30.11.253:35677,127.30.11.252:39405
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.11.212:37791
18:30:33.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:33.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:33.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:30:33.412 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535433411 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:33.433 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=21 ms, finalizationTime=0 ms).
18:30:33.440 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
18:30:33.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.502596 31213 heartbeater.cc:344] Connected to a master server at 127.30.11.253:35677
18:30:33.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.503146 31213 heartbeater.cc:461] Registering TS with master...
18:30:33.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.504459 31213 heartbeater.cc:507] Master 127.30.11.253:35677 requested a full tablet report, sending...
18:30:33.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.506995 31209 heartbeater.cc:344] Connected to a master server at 127.30.11.252:39405
18:30:33.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.507361 31209 heartbeater.cc:461] Registering TS with master...
18:30:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.508991 31209 heartbeater.cc:507] Master 127.30.11.252:39405 requested a full tablet report, sending...
18:30:33.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.512589 30970 ts_manager.cc:194] Registered new tserver with Master: 65f318326a6a4a469ec95434167d0082 (127.30.11.193:33411)
18:30:33.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.515550 30970 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.30.11.193:45693
18:30:33.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.518982 30888 ts_manager.cc:194] Registered new tserver with Master: 65f318326a6a4a469ec95434167d0082 (127.30.11.193:33411)
18:30:33.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.521026 31216 heartbeater.cc:344] Connected to a master server at 127.30.11.254:41811
18:30:33.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.521386 31216 heartbeater.cc:461] Registering TS with master...
18:30:33.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.522097 31216 heartbeater.cc:507] Master 127.30.11.254:41811 requested a full tablet report, sending...
18:30:33.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:33.525756 30811 ts_manager.cc:194] Registered new tserver with Master: 65f318326a6a4a469ec95434167d0082 (127.30.11.193:33411)
18:30:33.846 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:33.846 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:33.847 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:33.847 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:33.847 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:33.848 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:33.848 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:33.847 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:33.848 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:33.852 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:33.852 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:33.852 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:33.852 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:33.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535433909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:33.933 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=23 ms, finalizationTime=1 ms).
18:30:33.934 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
18:30:34.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:34.153856 31210 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:30:34.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:34.154691 31210 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:30:34.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:34.155607 31210 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:30:34.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:34.219987 31210 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:30:34.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:34.221314 31210 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.11.194
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:34.286520 31210 tablet_server_runner.cc:78] Tablet server non-default flags:
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.11.212:37791
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/data
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/wal
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.11.194:0
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/data/info.pb
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.11.194
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.11.254:41811,127.30.11.253:35677,127.30.11.252:39405
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.11.194
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/logs
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:30:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:30:34.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:30:34.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:30:34.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:34.288295 31210 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:30:34.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:34.290400 31210 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:30:34.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:34.307060 31226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:34.411 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535434409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:34.433 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=24 ms, finalizationTime=0 ms).
18:30:34.435 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
18:30:34.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:34.520808 31209 heartbeater.cc:499] Master 127.30.11.252:39405 was elected leader, sending a full tablet report...
18:30:34.914 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535434909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:34.939 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=29 ms, finalizationTime=1 ms).
18:30:34.941 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
18:30:35.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535435409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:35.428 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
18:30:35.430 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
18:30:35.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:35.708197 31225 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 31210
18:30:35.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:34.308331 31227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:35.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:35.806089 31225 kernel_stack_watchdog.cc:198] Thread 31210 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
18:30:35.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:30:35.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:30:35.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:30:35.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:30:35.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:35.806197 31210 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.501s	user 0.514s	sys 0.954s
18:30:35.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:35.806614 31210 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.501s	user 0.514s	sys 0.954s
18:30:35.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.816882 31210 server_base.cc:1061] running on GCE node
18:30:35.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:35.817247 31231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:35.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.818480 31210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:30:35.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.820518 31210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:30:35.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.821943 31210 hybrid_clock.cc:648] HybridClock initialized: now 1783535435821889 us; error 30 us; skew 500 ppm
18:30:35.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.822901 31210 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:30:35.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.829799 31210 webserver.cc:534] Webserver started at http://127.30.11.194:37213/ using document root <none> and password file <none>
18:30:35.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.830762 31210 fs_manager.cc:362] Metadata directory not provided
18:30:35.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.831074 31210 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:30:35.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.831600 31210 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:30:35.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.836084 31210 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/data/instance:
18:30:35.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9528f2c8dcc74589a5fd8b8b121d42c0"
18:30:35.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:35 on dist-test-slave-dxnw"
18:30:35.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.837296 31210 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/wal/instance:
18:30:35.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9528f2c8dcc74589a5fd8b8b121d42c0"
18:30:35.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:35 on dist-test-slave-dxnw"
18:30:35.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.844581 31210 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.000s	sys 0.008s
18:30:35.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.852521 31236 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:30:35.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.853883 31210 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.004s
18:30:35.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.854316 31210 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/wal
18:30:35.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9528f2c8dcc74589a5fd8b8b121d42c0"
18:30:35.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:35 on dist-test-slave-dxnw"
18:30:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.854678 31210 fs_report.cc:389] FS layout report
18:30:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:30:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/wal
18:30:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/wal
18:30:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/data/data
18:30:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:30:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:30:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:30:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:30:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:30:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:30:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:30:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:30:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:30:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:30:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:30:35.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535435909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:35.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.916657 31210 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:30:35.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.918460 31210 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:30:35.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.919052 31210 kserver.cc:163] Server-wide thread pool size limit: 3276
18:30:35.920 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:30:35.921 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
18:30:35.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.923514 31210 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:30:35.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.928146 31210 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:30:35.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.928404 31210 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:30:35.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.928735 31210 ts_tablet_manager.cc:616] Registered 0 tablets
18:30:35.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:35.928936 31210 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:30:36.045 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:36.046 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:36.046 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:36.046 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:36.047 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:36.048 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:36.048 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:36.048 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:36.050 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:36.051 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:36.051 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:36.051 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:36.051 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:36.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.101511 31210 rpc_server.cc:307] RPC server started. Bound to: 127.30.11.194:38295
18:30:36.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.101576 31348 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.11.194:38295 every 8 connection(s)
18:30:36.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.105250 31210 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/data/info.pb
18:30:36.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.110875 30767 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 31210
18:30:36.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.111382 30767 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-1/wal/instance
18:30:36.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.149367 30767 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/wal
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/data
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/logs
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/data/info.pb
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:30:36.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.11.195:0
18:30:36.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.11.195
18:30:36.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.11.195
18:30:36.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:36.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.11.254:41811,127.30.11.253:35677,127.30.11.252:39405
18:30:36.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.11.212:37791
18:30:36.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:36.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:36.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:30:36.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.237946 31349 heartbeater.cc:344] Connected to a master server at 127.30.11.252:39405
18:30:36.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.238471 31349 heartbeater.cc:461] Registering TS with master...
18:30:36.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.239838 31349 heartbeater.cc:507] Master 127.30.11.252:39405 requested a full tablet report, sending...
18:30:36.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.242368 30970 ts_manager.cc:194] Registered new tserver with Master: 9528f2c8dcc74589a5fd8b8b121d42c0 (127.30.11.194:38295)
18:30:36.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.243927 30970 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.30.11.194:60023
18:30:36.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.247973 31351 heartbeater.cc:344] Connected to a master server at 127.30.11.254:41811
18:30:36.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.248318 31351 heartbeater.cc:461] Registering TS with master...
18:30:36.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.249012 31351 heartbeater.cc:507] Master 127.30.11.254:41811 requested a full tablet report, sending...
18:30:36.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.249302 31350 heartbeater.cc:344] Connected to a master server at 127.30.11.253:35677
18:30:36.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.249614 31350 heartbeater.cc:461] Registering TS with master...
18:30:36.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.250244 31350 heartbeater.cc:507] Master 127.30.11.253:35677 requested a full tablet report, sending...
18:30:36.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.251837 30811 ts_manager.cc:194] Registered new tserver with Master: 9528f2c8dcc74589a5fd8b8b121d42c0 (127.30.11.194:38295)
18:30:36.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.252884 30888 ts_manager.cc:194] Registered new tserver with Master: 9528f2c8dcc74589a5fd8b8b121d42c0 (127.30.11.194:38295)
18:30:36.411 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535436410 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:36.424 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
18:30:36.425 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
18:30:36.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:36.592151 31359 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:30:36.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:36.592621 31359 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:30:36.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:36.593041 31359 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:30:36.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:36.626070 31359 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:30:36.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:36.626839 31359 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.11.195
18:30:36.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.665828 31359 tablet_server_runner.cc:78] Tablet server non-default flags:
18:30:36.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:36.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.11.212:37791
18:30:36.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:36.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:36.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/data
18:30:36.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/wal
18:30:36.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:36.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.11.195:0
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/data/info.pb
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.11.195
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.11.254:41811,127.30.11.253:35677,127.30.11.252:39405
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.11.195
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/logs
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:30:36.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.667321 31359 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:30:36.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:36.669190 31359 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:30:36.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:36.686182 31366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:36.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535436909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:36.929 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
18:30:36.931 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
18:30:37.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:37.248003 31349 heartbeater.cc:499] Master 127.30.11.252:39405 was elected leader, sending a full tablet report...
18:30:37.411 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535437409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:37.441 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=30 ms, finalizationTime=2 ms).
18:30:37.444 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
18:30:37.886 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:37.887 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:37.887 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:37.887 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:37.887 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:37.887 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:37.888 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:37.889 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:37.889 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:37.890 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:37.890 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:37.890 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:37.890 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:37.911 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535437909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:37.939 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=28 ms, finalizationTime=2 ms).
18:30:37.941 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
18:30:38.413 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535438409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:38.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:36.687700 31367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:38.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:38.091356 31365 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 31359
18:30:38.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:38.429428 31359 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.743s	user 0.574s	sys 1.124s
18:30:38.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:38.429841 31359 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.743s	user 0.574s	sys 1.124s
18:30:38.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:38.426790 31365 kernel_stack_watchdog.cc:198] Thread 31359 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 401ms:
18:30:38.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:30:38.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:30:38.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:30:38.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:30:38.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:38.432126 31369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:38.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:38.432777 31368 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1744 milliseconds
18:30:38.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.432753 31359 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:30:38.434 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=24 ms, finalizationTime=1 ms).
18:30:38.435 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
18:30:38.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.434587 31359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:30:38.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.438090 31359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:30:38.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.439635 31359 hybrid_clock.cc:648] HybridClock initialized: now 1783535438439582 us; error 36 us; skew 500 ppm
18:30:38.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.440985 31359 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:30:38.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.449012 31359 webserver.cc:534] Webserver started at http://127.30.11.195:43077/ using document root <none> and password file <none>
18:30:38.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.450073 31359 fs_manager.cc:362] Metadata directory not provided
18:30:38.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.450290 31359 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:30:38.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.450734 31359 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:30:38.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.455528 31359 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/data/instance:
18:30:38.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fe8cc76985484cc7badb53158fdd508c"
18:30:38.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:38 on dist-test-slave-dxnw"
18:30:38.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.456936 31359 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/wal/instance:
18:30:38.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fe8cc76985484cc7badb53158fdd508c"
18:30:38.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:38 on dist-test-slave-dxnw"
18:30:38.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.464869 31359 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
18:30:38.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.471267 31377 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:30:38.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.472496 31359 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.472811 31359 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/wal
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fe8cc76985484cc7badb53158fdd508c"
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:38 on dist-test-slave-dxnw"
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.473133 31359 fs_report.cc:389] FS layout report
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/wal
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/wal
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/data/data
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:30:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:30:38.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:30:38.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.538655 31359 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:30:38.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.540165 31359 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:30:38.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.540576 31359 kserver.cc:163] Server-wide thread pool size limit: 3276
18:30:38.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.543311 31359 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:30:38.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.547539 31359 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:30:38.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.547729 31359 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:30:38.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.547920 31359 ts_tablet_manager.cc:616] Registered 0 tablets
18:30:38.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.548097 31359 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:30:38.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.708261 31359 rpc_server.cc:307] RPC server started. Bound to: 127.30.11.195:42383
18:30:38.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.708421 31490 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.11.195:42383 every 8 connection(s)
18:30:38.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.712078 31359 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/data/info.pb
18:30:38.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.716778 30767 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 31359
18:30:38.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.717217 30767 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster363009890011463849/ts-2/wal/instance
18:30:38.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.759281 31492 heartbeater.cc:344] Connected to a master server at 127.30.11.253:35677
18:30:38.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.759783 31492 heartbeater.cc:461] Registering TS with master...
18:30:38.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.760411 31491 heartbeater.cc:344] Connected to a master server at 127.30.11.252:39405
18:30:38.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.760743 31491 heartbeater.cc:461] Registering TS with master...
18:30:38.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.761161 31492 heartbeater.cc:507] Master 127.30.11.253:35677 requested a full tablet report, sending...
18:30:38.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.761916 31491 heartbeater.cc:507] Master 127.30.11.252:39405 requested a full tablet report, sending...
18:30:38.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.763867 31493 heartbeater.cc:344] Connected to a master server at 127.30.11.254:41811
18:30:38.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.764212 31493 heartbeater.cc:461] Registering TS with master...
18:30:38.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.764429 30970 ts_manager.cc:194] Registered new tserver with Master: fe8cc76985484cc7badb53158fdd508c (127.30.11.195:42383)
18:30:38.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.764784 30888 ts_manager.cc:194] Registered new tserver with Master: fe8cc76985484cc7badb53158fdd508c (127.30.11.195:42383)
18:30:38.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.764894 31493 heartbeater.cc:507] Master 127.30.11.254:41811 requested a full tablet report, sending...
18:30:38.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.766247 30970 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.30.11.195:47485
18:30:38.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.767334 30811 ts_manager.cc:194] Registered new tserver with Master: fe8cc76985484cc7badb53158fdd508c (127.30.11.195:42383)
18:30:38.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:38.785909 30767 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
18:30:38.797 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:30:38.797 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

18:30:38.799 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.30.11.254"
      port: 41811
    }
    bound_http_address {
      host: "127.30.11.254"
      port: 45275
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.30.11.253"
      port: 35677
    }
    bound_http_address {
      host: "127.30.11.253"
      port: 44447
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.30.11.252"
      port: 39405
    }
    bound_http_address {
      host: "127.30.11.252"
      port: 45417
    }
  }
}

18:30:38.799 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

18:30:38.803 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.30.11.193"
      port: 33411
    }
    bound_http_address {
      host: "127.30.11.193"
      port: 45605
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.30.11.194"
      port: 38295
    }
    bound_http_address {
      host: "127.30.11.194"
      port: 37213
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.30.11.195"
      port: 42383
    }
    bound_http_address {
      host: "127.30.11.195"
      port: 43077
    }
  }
}

18:30:38.803 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
18:30:38.806 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:38.806 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
18:30:38.806 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskSwO0Je/test-tmp
18:30:38.806 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
18:30:38.806 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskSwO0Je/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
18:30:38.809 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

18:30:38.911 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535438910 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:38.920 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:30:38.921 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
18:30:39.139 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:30:39.139 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

18:30:39.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:39.144618 31501 mini_oidc.cc:150] Starting JWKS server
18:30:39.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:39.148686 31501 webserver.cc:534] Webserver started at http://127.0.0.1:38807/ using document root <none> and password file <none>
18:30:39.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:39.149296 31501 mini_oidc.cc:186] Starting OIDC Discovery server
18:30:39.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:39.151589 31501 webserver.cc:534] Webserver started at http://127.0.0.1:32917/ using document root <none> and password file <none>
18:30:39.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:30:39Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
18:30:39.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:30:39Z Disabled control of system clock
18:30:39.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:39.240397 31501 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:39.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/wal
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/data
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/logs
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/data/info.pb
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:30:39.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:30:39.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:30:39.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.195.126:33747
18:30:39.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.195.126
18:30:39.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:39.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.195.84:35305
18:30:39.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:39.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:39.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:39.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:30:39.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.195.126:33747,127.30.195.125:40423,127.30.195.124:38627
18:30:39.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:30:39.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38807/jwks.json with env {}
18:30:39.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535439409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:39.419 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:30:39.420 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
18:30:39.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:39.564512 31514 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:30:39.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:39.565368 31514 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:30:39.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:39.566216 31514 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:30:39.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:39.600981 31514 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:30:39.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:39.601351 31514 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:30:39.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:39.601745 31514 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:30:39.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:39.602082 31514 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:30:39.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:39.602420 31514 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:30:39.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:39.602711 31514 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38807/jwks.json
18:30:39.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:39.641000 31514 master_runner.cc:387] Master server non-default flags:
18:30:39.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:39.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.195.84:35305
18:30:39.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:39.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:39.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/data
18:30:39.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/wal
18:30:39.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:30:39.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.195.126:33747,127.30.195.125:40423,127.30.195.124:38627
18:30:39.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:39.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:39.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:30:39.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.195.126:33747
18:30:39.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38807/jwks.json
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/data/info.pb
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.195.126
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/logs
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:30:39.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:30:39.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:39.642719 31514 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:30:39.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:39.644392 31514 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:30:39.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:39.656683 31521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:39.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:39.769405 31491 heartbeater.cc:499] Master 127.30.11.252:39405 was elected leader, sending a full tablet report...
18:30:39.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535439909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:39.926 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=15 ms, finalizationTime=2 ms).
18:30:39.927 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
18:30:40.165 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:40.166 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:40.171 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:40.171 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:40.171 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:40.175 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:40.176 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:40.177 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:40.177 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:40.178 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:40.178 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:40.178 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:40.179 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:40.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535440409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:40.425 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
18:30:40.429 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
18:30:40.765 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:40.766 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:40.767 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:40.768 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:40.768 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:40.768 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:40.768 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:40.768 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:40.768 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:40.769 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:40.770 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:40.770 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:40.770 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:40.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535440909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:40.926 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=15 ms, finalizationTime=2 ms).
18:30:40.928 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
18:30:41.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:39.657171 31522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:41.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.036091 31524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:41.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.039535 31523 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1377 milliseconds
18:30:41.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.039732 31514 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:30:41.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.041385 31514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:30:41.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.044946 31514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:30:41.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.046663 31514 hybrid_clock.cc:648] HybridClock initialized: now 1783535441046567 us; error 82 us; skew 500 ppm
18:30:41.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.049016 31514 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:30:41.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.057430 31514 webserver.cc:534] Webserver started at http://127.30.195.126:46473/ using document root <none> and password file <none>
18:30:41.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.058488 31514 fs_manager.cc:362] Metadata directory not provided
18:30:41.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.058744 31514 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:30:41.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.059382 31514 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:30:41.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.064886 31514 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/data/instance:
18:30:41.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "249a25b616184c978569f1105ae1ad65"
18:30:41.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:41 on dist-test-slave-dxnw"
18:30:41.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.066107 31514 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/wal/instance:
18:30:41.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "249a25b616184c978569f1105ae1ad65"
18:30:41.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:41 on dist-test-slave-dxnw"
18:30:41.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.073917 31514 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.010s	sys 0.000s
18:30:41.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.080060 31533 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:30:41.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.081600 31514 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
18:30:41.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.082008 31514 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/wal
18:30:41.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "249a25b616184c978569f1105ae1ad65"
18:30:41.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:41 on dist-test-slave-dxnw"
18:30:41.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.082469 31514 fs_report.cc:389] FS layout report
18:30:41.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:30:41.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/wal
18:30:41.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/wal
18:30:41.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/data/data
18:30:41.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:30:41.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:30:41.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:30:41.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:30:41.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:30:41.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:30:41.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:30:41.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:30:41.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:30:41.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:30:41.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:30:41.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.146759 31514 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:30:41.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.148891 31514 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:30:41.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.149451 31514 kserver.cc:163] Server-wide thread pool size limit: 3276
18:30:41.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.252127 31514 rpc_server.cc:307] RPC server started. Bound to: 127.30.195.126:33747
18:30:41.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.252177 31584 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.195.126:33747 every 8 connection(s)
18:30:41.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.255896 31514 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/data/info.pb
18:30:41.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.262369 31501 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 31514
18:30:41.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.262924 31501 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-0/wal/instance
18:30:41.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.264518 31585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.267741 31501 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/wal
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/data
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/logs
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/data/info.pb
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.195.125:40423
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.195.125
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.195.84:35305
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:30:41.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.195.126:33747,127.30.195.125:40423,127.30.195.124:38627
18:30:41.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:30:41.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38807/jwks.json with env {}
18:30:41.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.282742 31585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } has no permanent_uuid. Determining permanent_uuid...
18:30:41.305 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:41.306 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:41.306 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:41.307 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:41.307 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:41.307 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:41.309 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:41.309 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:41.309 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:41.310 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:41.310 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:41.310 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:41.310 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:41.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.325094 31585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } has no permanent_uuid. Determining permanent_uuid...
18:30:41.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.328773 31534 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.195.125:40423: connect: Connection refused (error 111)
18:30:41.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.338742 31585 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.125:40423: Network error: Client connection negotiation failed: client connection to 127.30.195.125:40423: connect: Connection refused (error 111)
18:30:41.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.388334 31585 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } attempt: 1
18:30:41.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.393906 31585 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.125:40423: Network error: Client connection negotiation failed: client connection to 127.30.195.125:40423: connect: Connection refused (error 111)
18:30:41.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535441409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:41.427 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=15 ms, finalizationTime=2 ms).
18:30:41.428 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
18:30:41.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.462396 31585 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } attempt: 2
18:30:41.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.468154 31585 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.125:40423: Network error: Client connection negotiation failed: client connection to 127.30.195.125:40423: connect: Connection refused (error 111)
18:30:41.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.559641 31585 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } attempt: 3
18:30:41.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.565714 31585 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.125:40423: Network error: Client connection negotiation failed: client connection to 127.30.195.125:40423: connect: Connection refused (error 111)
18:30:41.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.667297 31587 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:30:41.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.667866 31587 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:30:41.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.668334 31587 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:30:41.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.703476 31587 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:30:41.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.704164 31587 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:30:41.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.704658 31587 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:30:41.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.705180 31587 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:30:41.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.705591 31587 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:30:41.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.705874 31587 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38807/jwks.json
18:30:41.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.709645 31585 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } attempt: 4
18:30:41.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.714962 31585 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.125:40423: Network error: Client connection negotiation failed: client connection to 127.30.195.125:40423: connect: Connection refused (error 111)
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.754932 31587 master_runner.cc:387] Master server non-default flags:
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.195.84:35305
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/data
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/wal
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.195.126:33747,127.30.195.125:40423,127.30.195.124:38627
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.195.125:40423
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38807/jwks.json
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/data/info.pb
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.195.125
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:30:41.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:41.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:30:41.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:30:41.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:41.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/logs
18:30:41.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:41.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:30:41.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:30:41.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:30:41.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:30:41.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:30:41.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:30:41.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:30:41.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:30:41.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:30:41.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.756270 31587 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:30:41.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:41.757833 31587 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:30:41.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.769816 31596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:41.911 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535441910 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:41.921 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:30:41.922 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
18:30:42.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:42.014411 31585 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } attempt: 5
18:30:42.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:42.019429 31585 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.125:40423: Network error: Client connection negotiation failed: client connection to 127.30.195.125:40423: connect: Connection refused (error 111)
18:30:42.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535442409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:42.421 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:30:42.422 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
18:30:42.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:42.566938 31585 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } attempt: 6
18:30:42.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:42.575232 31585 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.125:40423: Network error: Client connection negotiation failed: client connection to 127.30.195.125:40423: connect: Connection refused (error 111)
18:30:42.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535442909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:42.919 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:30:42.920 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
18:30:43.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.775394 31599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:43.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:41.771272 31597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:43.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.118155 31598 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
18:30:43.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.118183 31587 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:30:43.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.122028 31587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:30:43.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.124926 31587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:30:43.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.126333 31587 hybrid_clock.cc:648] HybridClock initialized: now 1783535443126283 us; error 94 us; skew 500 ppm
18:30:43.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.127714 31587 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:30:43.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.134289 31587 webserver.cc:534] Webserver started at http://127.30.195.125:45437/ using document root <none> and password file <none>
18:30:43.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.135419 31587 fs_manager.cc:362] Metadata directory not provided
18:30:43.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.135679 31587 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:30:43.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.136212 31587 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:30:43.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.140666 31587 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/data/instance:
18:30:43.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "98da2049ed2042cc90c686be4a0c1148"
18:30:43.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:43 on dist-test-slave-dxnw"
18:30:43.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.141832 31587 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/wal/instance:
18:30:43.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "98da2049ed2042cc90c686be4a0c1148"
18:30:43.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:43 on dist-test-slave-dxnw"
18:30:43.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.150141 31587 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.010s	sys 0.000s
18:30:43.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.157374 31610 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:30:43.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.158728 31587 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.003s
18:30:43.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.159184 31587 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/wal
18:30:43.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "98da2049ed2042cc90c686be4a0c1148"
18:30:43.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:43 on dist-test-slave-dxnw"
18:30:43.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.159619 31587 fs_report.cc:389] FS layout report
18:30:43.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:30:43.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/wal
18:30:43.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/wal
18:30:43.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/data/data
18:30:43.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:30:43.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:30:43.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:30:43.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:30:43.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:30:43.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:30:43.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:30:43.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:30:43.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:30:43.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:30:43.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:30:43.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.230655 31587 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:30:43.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.232195 31587 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:30:43.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.232602 31587 kserver.cc:163] Server-wide thread pool size limit: 3276
18:30:43.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.314335 31587 rpc_server.cc:307] RPC server started. Bound to: 127.30.195.125:40423
18:30:43.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.314400 31661 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.195.125:40423 every 8 connection(s)
18:30:43.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.317334 31587 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/data/info.pb
18:30:43.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.320123 31501 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 31587
18:30:43.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.320639 31501 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-1/wal/instance
18:30:43.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.324456 31662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:43.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.325137 31501 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:43.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:43.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/wal
18:30:43.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/data
18:30:43.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:30:43.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:30:43.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/logs
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/data/info.pb
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.195.124:38627
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.195.124
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.195.84:35305
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:43.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:43.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:43.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:30:43.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.195.126:33747,127.30.195.125:40423,127.30.195.124:38627
18:30:43.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:30:43.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38807/jwks.json with env {}
18:30:43.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.339854 31662 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } has no permanent_uuid. Determining permanent_uuid...
18:30:43.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.367525 31662 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } has no permanent_uuid. Determining permanent_uuid...
18:30:43.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.383824 31662 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } has no permanent_uuid. Determining permanent_uuid...
18:30:43.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.386837 31613 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.195.124:38627: connect: Connection refused (error 111)
18:30:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.391428 31662 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.124:38627: Network error: Client connection negotiation failed: client connection to 127.30.195.124:38627: connect: Connection refused (error 111)
18:30:43.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535443409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:43.420 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:30:43.421 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
18:30:43.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.440984 31662 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } attempt: 1
18:30:43.445 [DEBUG - pool-12-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] sending RPC to server master-127.28.68.190:40429, [4ms] received response from server master-127.28.68.190:40429: OK, deferred=null) with no deferred attached!
18:30:43.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.446642 31662 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.124:38627: Network error: Client connection negotiation failed: client connection to 127.30.195.124:38627: connect: Connection refused (error 111)
18:30:43.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.515141 31662 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } attempt: 2
18:30:43.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.519582 31662 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.124:38627: Network error: Client connection negotiation failed: client connection to 127.30.195.124:38627: connect: Connection refused (error 111)
18:30:43.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.611025 31662 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } attempt: 3
18:30:43.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.616003 31662 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.124:38627: Network error: Client connection negotiation failed: client connection to 127.30.195.124:38627: connect: Connection refused (error 111)
18:30:43.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.635855 31585 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } attempt: 7
18:30:43.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.648350 31585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } has no permanent_uuid. Determining permanent_uuid...
18:30:43.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.654963 31585 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.124:38627: Network error: Client connection negotiation failed: client connection to 127.30.195.124:38627: connect: Connection refused (error 111)
18:30:43.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.675338 31664 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:30:43.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.676159 31664 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:30:43.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.676685 31664 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:30:43.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.710763 31664 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:30:43.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.711585 31664 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:30:43.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.712131 31664 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:30:43.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.712530 31664 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:30:43.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.712896 31664 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:30:43.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.713071 31664 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38807/jwks.json
18:30:43.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.713414 31585 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } attempt: 1
18:30:43.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.718330 31585 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.124:38627: Network error: Client connection negotiation failed: client connection to 127.30.195.124:38627: connect: Connection refused (error 111)
18:30:43.725 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:43.726 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:43.726 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:43.726 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:43.727 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:43.727 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:43.727 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:43.727 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:43.727 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:43.728 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:43.728 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:43.728 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:43.728 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.753670 31664 master_runner.cc:387] Master server non-default flags:
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.195.84:35305
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/data
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/wal
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.195.126:33747,127.30.195.125:40423,127.30.195.124:38627
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.195.124:38627
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38807/jwks.json
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/data/info.pb
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.195.124
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:43.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/logs
18:30:43.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:43.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:30:43.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:30:43.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:30:43.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:30:43.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:30:43.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:30:43.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:30:43.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:30:43.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:30:43.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.755402 31664 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:30:43.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.757086 31664 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:30:43.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.759435 31662 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } attempt: 4
18:30:43.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.764111 31662 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.124:38627: Network error: Client connection negotiation failed: client connection to 127.30.195.124:38627: connect: Connection refused (error 111)
18:30:43.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.769316 31676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:43.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.799773 31585 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } attempt: 2
18:30:43.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.809454 31585 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.124:38627: Network error: Client connection negotiation failed: client connection to 127.30.195.124:38627: connect: Connection refused (error 111)
18:30:43.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:43.895098 31585 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } attempt: 3
18:30:43.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535443909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:43.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.914108 31585 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.124:38627: Network error: Client connection negotiation failed: client connection to 127.30.195.124:38627: connect: Connection refused (error 111)
18:30:43.932 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=22 ms, finalizationTime=1 ms).
18:30:43.933 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
18:30:44.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:44.054716 31585 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } attempt: 4
18:30:44.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:44.063609 31662 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } attempt: 5
18:30:44.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:44.067793 31585 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.124:38627: Network error: Client connection negotiation failed: client connection to 127.30.195.124:38627: connect: Connection refused (error 111)
18:30:44.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:44.069799 31662 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.124:38627: Network error: Client connection negotiation failed: client connection to 127.30.195.124:38627: connect: Connection refused (error 111)
18:30:44.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:44.351434 31585 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } attempt: 5
18:30:44.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:44.360466 31585 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.124:38627: Network error: Client connection negotiation failed: client connection to 127.30.195.124:38627: connect: Connection refused (error 111)
18:30:44.411 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535444410 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:44.430 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
18:30:44.431 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
18:30:44.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:44.617362 31662 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } attempt: 6
18:30:44.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:44.650025 31662 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.124:38627: Network error: Client connection negotiation failed: client connection to 127.30.195.124:38627: connect: Connection refused (error 111)
18:30:44.684 [DEBUG - pool-16-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30007), Traces: [0ms] sending RPC to server master-127.28.250.126:43415, [5ms] received response from server master-127.28.250.126:43415: OK, deferred=null) with no deferred attached!
18:30:44.685 [DEBUG - pool-16-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30002), Traces: [0ms] sending RPC to server master-127.28.250.126:43415, [7ms] received response from server master-127.28.250.126:43415: OK, deferred=null) with no deferred attached!
18:30:44.703 [DEBUG - pool-16-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30020), Traces: [0ms] sending RPC to server master-127.28.250.126:43415, [9ms] received response from server master-127.28.250.126:43415: OK, deferred=null) with no deferred attached!
18:30:44.709 [DEBUG - pool-14-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.28.250.126:43415, [5ms] received response from server master-127.28.250.126:43415: OK, deferred=null) with no deferred attached!
18:30:44.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:44.913041 31585 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } attempt: 6
18:30:44.916 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535444909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:44.937 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=27 ms, finalizationTime=1 ms).
18:30:44.938 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
18:30:44.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:44.994143 31585 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.124:38627: Network error: Client connection negotiation failed: client connection to 127.30.195.124:38627: connect: Connection refused (error 111)
18:30:45.285 [DEBUG - pool-12-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.28.68.190:40429, [3ms] received response from server master-127.28.68.190:40429: OK, deferred=null) with no deferred attached!
18:30:45.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535445409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:45.433 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=23 ms, finalizationTime=1 ms).
18:30:45.434 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
18:30:45.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:45.171717 31675 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 31664
18:30:45.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:45.641333 31664 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.871s	user 0.663s	sys 1.051s
18:30:45.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:45.641659 31664 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.872s	user 0.663s	sys 1.051s
18:30:45.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:43.770541 31677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:45.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:45.642773 31678 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1871 milliseconds
18:30:45.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:45.644057 31679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:45.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.644079 31664 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:30:45.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.647634 31664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:30:45.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.650050 31664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:30:45.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.651422 31664 hybrid_clock.cc:648] HybridClock initialized: now 1783535445651376 us; error 36 us; skew 500 ppm
18:30:45.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.652244 31664 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:30:45.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.658442 31664 webserver.cc:534] Webserver started at http://127.30.195.124:35731/ using document root <none> and password file <none>
18:30:45.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.659473 31664 fs_manager.cc:362] Metadata directory not provided
18:30:45.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.659662 31664 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:30:45.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.660044 31664 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:30:45.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.664503 31664 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/data/instance:
18:30:45.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "243cf868a7334e958f387067830e97f9"
18:30:45.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:45 on dist-test-slave-dxnw"
18:30:45.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.665704 31664 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/wal/instance:
18:30:45.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "243cf868a7334e958f387067830e97f9"
18:30:45.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:45 on dist-test-slave-dxnw"
18:30:45.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.673746 31664 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.010s	sys 0.000s
18:30:45.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.679821 31697 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:30:45.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.680963 31664 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
18:30:45.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.681234 31664 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/wal
18:30:45.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "243cf868a7334e958f387067830e97f9"
18:30:45.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:45 on dist-test-slave-dxnw"
18:30:45.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.681533 31664 fs_report.cc:389] FS layout report
18:30:45.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:30:45.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/wal
18:30:45.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/wal
18:30:45.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/data/data
18:30:45.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:30:45.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:30:45.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:30:45.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:30:45.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:30:45.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:30:45.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:30:45.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:30:45.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:30:45.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:30:45.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:30:45.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.710588 31662 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } attempt: 7
18:30:45.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:45.719425 31662 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.195.124:38627: Network error: Client connection negotiation failed: client connection to 127.30.195.124:38627: connect: Connection refused (error 111)
18:30:45.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.757265 31664 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:30:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.758876 31664 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:30:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.759299 31664 kserver.cc:163] Server-wide thread pool size limit: 3276
18:30:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.837709 31664 rpc_server.cc:307] RPC server started. Bound to: 127.30.195.124:38627
18:30:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.837746 31750 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.195.124:38627 every 8 connection(s)
18:30:45.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.840786 31664 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/data/info.pb
18:30:45.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.847267 31751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:45.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.850039 31501 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 31664
18:30:45.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.850476 31501 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/master-2/wal/instance
18:30:45.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.863060 31751 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } has no permanent_uuid. Determining permanent_uuid...
18:30:45.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.899906 31751 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } has no permanent_uuid. Determining permanent_uuid...
18:30:45.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535445909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:45.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.916352 31751 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } has no permanent_uuid. Determining permanent_uuid...
18:30:45.929 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
18:30:45.933 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
18:30:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.942920 31751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9: Bootstrap starting.
18:30:45.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.949229 31751 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9: Neither blocks nor log segments found. Creating new log.
18:30:45.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.951362 31751 log.cc:826] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9: Log is configured to *not* fsync() on all Append() calls
18:30:45.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.956384 31751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9: No bootstrap required, opened a new log
18:30:45.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.976020 31751 raft_consensus.cc:359] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } }
18:30:45.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.976683 31751 raft_consensus.cc:385] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:45.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.976994 31751 raft_consensus.cc:740] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 243cf868a7334e958f387067830e97f9, State: Initialized, Role: FOLLOWER
18:30:45.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.977805 31751 consensus_queue.cc:260] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } }
18:30:45.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.980561 31761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } } }
18:30:45.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.981317 31761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [sys.catalog]: This master's current role is: FOLLOWER
18:30:45.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:45.982636 31751 sys_catalog.cc:565] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [sys.catalog]: configured and running, proceeding with master startup.
18:30:46.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:46.011610 31772 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:30:46.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:46.012008 31772 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:30:46.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:46.014552 31705 tablet.cc:2406] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:30:46.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.027705 31585 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } attempt: 7
18:30:46.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.007815 31664 master_runner.cc:187] Error getting master registration for 127.30.195.126:33747: OK, instance_id { permanent_uuid: "249a25b616184c978569f1105ae1ad65" instance_seqno: 1783535441220280 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:30:46.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.040608 31664 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:30:46.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.056948 31585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65: Bootstrap starting.
18:30:46.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.064918 31585 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65: Neither blocks nor log segments found. Creating new log.
18:30:46.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.067246 31585 log.cc:826] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65: Log is configured to *not* fsync() on all Append() calls
18:30:46.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.073412 31585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65: No bootstrap required, opened a new log
18:30:46.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.101827 31585 raft_consensus.cc:359] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } }
18:30:46.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.102768 31585 raft_consensus.cc:385] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:46.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.103116 31585 raft_consensus.cc:740] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 249a25b616184c978569f1105ae1ad65, State: Initialized, Role: FOLLOWER
18:30:46.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.104203 31585 consensus_queue.cc:260] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } }
18:30:46.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.107535 31776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } } }
18:30:46.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.108769 31776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65 [sys.catalog]: This master's current role is: FOLLOWER
18:30:46.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.109774 31585 sys_catalog.cc:565] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65 [sys.catalog]: configured and running, proceeding with master startup.
18:30:46.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:46.147351 31788 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:30:46.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:46.148156 31788 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:30:46.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:46.166690 31539 tablet.cc:2406] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:30:46.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.143399 31514 master_runner.cc:187] Error getting master registration for 127.30.195.125:40423: OK, instance_id { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" instance_seqno: 1783535443292645 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:30:46.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.174469 31514 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:30:46.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.185948 31761 raft_consensus.cc:493] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:30:46.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.186502 31761 raft_consensus.cc:515] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } }
18:30:46.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.190217 31560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "243cf868a7334e958f387067830e97f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "249a25b616184c978569f1105ae1ad65" is_pre_election: true
18:30:46.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.191254 31560 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 243cf868a7334e958f387067830e97f9 in term 0.
18:30:46.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.192806 31703 leader_election.cc:304] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 243cf868a7334e958f387067830e97f9, 249a25b616184c978569f1105ae1ad65; no voters: 
18:30:46.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.194137 31761 leader_election.cc:290] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 249a25b616184c978569f1105ae1ad65 (127.30.195.126:33747), 98da2049ed2042cc90c686be4a0c1148 (127.30.195.125:40423)
18:30:46.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.194674 31761 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:30:46.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.195063 31761 raft_consensus.cc:493] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:30:46.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.195448 31761 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [term 0 FOLLOWER]: Advancing to term 1
18:30:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.202435 31761 raft_consensus.cc:515] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } }
18:30:46.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.204704 31761 leader_election.cc:290] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [CANDIDATE]: Term 1 election: Requested vote from peers 249a25b616184c978569f1105ae1ad65 (127.30.195.126:33747), 98da2049ed2042cc90c686be4a0c1148 (127.30.195.125:40423)
18:30:46.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.216918 31560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "243cf868a7334e958f387067830e97f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "249a25b616184c978569f1105ae1ad65"
18:30:46.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.217514 31560 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65 [term 0 FOLLOWER]: Advancing to term 1
18:30:46.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.224617 31560 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 243cf868a7334e958f387067830e97f9 in term 1.
18:30:46.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.228678 31703 leader_election.cc:304] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 243cf868a7334e958f387067830e97f9, 249a25b616184c978569f1105ae1ad65; no voters: 
18:30:46.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.229748 31790 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [term 1 FOLLOWER]: Leader election won for term 1
18:30:46.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.230235 31790 raft_consensus.cc:697] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [term 1 LEADER]: Becoming Leader. State: Replica: 243cf868a7334e958f387067830e97f9, State: Running, Role: LEADER
18:30:46.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.231159 31790 consensus_queue.cc:237] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } }
18:30:46.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.262650 31761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 243cf868a7334e958f387067830e97f9. Latest consensus state: current_term: 1 leader_uuid: "243cf868a7334e958f387067830e97f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } } }
18:30:46.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.263641 31761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [sys.catalog]: This master's current role is: LEADER
18:30:46.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.277956 31792 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:30:46.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.290809 31792 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:30:46.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.351274 31560 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65 [term 1 FOLLOWER]: Refusing update from remote peer 243cf868a7334e958f387067830e97f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:30:46.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.353139 31761 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:30:46.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.397889 31793 mvcc.cc:204] Tried to move back new op lower bound from 7305361188229464064 to 7305361187777478656. Current Snapshot: MvccSnapshot[applied={T|T < 7305361188229464064}]
18:30:46.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.398586 31776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 243cf868a7334e958f387067830e97f9. Latest consensus state: current_term: 1 leader_uuid: "243cf868a7334e958f387067830e97f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } } }
18:30:46.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.400967 31776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65 [sys.catalog]: This master's current role is: FOLLOWER
18:30:46.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535446409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:46.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.410055 31776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "243cf868a7334e958f387067830e97f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } } }
18:30:46.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.410386 31790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "243cf868a7334e958f387067830e97f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } } }
18:30:46.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.411159 31790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [sys.catalog]: This master's current role is: LEADER
18:30:46.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.411196 31776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65 [sys.catalog]: This master's current role is: FOLLOWER
18:30:46.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.414497 31792 catalog_manager.cc:1382] Generated new cluster ID: a27104ca557b4a2481748c29c6e42496
18:30:46.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.414778 31792 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:30:46.425 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
18:30:46.427 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
18:30:46.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.454551 31792 catalog_manager.cc:1405] Generated new certificate authority record
18:30:46.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.456907 31792 catalog_manager.cc:1539] Loading token signing keys...
18:30:46.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.484112 31792 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9: Generated new TSK 0
18:30:46.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.486259 31792 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:30:46.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:46.509302 31501 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:46.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:46.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/wal
18:30:46.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/data
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/logs
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/data/info.pb
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.195.65:0
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.195.65
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.195.65
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.195.126:33747,127.30.195.125:40423,127.30.195.124:38627
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.195.84:35305
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:46.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:30:46.546 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:46.547 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:46.548 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:46.549 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:46.549 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:46.549 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:46.550 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:46.550 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:46.551 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:46.551 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:46.551 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:46.551 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:46.551 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:46.910 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535446909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:46.926 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
18:30:46.928 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
18:30:47.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:47.133368 31798 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:30:47.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:47.134326 31798 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:30:47.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:47.135277 31798 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:30:47.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:47.153789 31788 catalog_manager.cc:1294] Loaded cluster ID: a27104ca557b4a2481748c29c6e42496
18:30:47.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:47.154049 31788 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65: loading cluster ID for follower catalog manager: success
18:30:47.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:47.196774 31798 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:30:47.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:47.198537 31798 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.195.65
18:30:47.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:47.206532 31788 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65: acquiring CA information for follower catalog manager: success
18:30:47.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:47.248404 31788 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 249a25b616184c978569f1105ae1ad65: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:30:47.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:47.268253 31798 tablet_server_runner.cc:78] Tablet server non-default flags:
18:30:47.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.195.84:35305
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/data
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/wal
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.195.65:0
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/data/info.pb
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.195.65
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.195.126:33747,127.30.195.125:40423,127.30.195.124:38627
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.195.65
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/logs
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:30:47.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:30:47.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:30:47.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:30:47.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:30:47.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:30:47.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:30:47.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:47.271925 31798 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:30:47.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:47.274397 31798 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:30:47.285 [DEBUG - pool-12-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.28.68.190:40429, [6ms] received response from server master-127.28.68.190:40429: OK, deferred=null) with no deferred attached!
18:30:47.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:47.304400 31807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:47.366 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:47.366 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:47.367 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:47.368 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:47.368 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:47.368 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:47.368 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:47.369 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:47.369 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:47.369 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:47.369 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:47.369 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:47.370 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:47.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535447409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:47.423 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
18:30:47.424 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
18:30:47.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:47.809957 31662 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } attempt: 8
18:30:47.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:47.821313 31700 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.195.125:40423 timed out after 1.626s (SENT)
18:30:47.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:47.882941 31662 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148: Bootstrap starting.
18:30:47.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:47.898967 31662 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148: Neither blocks nor log segments found. Creating new log.
18:30:47.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:47.908342 31662 log.cc:826] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148: Log is configured to *not* fsync() on all Append() calls
18:30:47.909 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535447909 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:47.925 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:47.926 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:47.926 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:47.927 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:47.927 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:47.928 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:47.928 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:47.928 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:47.929 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:47.930 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
18:30:47.931 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
18:30:47.932 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:47.932 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:47.932 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:47.932 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:47.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:47.961369 31662 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148: No bootstrap required, opened a new log
18:30:48.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.017570 31662 raft_consensus.cc:359] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } }
18:30:48.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.035027 31662 raft_consensus.cc:385] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:48.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.035753 31662 raft_consensus.cc:740] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98da2049ed2042cc90c686be4a0c1148, State: Initialized, Role: FOLLOWER
18:30:48.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.037289 31662 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } }
18:30:48.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.050323 31820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } } }
18:30:48.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.057535 31820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148 [sys.catalog]: This master's current role is: FOLLOWER
18:30:48.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.057076 31662 sys_catalog.cc:565] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148 [sys.catalog]: configured and running, proceeding with master startup.
18:30:48.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.058583 31633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "243cf868a7334e958f387067830e97f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98da2049ed2042cc90c686be4a0c1148"
18:30:48.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.059557 31633 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148 [term 0 FOLLOWER]: Advancing to term 1
18:30:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.063161 31634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "243cf868a7334e958f387067830e97f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98da2049ed2042cc90c686be4a0c1148" is_pre_election: true
18:30:48.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.065196 31636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "243cf868a7334e958f387067830e97f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98da2049ed2042cc90c686be4a0c1148"
18:30:48.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:48.066542 31636 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44402 (request call id 2) took 1861 ms (client timeout 1652 ms). Trace:
18:30:48.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.057346 31637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "243cf868a7334e958f387067830e97f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98da2049ed2042cc90c686be4a0c1148" is_pre_election: true
18:30:48.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:48.068339 31637 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44402 (request call id 1) took 1874 ms (client timeout 1626 ms). Trace:
18:30:48.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:48.068806 31637 rpcz_store.cc:269] 0708 18:30:46.194376 (+     0us) service_pool.cc:167] Inserting onto call queue
18:30:48.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:46.194513 (+   137us) service_pool.cc:224] Handling call
18:30:48.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:48.068247 (+1873734us) inbound_call.cc:177] Queueing success response
18:30:48.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
18:30:48.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:48.067107 31636 rpcz_store.cc:269] 0708 18:30:46.210117 (+     0us) service_pool.cc:167] Inserting onto call queue
18:30:48.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:46.210577 (+   460us) service_pool.cc:224] Handling call
18:30:48.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:48.066430 (+1855853us) inbound_call.cc:177] Queueing success response
18:30:48.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
18:30:48.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.099906 31633 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 243cf868a7334e958f387067830e97f9 in term 1.
18:30:48.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.106521 31635 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148 [term 1 FOLLOWER]: Refusing update from remote peer 243cf868a7334e958f387067830e97f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:30:48.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.129473 31635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44402 (request call id 3) took 1781 ms. Trace:
18:30:48.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.130023 31635 rpcz_store.cc:276] 0708 18:30:46.348291 (+     0us) service_pool.cc:167] Inserting onto call queue
18:30:48.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:46.348789 (+   498us) service_pool.cc:224] Handling call
18:30:48.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:48.105642 (+1756853us) raft_consensus.cc:1471] Updating replica for 0 ops
18:30:48.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:48.107053 (+  1411us) raft_consensus.cc:1697] Filling consensus response to leader.
18:30:48.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:48.129044 (+ 21991us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b5400030550. stack: 00007f7d2fdd3803 00007f7d2fdd3700 00007f7d2f9844b4 000000000050eb44 000000000050ead9 00007f7d36eb8891 00007f7d36f4ebcd 00007f7d37f7f9c9 00007f7d36631cf4 00007f7d36631c82 00007f7d36631bb1 00007f7d36631b2c 00007f7d36630de2 00007f7d34c1eaac 00007f7d34c1dee6 00007f7d34c1d88f
18:30:48.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:48.129384 (+   340us) inbound_call.cc:177] Queueing success response
18:30:48.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"spinlock_wait_cycles":81315712}
18:30:48.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.132644 31814 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:30:48.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.256312 31820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 243cf868a7334e958f387067830e97f9. Latest consensus state: current_term: 1 leader_uuid: "243cf868a7334e958f387067830e97f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } } }
18:30:48.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.257036 31820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148 [sys.catalog]: This master's current role is: FOLLOWER
18:30:48.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.256489 31833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "243cf868a7334e958f387067830e97f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } } }
18:30:48.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.257647 31833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148 [sys.catalog]: This master's current role is: FOLLOWER
18:30:48.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.269802 31836 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
18:30:48.410 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 69 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535448409 for job fa73e37017778341a79e5b3ef3d55eb9.
18:30:48.424 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 69 for job fa73e37017778341a79e5b3ef3d55eb9 (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
18:30:48.426 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 69 as completed for source Source: KuduSource.
18:30:48.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.602232 31837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "243cf868a7334e958f387067830e97f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249a25b616184c978569f1105ae1ad65" member_type: VOTER last_known_addr { host: "127.30.195.126" port: 33747 } } peers { permanent_uuid: "98da2049ed2042cc90c686be4a0c1148" member_type: VOTER last_known_addr { host: "127.30.195.125" port: 40423 } } peers { permanent_uuid: "243cf868a7334e958f387067830e97f9" member_type: VOTER last_known_addr { host: "127.30.195.124" port: 38627 } } }
18:30:48.606 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:48.606 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:48.607 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:48.607 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.607 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.608 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.616 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.616 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.616 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.617 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.617 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.617 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.618 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:48.619 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=28, TimeoutTracker(timeout=30000, elapsed=29354), Traces: [0ms] sending RPC to server master-127.28.68.190:40429, [3ms] received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [4ms] delaying RPC due to: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [22ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [26ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [28ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [32ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [41ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [45ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [46ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [48ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [49ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [64ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [66ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [66ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [84ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [85ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [85ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [85ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [125ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [125ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [166ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [284ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [284ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [286ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [286ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [341ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [363ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [721ms] refreshing cache from master, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [723ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [723ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [724ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [725ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [726ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [726ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1342ms] refreshing cache from master, [1342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1345ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3042ms] refreshing cache from master, [3042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3043ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3044ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3045ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [3045ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [3047ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3048ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [5822ms] refreshing cache from master, [5823ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [5824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [5824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [5824ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [5826ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [5828ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [5829ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [7102ms] refreshing cache from master, [7102ms] too many traces: truncated at 100 traces, deferred=Deferred@1047674529(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@2b7d4e90 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@409062645 after retry RPC after error@497812557) -> (continuation of Deferred@839165551 after retry RPC after error@1942779761) -> (continuation of Deferred@1708923801 after retry RPC after error@414184707) -> (continuation of Deferred@252645287 after retry RPC after error@526943944) -> (continuation of Deferred@451761775 after retry RPC after error@2098048988) -> (continuation of Deferred@168355309 after retry RPC after error@1359838370) -> (continuation of Deferred@564332226 after retry RPC after error@834678373) -> (continuation of Deferred@2091553341 after retry RPC after error@1182271846) -> (continuation of Deferred@2136248957 after retry RPC after error@1331112180) -> (continuation of Deferred@1740927065 after retry RPC after error@1643214590) -> (continuation of Deferred@988661703 after retry RPC after error@1284196582) -> (continuation of Deferred@143241110 after retry RPC after error@1646624511) -> (continuation of Deferred@908222083 after retry RPC after error@544799961) -> (continuation of Deferred@1699222111 after retry RPC after error@752048783) -> (continuation of Deferred@144826320 after retry RPC after error@1876456489) -> (continuation of Deferred@1252481383 after retry RPC after error@2090235294) -> (continuation of Deferred@2060417667 after retry RPC after error@1452945615) -> (continuation of Deferred@646330138 after retry RPC after error@1769180369) -> (continuation of Deferred@1751771166 after retry RPC after error@1878172052) -> (continuation of Deferred@2027648407 after retry RPC after error@230386521) -> (continuation of Deferred@708140008 after retry RPC after error@1345433915) -> (continuation of Deferred@1944387943 after retry RPC after error@634543585) -> (continuation of Deferred@624470184 after retry RPC after error@2019392861) -> (continuation of Deferred@594064648 after retry RPC after error@350411217) -> (continuation of Deferred@1954504205 after retry RPC after error@1742434890) -> (continuation of Deferred@24988492 after retry RPC after error@64173795), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@409062645 after retry RPC after error@497812557) -> (continuation of Deferred@839165551 after retry RPC after error@1942779761) -> (continuation of Deferred@1708923801 after retry RPC after error@414184707) -> (continuation of Deferred@252645287 after retry RPC after error@526943944) -> (continuation of Deferred@451761775 after retry RPC after error@2098048988) -> (continuation of Deferred@168355309 after retry RPC after error@1359838370) -> (continuation of Deferred@564332226 after retry RPC after error@834678373) -> (continuation of Deferred@2091553341 after retry RPC after error@1182271846) -> (continuation of Deferred@2136248957 after retry RPC after error@1331112180) -> (continuation of Deferred@1740927065 after retry RPC after error@1643214590) -> (continuation of Deferred@988661703 after retry RPC after error@1284196582) -> (continuation of Deferred@143241110 after retry RPC after error@1646624511) -> (continuation of Deferred@908222083 after retry RPC after error@544799961) -> (continuation of Deferred@1699222111 after retry RPC after error@752048783) -> (continuation of Deferred@144826320 after retry RPC after error@1876456489) -> (continuation of Deferred@1252481383 after retry RPC after error@2090235294) -> (continuation of Deferred@2060417667 after retry RPC after error@1452945615) -> (continuation of Deferred@646330138 after retry RPC after error@1769180369) -> (continuation of Deferred@1751771166 after retry RPC after error@1878172052) -> (continuation of Deferred@2027648407 after retry RPC after error@230386521) -> (continuation of Deferred@708140008 after retry RPC after error@1345433915) -> (continuation of Deferred@1944387943 after retry RPC after error@634543585) -> (continuation of Deferred@624470184 after retry RPC after error@2019392861) -> (continuation of Deferred@594064648 after retry RPC after error@350411217) -> (continuation of Deferred@1954504205 after retry RPC after error@1742434890) -> (continuation of Deferred@24988492 after retry RPC after error@64173795)))
18:30:48.621 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:48.621 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:48.621 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=28, TimeoutTracker(timeout=30000, elapsed=29354), Traces: [0ms] sending RPC to server master-127.28.68.190:40429, [3ms] received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [4ms] delaying RPC due to: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [22ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [26ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [28ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [32ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [41ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [45ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [46ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [48ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [49ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [64ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [66ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [66ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [84ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [85ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [85ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [85ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [125ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [125ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [166ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [284ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [284ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [286ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [286ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [341ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [363ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [721ms] refreshing cache from master, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [723ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [723ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [724ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [725ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [726ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [726ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1342ms] refreshing cache from master, [1342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1345ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3042ms] refreshing cache from master, [3042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3043ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3044ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3045ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [3045ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [3047ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3048ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [5822ms] refreshing cache from master, [5823ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [5824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [5824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [5824ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [5826ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [5828ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [5829ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [7102ms] refreshing cache from master, [7102ms] too many traces: truncated at 100 traces, deferred=Deferred@1047674529(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@2b7d4e90 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@409062645 after retry RPC after error@497812557) -> (continuation of Deferred@839165551 after retry RPC after error@1942779761) -> (continuation of Deferred@1708923801 after retry RPC after error@414184707) -> (continuation of Deferred@252645287 after retry RPC after error@526943944) -> (continuation of Deferred@451761775 after retry RPC after error@2098048988) -> (continuation of Deferred@168355309 after retry RPC after error@1359838370) -> (continuation of Deferred@564332226 after retry RPC after error@834678373) -> (continuation of Deferred@2091553341 after retry RPC after error@1182271846) -> (continuation of Deferred@2136248957 after retry RPC after error@1331112180) -> (continuation of Deferred@1740927065 after retry RPC after error@1643214590) -> (continuation of Deferred@988661703 after retry RPC after error@1284196582) -> (continuation of Deferred@143241110 after retry RPC after error@1646624511) -> (continuation of Deferred@908222083 after retry RPC after error@544799961) -> (continuation of Deferred@1699222111 after retry RPC after error@752048783) -> (continuation of Deferred@144826320 after retry RPC after error@1876456489) -> (continuation of Deferred@1252481383 after retry RPC after error@2090235294) -> (continuation of Deferred@2060417667 after retry RPC after error@1452945615) -> (continuation of Deferred@646330138 after retry RPC after error@1769180369) -> (continuation of Deferred@1751771166 after retry RPC after error@1878172052) -> (continuation of Deferred@2027648407 after retry RPC after error@230386521) -> (continuation of Deferred@708140008 after retry RPC after error@1345433915) -> (continuation of Deferred@1944387943 after retry RPC after error@634543585) -> (continuation of Deferred@624470184 after retry RPC after error@2019392861) -> (continuation of Deferred@594064648 after retry RPC after error@350411217) -> (continuation of Deferred@1954504205 after retry RPC after error@1742434890) -> (continuation of Deferred@24988492 after retry RPC after error@64173795), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@409062645 after retry RPC after error@497812557) -> (continuation of Deferred@839165551 after retry RPC after error@1942779761) -> (continuation of Deferred@1708923801 after retry RPC after error@414184707) -> (continuation of Deferred@252645287 after retry RPC after error@526943944) -> (continuation of Deferred@451761775 after retry RPC after error@2098048988) -> (continuation of Deferred@168355309 after retry RPC after error@1359838370) -> (continuation of Deferred@564332226 after retry RPC after error@834678373) -> (continuation of Deferred@2091553341 after retry RPC after error@1182271846) -> (continuation of Deferred@2136248957 after retry RPC after error@1331112180) -> (continuation of Deferred@1740927065 after retry RPC after error@1643214590) -> (continuation of Deferred@988661703 after retry RPC after error@1284196582) -> (continuation of Deferred@143241110 after retry RPC after error@1646624511) -> (continuation of Deferred@908222083 after retry RPC after error@544799961) -> (continuation of Deferred@1699222111 after retry RPC after error@752048783) -> (continuation of Deferred@144826320 after retry RPC after error@1876456489) -> (continuation of Deferred@1252481383 after retry RPC after error@2090235294) -> (continuation of Deferred@2060417667 after retry RPC after error@1452945615) -> (continuation of Deferred@646330138 after retry RPC after error@1769180369) -> (continuation of Deferred@1751771166 after retry RPC after error@1878172052) -> (continuation of Deferred@2027648407 after retry RPC after error@230386521) -> (continuation of Deferred@708140008 after retry RPC after error@1345433915) -> (continuation of Deferred@1944387943 after retry RPC after error@634543585) -> (continuation of Deferred@624470184 after retry RPC after error@2019392861) -> (continuation of Deferred@594064648 after retry RPC after error@350411217) -> (continuation of Deferred@1954504205 after retry RPC after error@1742434890) -> (continuation of Deferred@24988492 after retry RPC after error@64173795)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=28, TimeoutTracker(timeout=30000, elapsed=29354), Traces: [0ms] sending RPC to server master-127.28.68.190:40429, [3ms] received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [4ms] delaying RPC due to: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [22ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [26ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [28ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [32ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [41ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [45ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [46ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [48ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [49ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [64ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [66ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [66ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [84ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [85ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [85ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [85ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [125ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [125ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [166ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [284ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [284ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [286ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [286ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [341ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [363ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [721ms] refreshing cache from master, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [723ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [723ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [724ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [725ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [726ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [726ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1342ms] refreshing cache from master, [1342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1345ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3042ms] refreshing cache from master, [3042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3043ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3044ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3045ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [3045ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [3047ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3048ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [5822ms] refreshing cache from master, [5823ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [5824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [5824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [5824ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [5826ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [5828ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [5829ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [7102ms] refreshing cache from master, [7102ms] too many traces: truncated at 100 traces, deferred=Deferred@1047674529(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@2b7d4e90 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@409062645 after retry RPC after error@497812557) -> (continuation of Deferred@839165551 after retry RPC after error@1942779761) -> (continuation of Deferred@1708923801 after retry RPC after error@414184707) -> (continuation of Deferred@252645287 after retry RPC after error@526943944) -> (continuation of Deferred@451761775 after retry RPC after error@2098048988) -> (continuation of Deferred@168355309 after retry RPC after error@1359838370) -> (continuation of Deferred@564332226 after retry RPC after error@834678373) -> (continuation of Deferred@2091553341 after retry RPC after error@1182271846) -> (continuation of Deferred@2136248957 after retry RPC after error@1331112180) -> (continuation of Deferred@1740927065 after retry RPC after error@1643214590) -> (continuation of Deferred@988661703 after retry RPC after error@1284196582) -> (continuation of Deferred@143241110 after retry RPC after error@1646624511) -> (continuation of Deferred@908222083 after retry RPC after error@544799961) -> (continuation of Deferred@1699222111 after retry RPC after error@752048783) -> (continuation of Deferred@144826320 after retry RPC after error@1876456489) -> (continuation of Deferred@1252481383 after retry RPC after error@2090235294) -> (continuation of Deferred@2060417667 after retry RPC after error@1452945615) -> (continuation of Deferred@646330138 after retry RPC after error@1769180369) -> (continuation of Deferred@1751771166 after retry RPC after error@1878172052) -> (continuation of Deferred@2027648407 after retry RPC after error@230386521) -> (continuation of Deferred@708140008 after retry RPC after error@1345433915) -> (continuation of Deferred@1944387943 after retry RPC after error@634543585) -> (continuation of Deferred@624470184 after retry RPC after error@2019392861) -> (continuation of Deferred@594064648 after retry RPC after error@350411217) -> (continuation of Deferred@1954504205 after retry RPC after error@1742434890) -> (continuation of Deferred@24988492 after retry RPC after error@64173795), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@409062645 after retry RPC after error@497812557) -> (continuation of Deferred@839165551 after retry RPC after error@1942779761) -> (continuation of Deferred@1708923801 after retry RPC after error@414184707) -> (continuation of Deferred@252645287 after retry RPC after error@526943944) -> (continuation of Deferred@451761775 after retry RPC after error@2098048988) -> (continuation of Deferred@168355309 after retry RPC after error@1359838370) -> (continuation of Deferred@564332226 after retry RPC after error@834678373) -> (continuation of Deferred@2091553341 after retry RPC after error@1182271846) -> (continuation of Deferred@2136248957 after retry RPC after error@1331112180) -> (continuation of Deferred@1740927065 after retry RPC after error@1643214590) -> (continuation of Deferred@988661703 after retry RPC after error@1284196582) -> (continuation of Deferred@143241110 after retry RPC after error@1646624511) -> (continuation of Deferred@908222083 after retry RPC after error@544799961) -> (continuation of Deferred@1699222111 after retry RPC after error@752048783) -> (continuation of Deferred@144826320 after retry RPC after error@1876456489) -> (continuation of Deferred@1252481383 after retry RPC after error@2090235294) -> (continuation of Deferred@2060417667 after retry RPC after error@1452945615) -> (continuation of Deferred@646330138 after retry RPC after error@1769180369) -> (continuation of Deferred@1751771166 after retry RPC after error@1878172052) -> (continuation of Deferred@2027648407 after retry RPC after error@230386521) -> (continuation of Deferred@708140008 after retry RPC after error@1345433915) -> (continuation of Deferred@1944387943 after retry RPC after error@634543585) -> (continuation of Deferred@624470184 after retry RPC after error@2019392861) -> (continuation of Deferred@594064648 after retry RPC after error@350411217) -> (continuation of Deferred@1954504205 after retry RPC after error@1742434890) -> (continuation of Deferred@24988492 after retry RPC after error@64173795)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.68.189:33753
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:30:48.622 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.622 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.623 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.622 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:48.623 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.623 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.623 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.623 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.623 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.624 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.624 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:48.625 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:48.625 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:48.626 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:48.627 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.627 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.627 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.627 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.627 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.628 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.629 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.629 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.629 [INFO - pool-12-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.629 [WARN - pool-12-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:48.645 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:48.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:48.645284 31837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 243cf868a7334e958f387067830e97f9 [sys.catalog]: This master's current role is: LEADER
18:30:48.646 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:48.646 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:48.647 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.648 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.648 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.649 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.649 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.649 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.650 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.650 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.650 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.650 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:48.665 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:48.666 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:48.666 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.666 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:48.666 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.667 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.667 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.667 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.667 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.667 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.667 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.668 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.668 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:48.685 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:48.686 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:48.687 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:48.688 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.688 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.688 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.688 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.688 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.689 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.689 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.689 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.690 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.690 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:48.695 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=28, TimeoutTracker(timeout=30000, elapsed=29354), Traces: [0ms] sending RPC to server master-127.28.68.190:40429, [3ms] received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [4ms] delaying RPC due to: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [22ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [26ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [28ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [32ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [41ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [45ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [46ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [48ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [49ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [64ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [66ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [66ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [84ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [85ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [85ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [85ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [125ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [125ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [166ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [284ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [284ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [286ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [286ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [341ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [363ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [721ms] refreshing cache from master, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [723ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [723ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [724ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [725ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [726ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [726ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1342ms] refreshing cache from master, [1342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1345ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3042ms] refreshing cache from master, [3042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3043ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3044ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3045ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [3045ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [3047ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3048ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [5822ms] refreshing cache from master, [5823ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [5824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [5824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [5824ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [5826ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [5828ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [5829ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [7102ms] refreshing cache from master, [7102ms] too many traces: truncated at 100 traces, deferred=Deferred@1047674529(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@2b7d4e90 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@409062645 after retry RPC after error@497812557) -> (continuation of Deferred@839165551 after retry RPC after error@1942779761) -> (continuation of Deferred@1708923801 after retry RPC after error@414184707) -> (continuation of Deferred@252645287 after retry RPC after error@526943944) -> (continuation of Deferred@451761775 after retry RPC after error@2098048988) -> (continuation of Deferred@168355309 after retry RPC after error@1359838370) -> (continuation of Deferred@564332226 after retry RPC after error@834678373) -> (continuation of Deferred@2091553341 after retry RPC after error@1182271846) -> (continuation of Deferred@2136248957 after retry RPC after error@1331112180) -> (continuation of Deferred@1740927065 after retry RPC after error@1643214590) -> (continuation of Deferred@988661703 after retry RPC after error@1284196582) -> (continuation of Deferred@143241110 after retry RPC after error@1646624511) -> (continuation of Deferred@908222083 after retry RPC after error@544799961) -> (continuation of Deferred@1699222111 after retry RPC after error@752048783) -> (continuation of Deferred@144826320 after retry RPC after error@1876456489) -> (continuation of Deferred@1252481383 after retry RPC after error@2090235294) -> (continuation of Deferred@2060417667 after retry RPC after error@1452945615) -> (continuation of Deferred@646330138 after retry RPC after error@1769180369) -> (continuation of Deferred@1751771166 after retry RPC after error@1878172052) -> (continuation of Deferred@2027648407 after retry RPC after error@230386521) -> (continuation of Deferred@708140008 after retry RPC after error@1345433915) -> (continuation of Deferred@1944387943 after retry RPC after error@634543585) -> (continuation of Deferred@624470184 after retry RPC after error@2019392861) -> (continuation of Deferred@594064648 after retry RPC after error@350411217) -> (continuation of Deferred@1954504205 after retry RPC after error@1742434890) -> (continuation of Deferred@24988492 after retry RPC after error@64173795), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@409062645 after retry RPC after error@497812557) -> (continuation of Deferred@839165551 after retry RPC after error@1942779761) -> (continuation of Deferred@1708923801 after retry RPC after error@414184707) -> (continuation of Deferred@252645287 after retry RPC after error@526943944) -> (continuation of Deferred@451761775 after retry RPC after error@2098048988) -> (continuation of Deferred@168355309 after retry RPC after error@1359838370) -> (continuation of Deferred@564332226 after retry RPC after error@834678373) -> (continuation of Deferred@2091553341 after retry RPC after error@1182271846) -> (continuation of Deferred@2136248957 after retry RPC after error@1331112180) -> (continuation of Deferred@1740927065 after retry RPC after error@1643214590) -> (continuation of Deferred@988661703 after retry RPC after error@1284196582) -> (continuation of Deferred@143241110 after retry RPC after error@1646624511) -> (continuation of Deferred@908222083 after retry RPC after error@544799961) -> (continuation of Deferred@1699222111 after retry RPC after error@752048783) -> (continuation of Deferred@144826320 after retry RPC after error@1876456489) -> (continuation of Deferred@1252481383 after retry RPC after error@2090235294) -> (continuation of Deferred@2060417667 after retry RPC after error@1452945615) -> (continuation of Deferred@646330138 after retry RPC after error@1769180369) -> (continuation of Deferred@1751771166 after retry RPC after error@1878172052) -> (continuation of Deferred@2027648407 after retry RPC after error@230386521) -> (continuation of Deferred@708140008 after retry RPC after error@1345433915) -> (continuation of Deferred@1944387943 after retry RPC after error@634543585) -> (continuation of Deferred@624470184 after retry RPC after error@2019392861) -> (continuation of Deferred@594064648 after retry RPC after error@350411217) -> (continuation of Deferred@1954504205 after retry RPC after error@1742434890) -> (continuation of Deferred@24988492 after retry RPC after error@64173795)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=28, TimeoutTracker(timeout=30000, elapsed=29354), Traces: [0ms] sending RPC to server master-127.28.68.190:40429, [3ms] received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [4ms] delaying RPC due to: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [22ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [26ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [28ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [32ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [41ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [45ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [46ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [48ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [49ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [64ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [66ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [66ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [84ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [85ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [85ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [85ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [125ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [125ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [166ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [284ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [284ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [286ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [286ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [341ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [363ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [721ms] refreshing cache from master, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [723ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [723ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [724ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [725ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [726ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [726ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1342ms] refreshing cache from master, [1342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1343ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1345ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3042ms] refreshing cache from master, [3042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3043ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3044ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3045ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [3045ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [3047ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3048ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [5822ms] refreshing cache from master, [5823ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [5824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [5824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [5824ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [5826ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [5828ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [5829ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [7102ms] refreshing cache from master, [7102ms] too many traces: truncated at 100 traces, deferred=Deferred@1047674529(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@2b7d4e90 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@409062645 after retry RPC after error@497812557) -> (continuation of Deferred@839165551 after retry RPC after error@1942779761) -> (continuation of Deferred@1708923801 after retry RPC after error@414184707) -> (continuation of Deferred@252645287 after retry RPC after error@526943944) -> (continuation of Deferred@451761775 after retry RPC after error@2098048988) -> (continuation of Deferred@168355309 after retry RPC after error@1359838370) -> (continuation of Deferred@564332226 after retry RPC after error@834678373) -> (continuation of Deferred@2091553341 after retry RPC after error@1182271846) -> (continuation of Deferred@2136248957 after retry RPC after error@1331112180) -> (continuation of Deferred@1740927065 after retry RPC after error@1643214590) -> (continuation of Deferred@988661703 after retry RPC after error@1284196582) -> (continuation of Deferred@143241110 after retry RPC after error@1646624511) -> (continuation of Deferred@908222083 after retry RPC after error@544799961) -> (continuation of Deferred@1699222111 after retry RPC after error@752048783) -> (continuation of Deferred@144826320 after retry RPC after error@1876456489) -> (continuation of Deferred@1252481383 after retry RPC after error@2090235294) -> (continuation of Deferred@2060417667 after retry RPC after error@1452945615) -> (continuation of Deferred@646330138 after retry RPC after error@1769180369) -> (continuation of Deferred@1751771166 after retry RPC after error@1878172052) -> (continuation of Deferred@2027648407 after retry RPC after error@230386521) -> (continuation of Deferred@708140008 after retry RPC after error@1345433915) -> (continuation of Deferred@1944387943 after retry RPC after error@634543585) -> (continuation of Deferred@624470184 after retry RPC after error@2019392861) -> (continuation of Deferred@594064648 after retry RPC after error@350411217) -> (continuation of Deferred@1954504205 after retry RPC after error@1742434890) -> (continuation of Deferred@24988492 after retry RPC after error@64173795), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@409062645 after retry RPC after error@497812557) -> (continuation of Deferred@839165551 after retry RPC after error@1942779761) -> (continuation of Deferred@1708923801 after retry RPC after error@414184707) -> (continuation of Deferred@252645287 after retry RPC after error@526943944) -> (continuation of Deferred@451761775 after retry RPC after error@2098048988) -> (continuation of Deferred@168355309 after retry RPC after error@1359838370) -> (continuation of Deferred@564332226 after retry RPC after error@834678373) -> (continuation of Deferred@2091553341 after retry RPC after error@1182271846) -> (continuation of Deferred@2136248957 after retry RPC after error@1331112180) -> (continuation of Deferred@1740927065 after retry RPC after error@1643214590) -> (continuation of Deferred@988661703 after retry RPC after error@1284196582) -> (continuation of Deferred@143241110 after retry RPC after error@1646624511) -> (continuation of Deferred@908222083 after retry RPC after error@544799961) -> (continuation of Deferred@1699222111 after retry RPC after error@752048783) -> (continuation of Deferred@144826320 after retry RPC after error@1876456489) -> (continuation of Deferred@1252481383 after retry RPC after error@2090235294) -> (continuation of Deferred@2060417667 after retry RPC after error@1452945615) -> (continuation of Deferred@646330138 after retry RPC after error@1769180369) -> (continuation of Deferred@1751771166 after retry RPC after error@1878172052) -> (continuation of Deferred@2027648407 after retry RPC after error@230386521) -> (continuation of Deferred@708140008 after retry RPC after error@1345433915) -> (continuation of Deferred@1944387943 after retry RPC after error@634543585) -> (continuation of Deferred@624470184 after retry RPC after error@2019392861) -> (continuation of Deferred@594064648 after retry RPC after error@350411217) -> (continuation of Deferred@1954504205 after retry RPC after error@1742434890) -> (continuation of Deferred@24988492 after retry RPC after error@64173795)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.68.189:33753
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:30:48.720 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:30:48.721 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RUNNING to RESTARTING.
18:30:48.726 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:48.726 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:48.727 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:48.728 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.728 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.728 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.728 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.728 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.728 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.728 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.728 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.729 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.729 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:48.732 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
18:30:48.732 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
18:30:48.733 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
18:30:48.734 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
18:30:48.735 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
18:30:48.754 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
18:30:48.754 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
18:30:48.758 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)] disconnecting while in state TERMINATED
18:30:48.758 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
18:30:48.758 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.28.250.125:38957(127.28.250.125:38957)] disconnecting while in state TERMINATED
18:30:48.758 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.28.250.126:43415(127.28.250.126:43415)] disconnecting while in state TERMINATED
18:30:48.758 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
18:30:48.758 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.28.250.124:38123(127.28.250.124:38123)] disconnecting while in state TERMINATED
18:30:48.758 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
18:30:48.758 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
18:30:48.759 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:30:48.760 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:30:48.760 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
18:30:48.760 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
18:30:48.790 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:30:48.791 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
18:30:48.792 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
18:30:48.792 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
18:30:48.801 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
18:30:48.801 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
18:30:48.801 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
18:30:48.805 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:48.806 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:48.806 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:48.808 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.808 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.808 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.810 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.810 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.811 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.811 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.811 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.812 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e0daef4de5564bcda67a7642c8fda8d1(127.28.250.65:39837)] disconnecting while in state TERMINATED
18:30:48.812 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.28.250.125:38957(127.28.250.125:38957)] disconnecting while in state TERMINATED
18:30:48.812 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.28.250.126:43415(127.28.250.126:43415)] disconnecting while in state TERMINATED
18:30:48.812 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.28.250.124:38123(127.28.250.124:38123)] disconnecting while in state TERMINATED
18:30:48.812 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:30:48.813 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.813 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
18:30:48.813 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:48.813 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-2
18:30:48.814 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
18:30:48.815 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
18:30:48.815 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
18:30:48.815 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
18:30:48.828 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.28.250.125:38957(127.28.250.125:38957)] disconnecting while in state TERMINATED
18:30:48.829 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.28.250.126:43415(127.28.250.126:43415)] disconnecting while in state TERMINATED
18:30:48.829 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.28.250.124:38123(127.28.250.124:38123)] disconnecting while in state TERMINATED
18:30:48.829 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:30:48.830 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
18:30:48.831 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:30:48.847 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
18:30:48.847 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
18:30:48.848 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
18:30:48.859 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.28.250.125:38957(127.28.250.125:38957)] disconnecting while in state TERMINATED
18:30:48.859 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.28.250.126:43415(127.28.250.126:43415)] disconnecting while in state TERMINATED
18:30:48.860 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.28.250.124:38123(127.28.250.124:38123)] disconnecting while in state TERMINATED
18:30:48.860 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:30:48.860 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:30:48.861 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
18:30:48.865 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:48.866 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:48.866 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:48.868 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.868 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.868 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.868 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:48.869 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.869 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.869 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:48.869 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.869 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:48.869 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:48.884 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
18:30:48.888 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
18:30:48.890 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:30:48.890 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:30:48.891 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
18:30:48.891 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
18:30:48.892 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
18:30:48.897 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:30:48.902 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
18:30:48.902 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:30:48.911 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:30:48.911 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
18:30:48.911 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
18:30:48.911 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
18:30:48.912 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
18:30:48.913 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
18:30:48.914 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:30:48.935 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
18:30:48.935 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:30:48.936 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
18:30:48.936 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
18:30:48.937 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
18:30:48.938 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
18:30:48.939 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job fa73e37017778341a79e5b3ef3d55eb9
18:30:49.106 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:49.106 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:49.107 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:49.107 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:49.107 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:49.107 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:49.111 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:49.111 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:49.111 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:49.112 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:49.112 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:49.112 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:49.112 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:49.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:48.697944 31806 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 31798
18:30:49.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:49.219635 31811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:49.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:49.218107 31798 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.904s	user 0.262s	sys 0.426s
18:30:49.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:49.223898 31798 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.910s	user 0.262s	sys 0.426s
18:30:49.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:47.310384 31808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:49.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:49.225028 31809 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1912 milliseconds
18:30:49.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.225481 31798 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:30:49.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.226843 31798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:30:49.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.259086 31798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:30:49.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.260790 31798 hybrid_clock.cc:648] HybridClock initialized: now 1783535449260692 us; error 118 us; skew 500 ppm
18:30:49.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.262019 31798 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:30:49.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.300285 31836 catalog_manager.cc:1294] Loaded cluster ID: a27104ca557b4a2481748c29c6e42496
18:30:49.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.304397 31798 webserver.cc:534] Webserver started at http://127.30.195.65:46067/ using document root <none> and password file <none>
18:30:49.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.304874 31836 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148: loading cluster ID for follower catalog manager: success
18:30:49.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.305733 31798 fs_manager.cc:362] Metadata directory not provided
18:30:49.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.306291 31798 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:30:49.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.306809 31798 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:30:49.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.315310 31836 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148: acquiring CA information for follower catalog manager: success
18:30:49.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.327076 31798 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/data/instance:
18:30:49.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8aca7da9f7ca4619ad516415905960e6"
18:30:49.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:49 on dist-test-slave-dxnw"
18:30:49.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.328621 31798 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/wal/instance:
18:30:49.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8aca7da9f7ca4619ad516415905960e6"
18:30:49.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:49 on dist-test-slave-dxnw"
18:30:49.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.333091 31836 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 98da2049ed2042cc90c686be4a0c1148: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:30:49.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.356884 31798 fs_manager.cc:696] Time spent creating directory manager: real 0.019s	user 0.013s	sys 0.004s
18:30:49.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.374266 31867 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:30:49.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.375589 31798 fs_manager.cc:730] Time spent opening block manager: real 0.014s	user 0.001s	sys 0.008s
18:30:49.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.375988 31798 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/wal
18:30:49.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8aca7da9f7ca4619ad516415905960e6"
18:30:49.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:49 on dist-test-slave-dxnw"
18:30:49.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.376401 31798 fs_report.cc:389] FS layout report
18:30:49.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:30:49.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/wal
18:30:49.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/wal
18:30:49.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/data/data
18:30:49.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:30:49.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:30:49.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:30:49.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:30:49.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:30:49.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:30:49.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:30:49.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:30:49.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:30:49.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:30:49.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:30:49.485 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:49.486 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:49.487 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:49.487 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:49.487 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:49.488 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:49.488 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:49.488 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:49.488 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:49.489 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:49.489 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:49.489 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:49.489 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:49.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.557812 31798 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:30:49.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.559926 31798 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:30:49.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.560952 31798 kserver.cc:163] Server-wide thread pool size limit: 3276
18:30:49.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.573743 31798 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:30:49.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.592165 31798 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:30:49.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.592486 31798 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:30:49.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.592758 31798 ts_tablet_manager.cc:616] Registered 0 tablets
18:30:49.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:49.592965 31798 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:30:49.665 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:49.666 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:49.666 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:49.667 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:49.667 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:49.667 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:49.667 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:49.667 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:49.668 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:49.668 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:49.668 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:49.667 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:49.669 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:49.806 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RESTARTING to RUNNING.
18:30:49.808 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job fa73e37017778341a79e5b3ef3d55eb9 from Checkpoint 69 @ 1783535448409 for fa73e37017778341a79e5b3ef3d55eb9 located at file:/tmp/junit12731664100414606042/checkpoints/fa73e37017778341a79e5b3ef3d55eb9/chk-69.
18:30:49.858 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
18:30:49.859 [INFO - flink-pekko.actor.default-dispatcher-5] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:30:49.869 [INFO - Thread-10] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:30:49.869 [DEBUG - Thread-10] (Connection.java:575) [peer master-127.28.68.190:40429(127.28.68.190:40429)] disconnecting while in state TERMINATED
18:30:49.870 [DEBUG - Thread-10] (Connection.java:575) [peer master-127.28.68.188:38393(127.28.68.188:38393)] disconnecting while in state TERMINATED
18:30:49.870 [DEBUG - Thread-10] (Connection.java:575) [peer master-127.28.68.189:33753(127.28.68.189:33753)] disconnecting while in state TERMINATED
18:30:49.870 [DEBUG - Thread-10] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:30:49.883 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
18:30:49.883 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
18:30:49.883 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
18:30:49.888 [INFO - Thread-10] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:30:49.894 [INFO - flink-pekko.actor.default-dispatcher-5] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:30:49.898 [DEBUG - flink-pekko.actor.default-dispatcher-5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:49.899 [INFO - flink-pekko.actor.default-dispatcher-5] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:30:49.911 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
18:30:49.914 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:30:49.915 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
18:30:49.915 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 1623ba59e704d1676486c6f13d60068c
18:30:49.916 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 1623ba59e704d1676486c6f13d60068c.
18:30:49.917 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 1623ba59e704d1676486c6f13d60068c.
18:30:49.918 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
18:30:49.918 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:30:49.919 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
18:30:49.919 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 409256c48f07c3602c01f545df4e7b3c
18:30:49.920 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:30:49.920 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:30:49.920 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:30:49.920 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:30:49.923 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
18:30:49.924 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:30:49.926 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
18:30:49.926 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 120c9de24dd4d7d83c84cb1a65b36252
18:30:49.927 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
18:30:49.927 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:30:49.929 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
18:30:49.929 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d
18:30:49.934 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 409256c48f07c3602c01f545df4e7b3c.
18:30:49.936 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id 409256c48f07c3602c01f545df4e7b3c.
18:30:49.940 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
18:30:49.941 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 120c9de24dd4d7d83c84cb1a65b36252.
18:30:49.942 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 120c9de24dd4d7d83c84cb1a65b36252.
18:30:49.943 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
18:30:49.952 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot fe2a3c24d55fce5c8d5a55c4e880b53d.
18:30:49.953 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d.
18:30:49.956 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
18:30:49.957 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
18:30:49.977 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
18:30:49.979 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1e16caf1
18:30:49.979 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:30:49.979 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:30:49.980 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
18:30:49.984 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
18:30:49.993 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@32b1b5ab
18:30:49.994 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
18:30:49.995 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5b8cb27a
18:30:49.995 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:30:49.996 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:30:49.996 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
18:30:49.996 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
18:30:49.997 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
18:30:49.997 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7a43d535
18:30:49.997 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:30:49.998 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:30:49.998 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
18:30:49.998 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
18:30:49.998 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
18:30:49.999 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@58c99f92
18:30:49.999 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:30:49.999 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:30:50.000 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
18:30:50.001 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
18:30:50.004 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@48260073
18:30:50.006 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:50.010 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1a834fd7
18:30:50.012 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:50.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:50.020 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:50.035 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@61e3ec63
18:30:50.037 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:50.047 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.060 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.070 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.085 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:50.094 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.107 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.111 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.111 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.111 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.118 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.122 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.124 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.125 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.128 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.134 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.134 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.135 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.154 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.156 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.156 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.156 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.171 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.171 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.172 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.172 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.180 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.182 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.182 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.182 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.191 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.194 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.196 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.198 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.198 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.207 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:50.208 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.209 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.210 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.213 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:50.215 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.216 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.216 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.218 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.219 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.219 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.219 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.219 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.219 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:50.220 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.220 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.221 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.221 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.222 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.222 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.222 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.222 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.223 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.224 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.225 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.225 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.227 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.234 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.234 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:50.234 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.234 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.234 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.235 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.235 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.235 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.236 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.236 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.237 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.240 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.240 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.240 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.240 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.240 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.241 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.241 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.241 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.241 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.249 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:50.250 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:50.250 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.250 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.250 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.251 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.251 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.252 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.252 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.253 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.254 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.256 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.256 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.257 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.257 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.257 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.259 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.259 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:50.263 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.264 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.264 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.264 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.265 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:50.276 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.276 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.276 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.276 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.276 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.277 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.278 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:50.279 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.279 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.280 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:50.281 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.281 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.281 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.282 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.282 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.282 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.283 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.284 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.284 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.284 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.285 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.285 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.285 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.287 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.287 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.287 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.288 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.289 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.289 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:50.291 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.292 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.292 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.292 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.292 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.292 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.292 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.292 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.293 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.293 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.293 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.293 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.300 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.302 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.303 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.303 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.303 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.306 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:50.306 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:50.306 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.306 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.306 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:50.306 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.307 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.307 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.307 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.307 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.307 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.307 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.308 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:50.309 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.310 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.310 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.310 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.310 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.310 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.311 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.311 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.311 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.311 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.311 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.311 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.311 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.325 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:50.326 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:50.326 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:50.327 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.327 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.327 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.328 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.328 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.328 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.328 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.328 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.328 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.329 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:50.329 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.331 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.332 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.332 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.332 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.332 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.332 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.332 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.332 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.333 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.333 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.333 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.333 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.333 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.333 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.333 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.334 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.340 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.340 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.340 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.340 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.345 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.345 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:50.347 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:50.347 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.347 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.347 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:50.347 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.348 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.348 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.348 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.348 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.348 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.348 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.349 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:50.350 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.350 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.350 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.354 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.359 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.360 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.360 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.360 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.361 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.361 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.361 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.362 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.362 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.362 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.362 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.362 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.362 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.363 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.363 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.363 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.364 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.364 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.364 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.364 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.365 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.366 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.366 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.366 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.367 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.367 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.367 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.367 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.367 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.368 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.368 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.368 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.368 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.368 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.369 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.369 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.369 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.369 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.369 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.369 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.369 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.370 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.370 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.370 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.370 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.370 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.370 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.370 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.370 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.371 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.371 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.371 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.371 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.372 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.372 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.372 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.372 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.375 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.380 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.380 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.381 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.382 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.382 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.382 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.383 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.383 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.383 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.384 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.384 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.384 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.384 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.385 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:50.385 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:50.385 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.386 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.386 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:50.386 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.386 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.386 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.386 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.387 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.387 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.387 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.387 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.387 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.387 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.388 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.388 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.388 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.388 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.388 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.388 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.388 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.387 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.388 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.389 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.389 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:50.394 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.394 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.394 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.395 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.395 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.395 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.395 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.395 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.395 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.396 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.396 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.396 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.396 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.400 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.401 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.401 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.402 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.402 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.402 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.402 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.402 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.402 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.403 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.403 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.403 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.403 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.407 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.407 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.407 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.407 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.407 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.407 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.408 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.408 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.408 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.409 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.409 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.409 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.409 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.414 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.415 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.415 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.415 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.415 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.415 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.415 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.415 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.415 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.415 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.416 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.416 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.416 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.431 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.431 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.432 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.432 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.432 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.432 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.432 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.432 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.433 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.433 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.433 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.433 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.433 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.434 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.435 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.435 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.436 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.436 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.436 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.436 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.436 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.437 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.437 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.437 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.437 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.437 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.440 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.440 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.440 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.441 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.441 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.441 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.441 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.442 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.442 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.442 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.442 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.442 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.442 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.466 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:50.467 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:50.467 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.467 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.467 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.467 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.467 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:50.467 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.468 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.468 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.468 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.468 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.468 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.468 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.469 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.469 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.469 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.469 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:50.469 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.470 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.470 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.470 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.471 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.471 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.471 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.471 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.480 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.481 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.481 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.482 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.482 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.482 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.482 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.482 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.483 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.483 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.483 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.483 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.484 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.494 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.494 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.495 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.496 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.496 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.496 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.496 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.496 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.496 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.499 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.499 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.499 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.499 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:50.531 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.531 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.531 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.532 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.532 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.532 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.533 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.533 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.533 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.534 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.534 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.534 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.534 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.575 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.576 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.576 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.576 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.576 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.576 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.576 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.576 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.577 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.577 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.577 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.577 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.577 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.587 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.588 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.588 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.588 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.588 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.589 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.589 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.589 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.589 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.589 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.589 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.589 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.590 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.606 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:50.606 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:50.607 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.607 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.607 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.608 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.608 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.608 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.608 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:50.611 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.612 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.612 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.612 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:50.620 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.621 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.621 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.622 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.622 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.622 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.622 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.622 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.622 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.623 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.623 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.623 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.623 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.627502 31798 rpc_server.cc:307] RPC server started. Bound to: 127.30.195.65:33277
18:30:50.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.631840 31798 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/data/info.pb
18:30:50.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.626997 32035 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.195.65:33277 every 8 connection(s)
18:30:50.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.640906 31501 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 31798
18:30:50.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.641485 31501 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-0/wal/instance
18:30:50.654 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.655 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.655 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.656 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.657 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.657 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.657 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.657 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.658 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.658 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.658 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.658 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.659 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.666738 31501 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/wal
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/data
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/logs
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/data/info.pb
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.195.66:0
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.195.66
18:30:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.195.66
18:30:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.195.126:33747,127.30.195.125:40423,127.30.195.124:38627
18:30:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.195.84:35305
18:30:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:30:50.670 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.671 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.671 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.672 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.672 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.672 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.673 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.673 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.673 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.673 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.673 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.673 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.674 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.680 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.680 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.680 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.681 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.681 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.681 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.682 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.682 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.682 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.682 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.683 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.683 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.683 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.720 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.721 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.721 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.722 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.722 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.722 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.723 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.723 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.723 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.724 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.724 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.724 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.724 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.759830 32036 heartbeater.cc:344] Connected to a master server at 127.30.195.124:38627
18:30:50.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.760335 32036 heartbeater.cc:461] Registering TS with master...
18:30:50.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.761705 32036 heartbeater.cc:507] Master 127.30.195.124:38627 requested a full tablet report, sending...
18:30:50.767 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.768 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.768 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.764966 31716 ts_manager.cc:194] Registered new tserver with Master: 8aca7da9f7ca4619ad516415905960e6 (127.30.195.65:33277)
18:30:50.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.767489 31716 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.30.195.65:58075
18:30:50.769 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.769 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.769 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.770 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.770 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.770 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.770 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.770 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.771 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.771 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.771055 32037 heartbeater.cc:344] Connected to a master server at 127.30.195.125:40423
18:30:50.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.771405 32037 heartbeater.cc:461] Registering TS with master...
18:30:50.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.772251 32037 heartbeater.cc:507] Master 127.30.195.125:40423 requested a full tablet report, sending...
18:30:50.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.775224 31627 ts_manager.cc:194] Registered new tserver with Master: 8aca7da9f7ca4619ad516415905960e6 (127.30.195.65:33277)
18:30:50.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.780143 32041 heartbeater.cc:344] Connected to a master server at 127.30.195.126:33747
18:30:50.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.780508 32041 heartbeater.cc:461] Registering TS with master...
18:30:50.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.781209 32041 heartbeater.cc:507] Master 127.30.195.126:33747 requested a full tablet report, sending...
18:30:50.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:50.784498 31550 ts_manager.cc:194] Registered new tserver with Master: 8aca7da9f7ca4619ad516415905960e6 (127.30.195.65:33277)
18:30:50.786 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:50.786 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:50.787 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.787 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.787 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.788 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:50.788 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.788 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.788 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.789 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.789 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.789 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.789 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:50.886 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:50.888 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.888 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.888 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:50.889 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:50.890 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:50.891 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.891 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.891 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:50.891 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.891 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.891 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:50.892 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:50.907 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.908 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.908 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.909 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.909 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.909 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.910 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.910 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.910 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.911 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.911 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.911 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.911 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:50.950 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:50.950 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:50.951 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:50.952 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.952 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.952 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:50.952 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.952 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.953 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:50.953 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.953 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.953 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:50.953 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:51.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:51.115 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:51.115 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:51.115 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:51.116 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:51.116 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:51.117 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:51.117 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:51.118 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:51.118 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:51.118 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:51.118 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:51.118 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:51.118 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:51.180 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:51.180 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:51.181 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:51.182 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:51.182 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:51.182 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:51.183 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:51.183 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:51.183 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:51.185 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:51.185 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:51.185 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:51.185 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:51.207 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:51.208 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:51.208 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:51.209 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:51.209 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:51.209 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:51.210 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:51.210 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:51.210 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:51.211 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:51.211 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:51.211 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:51.211 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:51.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:51.330618 32040 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:30:51.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:51.335825 32040 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:30:51.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:51.336829 32040 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:30:51.354 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:51.355 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:51.356 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:51.356 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:51.356 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:51.356 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:51.356 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:51.356 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:51.356 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:51.358 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:51.358 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:51.358 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:51.358 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:51.386 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:51.386 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:51.387 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:51.388 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:51.389 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:51.389 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:51.389 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:51.389 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:51.389 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:51.390 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:51.390 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:51.390 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:51.390 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:51.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:51.393941 32040 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:30:51.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:51.395437 32040 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.195.66
18:30:51.450 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:51.451 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:51.451 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:51.452 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:51.452 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:51.452 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:51.453 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:51.453 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:51.453 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:51.453 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:51.453 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:51.453 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:51.453 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:51.468597 32040 tablet_server_runner.cc:78] Tablet server non-default flags:
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.195.84:35305
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/data
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/wal
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.195.66:0
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/data/info.pb
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.195.66
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.195.126:33747,127.30.195.125:40423,127.30.195.124:38627
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.195.66
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/logs
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:30:51.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:30:51.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:51.470479 32040 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:30:51.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:51.472854 32040 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:30:51.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:51.512588 32055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:51.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:51.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:51.774813 32036 heartbeater.cc:499] Master 127.30.195.124:38627 was elected leader, sending a full tablet report...
18:30:52.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:52.220 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:52.221 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:52.221 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:52.223 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:52.223 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:52.223 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:52.223 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:52.224 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:52.224 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:52.224 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:52.224 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:52.224 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:52.224 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:52.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:52.628 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:52.628 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:52.629 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:52.629 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:52.629 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:52.629 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:52.630 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:52.630 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:52.630 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:52.634 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:52.634 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:52.634 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:52.634 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:53.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:53.154 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:53.155 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:53.155 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:53.156 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:53.156 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:53.156 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:53.157 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:53.157 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:53.157 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:53.157 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:53.158 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:53.158 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:53.158 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:53.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:52.901077 32053 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 32040
18:30:53.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:53.257196 32040 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.748s	user 0.603s	sys 0.967s
18:30:53.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:51.512785 32054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:53.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:53.257635 32040 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.749s	user 0.603s	sys 0.967s
18:30:53.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:53.266705 32061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.268178 32040 server_base.cc:1061] running on GCE node
18:30:53.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.269440 32040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:30:53.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.271857 32040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:30:53.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.273334 32040 hybrid_clock.cc:648] HybridClock initialized: now 1783535453273296 us; error 35 us; skew 500 ppm
18:30:53.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.274273 32040 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:30:53.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.281356 32040 webserver.cc:534] Webserver started at http://127.30.195.66:46847/ using document root <none> and password file <none>
18:30:53.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.282321 32040 fs_manager.cc:362] Metadata directory not provided
18:30:53.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.282513 32040 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:30:53.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.282948 32040 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:30:53.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.287562 32040 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/data/instance:
18:30:53.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "848a93fc4b3244bd88f2910885d4bd9f"
18:30:53.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:53 on dist-test-slave-dxnw"
18:30:53.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.289139 32040 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/wal/instance:
18:30:53.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "848a93fc4b3244bd88f2910885d4bd9f"
18:30:53.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:53 on dist-test-slave-dxnw"
18:30:53.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.298272 32040 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.008s	sys 0.000s
18:30:53.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.304572 32067 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:30:53.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.306223 32040 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
18:30:53.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.306756 32040 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/wal
18:30:53.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "848a93fc4b3244bd88f2910885d4bd9f"
18:30:53.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:53 on dist-test-slave-dxnw"
18:30:53.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.307225 32040 fs_report.cc:389] FS layout report
18:30:53.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:30:53.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/wal
18:30:53.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/wal
18:30:53.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/data/data
18:30:53.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:30:53.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:30:53.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:30:53.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:30:53.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:30:53.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:30:53.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:30:53.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:30:53.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:30:53.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:30:53.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:30:53.310 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:53.311 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:53.311 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:53.311 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:53.311 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:53.311 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:53.312 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:53.312 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:53.312 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:53.312 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:53.312 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:53.312 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:53.312 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:53.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.365005 32040 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:30:53.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.366508 32040 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:30:53.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.366982 32040 kserver.cc:163] Server-wide thread pool size limit: 3276
18:30:53.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.369609 32040 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:30:53.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.373916 32040 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:30:53.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.374110 32040 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:30:53.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.374300 32040 ts_tablet_manager.cc:616] Registered 0 tablets
18:30:53.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.374439 32040 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:30:53.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.522541 32040 rpc_server.cc:307] RPC server started. Bound to: 127.30.195.66:40191
18:30:53.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.522655 32179 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.195.66:40191 every 8 connection(s)
18:30:53.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.525386 32040 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/data/info.pb
18:30:53.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.535851 31501 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 32040
18:30:53.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.536332 31501 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-1/wal/instance
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.556890 31501 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/wal
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/data
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/logs
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/data/info.pb
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:53.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:53.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:30:53.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:30:53.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.195.67:0
18:30:53.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.195.67
18:30:53.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.195.67
18:30:53.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:53.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.195.126:33747,127.30.195.125:40423,127.30.195.124:38627
18:30:53.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.195.84:35305
18:30:53.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:53.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:53.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:30:53.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.620965 32180 heartbeater.cc:344] Connected to a master server at 127.30.195.124:38627
18:30:53.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.621488 32180 heartbeater.cc:461] Registering TS with master...
18:30:53.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.623201 32180 heartbeater.cc:507] Master 127.30.195.124:38627 requested a full tablet report, sending...
18:30:53.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.625336 32181 heartbeater.cc:344] Connected to a master server at 127.30.195.125:40423
18:30:53.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.625661 32181 heartbeater.cc:461] Registering TS with master...
18:30:53.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.625883 31716 ts_manager.cc:194] Registered new tserver with Master: 848a93fc4b3244bd88f2910885d4bd9f (127.30.195.66:40191)
18:30:53.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.626497 32181 heartbeater.cc:507] Master 127.30.195.125:40423 requested a full tablet report, sending...
18:30:53.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.627624 31716 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.30.195.66:55169
18:30:53.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.629349 31627 ts_manager.cc:194] Registered new tserver with Master: 848a93fc4b3244bd88f2910885d4bd9f (127.30.195.66:40191)
18:30:53.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.635803 32184 heartbeater.cc:344] Connected to a master server at 127.30.195.126:33747
18:30:53.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.636154 32184 heartbeater.cc:461] Registering TS with master...
18:30:53.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.636765 32184 heartbeater.cc:507] Master 127.30.195.126:33747 requested a full tablet report, sending...
18:30:53.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:53.640064 31550 ts_manager.cc:194] Registered new tserver with Master: 848a93fc4b3244bd88f2910885d4bd9f (127.30.195.66:40191)
18:30:53.686 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:53.687 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:53.687 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:53.687 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:53.687 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:53.687 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:53.688 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:53.688 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:53.688 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:53.688 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:53.688 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:53.688 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:53.688 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:53.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:53.956723 32190 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:30:53.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:53.957207 32190 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:30:53.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:53.957741 32190 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:30:53.981 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:53.981 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:53.981 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:53.982 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:53.982 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:53.982 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:53.982 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:53.982 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:53.982 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:53.982 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:53.982 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:53.982 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:53.983 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:53.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:53.993410 32190 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:30:53.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:53.994213 32190 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.195.67
18:30:54.018 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:54.032701 32190 tablet_server_runner.cc:78] Tablet server non-default flags:
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.195.84:35305
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/data
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/wal
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.195.67:0
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/data/info.pb
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.195.67
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.195.126:33747,127.30.195.125:40423,127.30.195.124:38627
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.195.67
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/logs
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:30:54.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:30:54.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:54.033985 32190 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:30:54.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:54.035558 32190 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:30:54.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:54.048338 32197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:54.519 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:54.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:54.578619 31001 debug-util.cc:398] Leaking SignalData structure 0x7b08000703a0 after lost signal to thread 30934
18:30:54.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:54.579607 31001 debug-util.cc:398] Leaking SignalData structure 0x7b08000aa2c0 after lost signal to thread 31004
18:30:54.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:54.633477 32180 heartbeater.cc:499] Master 127.30.195.124:38627 was elected leader, sending a full tablet report...
18:30:54.751 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:54.751 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:54.753 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:54.753 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:54.753 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:54.754 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:54.754 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:54.754 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:54.754 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:54.755 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:54.755 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:54.755 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:54.755 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:55.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:55.347 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:55.348 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:55.348 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:55.349 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:55.349 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:55.349 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:55.349 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:55.349 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:55.349 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:55.350 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:55.350 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:55.350 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:55.350 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:55.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:54.050338 32198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:55.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:54.054069 32200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:30:55.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:55.492425 32199 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1438 milliseconds
18:30:55.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.492535 32190 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:30:55.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.493811 32190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:30:55.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.496104 32190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:30:55.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.497542 32190 hybrid_clock.cc:648] HybridClock initialized: now 1783535455497511 us; error 50 us; skew 500 ppm
18:30:55.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.498457 32190 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:30:55.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.505321 32190 webserver.cc:534] Webserver started at http://127.30.195.67:36581/ using document root <none> and password file <none>
18:30:55.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.506413 32190 fs_manager.cc:362] Metadata directory not provided
18:30:55.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.506670 32190 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:30:55.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.507195 32190 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:30:55.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.511780 32190 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/data/instance:
18:30:55.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "800a0053d41545519079c200a07e1eb7"
18:30:55.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:55 on dist-test-slave-dxnw"
18:30:55.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.513168 32190 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/wal/instance:
18:30:55.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "800a0053d41545519079c200a07e1eb7"
18:30:55.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:55 on dist-test-slave-dxnw"
18:30:55.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:55.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.521274 32190 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.004s
18:30:55.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.527594 32211 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:30:55.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.528811 32190 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
18:30:55.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.529170 32190 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/wal
18:30:55.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "800a0053d41545519079c200a07e1eb7"
18:30:55.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:30:55 on dist-test-slave-dxnw"
18:30:55.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.529527 32190 fs_report.cc:389] FS layout report
18:30:55.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:30:55.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/wal
18:30:55.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/wal
18:30:55.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/data/data
18:30:55.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:30:55.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:30:55.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:30:55.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:30:55.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:30:55.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:30:55.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:30:55.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:30:55.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:30:55.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:30:55.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:30:55.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.592149 32190 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:30:55.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.593931 32190 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:30:55.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.594496 32190 kserver.cc:163] Server-wide thread pool size limit: 3276
18:30:55.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.597582 32190 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:30:55.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.602193 32190 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:30:55.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.602427 32190 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:30:55.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.602768 32190 ts_tablet_manager.cc:616] Registered 0 tablets
18:30:55.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.603026 32190 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
18:30:55.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.760216 32190 rpc_server.cc:307] RPC server started. Bound to: 127.30.195.67:45841
18:30:55.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.760385 32323 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.195.67:45841 every 8 connection(s)
18:30:55.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.763125 32190 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/data/info.pb
18:30:55.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.771548 31501 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 32190
18:30:55.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.772115 31501 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster9236505352246115683/ts-2/wal/instance
18:30:55.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.807971 32325 heartbeater.cc:344] Connected to a master server at 127.30.195.125:40423
18:30:55.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.808502 32325 heartbeater.cc:461] Registering TS with master...
18:30:55.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.808868 32324 heartbeater.cc:344] Connected to a master server at 127.30.195.124:38627
18:30:55.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.809206 32324 heartbeater.cc:461] Registering TS with master...
18:30:55.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.810086 32325 heartbeater.cc:507] Master 127.30.195.125:40423 requested a full tablet report, sending...
18:30:55.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.810585 32324 heartbeater.cc:507] Master 127.30.195.124:38627 requested a full tablet report, sending...
18:30:55.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.814839 31627 ts_manager.cc:194] Registered new tserver with Master: 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841)
18:30:55.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.818015 32326 heartbeater.cc:344] Connected to a master server at 127.30.195.126:33747
18:30:55.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.818363 32326 heartbeater.cc:461] Registering TS with master...
18:30:55.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.819115 31716 ts_manager.cc:194] Registered new tserver with Master: 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841)
18:30:55.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.819319 32326 heartbeater.cc:507] Master 127.30.195.126:33747 requested a full tablet report, sending...
18:30:55.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.821041 31716 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.30.195.67:53707
18:30:55.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.822029 31550 ts_manager.cc:194] Registered new tserver with Master: 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841)
18:30:55.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.827383 31501 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
18:30:55.839 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:30:55.839 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

18:30:55.841 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.30.195.126"
      port: 33747
    }
    bound_http_address {
      host: "127.30.195.126"
      port: 46473
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.30.195.125"
      port: 40423
    }
    bound_http_address {
      host: "127.30.195.125"
      port: 45437
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.30.195.124"
      port: 38627
    }
    bound_http_address {
      host: "127.30.195.124"
      port: 35731
    }
  }
}

18:30:55.841 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

18:30:55.842 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.30.195.65"
      port: 33277
    }
    bound_http_address {
      host: "127.30.195.65"
      port: 46067
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.30.195.66"
      port: 40191
    }
    bound_http_address {
      host: "127.30.195.66"
      port: 46847
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.30.195.67"
      port: 45841
    }
    bound_http_address {
      host: "127.30.195.67"
      port: 36581
    }
  }
}

18:30:55.842 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
18:30:55.848 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:55.855 [DEBUG - main] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:30:55.856 [DEBUG - main] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:30:55.857 [DEBUG - main] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:30:55.858 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.30.11.254:41811(127.30.11.254:41811)] Successfully connected to peer
18:30:55.860 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.30.11.252:39405(127.30.11.252:39405)] Successfully connected to peer
18:30:55.864 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.252
18:30:55.865 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.30.11.253:35677(127.30.11.253:35677)] Successfully connected to peer
18:30:55.869 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.254
18:30:55.882 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:55.887 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.253
18:30:55.890 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:55.893 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2bb84c81, L:/127.0.0.1:32948 - R:/127.30.11.254:41811] using SASL/PLAIN
18:30:55.899 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:55.902 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x445e1557, L:/127.0.0.1:42604 - R:/127.30.11.253:35677] using SASL/PLAIN
18:30:55.909 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x4b2c7eff, L:/127.0.0.1:36972 - R:/127.30.11.252:39405] using SASL/PLAIN
18:30:55.916 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:30:55.916 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=61), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: OK, [54ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: OK, [60ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: OK, deferred=null) after lookup
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:55.918753 30970 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36972:
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:30:55.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   custom_hash_schema_ranges {
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     range_bounds {
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000"
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     hash_schema {
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       columns {
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)         name: "key1"
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       }
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       num_buckets: 5
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       seed: 123
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:55.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:30:55.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:55.924059 30970 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
18:30:55.971 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 18b53ee8d31d4c50837c15cc6e9b9583
18:30:56.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:56.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.037652 31283 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7d727e45674353a019fb4400b5b816 (DEFAULT_TABLE table=replication_test_table [id=18b53ee8d31d4c50837c15cc6e9b9583]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:56.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.040863 31283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7d727e45674353a019fb4400b5b816. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:56.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.044878 31282 tablet_service.cc:1511] Processing CreateTablet for tablet fc2c4cc9a9e04c2ab9e58e687df02d61 (DEFAULT_TABLE table=replication_test_table [id=18b53ee8d31d4c50837c15cc6e9b9583]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:56.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.046504 31282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2c4cc9a9e04c2ab9e58e687df02d61. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:56.047 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:56.048 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:56.048 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:56.049 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:56.049 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:56.049 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:56.050 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:56.050 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:56.050 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:56.051 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:56.051 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:56.051 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:56.051 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:56.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.059011 31281 tablet_service.cc:1511] Processing CreateTablet for tablet 1596d99b6178400ca4f4e37e3cbfe9aa (DEFAULT_TABLE table=replication_test_table [id=18b53ee8d31d4c50837c15cc6e9b9583]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:56.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.060554 31281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1596d99b6178400ca4f4e37e3cbfe9aa. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:56.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.034319 31284 tablet_service.cc:1511] Processing CreateTablet for tablet 088641b735ea44c68946bc19f249c6ef (DEFAULT_TABLE table=replication_test_table [id=18b53ee8d31d4c50837c15cc6e9b9583]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:56.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.064029 31284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 088641b735ea44c68946bc19f249c6ef. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:56.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.067487 31280 tablet_service.cc:1511] Processing CreateTablet for tablet bc0990262e854002be30002e55828c42 (DEFAULT_TABLE table=replication_test_table [id=18b53ee8d31d4c50837c15cc6e9b9583]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:56.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.068790 31280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc0990262e854002be30002e55828c42. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:56.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.095192 31139 tablet_service.cc:1511] Processing CreateTablet for tablet bc0990262e854002be30002e55828c42 (DEFAULT_TABLE table=replication_test_table [id=18b53ee8d31d4c50837c15cc6e9b9583]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:56.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.096643 31424 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7d727e45674353a019fb4400b5b816 (DEFAULT_TABLE table=replication_test_table [id=18b53ee8d31d4c50837c15cc6e9b9583]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:56.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.100145 31139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc0990262e854002be30002e55828c42. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:56.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.097347 31142 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7d727e45674353a019fb4400b5b816 (DEFAULT_TABLE table=replication_test_table [id=18b53ee8d31d4c50837c15cc6e9b9583]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:56.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.100405 31140 tablet_service.cc:1511] Processing CreateTablet for tablet 1596d99b6178400ca4f4e37e3cbfe9aa (DEFAULT_TABLE table=replication_test_table [id=18b53ee8d31d4c50837c15cc6e9b9583]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:56.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.100868 31141 tablet_service.cc:1511] Processing CreateTablet for tablet fc2c4cc9a9e04c2ab9e58e687df02d61 (DEFAULT_TABLE table=replication_test_table [id=18b53ee8d31d4c50837c15cc6e9b9583]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:56.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.104456 31424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7d727e45674353a019fb4400b5b816. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:56.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.099220 31421 tablet_service.cc:1511] Processing CreateTablet for tablet bc0990262e854002be30002e55828c42 (DEFAULT_TABLE table=replication_test_table [id=18b53ee8d31d4c50837c15cc6e9b9583]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:56.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.104521 31140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1596d99b6178400ca4f4e37e3cbfe9aa. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:56.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.105579 31421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc0990262e854002be30002e55828c42. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:56.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.105845 31142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7d727e45674353a019fb4400b5b816. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:56.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.104151 31143 tablet_service.cc:1511] Processing CreateTablet for tablet 088641b735ea44c68946bc19f249c6ef (DEFAULT_TABLE table=replication_test_table [id=18b53ee8d31d4c50837c15cc6e9b9583]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:56.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.097045 31425 tablet_service.cc:1511] Processing CreateTablet for tablet 088641b735ea44c68946bc19f249c6ef (DEFAULT_TABLE table=replication_test_table [id=18b53ee8d31d4c50837c15cc6e9b9583]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:56.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.112985 31141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2c4cc9a9e04c2ab9e58e687df02d61. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:56.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.113090 31425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 088641b735ea44c68946bc19f249c6ef. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:56.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.101436 31423 tablet_service.cc:1511] Processing CreateTablet for tablet fc2c4cc9a9e04c2ab9e58e687df02d61 (DEFAULT_TABLE table=replication_test_table [id=18b53ee8d31d4c50837c15cc6e9b9583]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:56.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.113880 31143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 088641b735ea44c68946bc19f249c6ef. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:56.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.102766 31422 tablet_service.cc:1511] Processing CreateTablet for tablet 1596d99b6178400ca4f4e37e3cbfe9aa (DEFAULT_TABLE table=replication_test_table [id=18b53ee8d31d4c50837c15cc6e9b9583]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:56.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.114686 31422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1596d99b6178400ca4f4e37e3cbfe9aa. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:56.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.116926 31423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2c4cc9a9e04c2ab9e58e687df02d61. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:56.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.196305 32357 tablet_bootstrap.cc:492] T 1596d99b6178400ca4f4e37e3cbfe9aa P 9528f2c8dcc74589a5fd8b8b121d42c0: Bootstrap starting.
18:30:56.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.196271 32358 tablet_bootstrap.cc:492] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082: Bootstrap starting.
18:30:56.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.205283 32357 tablet_bootstrap.cc:654] T 1596d99b6178400ca4f4e37e3cbfe9aa P 9528f2c8dcc74589a5fd8b8b121d42c0: Neither blocks nor log segments found. Creating new log.
18:30:56.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.208026 32357 log.cc:826] T 1596d99b6178400ca4f4e37e3cbfe9aa P 9528f2c8dcc74589a5fd8b8b121d42c0: Log is configured to *not* fsync() on all Append() calls
18:30:56.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.217222 32359 tablet_bootstrap.cc:492] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c: Bootstrap starting.
18:30:56.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.223654 32358 tablet_bootstrap.cc:654] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082: Neither blocks nor log segments found. Creating new log.
18:30:56.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.226189 32357 tablet_bootstrap.cc:492] T 1596d99b6178400ca4f4e37e3cbfe9aa P 9528f2c8dcc74589a5fd8b8b121d42c0: No bootstrap required, opened a new log
18:30:56.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.226576 32358 log.cc:826] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082: Log is configured to *not* fsync() on all Append() calls
18:30:56.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.227424 32357 ts_tablet_manager.cc:1403] T 1596d99b6178400ca4f4e37e3cbfe9aa P 9528f2c8dcc74589a5fd8b8b121d42c0: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.010s
18:30:56.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.232206 32359 tablet_bootstrap.cc:654] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c: Neither blocks nor log segments found. Creating new log.
18:30:56.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.234767 32359 log.cc:826] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c: Log is configured to *not* fsync() on all Append() calls
18:30:56.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.246980 32359 tablet_bootstrap.cc:492] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c: No bootstrap required, opened a new log
18:30:56.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.247064 32358 tablet_bootstrap.cc:492] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082: No bootstrap required, opened a new log
18:30:56.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.247570 32359 ts_tablet_manager.cc:1403] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c: Time spent bootstrapping tablet: real 0.031s	user 0.024s	sys 0.000s
18:30:56.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.247619 32358 ts_tablet_manager.cc:1403] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.012s
18:30:56.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.267109 32357 raft_consensus.cc:359] T 1596d99b6178400ca4f4e37e3cbfe9aa P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.268253 32357 raft_consensus.cc:385] T 1596d99b6178400ca4f4e37e3cbfe9aa P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:56.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.268652 32357 raft_consensus.cc:740] T 1596d99b6178400ca4f4e37e3cbfe9aa P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9528f2c8dcc74589a5fd8b8b121d42c0, State: Initialized, Role: FOLLOWER
18:30:56.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.269675 32357 consensus_queue.cc:260] T 1596d99b6178400ca4f4e37e3cbfe9aa P 9528f2c8dcc74589a5fd8b8b121d42c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.277393 32359 raft_consensus.cc:359] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.278357 32359 raft_consensus.cc:385] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:56.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.278667 32359 raft_consensus.cc:740] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8cc76985484cc7badb53158fdd508c, State: Initialized, Role: FOLLOWER
18:30:56.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.279663 32359 consensus_queue.cc:260] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.281385 32357 ts_tablet_manager.cc:1434] T 1596d99b6178400ca4f4e37e3cbfe9aa P 9528f2c8dcc74589a5fd8b8b121d42c0: Time spent starting tablet: real 0.053s	user 0.035s	sys 0.008s
18:30:56.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.284271 32358 raft_consensus.cc:359] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.285511 32358 raft_consensus.cc:385] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:56.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.285915 32358 raft_consensus.cc:740] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65f318326a6a4a469ec95434167d0082, State: Initialized, Role: FOLLOWER
18:30:56.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.287113 32358 consensus_queue.cc:260] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.296061 32357 tablet_bootstrap.cc:492] T 088641b735ea44c68946bc19f249c6ef P 9528f2c8dcc74589a5fd8b8b121d42c0: Bootstrap starting.
18:30:56.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.305509 32358 ts_tablet_manager.cc:1434] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082: Time spent starting tablet: real 0.057s	user 0.026s	sys 0.024s
18:30:56.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.308544 32358 tablet_bootstrap.cc:492] T 1596d99b6178400ca4f4e37e3cbfe9aa P 65f318326a6a4a469ec95434167d0082: Bootstrap starting.
18:30:56.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.317317 32358 tablet_bootstrap.cc:654] T 1596d99b6178400ca4f4e37e3cbfe9aa P 65f318326a6a4a469ec95434167d0082: Neither blocks nor log segments found. Creating new log.
18:30:56.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.331135 32358 tablet_bootstrap.cc:492] T 1596d99b6178400ca4f4e37e3cbfe9aa P 65f318326a6a4a469ec95434167d0082: No bootstrap required, opened a new log
18:30:56.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.332491 32358 ts_tablet_manager.cc:1403] T 1596d99b6178400ca4f4e37e3cbfe9aa P 65f318326a6a4a469ec95434167d0082: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.009s
18:30:56.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.340664 32358 raft_consensus.cc:359] T 1596d99b6178400ca4f4e37e3cbfe9aa P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.341557 32358 raft_consensus.cc:385] T 1596d99b6178400ca4f4e37e3cbfe9aa P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:56.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.341889 32358 raft_consensus.cc:740] T 1596d99b6178400ca4f4e37e3cbfe9aa P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65f318326a6a4a469ec95434167d0082, State: Initialized, Role: FOLLOWER
18:30:56.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.342705 32358 consensus_queue.cc:260] T 1596d99b6178400ca4f4e37e3cbfe9aa P 65f318326a6a4a469ec95434167d0082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.345304 32358 ts_tablet_manager.cc:1434] T 1596d99b6178400ca4f4e37e3cbfe9aa P 65f318326a6a4a469ec95434167d0082: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
18:30:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.347576 32358 tablet_bootstrap.cc:492] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082: Bootstrap starting.
18:30:56.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.364383 32358 tablet_bootstrap.cc:654] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082: Neither blocks nor log segments found. Creating new log.
18:30:56.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.375136 32357 tablet_bootstrap.cc:654] T 088641b735ea44c68946bc19f249c6ef P 9528f2c8dcc74589a5fd8b8b121d42c0: Neither blocks nor log segments found. Creating new log.
18:30:56.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.381129 32359 ts_tablet_manager.cc:1434] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c: Time spent starting tablet: real 0.133s	user 0.063s	sys 0.058s
18:30:56.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.383601 32359 tablet_bootstrap.cc:492] T 0d7d727e45674353a019fb4400b5b816 P fe8cc76985484cc7badb53158fdd508c: Bootstrap starting.
18:30:56.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.386255 32357 tablet_bootstrap.cc:492] T 088641b735ea44c68946bc19f249c6ef P 9528f2c8dcc74589a5fd8b8b121d42c0: No bootstrap required, opened a new log
18:30:56.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.386690 32357 ts_tablet_manager.cc:1403] T 088641b735ea44c68946bc19f249c6ef P 9528f2c8dcc74589a5fd8b8b121d42c0: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.002s
18:30:56.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.391757 32359 tablet_bootstrap.cc:654] T 0d7d727e45674353a019fb4400b5b816 P fe8cc76985484cc7badb53158fdd508c: Neither blocks nor log segments found. Creating new log.
18:30:56.394 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:56.395 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:56.395 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:56.396 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:56.396 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:56.396 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:56.397 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:56.397 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:56.397 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:56.397 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:56.397 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:56.398 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:56.398 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.402348 32358 tablet_bootstrap.cc:492] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082: No bootstrap required, opened a new log
18:30:56.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.403016 32358 ts_tablet_manager.cc:1403] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.007s
18:30:56.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.404112 32357 raft_consensus.cc:359] T 088641b735ea44c68946bc19f249c6ef P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.404927 32357 raft_consensus.cc:385] T 088641b735ea44c68946bc19f249c6ef P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:56.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.405261 32357 raft_consensus.cc:740] T 088641b735ea44c68946bc19f249c6ef P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9528f2c8dcc74589a5fd8b8b121d42c0, State: Initialized, Role: FOLLOWER
18:30:56.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.406307 32359 tablet_bootstrap.cc:492] T 0d7d727e45674353a019fb4400b5b816 P fe8cc76985484cc7badb53158fdd508c: No bootstrap required, opened a new log
18:30:56.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.406226 32357 consensus_queue.cc:260] T 088641b735ea44c68946bc19f249c6ef P 9528f2c8dcc74589a5fd8b8b121d42c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.406867 32359 ts_tablet_manager.cc:1403] T 0d7d727e45674353a019fb4400b5b816 P fe8cc76985484cc7badb53158fdd508c: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.005s
18:30:56.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.406759 32358 raft_consensus.cc:359] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.407780 32358 raft_consensus.cc:385] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:56.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.408124 32358 raft_consensus.cc:740] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65f318326a6a4a469ec95434167d0082, State: Initialized, Role: FOLLOWER
18:30:56.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.409113 32357 ts_tablet_manager.cc:1434] T 088641b735ea44c68946bc19f249c6ef P 9528f2c8dcc74589a5fd8b8b121d42c0: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
18:30:56.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.409314 32358 consensus_queue.cc:260] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.421198 32365 raft_consensus.cc:493] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:30:56.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.421741 32365 raft_consensus.cc:515] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.423054 32357 tablet_bootstrap.cc:492] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0: Bootstrap starting.
18:30:56.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.422250 32359 raft_consensus.cc:359] T 0d7d727e45674353a019fb4400b5b816 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.424429 32359 raft_consensus.cc:385] T 0d7d727e45674353a019fb4400b5b816 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:56.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.424878 32359 raft_consensus.cc:740] T 0d7d727e45674353a019fb4400b5b816 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8cc76985484cc7badb53158fdd508c, State: Initialized, Role: FOLLOWER
18:30:56.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.425935 32359 consensus_queue.cc:260] T 0d7d727e45674353a019fb4400b5b816 P fe8cc76985484cc7badb53158fdd508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.430441 32365 leader_election.cc:290] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9528f2c8dcc74589a5fd8b8b121d42c0 (127.30.11.194:38295), fe8cc76985484cc7badb53158fdd508c (127.30.11.195:42383)
18:30:56.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.431236 32359 ts_tablet_manager.cc:1434] T 0d7d727e45674353a019fb4400b5b816 P fe8cc76985484cc7badb53158fdd508c: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
18:30:56.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.442905 32358 ts_tablet_manager.cc:1434] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
18:30:56.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.443547 32357 tablet_bootstrap.cc:654] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0: Neither blocks nor log segments found. Creating new log.
18:30:56.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.447813 32359 tablet_bootstrap.cc:492] T 088641b735ea44c68946bc19f249c6ef P fe8cc76985484cc7badb53158fdd508c: Bootstrap starting.
18:30:56.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.453963 32364 raft_consensus.cc:493] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:30:56.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.454538 32364 raft_consensus.cc:515] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.457911 32358 tablet_bootstrap.cc:492] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082: Bootstrap starting.
18:30:56.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.462072 32364 leader_election.cc:290] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65f318326a6a4a469ec95434167d0082 (127.30.11.193:33411), 9528f2c8dcc74589a5fd8b8b121d42c0 (127.30.11.194:38295)
18:30:56.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.472862 32358 tablet_bootstrap.cc:654] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082: Neither blocks nor log segments found. Creating new log.
18:30:56.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.473551 32359 tablet_bootstrap.cc:654] T 088641b735ea44c68946bc19f249c6ef P fe8cc76985484cc7badb53158fdd508c: Neither blocks nor log segments found. Creating new log.
18:30:56.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.475131 32357 tablet_bootstrap.cc:492] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0: No bootstrap required, opened a new log
18:30:56.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.475632 32357 ts_tablet_manager.cc:1403] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0: Time spent bootstrapping tablet: real 0.063s	user 0.005s	sys 0.007s
18:30:56.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.478813 32357 raft_consensus.cc:359] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.479708 32357 raft_consensus.cc:385] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:56.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.480047 32357 raft_consensus.cc:740] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9528f2c8dcc74589a5fd8b8b121d42c0, State: Initialized, Role: FOLLOWER
18:30:56.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.480868 32357 consensus_queue.cc:260] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.483378 32357 ts_tablet_manager.cc:1434] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
18:30:56.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.484748 32357 tablet_bootstrap.cc:492] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 9528f2c8dcc74589a5fd8b8b121d42c0: Bootstrap starting.
18:30:56.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:56.490659 31356 tablet.cc:2406] T 088641b735ea44c68946bc19f249c6ef P 9528f2c8dcc74589a5fd8b8b121d42c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:30:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.503892 32357 tablet_bootstrap.cc:654] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 9528f2c8dcc74589a5fd8b8b121d42c0: Neither blocks nor log segments found. Creating new log.
18:30:56.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.505986 31304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088641b735ea44c68946bc19f249c6ef" candidate_uuid: "65f318326a6a4a469ec95434167d0082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" is_pre_election: true
18:30:56.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.507453 31304 raft_consensus.cc:2468] T 088641b735ea44c68946bc19f249c6ef P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65f318326a6a4a469ec95434167d0082 in term 0.
18:30:56.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.509645 32358 tablet_bootstrap.cc:492] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082: No bootstrap required, opened a new log
18:30:56.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.509521 31095 leader_election.cc:304] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65f318326a6a4a469ec95434167d0082, 9528f2c8dcc74589a5fd8b8b121d42c0; no voters: 
18:30:56.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.510164 32358 ts_tablet_manager.cc:1403] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.004s
18:30:56.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:56.511082 31498 tablet.cc:2406] T 0d7d727e45674353a019fb4400b5b816 P fe8cc76985484cc7badb53158fdd508c: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:30:56.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.511940 32365 raft_consensus.cc:2804] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:30:56.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.512295 32365 raft_consensus.cc:493] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:30:56.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.512625 32365 raft_consensus.cc:3060] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Advancing to term 1
18:30:56.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.513695 32359 tablet_bootstrap.cc:492] T 088641b735ea44c68946bc19f249c6ef P fe8cc76985484cc7badb53158fdd508c: No bootstrap required, opened a new log
18:30:56.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.514230 32359 ts_tablet_manager.cc:1403] T 088641b735ea44c68946bc19f249c6ef P fe8cc76985484cc7badb53158fdd508c: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.008s
18:30:56.518 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:56.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.518743 32359 raft_consensus.cc:359] T 088641b735ea44c68946bc19f249c6ef P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.519744 32359 raft_consensus.cc:385] T 088641b735ea44c68946bc19f249c6ef P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:56.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.520145 32359 raft_consensus.cc:740] T 088641b735ea44c68946bc19f249c6ef P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8cc76985484cc7badb53158fdd508c, State: Initialized, Role: FOLLOWER
18:30:56.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.521226 32359 consensus_queue.cc:260] T 088641b735ea44c68946bc19f249c6ef P fe8cc76985484cc7badb53158fdd508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.523660 32357 tablet_bootstrap.cc:492] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 9528f2c8dcc74589a5fd8b8b121d42c0: No bootstrap required, opened a new log
18:30:56.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.524250 32357 ts_tablet_manager.cc:1403] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 9528f2c8dcc74589a5fd8b8b121d42c0: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.012s
18:30:56.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.525740 32359 ts_tablet_manager.cc:1434] T 088641b735ea44c68946bc19f249c6ef P fe8cc76985484cc7badb53158fdd508c: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.005s
18:30:56.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.527540 32359 tablet_bootstrap.cc:492] T fc2c4cc9a9e04c2ab9e58e687df02d61 P fe8cc76985484cc7badb53158fdd508c: Bootstrap starting.
18:30:56.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.528399 32357 raft_consensus.cc:359] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.529279 32357 raft_consensus.cc:385] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:56.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.529713 32357 raft_consensus.cc:740] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9528f2c8dcc74589a5fd8b8b121d42c0, State: Initialized, Role: FOLLOWER
18:30:56.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.530673 32357 consensus_queue.cc:260] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 9528f2c8dcc74589a5fd8b8b121d42c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.531999 32365 raft_consensus.cc:515] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.534561 32357 ts_tablet_manager.cc:1434] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 9528f2c8dcc74589a5fd8b8b121d42c0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
18:30:56.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.535714 32357 tablet_bootstrap.cc:492] T 0d7d727e45674353a019fb4400b5b816 P 9528f2c8dcc74589a5fd8b8b121d42c0: Bootstrap starting.
18:30:56.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.541456 32359 tablet_bootstrap.cc:654] T fc2c4cc9a9e04c2ab9e58e687df02d61 P fe8cc76985484cc7badb53158fdd508c: Neither blocks nor log segments found. Creating new log.
18:30:56.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.543781 32357 tablet_bootstrap.cc:654] T 0d7d727e45674353a019fb4400b5b816 P 9528f2c8dcc74589a5fd8b8b121d42c0: Neither blocks nor log segments found. Creating new log.
18:30:56.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:56.544773 31219 tablet.cc:2406] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:30:56.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.548563 32358 raft_consensus.cc:359] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.549264 32358 raft_consensus.cc:385] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:56.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.549537 32358 raft_consensus.cc:740] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65f318326a6a4a469ec95434167d0082, State: Initialized, Role: FOLLOWER
18:30:56.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.550210 32358 consensus_queue.cc:260] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.554670 32359 tablet_bootstrap.cc:492] T fc2c4cc9a9e04c2ab9e58e687df02d61 P fe8cc76985484cc7badb53158fdd508c: No bootstrap required, opened a new log
18:30:56.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.555006 32357 tablet_bootstrap.cc:492] T 0d7d727e45674353a019fb4400b5b816 P 9528f2c8dcc74589a5fd8b8b121d42c0: No bootstrap required, opened a new log
18:30:56.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.555435 32357 ts_tablet_manager.cc:1403] T 0d7d727e45674353a019fb4400b5b816 P 9528f2c8dcc74589a5fd8b8b121d42c0: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
18:30:56.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.555460 32359 ts_tablet_manager.cc:1403] T fc2c4cc9a9e04c2ab9e58e687df02d61 P fe8cc76985484cc7badb53158fdd508c: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.007s
18:30:56.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.557814 31304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088641b735ea44c68946bc19f249c6ef" candidate_uuid: "65f318326a6a4a469ec95434167d0082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0"
18:30:56.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.558192 32365 leader_election.cc:290] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [CANDIDATE]: Term 1 election: Requested vote from peers 9528f2c8dcc74589a5fd8b8b121d42c0 (127.30.11.194:38295), fe8cc76985484cc7badb53158fdd508c (127.30.11.195:42383)
18:30:56.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.558657 31304 raft_consensus.cc:3060] T 088641b735ea44c68946bc19f249c6ef P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Advancing to term 1
18:30:56.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.559002 32357 raft_consensus.cc:359] T 0d7d727e45674353a019fb4400b5b816 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.559751 32357 raft_consensus.cc:385] T 0d7d727e45674353a019fb4400b5b816 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:56.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.560079 32357 raft_consensus.cc:740] T 0d7d727e45674353a019fb4400b5b816 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9528f2c8dcc74589a5fd8b8b121d42c0, State: Initialized, Role: FOLLOWER
18:30:56.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.560974 32357 consensus_queue.cc:260] T 0d7d727e45674353a019fb4400b5b816 P 9528f2c8dcc74589a5fd8b8b121d42c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.565369 32357 ts_tablet_manager.cc:1434] T 0d7d727e45674353a019fb4400b5b816 P 9528f2c8dcc74589a5fd8b8b121d42c0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
18:30:56.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.571642 31304 raft_consensus.cc:2468] T 088641b735ea44c68946bc19f249c6ef P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65f318326a6a4a469ec95434167d0082 in term 1.
18:30:56.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.573372 32359 raft_consensus.cc:359] T fc2c4cc9a9e04c2ab9e58e687df02d61 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.574656 32359 raft_consensus.cc:385] T fc2c4cc9a9e04c2ab9e58e687df02d61 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:56.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.575172 32359 raft_consensus.cc:740] T fc2c4cc9a9e04c2ab9e58e687df02d61 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8cc76985484cc7badb53158fdd508c, State: Initialized, Role: FOLLOWER
18:30:56.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.576159 32359 consensus_queue.cc:260] T fc2c4cc9a9e04c2ab9e58e687df02d61 P fe8cc76985484cc7badb53158fdd508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.576746 31095 leader_election.cc:304] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65f318326a6a4a469ec95434167d0082, 9528f2c8dcc74589a5fd8b8b121d42c0; no voters: 
18:30:56.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.578994 32365 raft_consensus.cc:2804] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [term 1 FOLLOWER]: Leader election won for term 1
18:30:56.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.579612 32365 raft_consensus.cc:697] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [term 1 LEADER]: Becoming Leader. State: Replica: 65f318326a6a4a469ec95434167d0082, State: Running, Role: LEADER
18:30:56.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.581147 32359 ts_tablet_manager.cc:1434] T fc2c4cc9a9e04c2ab9e58e687df02d61 P fe8cc76985484cc7badb53158fdd508c: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
18:30:56.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.580775 32365 consensus_queue.cc:237] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.582168 32359 tablet_bootstrap.cc:492] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c: Bootstrap starting.
18:30:56.595 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:56.596 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:56.596 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:56.597 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:56.597 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:56.597 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:56.597 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:56.597 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:56.597 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:56.597 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:56.598 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:56.598 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:56.598 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:56.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.597796 32358 ts_tablet_manager.cc:1434] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082: Time spent starting tablet: real 0.087s	user 0.011s	sys 0.000s
18:30:56.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.598946 32358 tablet_bootstrap.cc:492] T bc0990262e854002be30002e55828c42 P 65f318326a6a4a469ec95434167d0082: Bootstrap starting.
18:30:56.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.601233 32359 tablet_bootstrap.cc:654] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c: Neither blocks nor log segments found. Creating new log.
18:30:56.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.608408 31304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1596d99b6178400ca4f4e37e3cbfe9aa" candidate_uuid: "fe8cc76985484cc7badb53158fdd508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" is_pre_election: true
18:30:56.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.609017 31304 raft_consensus.cc:2468] T 1596d99b6178400ca4f4e37e3cbfe9aa P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe8cc76985484cc7badb53158fdd508c in term 0.
18:30:56.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.610647 31380 leader_election.cc:304] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9528f2c8dcc74589a5fd8b8b121d42c0, fe8cc76985484cc7badb53158fdd508c; no voters: 
18:30:56.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.611797 32364 raft_consensus.cc:2804] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Leader pre-election won for term 1
18:30:56.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.612154 32364 raft_consensus.cc:493] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:30:56.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.612509 32364 raft_consensus.cc:3060] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Advancing to term 1
18:30:56.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.619114 32381 raft_consensus.cc:493] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:30:56.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.620639 32381 raft_consensus.cc:515] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.621982 32364 raft_consensus.cc:515] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.624788 31164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1596d99b6178400ca4f4e37e3cbfe9aa" candidate_uuid: "fe8cc76985484cc7badb53158fdd508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65f318326a6a4a469ec95434167d0082" is_pre_election: true
18:30:56.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.626261 31164 raft_consensus.cc:2468] T 1596d99b6178400ca4f4e37e3cbfe9aa P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe8cc76985484cc7badb53158fdd508c in term 0.
18:30:56.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.631587 31304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1596d99b6178400ca4f4e37e3cbfe9aa" candidate_uuid: "fe8cc76985484cc7badb53158fdd508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0"
18:30:56.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.632109 31304 raft_consensus.cc:3060] T 1596d99b6178400ca4f4e37e3cbfe9aa P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Advancing to term 1
18:30:56.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.634393 31163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1596d99b6178400ca4f4e37e3cbfe9aa" candidate_uuid: "fe8cc76985484cc7badb53158fdd508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65f318326a6a4a469ec95434167d0082"
18:30:56.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.638466 31304 raft_consensus.cc:2468] T 1596d99b6178400ca4f4e37e3cbfe9aa P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe8cc76985484cc7badb53158fdd508c in term 1.
18:30:56.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.639501 31163 raft_consensus.cc:3060] T 1596d99b6178400ca4f4e37e3cbfe9aa P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Advancing to term 1
18:30:56.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.643566 31380 leader_election.cc:304] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9528f2c8dcc74589a5fd8b8b121d42c0, fe8cc76985484cc7badb53158fdd508c; no voters: 
18:30:56.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.648537 32364 leader_election.cc:290] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [CANDIDATE]: Term 1 election: Requested vote from peers 65f318326a6a4a469ec95434167d0082 (127.30.11.193:33411), 9528f2c8dcc74589a5fd8b8b121d42c0 (127.30.11.194:38295)
18:30:56.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.649299 32364 raft_consensus.cc:2804] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [term 1 FOLLOWER]: Leader election won for term 1
18:30:56.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.649792 32364 raft_consensus.cc:697] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [term 1 LEADER]: Becoming Leader. State: Replica: fe8cc76985484cc7badb53158fdd508c, State: Running, Role: LEADER
18:30:56.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.652490 32364 consensus_queue.cc:237] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.668555 32359 tablet_bootstrap.cc:492] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c: No bootstrap required, opened a new log
18:30:56.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.669015 32359 ts_tablet_manager.cc:1403] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c: Time spent bootstrapping tablet: real 0.087s	user 0.018s	sys 0.016s
18:30:56.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.669129 30970 catalog_manager.cc:5696] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65f318326a6a4a469ec95434167d0082 (127.30.11.193). New cstate: current_term: 1 leader_uuid: "65f318326a6a4a469ec95434167d0082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } health_report { overall_health: UNKNOWN } } }
18:30:56.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.673293 32359 raft_consensus.cc:359] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.674003 32359 raft_consensus.cc:385] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:56.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.674281 32359 raft_consensus.cc:740] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8cc76985484cc7badb53158fdd508c, State: Initialized, Role: FOLLOWER
18:30:56.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.675056 32359 consensus_queue.cc:260] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.677848 32359 ts_tablet_manager.cc:1434] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
18:30:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.682842 31163 raft_consensus.cc:2468] T 1596d99b6178400ca4f4e37e3cbfe9aa P 65f318326a6a4a469ec95434167d0082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe8cc76985484cc7badb53158fdd508c in term 1.
18:30:56.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.684906 32381 leader_election.cc:290] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9528f2c8dcc74589a5fd8b8b121d42c0 (127.30.11.194:38295), fe8cc76985484cc7badb53158fdd508c (127.30.11.195:42383)
18:30:56.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.686152 32358 tablet_bootstrap.cc:654] T bc0990262e854002be30002e55828c42 P 65f318326a6a4a469ec95434167d0082: Neither blocks nor log segments found. Creating new log.
18:30:56.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.686430 31304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2c4cc9a9e04c2ab9e58e687df02d61" candidate_uuid: "65f318326a6a4a469ec95434167d0082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" is_pre_election: true
18:30:56.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.687032 31304 raft_consensus.cc:2468] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65f318326a6a4a469ec95434167d0082 in term 0.
18:30:56.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.688679 31095 leader_election.cc:304] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65f318326a6a4a469ec95434167d0082, 9528f2c8dcc74589a5fd8b8b121d42c0; no voters: 
18:30:56.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.690114 32381 raft_consensus.cc:2804] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:30:56.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.690447 32381 raft_consensus.cc:493] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:30:56.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.690788 32381 raft_consensus.cc:3060] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Advancing to term 1
18:30:56.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.700512 32358 tablet_bootstrap.cc:492] T bc0990262e854002be30002e55828c42 P 65f318326a6a4a469ec95434167d0082: No bootstrap required, opened a new log
18:30:56.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.701157 32358 ts_tablet_manager.cc:1403] T bc0990262e854002be30002e55828c42 P 65f318326a6a4a469ec95434167d0082: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.007s
18:30:56.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.704279 32358 raft_consensus.cc:359] T bc0990262e854002be30002e55828c42 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.705482 31444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2c4cc9a9e04c2ab9e58e687df02d61" candidate_uuid: "65f318326a6a4a469ec95434167d0082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8cc76985484cc7badb53158fdd508c" is_pre_election: true
18:30:56.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.705992 31446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088641b735ea44c68946bc19f249c6ef" candidate_uuid: "65f318326a6a4a469ec95434167d0082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8cc76985484cc7badb53158fdd508c" is_pre_election: true
18:30:56.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.707070 31444 raft_consensus.cc:2468] T fc2c4cc9a9e04c2ab9e58e687df02d61 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65f318326a6a4a469ec95434167d0082 in term 0.
18:30:56.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.707504 31445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088641b735ea44c68946bc19f249c6ef" candidate_uuid: "65f318326a6a4a469ec95434167d0082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8cc76985484cc7badb53158fdd508c"
18:30:56.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.722287 31446 raft_consensus.cc:2468] T 088641b735ea44c68946bc19f249c6ef P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65f318326a6a4a469ec95434167d0082 in term 0.
18:30:56.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.720819 30969 catalog_manager.cc:5696] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c reported cstate change: term changed from 0 to 1, leader changed from <none> to fe8cc76985484cc7badb53158fdd508c (127.30.11.195). New cstate: current_term: 1 leader_uuid: "fe8cc76985484cc7badb53158fdd508c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } health_report { overall_health: HEALTHY } } }
18:30:56.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.731017 32358 raft_consensus.cc:385] T bc0990262e854002be30002e55828c42 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:56.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.731621 32358 raft_consensus.cc:740] T bc0990262e854002be30002e55828c42 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65f318326a6a4a469ec95434167d0082, State: Initialized, Role: FOLLOWER
18:30:56.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.732659 32358 consensus_queue.cc:260] T bc0990262e854002be30002e55828c42 P 65f318326a6a4a469ec95434167d0082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:56.733119 31380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.11.194:38295, user_credentials={real_user=slave}} blocked reactor thread for 89433.9us
18:30:56.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.734789 32381 raft_consensus.cc:515] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.740628 32381 leader_election.cc:290] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [CANDIDATE]: Term 1 election: Requested vote from peers 9528f2c8dcc74589a5fd8b8b121d42c0 (127.30.11.194:38295), fe8cc76985484cc7badb53158fdd508c (127.30.11.195:42383)
18:30:56.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.738762 32358 ts_tablet_manager.cc:1434] T bc0990262e854002be30002e55828c42 P 65f318326a6a4a469ec95434167d0082: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
18:30:56.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.741582 31304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2c4cc9a9e04c2ab9e58e687df02d61" candidate_uuid: "65f318326a6a4a469ec95434167d0082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0"
18:30:56.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.742141 31304 raft_consensus.cc:3060] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Advancing to term 1
18:30:56.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.742928 31446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2c4cc9a9e04c2ab9e58e687df02d61" candidate_uuid: "65f318326a6a4a469ec95434167d0082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8cc76985484cc7badb53158fdd508c"
18:30:56.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.743429 31446 raft_consensus.cc:3060] T fc2c4cc9a9e04c2ab9e58e687df02d61 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Advancing to term 1
18:30:56.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.755036 31446 raft_consensus.cc:2468] T fc2c4cc9a9e04c2ab9e58e687df02d61 P fe8cc76985484cc7badb53158fdd508c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65f318326a6a4a469ec95434167d0082 in term 1.
18:30:56.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.760512 31304 raft_consensus.cc:2468] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65f318326a6a4a469ec95434167d0082 in term 1.
18:30:56.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.759557 31096 leader_election.cc:304] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65f318326a6a4a469ec95434167d0082, fe8cc76985484cc7badb53158fdd508c; no voters: 
18:30:56.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.761812 32381 raft_consensus.cc:2804] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [term 1 FOLLOWER]: Leader election won for term 1
18:30:56.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.762255 32381 raft_consensus.cc:697] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [term 1 LEADER]: Becoming Leader. State: Replica: 65f318326a6a4a469ec95434167d0082, State: Running, Role: LEADER
18:30:56.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.763057 32381 consensus_queue.cc:237] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.763480 32363 raft_consensus.cc:493] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:30:56.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.764115 32363 raft_consensus.cc:515] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.767728 32363 leader_election.cc:290] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65f318326a6a4a469ec95434167d0082 (127.30.11.193:33411), fe8cc76985484cc7badb53158fdd508c (127.30.11.195:42383)
18:30:56.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.769078 32365 raft_consensus.cc:493] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:30:56.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.769500 32365 raft_consensus.cc:515] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.771440 32365 leader_election.cc:290] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9528f2c8dcc74589a5fd8b8b121d42c0 (127.30.11.194:38295), fe8cc76985484cc7badb53158fdd508c (127.30.11.195:42383)
18:30:56.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.774168 31446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7d727e45674353a019fb4400b5b816" candidate_uuid: "65f318326a6a4a469ec95434167d0082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8cc76985484cc7badb53158fdd508c" is_pre_election: true
18:30:56.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.775084 31446 raft_consensus.cc:2468] T 0d7d727e45674353a019fb4400b5b816 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65f318326a6a4a469ec95434167d0082 in term 0.
18:30:56.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.776459 31096 leader_election.cc:304] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65f318326a6a4a469ec95434167d0082, fe8cc76985484cc7badb53158fdd508c; no voters: 
18:30:56.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.778148 32365 raft_consensus.cc:2804] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:30:56.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.778481 32365 raft_consensus.cc:493] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:30:56.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.778816 32365 raft_consensus.cc:3060] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Advancing to term 1
18:30:56.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.785533 32365 raft_consensus.cc:515] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.791169 32365 leader_election.cc:290] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [CANDIDATE]: Term 1 election: Requested vote from peers 9528f2c8dcc74589a5fd8b8b121d42c0 (127.30.11.194:38295), fe8cc76985484cc7badb53158fdd508c (127.30.11.195:42383)
18:30:56.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.792699 31446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7d727e45674353a019fb4400b5b816" candidate_uuid: "65f318326a6a4a469ec95434167d0082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8cc76985484cc7badb53158fdd508c"
18:30:56.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.793380 31446 raft_consensus.cc:3060] T 0d7d727e45674353a019fb4400b5b816 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Advancing to term 1
18:30:56.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.809613 31446 raft_consensus.cc:2468] T 0d7d727e45674353a019fb4400b5b816 P fe8cc76985484cc7badb53158fdd508c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65f318326a6a4a469ec95434167d0082 in term 1.
18:30:56.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.815127 31096 leader_election.cc:304] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65f318326a6a4a469ec95434167d0082, fe8cc76985484cc7badb53158fdd508c; no voters: 
18:30:56.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.816056 32365 raft_consensus.cc:2804] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [term 1 FOLLOWER]: Leader election won for term 1
18:30:56.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.816498 32365 raft_consensus.cc:697] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [term 1 LEADER]: Becoming Leader. State: Replica: 65f318326a6a4a469ec95434167d0082, State: Running, Role: LEADER
18:30:56.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.817268 32365 consensus_queue.cc:237] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.825030 32324 heartbeater.cc:499] Master 127.30.195.124:38627 was elected leader, sending a full tablet report...
18:30:56.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.853713 32386 raft_consensus.cc:493] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:30:56.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.854269 32386 raft_consensus.cc:515] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.859113 31304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7d727e45674353a019fb4400b5b816" candidate_uuid: "65f318326a6a4a469ec95434167d0082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" is_pre_election: true
18:30:56.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.859705 31304 raft_consensus.cc:2468] T 0d7d727e45674353a019fb4400b5b816 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65f318326a6a4a469ec95434167d0082 in term 0.
18:30:56.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.860446 31303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0990262e854002be30002e55828c42" candidate_uuid: "fe8cc76985484cc7badb53158fdd508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" is_pre_election: true
18:30:56.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.861088 31303 raft_consensus.cc:2468] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe8cc76985484cc7badb53158fdd508c in term 0.
18:30:56.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.861055 31163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0990262e854002be30002e55828c42" candidate_uuid: "fe8cc76985484cc7badb53158fdd508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65f318326a6a4a469ec95434167d0082" is_pre_election: true
18:30:56.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.861649 31163 raft_consensus.cc:2468] T bc0990262e854002be30002e55828c42 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe8cc76985484cc7badb53158fdd508c in term 0.
18:30:56.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.861688 32386 leader_election.cc:290] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65f318326a6a4a469ec95434167d0082 (127.30.11.193:33411), 9528f2c8dcc74589a5fd8b8b121d42c0 (127.30.11.194:38295)
18:30:56.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.862591 31304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7d727e45674353a019fb4400b5b816" candidate_uuid: "65f318326a6a4a469ec95434167d0082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0"
18:30:56.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.863080 31304 raft_consensus.cc:3060] T 0d7d727e45674353a019fb4400b5b816 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Advancing to term 1
18:30:56.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.862778 31380 leader_election.cc:304] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9528f2c8dcc74589a5fd8b8b121d42c0, fe8cc76985484cc7badb53158fdd508c; no voters: 
18:30:56.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.867666 32386 raft_consensus.cc:2804] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Leader pre-election won for term 1
18:30:56.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.868103 32386 raft_consensus.cc:493] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:30:56.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.868551 32386 raft_consensus.cc:3060] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Advancing to term 1
18:30:56.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.875516 32386 raft_consensus.cc:515] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.881824 31304 raft_consensus.cc:2468] T 0d7d727e45674353a019fb4400b5b816 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65f318326a6a4a469ec95434167d0082 in term 1.
18:30:56.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.884135 31163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0990262e854002be30002e55828c42" candidate_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65f318326a6a4a469ec95434167d0082" is_pre_election: true
18:30:56.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.885089 31163 raft_consensus.cc:2468] T bc0990262e854002be30002e55828c42 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9528f2c8dcc74589a5fd8b8b121d42c0 in term 0.
18:30:56.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.887890 30970 catalog_manager.cc:5696] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65f318326a6a4a469ec95434167d0082 (127.30.11.193). New cstate: current_term: 1 leader_uuid: "65f318326a6a4a469ec95434167d0082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } health_report { overall_health: UNKNOWN } } }
18:30:56.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.888901 31240 leader_election.cc:304] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65f318326a6a4a469ec95434167d0082, 9528f2c8dcc74589a5fd8b8b121d42c0; no voters: 
18:30:56.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.889807 30970 catalog_manager.cc:5696] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65f318326a6a4a469ec95434167d0082 (127.30.11.193). New cstate: current_term: 1 leader_uuid: "65f318326a6a4a469ec95434167d0082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } health_report { overall_health: UNKNOWN } } }
18:30:56.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.896021 32363 raft_consensus.cc:2804] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:30:56.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.896425 32363 raft_consensus.cc:493] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:30:56.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.896762 32363 raft_consensus.cc:3060] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 0 FOLLOWER]: Advancing to term 1
18:30:56.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.880873 31446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0990262e854002be30002e55828c42" candidate_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8cc76985484cc7badb53158fdd508c" is_pre_election: true
18:30:56.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.904467 32363 raft_consensus.cc:515] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.906349 31446 raft_consensus.cc:2393] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9528f2c8dcc74589a5fd8b8b121d42c0 in current term 1: Already voted for candidate fe8cc76985484cc7badb53158fdd508c in this term.
18:30:56.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.909489 32363 leader_election.cc:290] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [CANDIDATE]: Term 1 election: Requested vote from peers 65f318326a6a4a469ec95434167d0082 (127.30.11.193:33411), fe8cc76985484cc7badb53158fdd508c (127.30.11.195:42383)
18:30:56.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.911111 31163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0990262e854002be30002e55828c42" candidate_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65f318326a6a4a469ec95434167d0082"
18:30:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.911707 31163 raft_consensus.cc:3060] T bc0990262e854002be30002e55828c42 P 65f318326a6a4a469ec95434167d0082 [term 0 FOLLOWER]: Advancing to term 1
18:30:56.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.914386 31446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0990262e854002be30002e55828c42" candidate_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe8cc76985484cc7badb53158fdd508c"
18:30:56.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.915181 31446 raft_consensus.cc:2393] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9528f2c8dcc74589a5fd8b8b121d42c0 in current term 1: Already voted for candidate fe8cc76985484cc7badb53158fdd508c in this term.
18:30:56.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.917651 31164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0990262e854002be30002e55828c42" candidate_uuid: "fe8cc76985484cc7badb53158fdd508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65f318326a6a4a469ec95434167d0082"
18:30:56.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.920888 31304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc0990262e854002be30002e55828c42" candidate_uuid: "fe8cc76985484cc7badb53158fdd508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0"
18:30:56.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.921178 31163 raft_consensus.cc:2468] T bc0990262e854002be30002e55828c42 P 65f318326a6a4a469ec95434167d0082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9528f2c8dcc74589a5fd8b8b121d42c0 in term 1.
18:30:56.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.921774 31304 raft_consensus.cc:2393] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fe8cc76985484cc7badb53158fdd508c in current term 1: Already voted for candidate 9528f2c8dcc74589a5fd8b8b121d42c0 in this term.
18:30:56.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.922500 32386 leader_election.cc:290] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [CANDIDATE]: Term 1 election: Requested vote from peers 65f318326a6a4a469ec95434167d0082 (127.30.11.193:33411), 9528f2c8dcc74589a5fd8b8b121d42c0 (127.30.11.194:38295)
18:30:56.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.923262 31240 leader_election.cc:304] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65f318326a6a4a469ec95434167d0082, 9528f2c8dcc74589a5fd8b8b121d42c0; no voters: fe8cc76985484cc7badb53158fdd508c
18:30:56.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.923235 31380 leader_election.cc:304] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe8cc76985484cc7badb53158fdd508c; no voters: 65f318326a6a4a469ec95434167d0082, 9528f2c8dcc74589a5fd8b8b121d42c0
18:30:56.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.929018 32386 raft_consensus.cc:2749] T bc0990262e854002be30002e55828c42 P fe8cc76985484cc7badb53158fdd508c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
18:30:56.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.929741 32363 raft_consensus.cc:2804] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 1 FOLLOWER]: Leader election won for term 1
18:30:56.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.940205 32363 raft_consensus.cc:697] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [term 1 LEADER]: Becoming Leader. State: Replica: 9528f2c8dcc74589a5fd8b8b121d42c0, State: Running, Role: LEADER
18:30:56.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.941274 32363 consensus_queue.cc:237] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } }
18:30:56.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:56.962212 30970 catalog_manager.cc:5696] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9528f2c8dcc74589a5fd8b8b121d42c0 (127.30.11.194). New cstate: current_term: 1 leader_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 } health_report { overall_health: UNKNOWN } } }
18:30:56.980 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:56.980 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:56.981 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:56.981 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:56.981 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:56.981 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:56.981 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:56.981 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:56.981 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:56.981 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:56.982 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:56.982 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:56.982 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:57.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:57.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:57.085793 32386 consensus_queue.cc:1048] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:30:57.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:57.100319 32365 consensus_queue.cc:1048] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:30:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:57.108120 32406 consensus_queue.cc:1048] T 1596d99b6178400ca4f4e37e3cbfe9aa P fe8cc76985484cc7badb53158fdd508c [LEADER]: Connected to new peer: Peer: permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:30:57.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:57.152894 31446 raft_consensus.cc:3060] T 088641b735ea44c68946bc19f249c6ef P fe8cc76985484cc7badb53158fdd508c [term 0 FOLLOWER]: Advancing to term 1
18:30:57.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:57.168331 32381 consensus_queue.cc:1048] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:30:57.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:57.169664 32365 consensus_queue.cc:1048] T 088641b735ea44c68946bc19f249c6ef P 65f318326a6a4a469ec95434167d0082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:30:57.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:57.220112 32365 consensus_queue.cc:1048] T fc2c4cc9a9e04c2ab9e58e687df02d61 P 65f318326a6a4a469ec95434167d0082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:30:57.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:57.301255 32414 consensus_queue.cc:1048] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9528f2c8dcc74589a5fd8b8b121d42c0" member_type: VOTER last_known_addr { host: "127.30.11.194" port: 38295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:30:57.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:57.332860 32414 consensus_queue.cc:1048] T 0d7d727e45674353a019fb4400b5b816 P 65f318326a6a4a469ec95434167d0082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:30:57.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:57.358237 32363 consensus_queue.cc:1048] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe8cc76985484cc7badb53158fdd508c" member_type: VOTER last_known_addr { host: "127.30.11.195" port: 42383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:30:57.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:57.376216 32363 consensus_queue.cc:1048] T bc0990262e854002be30002e55828c42 P 9528f2c8dcc74589a5fd8b8b121d42c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65f318326a6a4a469ec95434167d0082" member_type: VOTER last_known_addr { host: "127.30.11.193" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:30:57.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:57.785 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:30:57.786 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:30:57.786 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:30:57.786 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:57.786 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:57.786 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:57.786 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:30:57.786 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:57.786 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:30:57.786 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:57.787 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:57.787 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:30:57.787 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:30:58.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:58.434 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:58.435 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:58.435 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:58.435 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:58.435 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:58.435 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:58.435 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:58.435 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:58.435 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:58.435 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:58.436 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:58.436 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:58.436 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:58.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:58.761 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 18b53ee8d31d4c50837c15cc6e9b9583
18:30:58.772 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0d7d727e45674353a019fb4400b5b816 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
18:30:58.772 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet fc2c4cc9a9e04c2ab9e58e687df02d61 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:30:58.772 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 1596d99b6178400ca4f4e37e3cbfe9aa for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:30:58.772 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bc0990262e854002be30002e55828c42 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:30:58.772 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=0d7d727e45674353a019fb4400b5b816@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=1596d99b6178400ca4f4e37e3cbfe9aa@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bc0990262e854002be30002e55828c42@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:30:58.773 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=10), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.11.252:39405, [7ms] Sub RPC GetTableLocations: received response from server master-127.30.11.252:39405: OK, deferred=null) after lookup
18:30:58.773 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:30:58.775 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:30:58.786 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:58.790 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x7beaf00a, L:/127.0.0.1:49586 - R:/127.30.11.193:33411] using TOKEN/null
18:30:58.829 [DEBUG - main] (Connection.java:748) [peer fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)] connecting to peer
18:30:58.830 [DEBUG - kudu-nio-4] (Connection.java:757) [peer fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)] Successfully connected to peer
18:30:58.861 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:58.870 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x813c9b2b, L:/127.0.0.1:43918 - R:/127.30.11.195:42383] using TOKEN/null
18:30:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:58.893971 30920 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0280 after lost signal to thread 30853
18:30:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:58.894816 30920 debug-util.cc:398] Leaking SignalData structure 0x7b080008ab00 after lost signal to thread 30923
18:30:58.897 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 088641b735ea44c68946bc19f249c6ef for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
18:30:58.897 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0d7d727e45674353a019fb4400b5b816 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
18:30:58.897 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet fc2c4cc9a9e04c2ab9e58e687df02d61 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:30:58.897 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 1596d99b6178400ca4f4e37e3cbfe9aa for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:30:58.897 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bc0990262e854002be30002e55828c42 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:30:58.898 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=088641b735ea44c68946bc19f249c6ef@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=0d7d727e45674353a019fb4400b5b816@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=1596d99b6178400ca4f4e37e3cbfe9aa@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bc0990262e854002be30002e55828c42@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:30:58.898 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.11.252:39405, [5ms] Sub RPC GetTableLocations: received response from server master-127.30.11.252:39405: OK, deferred=null) after lookup
18:30:59.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:59.077 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:59.079 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:30:59.080 [DEBUG - main] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:30:59.081 [DEBUG - main] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:30:59.081 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.30.195.125:40423(127.30.195.125:40423)] Successfully connected to peer
18:30:59.086 [DEBUG - main] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:30:59.095 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.30.195.126:33747(127.30.195.126:33747)] Successfully connected to peer
18:30:59.097 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.30.195.124:38627(127.30.195.124:38627)] Successfully connected to peer
18:30:59.108 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.124
18:30:59.114 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.126
18:30:59.117 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.125
18:30:59.134 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:59.135 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:59.143 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb91f2536, L:/127.0.0.1:41080 - R:/127.30.195.125:40423] using SASL/PLAIN
18:30:59.143 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:59.145 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xa705a5c2, L:/127.0.0.1:54730 - R:/127.30.195.126:33747] using SASL/PLAIN
18:30:59.150 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc0661d77, L:/127.0.0.1:47212 - R:/127.30.195.124:38627] using SASL/PLAIN
18:30:59.160 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:30:59.160 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=81), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [72ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: OK, [81ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: OK, deferred=null) after lookup
18:30:59.175 [DEBUG - main] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:30:59.176 [DEBUG - main] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:30:59.184 [DEBUG - main] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:30:59.185 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.30.11.252:39405(127.30.11.252:39405)] Successfully connected to peer
18:30:59.184 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.30.11.254:41811(127.30.11.254:41811)] Successfully connected to peer
18:30:59.199 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.252
18:30:59.199 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.254
18:30:59.202 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.30.11.253:35677(127.30.11.253:35677)] Successfully connected to peer
18:30:59.217 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.253
18:30:59.214 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:59.224 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:59.226 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf4c9371f, L:/127.0.0.1:32956 - R:/127.30.11.254:41811] using SASL/PLAIN
18:30:59.235 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x0d283c31, L:/127.0.0.1:36980 - R:/127.30.11.252:39405] using SASL/PLAIN
18:30:59.236 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:30:59.242 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:30:59.242 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=76), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [56ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: OK, deferred=null) after lookup
18:30:59.245 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xa53e8782, L:/127.0.0.1:42614 - R:/127.30.11.253:35677] using SASL/PLAIN
18:30:59.249 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 18b53ee8d31d4c50837c15cc6e9b9583
18:30:59.256 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 088641b735ea44c68946bc19f249c6ef for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
18:30:59.256 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0d7d727e45674353a019fb4400b5b816 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
18:30:59.256 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet fc2c4cc9a9e04c2ab9e58e687df02d61 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:30:59.256 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 1596d99b6178400ca4f4e37e3cbfe9aa for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:30:59.256 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bc0990262e854002be30002e55828c42 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:30:59.257 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=088641b735ea44c68946bc19f249c6ef@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=0d7d727e45674353a019fb4400b5b816@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=1596d99b6178400ca4f4e37e3cbfe9aa@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bc0990262e854002be30002e55828c42@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.261132 31716 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47212:
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:30:59.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   custom_hash_schema_ranges {
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     range_bounds {
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000"
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     hash_schema {
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       columns {
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)         name: "key1"
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       }
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       num_buckets: 5
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       seed: 123
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:30:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
18:30:59.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:30:59.272549 31716 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
18:30:59.388 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:59.388 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:59.389 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:59.390 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:59.390 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:59.390 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:59.391 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:59.391 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:59.391 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:59.392 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:59.392 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:59.392 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:59.392 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:59.428 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table d0cdf0b8f05947b0883a7449df8326c4
18:30:59.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:30:59.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.540782 31923 tablet_service.cc:1511] Processing CreateTablet for tablet d5ce817a84a143078ef0f217b48456d4 (DEFAULT_TABLE table=replication_test_table [id=d0cdf0b8f05947b0883a7449df8326c4]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:59.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.544649 31925 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 (DEFAULT_TABLE table=replication_test_table [id=d0cdf0b8f05947b0883a7449df8326c4]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:59.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.546578 31925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:59.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.552410 31921 tablet_service.cc:1511] Processing CreateTablet for tablet 6c11de6974dc43b2a66d04f951efa20f (DEFAULT_TABLE table=replication_test_table [id=d0cdf0b8f05947b0883a7449df8326c4]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:59.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.556437 31916 tablet_service.cc:1511] Processing CreateTablet for tablet 105acef0326e4306a624e1f62425453b (DEFAULT_TABLE table=replication_test_table [id=d0cdf0b8f05947b0883a7449df8326c4]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:59.557 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:30:59.558 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:30:59.558 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:30:59.558 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:59.558 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:59.558 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:30:59.559 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:59.559 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:59.559 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:30:59.559 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:59.559 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:59.559 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:30:59.559 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:30:59.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.560626 31918 tablet_service.cc:1511] Processing CreateTablet for tablet 73cd0ad62a2a4f54b07484a5c1388f8d (DEFAULT_TABLE table=replication_test_table [id=d0cdf0b8f05947b0883a7449df8326c4]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:59.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.570079 31918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73cd0ad62a2a4f54b07484a5c1388f8d. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:59.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.574528 31916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105acef0326e4306a624e1f62425453b. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:59.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.577808 31921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c11de6974dc43b2a66d04f951efa20f. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.578773 31923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ce817a84a143078ef0f217b48456d4. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:59.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.603346 32111 tablet_service.cc:1511] Processing CreateTablet for tablet 105acef0326e4306a624e1f62425453b (DEFAULT_TABLE table=replication_test_table [id=d0cdf0b8f05947b0883a7449df8326c4]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:59.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.605580 32111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105acef0326e4306a624e1f62425453b. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:59.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.607148 32112 tablet_service.cc:1511] Processing CreateTablet for tablet 73cd0ad62a2a4f54b07484a5c1388f8d (DEFAULT_TABLE table=replication_test_table [id=d0cdf0b8f05947b0883a7449df8326c4]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:59.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.608453 32112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73cd0ad62a2a4f54b07484a5c1388f8d. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:59.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.612486 32113 tablet_service.cc:1511] Processing CreateTablet for tablet 6c11de6974dc43b2a66d04f951efa20f (DEFAULT_TABLE table=replication_test_table [id=d0cdf0b8f05947b0883a7449df8326c4]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:59.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.613919 32113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c11de6974dc43b2a66d04f951efa20f. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:59.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.615984 32114 tablet_service.cc:1511] Processing CreateTablet for tablet d5ce817a84a143078ef0f217b48456d4 (DEFAULT_TABLE table=replication_test_table [id=d0cdf0b8f05947b0883a7449df8326c4]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:59.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.617659 32114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ce817a84a143078ef0f217b48456d4. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:59.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.612462 32257 tablet_service.cc:1511] Processing CreateTablet for tablet 6c11de6974dc43b2a66d04f951efa20f (DEFAULT_TABLE table=replication_test_table [id=d0cdf0b8f05947b0883a7449df8326c4]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:59.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.617142 32259 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 (DEFAULT_TABLE table=replication_test_table [id=d0cdf0b8f05947b0883a7449df8326c4]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:59.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.622398 32115 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 (DEFAULT_TABLE table=replication_test_table [id=d0cdf0b8f05947b0883a7449df8326c4]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:59.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.614162 32255 tablet_service.cc:1511] Processing CreateTablet for tablet 105acef0326e4306a624e1f62425453b (DEFAULT_TABLE table=replication_test_table [id=d0cdf0b8f05947b0883a7449df8326c4]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:59.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.623682 32115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:59.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.624111 32255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105acef0326e4306a624e1f62425453b. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:59.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.615724 32256 tablet_service.cc:1511] Processing CreateTablet for tablet 73cd0ad62a2a4f54b07484a5c1388f8d (DEFAULT_TABLE table=replication_test_table [id=d0cdf0b8f05947b0883a7449df8326c4]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:59.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.627765 32259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:59.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.630155 32256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73cd0ad62a2a4f54b07484a5c1388f8d. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:59.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.625232 32258 tablet_service.cc:1511] Processing CreateTablet for tablet d5ce817a84a143078ef0f217b48456d4 (DEFAULT_TABLE table=replication_test_table [id=d0cdf0b8f05947b0883a7449df8326c4]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
18:30:59.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.639199 32257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c11de6974dc43b2a66d04f951efa20f. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:59.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.642966 32258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ce817a84a143078ef0f217b48456d4. 1 dirs total, 0 dirs full, 0 dirs failed
18:30:59.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.749768 32485 tablet_bootstrap.cc:492] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7: Bootstrap starting.
18:30:59.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.768263 32486 tablet_bootstrap.cc:492] T 105acef0326e4306a624e1f62425453b P 848a93fc4b3244bd88f2910885d4bd9f: Bootstrap starting.
18:30:59.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.779677 32487 tablet_bootstrap.cc:492] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6: Bootstrap starting.
18:30:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.791925 32486 tablet_bootstrap.cc:654] T 105acef0326e4306a624e1f62425453b P 848a93fc4b3244bd88f2910885d4bd9f: Neither blocks nor log segments found. Creating new log.
18:30:59.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.794134 32486 log.cc:826] T 105acef0326e4306a624e1f62425453b P 848a93fc4b3244bd88f2910885d4bd9f: Log is configured to *not* fsync() on all Append() calls
18:30:59.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.799626 32487 tablet_bootstrap.cc:654] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6: Neither blocks nor log segments found. Creating new log.
18:30:59.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.801961 32487 log.cc:826] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6: Log is configured to *not* fsync() on all Append() calls
18:30:59.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.809006 32486 tablet_bootstrap.cc:492] T 105acef0326e4306a624e1f62425453b P 848a93fc4b3244bd88f2910885d4bd9f: No bootstrap required, opened a new log
18:30:59.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.809487 32486 ts_tablet_manager.cc:1403] T 105acef0326e4306a624e1f62425453b P 848a93fc4b3244bd88f2910885d4bd9f: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.006s
18:30:59.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.810256 32485 tablet_bootstrap.cc:654] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7: Neither blocks nor log segments found. Creating new log.
18:30:59.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.819689 32487 tablet_bootstrap.cc:492] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6: No bootstrap required, opened a new log
18:30:59.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.820323 32487 ts_tablet_manager.cc:1403] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.006s
18:30:59.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.822067 32485 log.cc:826] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7: Log is configured to *not* fsync() on all Append() calls
18:30:59.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.850185 32486 raft_consensus.cc:359] T 105acef0326e4306a624e1f62425453b P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:30:59.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.851416 32486 raft_consensus.cc:385] T 105acef0326e4306a624e1f62425453b P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:59.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.851833 32486 raft_consensus.cc:740] T 105acef0326e4306a624e1f62425453b P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 848a93fc4b3244bd88f2910885d4bd9f, State: Initialized, Role: FOLLOWER
18:30:59.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.852885 32486 consensus_queue.cc:260] T 105acef0326e4306a624e1f62425453b P 848a93fc4b3244bd88f2910885d4bd9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:30:59.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.868569 32487 raft_consensus.cc:359] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:30:59.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.869589 32487 raft_consensus.cc:385] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:59.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.869876 32487 raft_consensus.cc:740] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aca7da9f7ca4619ad516415905960e6, State: Initialized, Role: FOLLOWER
18:30:59.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.870878 32487 consensus_queue.cc:260] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:30:59.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.875303 32486 ts_tablet_manager.cc:1434] T 105acef0326e4306a624e1f62425453b P 848a93fc4b3244bd88f2910885d4bd9f: Time spent starting tablet: real 0.065s	user 0.037s	sys 0.011s
18:30:59.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.876415 32486 tablet_bootstrap.cc:492] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f: Bootstrap starting.
18:30:59.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.883572 32486 tablet_bootstrap.cc:654] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f: Neither blocks nor log segments found. Creating new log.
18:30:59.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.896214 32486 tablet_bootstrap.cc:492] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f: No bootstrap required, opened a new log
18:30:59.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.896974 32486 ts_tablet_manager.cc:1403] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.013s
18:30:59.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.900457 32486 raft_consensus.cc:359] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:30:59.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.901330 32486 raft_consensus.cc:385] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:59.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.901712 32486 raft_consensus.cc:740] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 848a93fc4b3244bd88f2910885d4bd9f, State: Initialized, Role: FOLLOWER
18:30:59.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.902081 32485 tablet_bootstrap.cc:492] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7: No bootstrap required, opened a new log
18:30:59.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.903053 32485 ts_tablet_manager.cc:1403] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7: Time spent bootstrapping tablet: real 0.156s	user 0.010s	sys 0.010s
18:30:59.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.902513 32486 consensus_queue.cc:260] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:30:59.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.905170 32486 ts_tablet_manager.cc:1434] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
18:30:59.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.906126 32486 tablet_bootstrap.cc:492] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 848a93fc4b3244bd88f2910885d4bd9f: Bootstrap starting.
18:30:59.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.913338 32486 tablet_bootstrap.cc:654] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 848a93fc4b3244bd88f2910885d4bd9f: Neither blocks nor log segments found. Creating new log.
18:30:59.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.936766 32486 tablet_bootstrap.cc:492] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 848a93fc4b3244bd88f2910885d4bd9f: No bootstrap required, opened a new log
18:30:59.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.937232 32486 ts_tablet_manager.cc:1403] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 848a93fc4b3244bd88f2910885d4bd9f: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.009s
18:30:59.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.940408 32486 raft_consensus.cc:359] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } }
18:30:59.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.941098 32486 raft_consensus.cc:385] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:30:59.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.941406 32486 raft_consensus.cc:740] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 848a93fc4b3244bd88f2910885d4bd9f, State: Initialized, Role: FOLLOWER
18:30:59.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.942106 32486 consensus_queue.cc:260] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 848a93fc4b3244bd88f2910885d4bd9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } }
18:30:59.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.944345 32486 ts_tablet_manager.cc:1434] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 848a93fc4b3244bd88f2910885d4bd9f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
18:30:59.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.945462 32486 tablet_bootstrap.cc:492] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f: Bootstrap starting.
18:30:59.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.952322 32486 tablet_bootstrap.cc:654] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f: Neither blocks nor log segments found. Creating new log.
18:30:59.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.979393 32493 raft_consensus.cc:493] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:30:59.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.982576 32493 raft_consensus.cc:515] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:30:59.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.988897 32487 ts_tablet_manager.cc:1434] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6: Time spent starting tablet: real 0.168s	user 0.041s	sys 0.038s
18:30:59.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:30:59.989979 32487 tablet_bootstrap.cc:492] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6: Bootstrap starting.
18:31:00.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.009743 32487 tablet_bootstrap.cc:654] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6: Neither blocks nor log segments found. Creating new log.
18:31:00.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:00.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.025611 32487 tablet_bootstrap.cc:492] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6: No bootstrap required, opened a new log
18:31:00.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.026084 32487 ts_tablet_manager.cc:1403] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.000s
18:31:00.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.026763 32493 leader_election.cc:290] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 848a93fc4b3244bd88f2910885d4bd9f (127.30.195.66:40191), 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841)
18:31:00.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.030488 32487 raft_consensus.cc:359] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } }
18:31:00.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.031440 32487 raft_consensus.cc:385] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:00.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.031809 32487 raft_consensus.cc:740] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aca7da9f7ca4619ad516415905960e6, State: Initialized, Role: FOLLOWER
18:31:00.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.032711 32487 consensus_queue.cc:260] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } }
18:31:00.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.035130 32487 ts_tablet_manager.cc:1434] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
18:31:00.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.036645 32487 tablet_bootstrap.cc:492] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6: Bootstrap starting.
18:31:00.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.046037 32487 tablet_bootstrap.cc:654] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6: Neither blocks nor log segments found. Creating new log.
18:31:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.058301 32135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105acef0326e4306a624e1f62425453b" candidate_uuid: "8aca7da9f7ca4619ad516415905960e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "848a93fc4b3244bd88f2910885d4bd9f" is_pre_election: true
18:31:00.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.059218 32135 raft_consensus.cc:2468] T 105acef0326e4306a624e1f62425453b P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aca7da9f7ca4619ad516415905960e6 in term 0.
18:31:00.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.063022 31872 leader_election.cc:304] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 848a93fc4b3244bd88f2910885d4bd9f, 8aca7da9f7ca4619ad516415905960e6; no voters: 
18:31:00.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.064909 32493 raft_consensus.cc:2804] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:31:00.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.065448 32493 raft_consensus.cc:493] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:31:00.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.066025 32493 raft_consensus.cc:3060] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Advancing to term 1
18:31:00.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.067029 32486 tablet_bootstrap.cc:492] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f: No bootstrap required, opened a new log
18:31:00.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.067525 32486 ts_tablet_manager.cc:1403] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f: Time spent bootstrapping tablet: real 0.122s	user 0.027s	sys 0.025s
18:31:00.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.071616 32486 raft_consensus.cc:359] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.072388 32486 raft_consensus.cc:385] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:00.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.072647 32487 tablet_bootstrap.cc:492] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6: No bootstrap required, opened a new log
18:31:00.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.072705 32486 raft_consensus.cc:740] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 848a93fc4b3244bd88f2910885d4bd9f, State: Initialized, Role: FOLLOWER
18:31:00.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.073097 32487 ts_tablet_manager.cc:1403] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.001s
18:31:00.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.076216 32487 raft_consensus.cc:359] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.077018 32487 raft_consensus.cc:385] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:00.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.073499 32486 consensus_queue.cc:260] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.077312 32487 raft_consensus.cc:740] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aca7da9f7ca4619ad516415905960e6, State: Initialized, Role: FOLLOWER
18:31:00.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.081904 32189 tablet.cc:2406] T 105acef0326e4306a624e1f62425453b P 848a93fc4b3244bd88f2910885d4bd9f: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:31:00.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.079475 32486 ts_tablet_manager.cc:1434] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
18:31:00.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.088833 32486 tablet_bootstrap.cc:492] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f: Bootstrap starting.
18:31:00.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.096288 32486 tablet_bootstrap.cc:654] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f: Neither blocks nor log segments found. Creating new log.
18:31:00.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.107929 32487 consensus_queue.cc:260] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.110253 32487 ts_tablet_manager.cc:1434] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
18:31:00.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.111394 32487 tablet_bootstrap.cc:492] T d5ce817a84a143078ef0f217b48456d4 P 8aca7da9f7ca4619ad516415905960e6: Bootstrap starting.
18:31:00.120 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:00.121 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:00.122 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:00.123 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:00.123 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:00.123 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:00.124 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:00.124 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:00.124 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:00.124 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:00.124 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:00.124 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:00.124 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:00.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.128930 32487 tablet_bootstrap.cc:654] T d5ce817a84a143078ef0f217b48456d4 P 8aca7da9f7ca4619ad516415905960e6: Neither blocks nor log segments found. Creating new log.
18:31:00.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.141927 32491 raft_consensus.cc:493] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:31:00.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.142506 32491 raft_consensus.cc:515] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.146494 32491 leader_election.cc:290] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8aca7da9f7ca4619ad516415905960e6 (127.30.195.65:33277), 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841)
18:31:00.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.069993 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105acef0326e4306a624e1f62425453b" candidate_uuid: "8aca7da9f7ca4619ad516415905960e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800a0053d41545519079c200a07e1eb7" is_pre_election: true
18:31:00.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.144462 32493 raft_consensus.cc:515] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.176923 31869 leader_election.cc:343] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841): Illegal state: must be running to vote when last-logged opid is not known
18:31:00.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.179464 32492 raft_consensus.cc:493] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:31:00.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.180430 32492 raft_consensus.cc:515] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.194871 32493 leader_election.cc:290] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 election: Requested vote from peers 848a93fc4b3244bd88f2910885d4bd9f (127.30.195.66:40191), 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841)
18:31:00.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.195887 32492 leader_election.cc:290] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 848a93fc4b3244bd88f2910885d4bd9f (127.30.195.66:40191), 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841)
18:31:00.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.202442 32487 tablet_bootstrap.cc:492] T d5ce817a84a143078ef0f217b48456d4 P 8aca7da9f7ca4619ad516415905960e6: No bootstrap required, opened a new log
18:31:00.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.203123 32487 ts_tablet_manager.cc:1403] T d5ce817a84a143078ef0f217b48456d4 P 8aca7da9f7ca4619ad516415905960e6: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.013s
18:31:00.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.223281 32487 raft_consensus.cc:359] T d5ce817a84a143078ef0f217b48456d4 P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.224287 32487 raft_consensus.cc:385] T d5ce817a84a143078ef0f217b48456d4 P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:00.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.224658 32487 raft_consensus.cc:740] T d5ce817a84a143078ef0f217b48456d4 P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aca7da9f7ca4619ad516415905960e6, State: Initialized, Role: FOLLOWER
18:31:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.199647 32278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c11de6974dc43b2a66d04f951efa20f" candidate_uuid: "8aca7da9f7ca4619ad516415905960e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800a0053d41545519079c200a07e1eb7" is_pre_election: true
18:31:00.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.228103 31869 leader_election.cc:343] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841): Illegal state: must be running to vote when last-logged opid is not known
18:31:00.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.199936 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105acef0326e4306a624e1f62425453b" candidate_uuid: "8aca7da9f7ca4619ad516415905960e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800a0053d41545519079c200a07e1eb7"
18:31:00.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.231942 31869 leader_election.cc:343] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841): Illegal state: must be running to vote when last-logged opid is not known
18:31:00.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.232965 32046 tablet.cc:2406] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:31:00.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.236436 32134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c11de6974dc43b2a66d04f951efa20f" candidate_uuid: "8aca7da9f7ca4619ad516415905960e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "848a93fc4b3244bd88f2910885d4bd9f" is_pre_election: true
18:31:00.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.237712 32134 raft_consensus.cc:2468] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aca7da9f7ca4619ad516415905960e6 in term 0.
18:31:00.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.217320 32135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105acef0326e4306a624e1f62425453b" candidate_uuid: "8aca7da9f7ca4619ad516415905960e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "848a93fc4b3244bd88f2910885d4bd9f"
18:31:00.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.239596 32135 raft_consensus.cc:3060] T 105acef0326e4306a624e1f62425453b P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Advancing to term 1
18:31:00.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.239564 31872 leader_election.cc:304] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 848a93fc4b3244bd88f2910885d4bd9f, 8aca7da9f7ca4619ad516415905960e6; no voters: 800a0053d41545519079c200a07e1eb7
18:31:00.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.241628 32493 raft_consensus.cc:2804] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:31:00.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.225883 32487 consensus_queue.cc:260] T d5ce817a84a143078ef0f217b48456d4 P 8aca7da9f7ca4619ad516415905960e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.251602 32487 ts_tablet_manager.cc:1434] T d5ce817a84a143078ef0f217b48456d4 P 8aca7da9f7ca4619ad516415905960e6: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.004s
18:31:00.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.252550 32487 tablet_bootstrap.cc:492] T 73cd0ad62a2a4f54b07484a5c1388f8d P 8aca7da9f7ca4619ad516415905960e6: Bootstrap starting.
18:31:00.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.258834 32492 raft_consensus.cc:493] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:31:00.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.259387 32492 raft_consensus.cc:515] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } }
18:31:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.262219 32492 leader_election.cc:290] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841), 848a93fc4b3244bd88f2910885d4bd9f (127.30.195.66:40191)
18:31:00.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.271596 32134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9c2a0cb1740a5b71ab9fb4f503bf1" candidate_uuid: "8aca7da9f7ca4619ad516415905960e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "848a93fc4b3244bd88f2910885d4bd9f" is_pre_election: true
18:31:00.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.272394 32134 raft_consensus.cc:2468] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aca7da9f7ca4619ad516415905960e6 in term 0.
18:31:00.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.274022 32493 raft_consensus.cc:493] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:31:00.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.274400 32493 raft_consensus.cc:3060] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Advancing to term 1
18:31:00.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.275816 31872 leader_election.cc:304] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 848a93fc4b3244bd88f2910885d4bd9f, 8aca7da9f7ca4619ad516415905960e6; no voters: 
18:31:00.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.276531 32492 raft_consensus.cc:2804] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:31:00.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.276932 32492 raft_consensus.cc:493] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:31:00.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.277263 32492 raft_consensus.cc:3060] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Advancing to term 1
18:31:00.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.280061 32135 raft_consensus.cc:2468] T 105acef0326e4306a624e1f62425453b P 848a93fc4b3244bd88f2910885d4bd9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aca7da9f7ca4619ad516415905960e6 in term 1.
18:31:00.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.283398 32486 tablet_bootstrap.cc:492] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f: No bootstrap required, opened a new log
18:31:00.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.284766 32486 ts_tablet_manager.cc:1403] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f: Time spent bootstrapping tablet: real 0.196s	user 0.039s	sys 0.015s
18:31:00.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.284224 32492 raft_consensus.cc:515] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } }
18:31:00.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.285173 31872 leader_election.cc:304] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 848a93fc4b3244bd88f2910885d4bd9f, 8aca7da9f7ca4619ad516415905960e6; no voters: 800a0053d41545519079c200a07e1eb7
18:31:00.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.288434 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9c2a0cb1740a5b71ab9fb4f503bf1" candidate_uuid: "8aca7da9f7ca4619ad516415905960e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800a0053d41545519079c200a07e1eb7" is_pre_election: true
18:31:00.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.288386 32486 raft_consensus.cc:359] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.289043 32486 raft_consensus.cc:385] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:00.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.289328 32486 raft_consensus.cc:740] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 848a93fc4b3244bd88f2910885d4bd9f, State: Initialized, Role: FOLLOWER
18:31:00.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.289654 31869 leader_election.cc:343] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841): Illegal state: must be running to vote when last-logged opid is not known
18:31:00.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.289990 32486 consensus_queue.cc:260] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.290831 32492 leader_election.cc:290] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 election: Requested vote from peers 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841), 848a93fc4b3244bd88f2910885d4bd9f (127.30.195.66:40191)
18:31:00.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.292218 32492 raft_consensus.cc:2804] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [term 1 FOLLOWER]: Leader election won for term 1
18:31:00.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.290282 32278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9c2a0cb1740a5b71ab9fb4f503bf1" candidate_uuid: "8aca7da9f7ca4619ad516415905960e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800a0053d41545519079c200a07e1eb7"
18:31:00.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.292636 32492 raft_consensus.cc:697] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [term 1 LEADER]: Becoming Leader. State: Replica: 8aca7da9f7ca4619ad516415905960e6, State: Running, Role: LEADER
18:31:00.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.293812 31869 leader_election.cc:343] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841): Illegal state: must be running to vote when last-logged opid is not known
18:31:00.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.296890 32486 ts_tablet_manager.cc:1434] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
18:31:00.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.309686 32492 consensus_queue.cc:237] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.312206 32487 tablet_bootstrap.cc:654] T 73cd0ad62a2a4f54b07484a5c1388f8d P 8aca7da9f7ca4619ad516415905960e6: Neither blocks nor log segments found. Creating new log.
18:31:00.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.329659 31953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c11de6974dc43b2a66d04f951efa20f" candidate_uuid: "848a93fc4b3244bd88f2910885d4bd9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aca7da9f7ca4619ad516415905960e6" is_pre_election: true
18:31:00.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.330919 32278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c11de6974dc43b2a66d04f951efa20f" candidate_uuid: "848a93fc4b3244bd88f2910885d4bd9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800a0053d41545519079c200a07e1eb7" is_pre_election: true
18:31:00.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.332656 32069 leader_election.cc:343] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841): Illegal state: must be running to vote when last-logged opid is not known
18:31:00.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.350441 32487 tablet_bootstrap.cc:492] T 73cd0ad62a2a4f54b07484a5c1388f8d P 8aca7da9f7ca4619ad516415905960e6: No bootstrap required, opened a new log
18:31:00.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.351096 32487 ts_tablet_manager.cc:1403] T 73cd0ad62a2a4f54b07484a5c1388f8d P 8aca7da9f7ca4619ad516415905960e6: Time spent bootstrapping tablet: real 0.099s	user 0.015s	sys 0.003s
18:31:00.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.360292 31872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.195.66:40191, user_credentials={real_user=slave}} blocked reactor thread for 75188.1us
18:31:00.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.360344 32487 raft_consensus.cc:359] T 73cd0ad62a2a4f54b07484a5c1388f8d P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.361348 32487 raft_consensus.cc:385] T 73cd0ad62a2a4f54b07484a5c1388f8d P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:00.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.361657 32487 raft_consensus.cc:740] T 73cd0ad62a2a4f54b07484a5c1388f8d P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aca7da9f7ca4619ad516415905960e6, State: Initialized, Role: FOLLOWER
18:31:00.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.362717 32135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9c2a0cb1740a5b71ab9fb4f503bf1" candidate_uuid: "8aca7da9f7ca4619ad516415905960e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "848a93fc4b3244bd88f2910885d4bd9f"
18:31:00.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.362594 32487 consensus_queue.cc:260] T 73cd0ad62a2a4f54b07484a5c1388f8d P 8aca7da9f7ca4619ad516415905960e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.363374 32135 raft_consensus.cc:3060] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Advancing to term 1
18:31:00.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.364459 32493 raft_consensus.cc:515] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.366032 31953 raft_consensus.cc:2393] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 848a93fc4b3244bd88f2910885d4bd9f in current term 1: Already voted for candidate 8aca7da9f7ca4619ad516415905960e6 in this term.
18:31:00.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.369262 32134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c11de6974dc43b2a66d04f951efa20f" candidate_uuid: "8aca7da9f7ca4619ad516415905960e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "848a93fc4b3244bd88f2910885d4bd9f"
18:31:00.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.366003 32487 ts_tablet_manager.cc:1434] T 73cd0ad62a2a4f54b07484a5c1388f8d P 8aca7da9f7ca4619ad516415905960e6: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
18:31:00.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.369959 32134 raft_consensus.cc:3060] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Advancing to term 1
18:31:00.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.370800 32071 leader_election.cc:304] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 848a93fc4b3244bd88f2910885d4bd9f; no voters: 800a0053d41545519079c200a07e1eb7, 8aca7da9f7ca4619ad516415905960e6
18:31:00.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.375485 32135 raft_consensus.cc:2468] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 848a93fc4b3244bd88f2910885d4bd9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aca7da9f7ca4619ad516415905960e6 in term 1.
18:31:00.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.378077 32134 raft_consensus.cc:2468] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aca7da9f7ca4619ad516415905960e6 in term 1.
18:31:00.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.378691 32491 raft_consensus.cc:2749] T 6c11de6974dc43b2a66d04f951efa20f P 848a93fc4b3244bd88f2910885d4bd9f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:31:00.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.381507 32491 raft_consensus.cc:493] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:31:00.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.381937 32491 raft_consensus.cc:515] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.386711 31953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ce817a84a143078ef0f217b48456d4" candidate_uuid: "848a93fc4b3244bd88f2910885d4bd9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aca7da9f7ca4619ad516415905960e6" is_pre_election: true
18:31:00.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.387415 31953 raft_consensus.cc:2468] T d5ce817a84a143078ef0f217b48456d4 P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 848a93fc4b3244bd88f2910885d4bd9f in term 0.
18:31:00.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.388589 30843 debug-util.cc:398] Leaking SignalData structure 0x7b08000415c0 after lost signal to thread 30780
18:31:00.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.389322 30843 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8300 after lost signal to thread 30846
18:31:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.399377 32071 leader_election.cc:304] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 848a93fc4b3244bd88f2910885d4bd9f, 8aca7da9f7ca4619ad516415905960e6; no voters: 
18:31:00.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.402892 31715 catalog_manager.cc:5696] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8aca7da9f7ca4619ad516415905960e6 (127.30.195.65). New cstate: current_term: 1 leader_uuid: "8aca7da9f7ca4619ad516415905960e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } health_report { overall_health: UNKNOWN } } }
18:31:00.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.407671 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c11de6974dc43b2a66d04f951efa20f" candidate_uuid: "8aca7da9f7ca4619ad516415905960e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800a0053d41545519079c200a07e1eb7"
18:31:00.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.407629 32278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ce817a84a143078ef0f217b48456d4" candidate_uuid: "848a93fc4b3244bd88f2910885d4bd9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800a0053d41545519079c200a07e1eb7" is_pre_election: true
18:31:00.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.409619 31869 leader_election.cc:343] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841): Illegal state: must be running to vote when last-logged opid is not known
18:31:00.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.409366 32493 leader_election.cc:290] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 election: Requested vote from peers 848a93fc4b3244bd88f2910885d4bd9f (127.30.195.66:40191), 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841)
18:31:00.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.413690 32069 leader_election.cc:343] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841): Illegal state: must be running to vote when last-logged opid is not known
18:31:00.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.408926 32491 leader_election.cc:290] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8aca7da9f7ca4619ad516415905960e6 (127.30.195.65:33277), 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841)
18:31:00.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.416216 32491 raft_consensus.cc:2804] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Leader pre-election won for term 1
18:31:00.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.416610 32491 raft_consensus.cc:493] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:31:00.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.416968 32491 raft_consensus.cc:3060] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Advancing to term 1
18:31:00.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.425513 32485 raft_consensus.cc:359] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.426438 32485 raft_consensus.cc:385] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:00.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.436920 32485 raft_consensus.cc:740] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 800a0053d41545519079c200a07e1eb7, State: Initialized, Role: FOLLOWER
18:31:00.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.440245 31872 leader_election.cc:304] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 848a93fc4b3244bd88f2910885d4bd9f, 8aca7da9f7ca4619ad516415905960e6; no voters: 800a0053d41545519079c200a07e1eb7
18:31:00.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.441102 32493 raft_consensus.cc:2804] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [term 1 FOLLOWER]: Leader election won for term 1
18:31:00.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.441577 32493 raft_consensus.cc:697] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [term 1 LEADER]: Becoming Leader. State: Replica: 8aca7da9f7ca4619ad516415905960e6, State: Running, Role: LEADER
18:31:00.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.442370 32493 consensus_queue.cc:237] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } }
18:31:00.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.448896 31872 leader_election.cc:304] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 848a93fc4b3244bd88f2910885d4bd9f, 8aca7da9f7ca4619ad516415905960e6; no voters: 800a0053d41545519079c200a07e1eb7
18:31:00.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.449833 32492 raft_consensus.cc:2804] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [term 1 FOLLOWER]: Leader election won for term 1
18:31:00.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.450953 32492 raft_consensus.cc:697] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [term 1 LEADER]: Becoming Leader. State: Replica: 8aca7da9f7ca4619ad516415905960e6, State: Running, Role: LEADER
18:31:00.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.451439 32491 raft_consensus.cc:515] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.451820 32492 consensus_queue.cc:237] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.454671 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ce817a84a143078ef0f217b48456d4" candidate_uuid: "848a93fc4b3244bd88f2910885d4bd9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800a0053d41545519079c200a07e1eb7"
18:31:00.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.456749 32069 leader_election.cc:343] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841): Illegal state: must be running to vote when last-logged opid is not known
18:31:00.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.462118 31953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ce817a84a143078ef0f217b48456d4" candidate_uuid: "848a93fc4b3244bd88f2910885d4bd9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aca7da9f7ca4619ad516415905960e6"
18:31:00.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.462616 31953 raft_consensus.cc:3060] T d5ce817a84a143078ef0f217b48456d4 P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Advancing to term 1
18:31:00.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.464640 32491 leader_election.cc:290] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [CANDIDATE]: Term 1 election: Requested vote from peers 8aca7da9f7ca4619ad516415905960e6 (127.30.195.65:33277), 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841)
18:31:00.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.472333 31953 raft_consensus.cc:2468] T d5ce817a84a143078ef0f217b48456d4 P 8aca7da9f7ca4619ad516415905960e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 848a93fc4b3244bd88f2910885d4bd9f in term 1.
18:31:00.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.474198 32071 leader_election.cc:304] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 848a93fc4b3244bd88f2910885d4bd9f, 8aca7da9f7ca4619ad516415905960e6; no voters: 800a0053d41545519079c200a07e1eb7
18:31:00.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.475368 32491 raft_consensus.cc:2804] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [term 1 FOLLOWER]: Leader election won for term 1
18:31:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.476037 32491 raft_consensus.cc:697] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [term 1 LEADER]: Becoming Leader. State: Replica: 848a93fc4b3244bd88f2910885d4bd9f, State: Running, Role: LEADER
18:31:00.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.484465 32491 consensus_queue.cc:237] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.438078 32485 consensus_queue.cc:260] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.520987 32485 ts_tablet_manager.cc:1434] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7: Time spent starting tablet: real 0.618s	user 0.038s	sys 0.008s
18:31:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.521324 32485 ts_tablet_manager.cc:1467] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7: Tablet startup took 617ms
18:31:00.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.521617 32485 ts_tablet_manager.cc:1469] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7: Trace:
18:31:00.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:59.604346 (+     0us) service_pool.cc:167] Inserting onto call queue
18:31:00.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:59.607764 (+  3418us) service_pool.cc:224] Handling call
18:31:00.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:59.623533 (+ 15769us) ts_tablet_manager.cc:669] Acquired tablet manager lock
18:31:00.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:59.623625 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
18:31:00.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:59.686707 (+ 63082us) tablet_metadata.cc:665] Metadata flushed
18:31:00.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:59.714032 (+ 27325us) tablet_replica.cc:206] Creating consensus instance
18:31:00.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:59.746474 (+ 32442us) ts_tablet_manager.cc:1379] Bootstrapping tablet
18:31:00.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:59.746583 (+   109us) inbound_call.cc:177] Queueing success response
18:31:00.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:59.903413 (+156830us) ts_tablet_manager.cc:1435] Starting tablet replica
18:31:00.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:59.972310 (+ 68897us) tablet_replica.cc:261] Starting instrumentation
18:31:00.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:30:59.973249 (+   939us) tablet_replica.cc:280] Starting consensus
18:31:00.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"raft.queue_time_us":12851,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":9005,"tablet-open.queue_time_us":31636,"thread_start_us":48866,"threads_started":2}
18:31:00.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.524428 32485 tablet_bootstrap.cc:492] T d5ce817a84a143078ef0f217b48456d4 P 800a0053d41545519079c200a07e1eb7: Bootstrap starting.
18:31:00.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.539654 32485 tablet_bootstrap.cc:654] T d5ce817a84a143078ef0f217b48456d4 P 800a0053d41545519079c200a07e1eb7: Neither blocks nor log segments found. Creating new log.
18:31:00.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.541838 32514 raft_consensus.cc:493] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:31:00.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.542481 32514 raft_consensus.cc:515] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.545120 32327 tablet.cc:2406] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:31:00.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.547782 31953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73cd0ad62a2a4f54b07484a5c1388f8d" candidate_uuid: "848a93fc4b3244bd88f2910885d4bd9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aca7da9f7ca4619ad516415905960e6" is_pre_election: true
18:31:00.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.548395 31953 raft_consensus.cc:2468] T 73cd0ad62a2a4f54b07484a5c1388f8d P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 848a93fc4b3244bd88f2910885d4bd9f in term 0.
18:31:00.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.548542 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73cd0ad62a2a4f54b07484a5c1388f8d" candidate_uuid: "848a93fc4b3244bd88f2910885d4bd9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800a0053d41545519079c200a07e1eb7" is_pre_election: true
18:31:00.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.550376 32071 leader_election.cc:304] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 848a93fc4b3244bd88f2910885d4bd9f, 8aca7da9f7ca4619ad516415905960e6; no voters: 
18:31:00.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.550441 32514 leader_election.cc:290] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8aca7da9f7ca4619ad516415905960e6 (127.30.195.65:33277), 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841)
18:31:00.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.551569 32514 raft_consensus.cc:2804] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Leader pre-election won for term 1
18:31:00.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.552091 32514 raft_consensus.cc:493] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:31:00.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.552623 32514 raft_consensus.cc:3060] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [term 0 FOLLOWER]: Advancing to term 1
18:31:00.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.555091 32069 leader_election.cc:343] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841): Illegal state: must be running to vote when last-logged opid is not known
18:31:00.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.595775 32071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.30.195.65:33277, user_credentials={real_user=slave}} blocked reactor thread for 45507.2us
18:31:00.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.611346 32514 raft_consensus.cc:515] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.617602 31953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73cd0ad62a2a4f54b07484a5c1388f8d" candidate_uuid: "848a93fc4b3244bd88f2910885d4bd9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aca7da9f7ca4619ad516415905960e6"
18:31:00.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.618201 31953 raft_consensus.cc:3060] T 73cd0ad62a2a4f54b07484a5c1388f8d P 8aca7da9f7ca4619ad516415905960e6 [term 0 FOLLOWER]: Advancing to term 1
18:31:00.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.627256 32485 tablet_bootstrap.cc:492] T d5ce817a84a143078ef0f217b48456d4 P 800a0053d41545519079c200a07e1eb7: No bootstrap required, opened a new log
18:31:00.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.627348 32279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73cd0ad62a2a4f54b07484a5c1388f8d" candidate_uuid: "848a93fc4b3244bd88f2910885d4bd9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "800a0053d41545519079c200a07e1eb7"
18:31:00.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.628333 32485 ts_tablet_manager.cc:1403] T d5ce817a84a143078ef0f217b48456d4 P 800a0053d41545519079c200a07e1eb7: Time spent bootstrapping tablet: real 0.104s	user 0.051s	sys 0.028s
18:31:00.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:00.629557 32069 leader_election.cc:343] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841): Illegal state: must be running to vote when last-logged opid is not known
18:31:00.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.633320 32514 leader_election.cc:290] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [CANDIDATE]: Term 1 election: Requested vote from peers 8aca7da9f7ca4619ad516415905960e6 (127.30.195.65:33277), 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841)
18:31:00.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.636443 31714 catalog_manager.cc:5696] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 848a93fc4b3244bd88f2910885d4bd9f (127.30.195.66). New cstate: current_term: 1 leader_uuid: "848a93fc4b3244bd88f2910885d4bd9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } health_report { overall_health: UNKNOWN } } }
18:31:00.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.648593 32485 raft_consensus.cc:359] T d5ce817a84a143078ef0f217b48456d4 P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.649286 32485 raft_consensus.cc:385] T d5ce817a84a143078ef0f217b48456d4 P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:00.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.649602 32485 raft_consensus.cc:740] T d5ce817a84a143078ef0f217b48456d4 P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 800a0053d41545519079c200a07e1eb7, State: Initialized, Role: FOLLOWER
18:31:00.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.650326 32485 consensus_queue.cc:260] T d5ce817a84a143078ef0f217b48456d4 P 800a0053d41545519079c200a07e1eb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.661185 32485 ts_tablet_manager.cc:1434] T d5ce817a84a143078ef0f217b48456d4 P 800a0053d41545519079c200a07e1eb7: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
18:31:00.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.670835 32485 tablet_bootstrap.cc:492] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 800a0053d41545519079c200a07e1eb7: Bootstrap starting.
18:31:00.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.679388 31953 raft_consensus.cc:2468] T 73cd0ad62a2a4f54b07484a5c1388f8d P 8aca7da9f7ca4619ad516415905960e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 848a93fc4b3244bd88f2910885d4bd9f in term 1.
18:31:00.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.695761 31716 catalog_manager.cc:5696] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8aca7da9f7ca4619ad516415905960e6 (127.30.195.65). New cstate: current_term: 1 leader_uuid: "8aca7da9f7ca4619ad516415905960e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } health_report { overall_health: UNKNOWN } } }
18:31:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.699105 32071 leader_election.cc:304] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 848a93fc4b3244bd88f2910885d4bd9f, 8aca7da9f7ca4619ad516415905960e6; no voters: 800a0053d41545519079c200a07e1eb7
18:31:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.696171 32485 tablet_bootstrap.cc:654] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 800a0053d41545519079c200a07e1eb7: Neither blocks nor log segments found. Creating new log.
18:31:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.700276 32514 raft_consensus.cc:2804] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [term 1 FOLLOWER]: Leader election won for term 1
18:31:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.700727 32514 raft_consensus.cc:697] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [term 1 LEADER]: Becoming Leader. State: Replica: 848a93fc4b3244bd88f2910885d4bd9f, State: Running, Role: LEADER
18:31:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.699458 31716 catalog_manager.cc:5696] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8aca7da9f7ca4619ad516415905960e6 (127.30.195.65). New cstate: current_term: 1 leader_uuid: "8aca7da9f7ca4619ad516415905960e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } health_report { overall_health: UNKNOWN } } }
18:31:00.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.701514 32514 consensus_queue.cc:237] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.727 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:00.728 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:00.728 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:00.729 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:00.729 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:00.729 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:00.730 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:00.730 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:00.730 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:00.730 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:00.731 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:00.731 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:00.731 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:00.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.734652 31716 catalog_manager.cc:5696] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 848a93fc4b3244bd88f2910885d4bd9f (127.30.195.66). New cstate: current_term: 1 leader_uuid: "848a93fc4b3244bd88f2910885d4bd9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } health_report { overall_health: UNKNOWN } } }
18:31:00.745 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:00.746 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:00.746 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:00.746 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:00.746 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:00.746 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:00.747 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:00.747 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:00.747 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:00.748 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:00.748 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:00.748 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:00.748 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:00.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.752175 32485 tablet_bootstrap.cc:492] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 800a0053d41545519079c200a07e1eb7: No bootstrap required, opened a new log
18:31:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.752804 32485 ts_tablet_manager.cc:1403] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 800a0053d41545519079c200a07e1eb7: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.008s
18:31:00.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.776456 32485 raft_consensus.cc:359] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } }
18:31:00.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.777256 32485 raft_consensus.cc:385] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:00.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.777639 32485 raft_consensus.cc:740] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 800a0053d41545519079c200a07e1eb7, State: Initialized, Role: FOLLOWER
18:31:00.784 [DEBUG - main] (Connection.java:575) [peer master-127.30.11.253:35677(127.30.11.253:35677)] disconnecting while in state READY
18:31:00.784 [DEBUG - main] (Connection.java:575) [peer master-127.30.11.252:39405(127.30.11.252:39405)] disconnecting while in state READY
18:31:00.784 [DEBUG - main] (Connection.java:575) [peer master-127.30.11.254:41811(127.30.11.254:41811)] disconnecting while in state READY
18:31:00.786 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.30.11.254:41811(127.30.11.254:41811)] handling channelInactive
18:31:00.787 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state READY due to: connection closed
18:31:00.787 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.30.11.252:39405(127.30.11.252:39405)] handling channelInactive
18:31:00.787 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state READY due to: connection closed
18:31:00.788 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:00.789 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-1
18:31:00.790 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
18:31:00.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.778465 32485 consensus_queue.cc:260] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 800a0053d41545519079c200a07e1eb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } }
18:31:00.820 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.30.11.253:35677(127.30.11.253:35677)] handling channelInactive
18:31:00.820 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state READY due to: connection closed
18:31:00.821 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
18:31:00.821 [DEBUG - main] (Connection.java:575) [peer master-127.30.195.124:38627(127.30.195.124:38627)] disconnecting while in state READY
18:31:00.821 [DEBUG - main] (Connection.java:575) [peer master-127.30.195.125:40423(127.30.195.125:40423)] disconnecting while in state READY
18:31:00.822 [DEBUG - main] (Connection.java:575) [peer master-127.30.195.126:33747(127.30.195.126:33747)] disconnecting while in state READY
18:31:00.822 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.30.195.124:38627(127.30.195.124:38627)] handling channelInactive
18:31:00.823 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state READY due to: connection closed
18:31:00.823 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.30.195.125:40423(127.30.195.125:40423)] handling channelInactive
18:31:00.823 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state READY due to: connection closed
18:31:00.824 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:00.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.817239 32485 ts_tablet_manager.cc:1434] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 800a0053d41545519079c200a07e1eb7: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.002s
18:31:00.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.818637 32485 tablet_bootstrap.cc:492] T 73cd0ad62a2a4f54b07484a5c1388f8d P 800a0053d41545519079c200a07e1eb7: Bootstrap starting.
18:31:00.835 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:31:00.836 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-1
18:31:00.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.839861 32522 raft_consensus.cc:493] T d5ce817a84a143078ef0f217b48456d4 P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:31:00.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.846809 32522 raft_consensus.cc:515] T d5ce817a84a143078ef0f217b48456d4 P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.853030 32522 leader_election.cc:290] T d5ce817a84a143078ef0f217b48456d4 P 800a0053d41545519079c200a07e1eb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8aca7da9f7ca4619ad516415905960e6 (127.30.195.65:33277), 848a93fc4b3244bd88f2910885d4bd9f (127.30.195.66:40191)
18:31:00.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.853833 32522 raft_consensus.cc:493] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:31:00.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.854398 32522 raft_consensus.cc:515] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.858615 32522 leader_election.cc:290] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8aca7da9f7ca4619ad516415905960e6 (127.30.195.65:33277), 848a93fc4b3244bd88f2910885d4bd9f (127.30.195.66:40191)
18:31:00.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.861177 32492 consensus_queue.cc:1048] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:31:00.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.866458 32279 raft_consensus.cc:3060] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Advancing to term 1
18:31:00.882 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.30.195.126:33747(127.30.195.126:33747)] handling channelInactive
18:31:00.882 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state READY due to: connection closed
18:31:00.883 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
18:31:00.885 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:31:00.886 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
18:31:00.886 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
18:31:00.886 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:31:00.886 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:31:00.886 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:31:00.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.888010 32278 raft_consensus.cc:3060] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Advancing to term 1
18:31:00.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.888644 32485 tablet_bootstrap.cc:654] T 73cd0ad62a2a4f54b07484a5c1388f8d P 800a0053d41545519079c200a07e1eb7: Neither blocks nor log segments found. Creating new log.
18:31:00.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.897392 32511 consensus_queue.cc:1048] T 105acef0326e4306a624e1f62425453b P 8aca7da9f7ca4619ad516415905960e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:31:00.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.912253 32485 tablet_bootstrap.cc:492] T 73cd0ad62a2a4f54b07484a5c1388f8d P 800a0053d41545519079c200a07e1eb7: No bootstrap required, opened a new log
18:31:00.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.915395 32485 ts_tablet_manager.cc:1403] T 73cd0ad62a2a4f54b07484a5c1388f8d P 800a0053d41545519079c200a07e1eb7: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.004s
18:31:00.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.917217 32511 consensus_queue.cc:1048] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:31:00.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.919651 32485 raft_consensus.cc:359] T 73cd0ad62a2a4f54b07484a5c1388f8d P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.922798 32485 raft_consensus.cc:385] T 73cd0ad62a2a4f54b07484a5c1388f8d P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:00.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.923892 32485 raft_consensus.cc:740] T 73cd0ad62a2a4f54b07484a5c1388f8d P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 800a0053d41545519079c200a07e1eb7, State: Initialized, Role: FOLLOWER
18:31:00.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.931703 32485 consensus_queue.cc:260] T 73cd0ad62a2a4f54b07484a5c1388f8d P 800a0053d41545519079c200a07e1eb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:00.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.941388 32485 ts_tablet_manager.cc:1434] T 73cd0ad62a2a4f54b07484a5c1388f8d P 800a0053d41545519079c200a07e1eb7: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
18:31:00.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.942348 32485 tablet_bootstrap.cc:492] T 6c11de6974dc43b2a66d04f951efa20f P 800a0053d41545519079c200a07e1eb7: Bootstrap starting.
18:31:00.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.949918 32485 tablet_bootstrap.cc:654] T 6c11de6974dc43b2a66d04f951efa20f P 800a0053d41545519079c200a07e1eb7: Neither blocks nor log segments found. Creating new log.
18:31:00.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.983273 32511 consensus_queue.cc:1048] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:31:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:00.995355 32514 consensus_queue.cc:1048] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:31:01.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.005681 32493 consensus_queue.cc:1048] T 2ff9c2a0cb1740a5b71ab9fb4f503bf1 P 8aca7da9f7ca4619ad516415905960e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:31:01.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:01.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:01.054790 31869 consensus_peers.cc:597] T 6c11de6974dc43b2a66d04f951efa20f P 8aca7da9f7ca4619ad516415905960e6 -> Peer 800a0053d41545519079c200a07e1eb7 (127.30.195.67:45841): Couldn't send request to peer 800a0053d41545519079c200a07e1eb7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
18:31:01.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.122658 31951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ce817a84a143078ef0f217b48456d4" candidate_uuid: "800a0053d41545519079c200a07e1eb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aca7da9f7ca4619ad516415905960e6" is_pre_election: true
18:31:01.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.125569 31951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105acef0326e4306a624e1f62425453b" candidate_uuid: "800a0053d41545519079c200a07e1eb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aca7da9f7ca4619ad516415905960e6" is_pre_election: true
18:31:01.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.164528 32514 consensus_queue.cc:1048] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:31:01.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.188342 32277 raft_consensus.cc:3060] T 73cd0ad62a2a4f54b07484a5c1388f8d P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Advancing to term 1
18:31:01.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.214663 32526 consensus_queue.cc:1048] T 73cd0ad62a2a4f54b07484a5c1388f8d P 848a93fc4b3244bd88f2910885d4bd9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:31:01.258 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
18:31:01.258 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
18:31:01.258 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
18:31:01.258 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
18:31:01.258 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
18:31:01.258 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
18:31:01.259 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
18:31:01.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.299463 32277 raft_consensus.cc:3060] T d5ce817a84a143078ef0f217b48456d4 P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Advancing to term 1
18:31:01.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.308372 32526 consensus_queue.cc:1048] T d5ce817a84a143078ef0f217b48456d4 P 848a93fc4b3244bd88f2910885d4bd9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:31:01.314 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:01.315 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:01.316 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:01.316 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:01.316 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:01.317 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:01.317 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:01.317 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:01.317 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:01.319 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:01.319 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:01.319 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:01.319 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:01.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:01.343122 32552 log.cc:927] Time spent T d5ce817a84a143078ef0f217b48456d4 P 8aca7da9f7ca4619ad516415905960e6: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
18:31:01.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.422283 32485 tablet_bootstrap.cc:492] T 6c11de6974dc43b2a66d04f951efa20f P 800a0053d41545519079c200a07e1eb7: No bootstrap required, opened a new log
18:31:01.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.423365 32485 ts_tablet_manager.cc:1403] T 6c11de6974dc43b2a66d04f951efa20f P 800a0053d41545519079c200a07e1eb7: Time spent bootstrapping tablet: real 0.481s	user 0.078s	sys 0.113s
18:31:01.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.426693 32485 raft_consensus.cc:359] T 6c11de6974dc43b2a66d04f951efa20f P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:01.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.427637 32485 raft_consensus.cc:385] T 6c11de6974dc43b2a66d04f951efa20f P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:01.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.428085 32485 raft_consensus.cc:740] T 6c11de6974dc43b2a66d04f951efa20f P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 800a0053d41545519079c200a07e1eb7, State: Initialized, Role: FOLLOWER
18:31:01.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.429060 32485 consensus_queue.cc:260] T 6c11de6974dc43b2a66d04f951efa20f P 800a0053d41545519079c200a07e1eb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aca7da9f7ca4619ad516415905960e6" member_type: VOTER last_known_addr { host: "127.30.195.65" port: 33277 } } peers { permanent_uuid: "848a93fc4b3244bd88f2910885d4bd9f" member_type: VOTER last_known_addr { host: "127.30.195.66" port: 40191 } } peers { permanent_uuid: "800a0053d41545519079c200a07e1eb7" member_type: VOTER last_known_addr { host: "127.30.195.67" port: 45841 } }
18:31:01.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.431480 32485 ts_tablet_manager.cc:1434] T 6c11de6974dc43b2a66d04f951efa20f P 800a0053d41545519079c200a07e1eb7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
18:31:01.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.453982 32134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105acef0326e4306a624e1f62425453b" candidate_uuid: "800a0053d41545519079c200a07e1eb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "848a93fc4b3244bd88f2910885d4bd9f" is_pre_election: true
18:31:01.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.456399 32135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ce817a84a143078ef0f217b48456d4" candidate_uuid: "800a0053d41545519079c200a07e1eb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "848a93fc4b3244bd88f2910885d4bd9f" is_pre_election: true
18:31:01.458 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:01.458 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:01.458 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:01.459 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:01.459 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:01.459 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:01.460 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:01.460 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:01.460 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:01.461 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:01.461 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:01.461 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:01.461 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:01.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.477351 32215 leader_election.cc:304] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 800a0053d41545519079c200a07e1eb7; no voters: 848a93fc4b3244bd88f2910885d4bd9f, 8aca7da9f7ca4619ad516415905960e6
18:31:01.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.478992 32215 leader_election.cc:304] T d5ce817a84a143078ef0f217b48456d4 P 800a0053d41545519079c200a07e1eb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 800a0053d41545519079c200a07e1eb7; no voters: 848a93fc4b3244bd88f2910885d4bd9f, 8aca7da9f7ca4619ad516415905960e6
18:31:01.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.491168 32535 raft_consensus.cc:2749] T 105acef0326e4306a624e1f62425453b P 800a0053d41545519079c200a07e1eb7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:31:01.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.492133 32276 raft_consensus.cc:3060] T 6c11de6974dc43b2a66d04f951efa20f P 800a0053d41545519079c200a07e1eb7 [term 0 FOLLOWER]: Advancing to term 1
18:31:01.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:01.507064 32566 raft_consensus.cc:2749] T d5ce817a84a143078ef0f217b48456d4 P 800a0053d41545519079c200a07e1eb7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:31:01.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:01.927 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:01.928 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:01.929 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:01.929 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:01.929 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:01.929 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:01.930 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:01.930 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:01.930 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:01.931 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:01.931 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:01.931 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:01.931 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:02.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:02.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:02.027508 31869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.30.195.67:45841, user_credentials={real_user=slave}} blocked reactor thread for 57676.6us
18:31:02.101 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
18:31:02.177 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
18:31:02.177 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
18:31:02.177 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
18:31:02.193 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
18:31:02.225 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:02.226 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:02.226 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:02.226 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:02.226 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:02.226 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:02.226 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:02.227 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:02.227 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:02.255 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:02.255 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:02.255 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:02.260 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:02.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:02.761 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:02.762 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:02.762 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:02.762 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:02.762 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:02.762 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:02.763 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:02.763 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:02.762 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:02.764 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:02.764 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:02.764 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:02.764 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:03.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:03.240 [INFO - flink-pekko.actor.default-dispatcher-6] (Slf4jLogger.scala:117) Slf4jLogger started
18:31:03.504 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
18:31:03.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:03.519 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
18:31:03.600 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
18:31:03.623 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
18:31:03.660 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
18:31:03.680 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
18:31:03.681 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
18:31:03.681 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
18:31:03.681 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
18:31:03.682 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
18:31:03.682 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
18:31:03.682 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
18:31:03.682 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
18:31:03.682 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
18:31:03.683 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
18:31:03.683 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
18:31:03.683 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
18:31:03.683 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
18:31:03.683 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
18:31:03.683 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
18:31:03.684 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
18:31:03.684 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
18:31:03.684 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
18:31:03.684 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
18:31:03.684 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
18:31:03.684 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
18:31:03.685 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
18:31:03.685 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
18:31:03.685 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
18:31:03.685 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_1fcefcd4014428a66ec7ec98ad4c5c84/blobStorage
18:31:03.688 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:34301 - max concurrent requests: 50 - max backlog: 1000
18:31:03.699 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_1fcefcd4014428a66ec7ec98ad4c5c84/blobStorage
18:31:03.702 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_1fcefcd4014428a66ec7ec98ad4c5c84/blobStorage
18:31:03.703 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
18:31:03.704 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 6e26636a-a315-4138-a87e-a0f639187247
18:31:03.706 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 32 GB (66.67% usable)
18:31:03.707 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-3cea3ef9-8b6b-4edd-9b11-f626254ca5af
18:31:03.716 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-24b12011-a40e-4195-b68a-4a8dcf724248
18:31:03.800 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
18:31:03.801 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
18:31:03.801 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
18:31:03.801 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
18:31:03.802 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
18:31:03.803 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_4 .
18:31:03.810 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultJobLeaderService.java:127) Start job leader service.
18:31:03.811 [INFO - flink-pekko.actor.default-dispatcher-6] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-f4004e1f-dbcb-4759-8d6a-40a5680c2dec
18:31:03.811 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
18:31:03.811 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
18:31:03.821 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
18:31:03.821 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
18:31:03.829 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:45097
18:31:03.829 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
18:31:03.831 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:45097 was granted leadership with leaderSessionID=40871331-92be-46cf-867b-351427b5630b
18:31:03.831 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:45097 , session=40871331-92be-46cf-867b-351427b5630b
18:31:03.832 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
18:31:03.832 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
18:31:03.832 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
18:31:03.833 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id e36f67a0-8ecc-4c0f-8f4e-d43d7e3a2a1e. Creating new DispatcherLeaderProcess.
18:31:03.833 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
18:31:03.835 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
18:31:03.837 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
18:31:03.837 [INFO - pool-53-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id e99f082a-1f46-4e48-abb1-89e203812dd2.
18:31:03.837 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
18:31:03.840 [INFO - pool-53-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_5 .
18:31:03.843 [INFO - mini-cluster-io-thread-4] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_6 .
18:31:03.846 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:253) Starting the resource manager.
18:31:03.852 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:212) Starting the slot manager.
18:31:03.853 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:308) Starting tokens update task
18:31:03.853 [WARN - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
18:31:03.853 [WARN - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
18:31:03.853 [INFO - mini-cluster-io-thread-2] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_5 , session=e99f082a-1f46-4e48-abb1-89e203812dd2
18:31:03.853 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_5(abb189e203812dd2e99f082a1f464e48).
18:31:03.854 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_6 , session=e36f67a0-8ecc-4c0f-8f4e-d43d7e3a2a1e
18:31:03.887 [INFO - flink-pekko.actor.default-dispatcher-6] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
18:31:03.905 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:1080) Registering TaskManager with ResourceID 6e26636a-a315-4138-a87e-a0f639187247 (pekko://flink/user/rpc/taskmanager_4) at ResourceManager
18:31:03.910 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_5 under registration id a85f5ffcb704777b3fc8f4bbc3f453d0.
18:31:03.911 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:344) Registering task executor 6e26636a-a315-4138-a87e-a0f639187247 under a85f5ffcb704777b3fc8f4bbc3f453d0 at the slot manager.
18:31:03.911 [INFO - flink-pekko.actor.default-dispatcher-6] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (f6e63683f34d031c5da392b08baea20c).
18:31:03.912 [INFO - flink-pekko.actor.default-dispatcher-6] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (f6e63683f34d031c5da392b08baea20c).
18:31:03.912 [INFO - flink-pekko.actor.default-dispatcher-6] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-f6e63683f34d031c5da392b08baea20c'.
18:31:03.912 [INFO - mini-cluster-io-thread-1] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job f6e63683f34d031c5da392b08baea20c was granted leadership with leader id 71058df4-3504-4c5e-a4c9-60676a1531ac. Creating new JobMasterServiceProcess.
18:31:03.922 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_7 .
18:31:03.927 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (f6e63683f34d031c5da392b08baea20c).
18:31:03.928 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (f6e63683f34d031c5da392b08baea20c).
18:31:03.930 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph ae82f75004e34cafb8ece16bc6587e70 for job f6e63683f34d031c5da392b08baea20c.
18:31:03.930 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c).
18:31:03.930 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
18:31:03.931 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
18:31:03.931 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3523f7d2
18:31:03.931 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:03.932 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:31:03.934 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
18:31:03.934 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@f8e209d for Flink Streaming Job (f6e63683f34d031c5da392b08baea20c).
18:31:03.935 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_7 , session=71058df4-3504-4c5e-a4c9-60676a1531ac
18:31:03.936 [INFO - flink-pekko.actor.default-dispatcher-6] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (f6e63683f34d031c5da392b08baea20c) under job master id a4c960676a1531ac71058df435044c5e.
18:31:03.936 [INFO - flink-pekko.actor.default-dispatcher-6] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:31:03.938 [DEBUG - flink-pekko.actor.default-dispatcher-6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:03.941 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
18:31:03.941 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state CREATED to RUNNING.
18:31:03.941 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
18:31:03.942 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
18:31:03.943 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
18:31:03.943 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
18:31:03.943 [INFO - flink-pekko.actor.default-dispatcher-6] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_5(abb189e203812dd2e99f082a1f464e48)
18:31:03.944 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:03.945 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:03.946 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:03.946 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
18:31:03.947 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:390) Registering job manager a4c960676a1531ac71058df435044c5e@pekko://flink/user/rpc/jobmanager_7 for job f6e63683f34d031c5da392b08baea20c.
18:31:03.950 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.30.11.254:41811(127.30.11.254:41811)] Successfully connected to peer
18:31:03.952 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.30.11.252:39405(127.30.11.252:39405)] Successfully connected to peer
18:31:03.953 [INFO - flink-pekko.actor.default-dispatcher-10] (ResourceManager.java:1015) Registered job manager a4c960676a1531ac71058df435044c5e@pekko://flink/user/rpc/jobmanager_7 for job f6e63683f34d031c5da392b08baea20c.
18:31:03.956 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.254
18:31:03.958 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.30.11.253:35677(127.30.11.253:35677)] Successfully connected to peer
18:31:03.969 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.252
18:31:03.981 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:03.988 [INFO - flink-pekko.actor.default-dispatcher-6] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: abb189e203812dd2e99f082a1f464e48.
18:31:03.988 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:31:03.993 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x54f1410e, L:/127.0.0.1:49948 - R:/127.30.11.252:39405] using SASL/PLAIN
18:31:03.993 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.253
18:31:03.996 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.004 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:31:04.004 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=60), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [59ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: OK, deferred=null) after lookup
18:31:04.008 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.009 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5a0c1610, L:/127.0.0.1:51186 - R:/127.30.11.254:41811] using SASL/PLAIN
18:31:04.012 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x75592f0c, L:/127.0.0.1:34858 - R:/127.30.11.253:35677] using SASL/PLAIN
18:31:04.012 [DEBUG - main] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:04.013 [DEBUG - main] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:04.015 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 18b53ee8d31d4c50837c15cc6e9b9583
18:31:04.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:04.016 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.30.195.125:40423(127.30.195.125:40423)] Successfully connected to peer
18:31:04.018 [DEBUG - main] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:04.021 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 088641b735ea44c68946bc19f249c6ef for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
18:31:04.021 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0d7d727e45674353a019fb4400b5b816 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
18:31:04.021 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet fc2c4cc9a9e04c2ab9e58e687df02d61 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:31:04.021 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 1596d99b6178400ca4f4e37e3cbfe9aa for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:31:04.022 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bc0990262e854002be30002e55828c42 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:31:04.022 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=088641b735ea44c68946bc19f249c6ef@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=0d7d727e45674353a019fb4400b5b816@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=1596d99b6178400ca4f4e37e3cbfe9aa@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bc0990262e854002be30002e55828c42@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:31:04.026 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.30.195.124:38627(127.30.195.124:38627)] Successfully connected to peer
18:31:04.035 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.30.195.126:33747(127.30.195.126:33747)] Successfully connected to peer
18:31:04.037 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.125
18:31:04.039 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.124
18:31:04.052 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job f6e63683f34d031c5da392b08baea20c
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 6e26636a-a315-4138-a87e-a0f639187247
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
18:31:04.053 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 8ff5a8fd5a1d7f8775f563b9a37bf60a from 6e26636a-a315-4138-a87e-a0f639187247 for job f6e63683f34d031c5da392b08baea20c with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:31:04.054 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 13a0441c1420d35b57a28ebd584f9846 from 6e26636a-a315-4138-a87e-a0f639187247 for job f6e63683f34d031c5da392b08baea20c with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:31:04.054 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 8c518d750e8767059e15b0e0577096dd from 6e26636a-a315-4138-a87e-a0f639187247 for job f6e63683f34d031c5da392b08baea20c with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:31:04.055 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot e5ed6e64fe4e0a504f52a2cb8573a359 from 6e26636a-a315-4138-a87e-a0f639187247 for job f6e63683f34d031c5da392b08baea20c with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:31:04.055 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 8ff5a8fd5a1d7f8775f563b9a37bf60a for job f6e63683f34d031c5da392b08baea20c from resource manager with leader id abb189e203812dd2e99f082a1f464e48.
18:31:04.056 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 8ff5a8fd5a1d7f8775f563b9a37bf60a with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:31:04.058 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.060 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.061 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.126
18:31:04.066 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xa363c3c5, L:/127.0.0.1:43568 - R:/127.30.195.124:38627] using SASL/PLAIN
18:31:04.069 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe87e1ba8, L:/127.0.0.1:53680 - R:/127.30.195.125:40423] using SASL/PLAIN
18:31:04.074 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:31:04.075 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=99), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: OK, deferred=null) after lookup
18:31:04.075 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:192) Add job f6e63683f34d031c5da392b08baea20c for job leader monitoring.
18:31:04.076 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 13a0441c1420d35b57a28ebd584f9846 for job f6e63683f34d031c5da392b08baea20c from resource manager with leader id abb189e203812dd2e99f082a1f464e48.
18:31:04.076 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.076 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 13a0441c1420d35b57a28ebd584f9846 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:31:04.077 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 8c518d750e8767059e15b0e0577096dd for job f6e63683f34d031c5da392b08baea20c from resource manager with leader id abb189e203812dd2e99f082a1f464e48.
18:31:04.077 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 8c518d750e8767059e15b0e0577096dd with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:31:04.077 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request e5ed6e64fe4e0a504f52a2cb8573a359 for job f6e63683f34d031c5da392b08baea20c from resource manager with leader id abb189e203812dd2e99f082a1f464e48.
18:31:04.077 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for e5ed6e64fe4e0a504f52a2cb8573a359 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:31:04.078 [INFO - mini-cluster-io-thread-1] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_7 with leader id 71058df4-3504-4c5e-a4c9-60676a1531ac.
18:31:04.082 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
18:31:04.083 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_7 for job f6e63683f34d031c5da392b08baea20c.
18:31:04.084 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1783) Establish JobManager connection for job f6e63683f34d031c5da392b08baea20c.
18:31:04.084 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1633) Offer reserved slots to the leader of job f6e63683f34d031c5da392b08baea20c.
18:31:04.084 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table d0cdf0b8f05947b0883a7449df8326c4
18:31:04.085 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
18:31:04.085 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 13a0441c1420d35b57a28ebd584f9846
18:31:04.086 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x35532c43, L:/127.0.0.1:46774 - R:/127.30.195.126:33747] using SASL/PLAIN
18:31:04.086 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 13a0441c1420d35b57a28ebd584f9846.
18:31:04.089 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job f6e63683f34d031c5da392b08baea20c.
18:31:04.089 [INFO - flink-pekko.actor.default-dispatcher-8] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
18:31:04.089 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id f6e63683f34d031c5da392b08baea20c
18:31:04.090 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
18:31:04.090 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet d5ce817a84a143078ef0f217b48456d4 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
18:31:04.090 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6c11de6974dc43b2a66d04f951efa20f for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:31:04.090 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 73cd0ad62a2a4f54b07484a5c1388f8d for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:31:04.090 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 13a0441c1420d35b57a28ebd584f9846.
18:31:04.090 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 105acef0326e4306a624e1f62425453b for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:31:04.091 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=d5ce817a84a143078ef0f217b48456d4@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)[L],8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=6c11de6974dc43b2a66d04f951efa20f@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=73cd0ad62a2a4f54b07484a5c1388f8d@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)[L],8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=105acef0326e4306a624e1f62425453b@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:31:04.091 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.195.124:38627, [5ms] Sub RPC GetTableLocations: received response from server master-127.30.195.124:38627: OK, deferred=null)) after lookup
18:31:04.091 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)] connecting to peer
18:31:04.095 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
18:31:04.095 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id e5ed6e64fe4e0a504f52a2cb8573a359
18:31:04.095 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
18:31:04.096 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8c518d750e8767059e15b0e0577096dd
18:31:04.096 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot e5ed6e64fe4e0a504f52a2cb8573a359.
18:31:04.100 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
18:31:04.100 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
18:31:04.102 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@10a0d34b
18:31:04.102 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:04.102 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id e5ed6e64fe4e0a504f52a2cb8573a359.
18:31:04.102 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:31:04.103 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
18:31:04.111 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)] Successfully connected to peer
18:31:04.113 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5c595f12
18:31:04.114 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
18:31:04.115 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8ff5a8fd5a1d7f8775f563b9a37bf60a
18:31:04.115 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
18:31:04.119 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:04.124 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 8c518d750e8767059e15b0e0577096dd.
18:31:04.126 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 8c518d750e8767059e15b0e0577096dd.
18:31:04.128 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
18:31:04.128 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
18:31:04.129 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@73a2cd4d
18:31:04.129 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:04.129 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:31:04.131 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
18:31:04.131 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
18:31:04.142 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 13a0441c1420d35b57a28ebd584f9846.
18:31:04.142 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot e5ed6e64fe4e0a504f52a2cb8573a359.
18:31:04.142 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 8c518d750e8767059e15b0e0577096dd.
18:31:04.142 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:31:04.142 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:31:04.149 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
18:31:04.149 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
18:31:04.153 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@24af96df
18:31:04.153 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:04.153 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:31:04.154 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
18:31:04.154 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
18:31:04.159 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:04.162 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:04.166 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.30.195.125:40423(127.30.195.125:40423)] Successfully connected to peer
18:31:04.167 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.179 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.125
18:31:04.179 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:31:04.183 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@213ffe19
18:31:04.184 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:04.185 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.30.195.124:38627(127.30.195.124:38627)] Successfully connected to peer
18:31:04.187 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@78a0a67c
18:31:04.188 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x80c32245, L:/127.0.0.1:34308 - R:/127.30.195.65:33277] using TOKEN/null
18:31:04.197 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.124
18:31:04.200 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:04.201 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:04.202 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.210 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
18:31:04.211 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
18:31:04.216 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7e9abd26
18:31:04.216 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:04.216 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:31:04.217 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
18:31:04.217 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
18:31:04.225 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.226 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:04.226 [DEBUG - main] (Connection.java:748) [peer 848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)] connecting to peer
18:31:04.230 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4904ab44, L:/127.0.0.1:53696 - R:/127.30.195.125:40423] using SASL/PLAIN
18:31:04.234 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.235 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.30.195.126:33747(127.30.195.126:33747)] Successfully connected to peer
18:31:04.237 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.126
18:31:04.239 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x3d7aa2ad, L:/127.0.0.1:43574 - R:/127.30.195.124:38627] using SASL/PLAIN
18:31:04.242 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:31:04.242 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=123), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [74ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: OK, deferred=null) after lookup
18:31:04.249 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table d0cdf0b8f05947b0883a7449df8326c4
18:31:04.251 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:04.251 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@518cd387
18:31:04.260 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table d0cdf0b8f05947b0883a7449df8326c4
18:31:04.262 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:04.264 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)] Successfully connected to peer
18:31:04.264 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:04.264 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@72ef1f7a
18:31:04.266 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
18:31:04.266 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
18:31:04.268 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.270 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:04.273 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.30.195.125:40423(127.30.195.125:40423)] Successfully connected to peer
18:31:04.275 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.125
18:31:04.277 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x362414a1, L:/127.0.0.1:46776 - R:/127.30.195.126:33747] using SASL/PLAIN
18:31:04.277 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:04.281 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.30.195.124:38627(127.30.195.124:38627)] Successfully connected to peer
18:31:04.284 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.286 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.124
18:31:04.288 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x79daef4b, L:/127.0.0.1:53698 - R:/127.30.195.125:40423] using SASL/PLAIN
18:31:04.295 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.30.195.126:33747(127.30.195.126:33747)] Successfully connected to peer
18:31:04.297 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.126
18:31:04.301 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:04.303 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.313 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x0aba08bc, L:/127.0.0.1:43578 - R:/127.30.195.124:38627] using SASL/PLAIN
18:31:04.315 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.319 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x8925b52a, L:/127.0.0.1:52950 - R:/127.30.195.66:40191] using TOKEN/null
18:31:04.328 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:04.329 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.343 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:31:04.343 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=142), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [40ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: OK, deferred=null) after lookup
18:31:04.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:04.345 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.30.195.125:40423(127.30.195.125:40423)] Successfully connected to peer
18:31:04.347 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table d0cdf0b8f05947b0883a7449df8326c4
18:31:04.348 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.125
18:31:04.349 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x21ed69ae, L:/127.0.0.1:46780 - R:/127.30.195.126:33747] using SASL/PLAIN
18:31:04.352 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table d0cdf0b8f05947b0883a7449df8326c4
18:31:04.352 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@259a44d0
18:31:04.354 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
18:31:04.354 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
18:31:04.359 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:04.360 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:04.361 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:04.361 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
18:31:04.361 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:04.361 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='32d02d03b298231d5dbb1d80b34171360f1db57c4dde437b0cb1ad0cee59a695'}]
18:31:04.361 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:04.361 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:04.362 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:04.362 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:04.362 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:04.362 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:04.363 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:04.364 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:04.364 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:04.364 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:04.364 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:04.366 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
18:31:04.371 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.30.195.124:38627(127.30.195.124:38627)] Successfully connected to peer
18:31:04.371 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:04.372 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:31:04.372 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:04.372 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299998, tablet=088641b735ea44c68946bc19f249c6ef@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}]
18:31:04.373 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.30.195.126:33747(127.30.195.126:33747)] Successfully connected to peer
18:31:04.379 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.30.195.125:40423(127.30.195.125:40423)] Successfully connected to peer
18:31:04.383 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d5ce817a84a143078ef0f217b48456d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.383 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.126
18:31:04.383 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d5ce817a84a143078ef0f217b48456d4 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:04.387 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.124
18:31:04.389 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6c11de6974dc43b2a66d04f951efa20f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.389 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6c11de6974dc43b2a66d04f951efa20f for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:04.392 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.30.195.124:38627(127.30.195.124:38627)] Successfully connected to peer
18:31:04.392 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.125
18:31:04.393 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.30.195.126:33747(127.30.195.126:33747)] Successfully connected to peer
18:31:04.395 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
18:31:04.396 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='0b7b349fef58afaaedea08123fdd255f097659c7f38fff10a527f633bf62af54'}]
18:31:04.398 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:04.399 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.124
18:31:04.401 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
18:31:04.402 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:04.403 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:31:04.405 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.406 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299998, tablet=0d7d727e45674353a019fb4400b5b816@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}]
18:31:04.408 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.410 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x654242dd, L:/127.0.0.1:53712 - R:/127.30.195.125:40423] using SASL/PLAIN
18:31:04.415 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.417 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:04.419 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.195.126
18:31:04.421 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=73cd0ad62a2a4f54b07484a5c1388f8d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.421 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 73cd0ad62a2a4f54b07484a5c1388f8d for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:04.433 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=105acef0326e4306a624e1f62425453b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.434 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc7ae1e11, L:/127.0.0.1:53706 - R:/127.30.195.125:40423] using SASL/PLAIN
18:31:04.435 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x4d33a915, L:/127.0.0.1:43604 - R:/127.30.195.124:38627] using SASL/PLAIN
18:31:04.436 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.440 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:31:04.440 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=172), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: OK, [139ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: OK, deferred=null) after lookup
18:31:04.441 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.442 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x3c279926, L:/127.0.0.1:43594 - R:/127.30.195.124:38627] using SASL/PLAIN
18:31:04.444 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xdb1d618f, L:/127.0.0.1:46796 - R:/127.30.195.126:33747] using SASL/PLAIN
18:31:04.445 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:04.446 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:04.446 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:04.446 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:04.446 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:04.447 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:04.447 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:04.447 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:04.447 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:04.447 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:04.447 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:04.447 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:04.448 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:04.448 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:04.448 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:31:04.448 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=246), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [177ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: OK, [185ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: OK, deferred=null) after lookup
18:31:04.451 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.452 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table d0cdf0b8f05947b0883a7449df8326c4
18:31:04.456 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:04.457 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table d0cdf0b8f05947b0883a7449df8326c4
18:31:04.457 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x0fb45f51, L:/127.0.0.1:46810 - R:/127.30.195.126:33747] using SASL/PLAIN
18:31:04.457 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@44e5fbdd
18:31:04.458 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table d0cdf0b8f05947b0883a7449df8326c4
18:31:04.458 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
18:31:04.459 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
18:31:04.464 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.467 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table d0cdf0b8f05947b0883a7449df8326c4
18:31:04.468 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2fcc8a80
18:31:04.469 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
18:31:04.469 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
18:31:04.469 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:04.470 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:04.470 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:04.471 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:04.471 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:04.471 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:04.471 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:04.471 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:04.471 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:04.471 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:04.473 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:04.474 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:04.474 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:04.473 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x67449ac7, L:/127.0.0.1:37766 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:04.489 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.489 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:04.492 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false, responseScanTimestamp = 7305361260310528001) for scanner KuduScanner(table=replication_test_table, tablet=088641b735ea44c68946bc19f249c6ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.492 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [32d02d03b298231d5dbb1d80b34171360f1db57c4dde437b0cb1ad0cee59a695]
18:31:04.495 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
18:31:04.497 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [32d02d03b298231d5dbb1d80b34171360f1db57c4dde437b0cb1ad0cee59a695]
18:31:04.498 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:31:04.498 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:31:04.498 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:04.498 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d5ce817a84a143078ef0f217b48456d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.498 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d5ce817a84a143078ef0f217b48456d4 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:04.499 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:04.499 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 32d02d03b298231d5dbb1d80b34171360f1db57c4dde437b0cb1ad0cee59a695 finished by subtask 0; deferring removal (restored in pending)
18:31:04.505 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
18:31:04.505 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet d5ce817a84a143078ef0f217b48456d4 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
18:31:04.505 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6c11de6974dc43b2a66d04f951efa20f for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:31:04.506 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 73cd0ad62a2a4f54b07484a5c1388f8d for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:31:04.506 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 105acef0326e4306a624e1f62425453b for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:31:04.506 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=d5ce817a84a143078ef0f217b48456d4@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)[L],8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=6c11de6974dc43b2a66d04f951efa20f@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=73cd0ad62a2a4f54b07484a5c1388f8d@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)[L],8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=105acef0326e4306a624e1f62425453b@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:31:04.508 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6c11de6974dc43b2a66d04f951efa20f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.508 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6c11de6974dc43b2a66d04f951efa20f for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:04.510 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
18:31:04.510 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet d5ce817a84a143078ef0f217b48456d4 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
18:31:04.510 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6c11de6974dc43b2a66d04f951efa20f for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:31:04.510 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 73cd0ad62a2a4f54b07484a5c1388f8d for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:31:04.510 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 105acef0326e4306a624e1f62425453b for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:31:04.510 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='bda743ba045f6d482b8ab246594c528fb18b9f4dd6ee6ac41a64d5bccf9d9565'}]
18:31:04.510 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=d5ce817a84a143078ef0f217b48456d4@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)[L],8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=6c11de6974dc43b2a66d04f951efa20f@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=73cd0ad62a2a4f54b07484a5c1388f8d@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)[L],8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=105acef0326e4306a624e1f62425453b@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:31:04.512 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:04.514 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=73cd0ad62a2a4f54b07484a5c1388f8d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.514 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 73cd0ad62a2a4f54b07484a5c1388f8d for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:04.518 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:04.521 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=105acef0326e4306a624e1f62425453b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.522 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:04.526 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:04.547 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
18:31:04.548 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='0442adb0016f1989caca1911780a4030b4f2124e3fcec66a136e5dfb2ba0482f'}]
18:31:04.550 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:04.552 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.565 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xaa2a6c8f, L:/127.0.0.1:37780 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:04.565 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:31:04.569 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299997, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}]
18:31:04.577 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.577 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:04.583 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d5ce817a84a143078ef0f217b48456d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.583 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d5ce817a84a143078ef0f217b48456d4 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:04.586 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false, responseScanTimestamp = 7305361260310528001) for scanner KuduScanner(table=replication_test_table, tablet=0d7d727e45674353a019fb4400b5b816, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.587 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [0b7b349fef58afaaedea08123fdd255f097659c7f38fff10a527f633bf62af54]
18:31:04.587 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
18:31:04.589 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [0b7b349fef58afaaedea08123fdd255f097659c7f38fff10a527f633bf62af54]
18:31:04.590 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:31:04.590 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:31:04.590 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:04.591 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:04.595 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet d5ce817a84a143078ef0f217b48456d4 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
18:31:04.595 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6c11de6974dc43b2a66d04f951efa20f for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:31:04.595 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 73cd0ad62a2a4f54b07484a5c1388f8d for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:31:04.595 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 105acef0326e4306a624e1f62425453b for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:31:04.595 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=d5ce817a84a143078ef0f217b48456d4@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)[L],8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=6c11de6974dc43b2a66d04f951efa20f@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=73cd0ad62a2a4f54b07484a5c1388f8d@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)[L],8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=105acef0326e4306a624e1f62425453b@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:31:04.612 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6c11de6974dc43b2a66d04f951efa20f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.612 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6c11de6974dc43b2a66d04f951efa20f for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:04.621 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=73cd0ad62a2a4f54b07484a5c1388f8d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.621 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 73cd0ad62a2a4f54b07484a5c1388f8d for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:04.636 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=105acef0326e4306a624e1f62425453b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.638 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:31:04.639 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=bc0990262e854002be30002e55828c42@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}]
18:31:04.648 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
18:31:04.649 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8a8a8ed97803dfb43df766400cd85ff3056ece1979e105280ddfa8336d004423'}]
18:31:04.651 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:04.692 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.693 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:04.698 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d5ce817a84a143078ef0f217b48456d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.698 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d5ce817a84a143078ef0f217b48456d4 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:04.704 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6c11de6974dc43b2a66d04f951efa20f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.704 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6c11de6974dc43b2a66d04f951efa20f for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:04.709 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=73cd0ad62a2a4f54b07484a5c1388f8d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.709 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 73cd0ad62a2a4f54b07484a5c1388f8d for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:04.716 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=105acef0326e4306a624e1f62425453b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.718 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:04.718 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:04.719 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:04.719 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:31:04.740 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:04.754 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:04.760 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
18:31:04.761 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
18:31:04.762 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 0b7b349fef58afaaedea08123fdd255f097659c7f38fff10a527f633bf62af54 finished by subtask 2; deferring removal (restored in pending)
18:31:04.768 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:31:04.772 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.772 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:04.787 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d5ce817a84a143078ef0f217b48456d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.787 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d5ce817a84a143078ef0f217b48456d4 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:04.789 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299997, tablet=1596d99b6178400ca4f4e37e3cbfe9aa@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}]
18:31:04.794 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6c11de6974dc43b2a66d04f951efa20f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.794 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6c11de6974dc43b2a66d04f951efa20f for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:04.800 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=73cd0ad62a2a4f54b07484a5c1388f8d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.800 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 73cd0ad62a2a4f54b07484a5c1388f8d for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:04.808 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=105acef0326e4306a624e1f62425453b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.823 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:04.823 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:04.823 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
18:31:04.823 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:31:04.831 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:04.839 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535464836 for job f6e63683f34d031c5da392b08baea20c.
18:31:04.845 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:04.846 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=2, operationSize=130, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@32991314, flushNotification=Deferred@991683797(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:31:04.847 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=65, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@488635c2, flushNotification=Deferred@1814261155(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:31:04.847 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)] connecting to peer
18:31:04.848 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)] connecting to peer
18:31:04.849 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:04.851 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:04.856 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.861 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xbf355dd4, L:/127.0.0.1:37790 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:04.865 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.865 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:04.868 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:04.878 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:04.880 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d5ce817a84a143078ef0f217b48456d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.880 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d5ce817a84a143078ef0f217b48456d4 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:04.882 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb764de95, L:/127.0.0.1:37798 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:04.890 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6c11de6974dc43b2a66d04f951efa20f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.890 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6c11de6974dc43b2a66d04f951efa20f for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:04.905 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=73cd0ad62a2a4f54b07484a5c1388f8d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.905 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 73cd0ad62a2a4f54b07484a5c1388f8d for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:04.905 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361260310528001) for scanner KuduScanner(table=replication_test_table, tablet=bc0990262e854002be30002e55828c42, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.905 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [bda743ba045f6d482b8ab246594c528fb18b9f4dd6ee6ac41a64d5bccf9d9565]
18:31:04.917 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false, responseScanTimestamp = 7305361260310528001) for scanner KuduScanner(table=replication_test_table, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.918 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [0442adb0016f1989caca1911780a4030b4f2124e3fcec66a136e5dfb2ba0482f]
18:31:04.922 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=105acef0326e4306a624e1f62425453b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.927 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
18:31:04.934 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6c11de6974dc43b2a66d04f951efa20f for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:31:04.934 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 73cd0ad62a2a4f54b07484a5c1388f8d for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:31:04.934 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 105acef0326e4306a624e1f62425453b for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:31:04.934 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=6c11de6974dc43b2a66d04f951efa20f@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=73cd0ad62a2a4f54b07484a5c1388f8d@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)[L],8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=105acef0326e4306a624e1f62425453b@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:31:04.935 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6c11de6974dc43b2a66d04f951efa20f for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:31:04.935 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 73cd0ad62a2a4f54b07484a5c1388f8d for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:31:04.935 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 105acef0326e4306a624e1f62425453b for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:31:04.935 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=6c11de6974dc43b2a66d04f951efa20f@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=73cd0ad62a2a4f54b07484a5c1388f8d@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)[L],8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=105acef0326e4306a624e1f62425453b@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:31:04.936 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [0442adb0016f1989caca1911780a4030b4f2124e3fcec66a136e5dfb2ba0482f]
18:31:04.937 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:31:04.937 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:31:04.937 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:04.937 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:04.938 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 0442adb0016f1989caca1911780a4030b4f2124e3fcec66a136e5dfb2ba0482f finished by subtask 1; deferring removal (restored in pending)
18:31:04.981 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.981 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:04.988 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d5ce817a84a143078ef0f217b48456d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:04.988 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d5ce817a84a143078ef0f217b48456d4 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:05.005 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6c11de6974dc43b2a66d04f951efa20f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.005 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6c11de6974dc43b2a66d04f951efa20f for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:05.012 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)] Successfully connected to peer
18:31:05.012 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=73cd0ad62a2a4f54b07484a5c1388f8d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.012 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 73cd0ad62a2a4f54b07484a5c1388f8d for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:05.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:05.020 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=105acef0326e4306a624e1f62425453b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.030 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)] Successfully connected to peer
18:31:05.050 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:05.053 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:05.056 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:05.057 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:05.057 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:05.057 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:31:05.057 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:31:05.081 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.081 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:05.088 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d5ce817a84a143078ef0f217b48456d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.088 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d5ce817a84a143078ef0f217b48456d4 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:05.089 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:05.096 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6c11de6974dc43b2a66d04f951efa20f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.096 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6c11de6974dc43b2a66d04f951efa20f for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:05.099 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x320e4931, L:/127.0.0.1:34324 - R:/127.30.195.65:33277] using TOKEN/null
18:31:05.107 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=73cd0ad62a2a4f54b07484a5c1388f8d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.107 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 73cd0ad62a2a4f54b07484a5c1388f8d for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:05.110 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x10fb6c20, L:/127.0.0.1:52952 - R:/127.30.195.66:40191] using TOKEN/null
18:31:05.115 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=105acef0326e4306a624e1f62425453b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.116 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:05.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:05.150637 30843 debug-util.cc:398] Leaking SignalData structure 0x7b08000aaf60 after lost signal to thread 30780
18:31:05.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:05.151376 30843 debug-util.cc:398] Leaking SignalData structure 0x7b0800070d20 after lost signal to thread 30846
18:31:05.162 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3cf25bc2, L:/127.0.0.1:37806 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:05.173 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.174 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:05.190 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d5ce817a84a143078ef0f217b48456d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.190 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d5ce817a84a143078ef0f217b48456d4 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:05.194 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:05.194 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:05.194 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:05.195 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:05.195 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:05.195 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:05.195 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:05.195 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:05.195 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:05.195 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:05.196 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:05.196 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:05.196 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:05.198 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6c11de6974dc43b2a66d04f951efa20f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.198 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6c11de6974dc43b2a66d04f951efa20f for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:05.209 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=73cd0ad62a2a4f54b07484a5c1388f8d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.209 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 73cd0ad62a2a4f54b07484a5c1388f8d for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:05.217 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=105acef0326e4306a624e1f62425453b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.223 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false, responseScanTimestamp = 7305361260310528001) for scanner KuduScanner(table=replication_test_table, tablet=1596d99b6178400ca4f4e37e3cbfe9aa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.223 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [8a8a8ed97803dfb43df766400cd85ff3056ece1979e105280ddfa8336d004423]
18:31:05.224 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
18:31:05.230 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 73cd0ad62a2a4f54b07484a5c1388f8d for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:31:05.230 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 105acef0326e4306a624e1f62425453b for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:31:05.230 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=73cd0ad62a2a4f54b07484a5c1388f8d@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)[L],8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=105acef0326e4306a624e1f62425453b@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:31:05.233 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8a8a8ed97803dfb43df766400cd85ff3056ece1979e105280ddfa8336d004423]
18:31:05.234 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8a8a8ed97803dfb43df766400cd85ff3056ece1979e105280ddfa8336d004423 finished by subtask 3; deferring removal (restored in pending)
18:31:05.234 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:31:05.234 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:31:05.234 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:05.235 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:05.266 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:31:05.266 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:05.266 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:05.267 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:05.281 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.282 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:05.290 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d5ce817a84a143078ef0f217b48456d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.291 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d5ce817a84a143078ef0f217b48456d4 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:05.298 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6c11de6974dc43b2a66d04f951efa20f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.298 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6c11de6974dc43b2a66d04f951efa20f for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:05.306 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=73cd0ad62a2a4f54b07484a5c1388f8d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.307 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 73cd0ad62a2a4f54b07484a5c1388f8d for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:05.315 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=105acef0326e4306a624e1f62425453b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.388 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.388 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:05.401 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [bda743ba045f6d482b8ab246594c528fb18b9f4dd6ee6ac41a64d5bccf9d9565]
18:31:05.401 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:31:05.402 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:31:05.402 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:05.403 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split bda743ba045f6d482b8ab246594c528fb18b9f4dd6ee6ac41a64d5bccf9d9565 finished by subtask 0; deferring removal (restored in pending)
18:31:05.403 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:05.406 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d5ce817a84a143078ef0f217b48456d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.406 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d5ce817a84a143078ef0f217b48456d4 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:05.414 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6c11de6974dc43b2a66d04f951efa20f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.414 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6c11de6974dc43b2a66d04f951efa20f for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:05.421 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=73cd0ad62a2a4f54b07484a5c1388f8d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.421 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 73cd0ad62a2a4f54b07484a5c1388f8d for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:05.428 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=105acef0326e4306a624e1f62425453b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.459 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:05.459 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:05.460 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:05.460 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:31:05.476 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job f6e63683f34d031c5da392b08baea20c (4449 bytes, checkpointDuration=640 ms, finalizationTime=0 ms).
18:31:05.477 [INFO - Checkpoint Timer] (CheckpointRequestDecider.java:220) checkpoint request time in queue: 142
18:31:05.478 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
18:31:05.479 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 0442adb0016f1989caca1911780a4030b4f2124e3fcec66a136e5dfb2ba0482f from pending
18:31:05.479 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split bda743ba045f6d482b8ab246594c528fb18b9f4dd6ee6ac41a64d5bccf9d9565 from pending
18:31:05.479 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 32d02d03b298231d5dbb1d80b34171360f1db57c4dde437b0cb1ad0cee59a695 from pending
18:31:05.479 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 0b7b349fef58afaaedea08123fdd255f097659c7f38fff10a527f633bf62af54 from pending
18:31:05.479 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 8a8a8ed97803dfb43df766400cd85ff3056ece1979e105280ddfa8336d004423 from pending
18:31:05.479 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 5 finished splits from enumerator state
18:31:05.479 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535465477 for job f6e63683f34d031c5da392b08baea20c.
18:31:05.482 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=3, operationSize=195, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4537e20d, flushNotification=Deferred@1965445788(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:31:05.483 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)] connecting to peer
18:31:05.483 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=4, operationSize=260, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@7b81cb9, flushNotification=Deferred@2056972615(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:31:05.484 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)] connecting to peer
18:31:05.492 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)] Successfully connected to peer
18:31:05.494 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.495 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:05.508 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d5ce817a84a143078ef0f217b48456d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.508 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d5ce817a84a143078ef0f217b48456d4 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:05.514 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)] Successfully connected to peer
18:31:05.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:05.518 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6c11de6974dc43b2a66d04f951efa20f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.518 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6c11de6974dc43b2a66d04f951efa20f for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:05.524 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=73cd0ad62a2a4f54b07484a5c1388f8d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.524 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 73cd0ad62a2a4f54b07484a5c1388f8d for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:05.531 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=105acef0326e4306a624e1f62425453b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.549 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:05.559 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:05.561 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x619647f7, L:/127.0.0.1:34336 - R:/127.30.195.65:33277] using TOKEN/null
18:31:05.566 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x918b604c, L:/127.0.0.1:52954 - R:/127.30.195.66:40191] using TOKEN/null
18:31:05.594 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.594 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:05.605 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d5ce817a84a143078ef0f217b48456d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.605 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d5ce817a84a143078ef0f217b48456d4 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:05.644 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6c11de6974dc43b2a66d04f951efa20f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.645 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6c11de6974dc43b2a66d04f951efa20f for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:05.647 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:05.648 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:05.648 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:05.649 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:05.649 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:05.649 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:05.650 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:05.650 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:05.650 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:05.651 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:05.651 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:05.651 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:05.651 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:05.656 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=73cd0ad62a2a4f54b07484a5c1388f8d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.657 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 73cd0ad62a2a4f54b07484a5c1388f8d for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:05.664 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=105acef0326e4306a624e1f62425453b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.680 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:05.680 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:05.681 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:05.681 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:05.681 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:05.681 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:05.682 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:05.682 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:05.682 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:05.683 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:05.683 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:05.683 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:05.683 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:05.718 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=240 ms, finalizationTime=0 ms).
18:31:05.719 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
18:31:05.733 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.734 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:05.743 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d5ce817a84a143078ef0f217b48456d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.743 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d5ce817a84a143078ef0f217b48456d4 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:05.752 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6c11de6974dc43b2a66d04f951efa20f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.752 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6c11de6974dc43b2a66d04f951efa20f for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:05.781 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=73cd0ad62a2a4f54b07484a5c1388f8d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.782 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 73cd0ad62a2a4f54b07484a5c1388f8d for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:05.789 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=105acef0326e4306a624e1f62425453b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.798 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 18b53ee8d31d4c50837c15cc6e9b9583
18:31:05.802 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table d0cdf0b8f05947b0883a7449df8326c4
18:31:05.816 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 18b53ee8d31d4c50837c15cc6e9b9583
18:31:05.820 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table d0cdf0b8f05947b0883a7449df8326c4
18:31:05.828 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 088641b735ea44c68946bc19f249c6ef for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
18:31:05.828 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0d7d727e45674353a019fb4400b5b816 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
18:31:05.828 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet fc2c4cc9a9e04c2ab9e58e687df02d61 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:31:05.828 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 1596d99b6178400ca4f4e37e3cbfe9aa for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:31:05.828 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bc0990262e854002be30002e55828c42 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:31:05.828 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=088641b735ea44c68946bc19f249c6ef@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=0d7d727e45674353a019fb4400b5b816@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=1596d99b6178400ca4f4e37e3cbfe9aa@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bc0990262e854002be30002e55828c42@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:31:05.835 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
18:31:05.835 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet d5ce817a84a143078ef0f217b48456d4 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
18:31:05.835 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6c11de6974dc43b2a66d04f951efa20f for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:31:05.835 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 73cd0ad62a2a4f54b07484a5c1388f8d for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:31:05.835 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 105acef0326e4306a624e1f62425453b for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:31:05.835 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=d5ce817a84a143078ef0f217b48456d4@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)[L],8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=6c11de6974dc43b2a66d04f951efa20f@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=73cd0ad62a2a4f54b07484a5c1388f8d@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)[L],8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=105acef0326e4306a624e1f62425453b@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:31:05.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535465835 for job f6e63683f34d031c5da392b08baea20c.
18:31:05.850 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 18b53ee8d31d4c50837c15cc6e9b9583
18:31:05.854 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table d0cdf0b8f05947b0883a7449df8326c4
18:31:05.860 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=25 ms, finalizationTime=0 ms).
18:31:05.862 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
18:31:05.864 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 088641b735ea44c68946bc19f249c6ef for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
18:31:05.865 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0d7d727e45674353a019fb4400b5b816 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
18:31:05.865 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet fc2c4cc9a9e04c2ab9e58e687df02d61 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:31:05.865 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 1596d99b6178400ca4f4e37e3cbfe9aa for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:31:05.865 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bc0990262e854002be30002e55828c42 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:31:05.865 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=088641b735ea44c68946bc19f249c6ef@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=0d7d727e45674353a019fb4400b5b816@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=1596d99b6178400ca4f4e37e3cbfe9aa@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bc0990262e854002be30002e55828c42@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:31:05.865 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=10), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.11.252:39405, [9ms] Sub RPC GetTableLocations: received response from server master-127.30.11.252:39405: OK, deferred=null)) after lookup
18:31:05.880 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=088641b735ea44c68946bc19f249c6ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.880 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 088641b735ea44c68946bc19f249c6ef for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:05.892 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0d7d727e45674353a019fb4400b5b816, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.893 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0d7d727e45674353a019fb4400b5b816 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:05.920 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.921 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fc2c4cc9a9e04c2ab9e58e687df02d61 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:05.947 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 18b53ee8d31d4c50837c15cc6e9b9583
18:31:05.956 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 088641b735ea44c68946bc19f249c6ef for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
18:31:05.956 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0d7d727e45674353a019fb4400b5b816 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
18:31:05.956 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet fc2c4cc9a9e04c2ab9e58e687df02d61 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:31:05.956 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 1596d99b6178400ca4f4e37e3cbfe9aa for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:31:05.956 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bc0990262e854002be30002e55828c42 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:31:05.957 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=088641b735ea44c68946bc19f249c6ef@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=0d7d727e45674353a019fb4400b5b816@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=1596d99b6178400ca4f4e37e3cbfe9aa@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bc0990262e854002be30002e55828c42@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:31:05.958 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1596d99b6178400ca4f4e37e3cbfe9aa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:05.958 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 1596d99b6178400ca4f4e37e3cbfe9aa for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:05.958 [DEBUG - main] (Connection.java:748) [peer 9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)] connecting to peer
18:31:05.960 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='3c6e068691a71f4b2a9fdae2932f1100e4128caa4bdd0f2830c805a9d8ce22b2'}]
18:31:05.960 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='886b75e3a73a8332e93c59a12656124ab5f97c856d3a998ccd80e34c57652f9d'}]
18:31:05.961 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='b2cbc670d9db7e4bcb4b94f19a10811b1e602164526ff9cad35bab83b79da846'}]
18:31:05.961 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:05.962 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:31:05.963 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299998, tablet=088641b735ea44c68946bc19f249c6ef@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}]
18:31:05.963 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:05.963 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d146a942d31f3a76f4f83e72529ac213138e749996b4c651020e67e6291133fc'}]
18:31:05.964 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:05.965 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:31:05.965 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:31:05.966 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299998, tablet=0d7d727e45674353a019fb4400b5b816@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}]
18:31:05.966 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299997, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}]
18:31:05.967 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:05.967 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
18:31:05.967 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299997, tablet=1596d99b6178400ca4f4e37e3cbfe9aa@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}]
18:31:05.982 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)] Successfully connected to peer
18:31:05.987 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:06.003 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:06.008 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:06.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:06.025 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:06.045 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:06.048 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x65e69934, L:/127.0.0.1:59966 - R:/127.30.11.194:38295] using TOKEN/null
18:31:06.059 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:06.069 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:06.077 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bc0990262e854002be30002e55828c42, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.079 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:06.079 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:06.084 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
18:31:06.084 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet d5ce817a84a143078ef0f217b48456d4 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
18:31:06.084 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6c11de6974dc43b2a66d04f951efa20f for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:31:06.085 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 73cd0ad62a2a4f54b07484a5c1388f8d for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:31:06.085 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 105acef0326e4306a624e1f62425453b for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:31:06.085 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=d5ce817a84a143078ef0f217b48456d4@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)[L],8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=6c11de6974dc43b2a66d04f951efa20f@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=73cd0ad62a2a4f54b07484a5c1388f8d@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)[L],8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=105acef0326e4306a624e1f62425453b@[800a0053d41545519079c200a07e1eb7(127.30.195.67:45841),848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191),8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:31:06.085 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=7), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.195.124:38627, [7ms] Sub RPC GetTableLocations: received response from server master-127.30.195.124:38627: OK, deferred=null)) after lookup
18:31:06.094 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.094 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:06.098 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:06.105 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d5ce817a84a143078ef0f217b48456d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.106 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d5ce817a84a143078ef0f217b48456d4 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:06.117 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:06.134 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6c11de6974dc43b2a66d04f951efa20f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.134 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6c11de6974dc43b2a66d04f951efa20f for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:06.141 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:06.163 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:06.166 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:06.166 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:06.167 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=73cd0ad62a2a4f54b07484a5c1388f8d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.167 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 73cd0ad62a2a4f54b07484a5c1388f8d for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:06.174 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:06.180 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=105acef0326e4306a624e1f62425453b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.180 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa8f399c6, L:/127.0.0.1:37812 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:06.180 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:06.184 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb9ddaa88, L:/127.0.0.1:37834 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:06.187 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2fba4144, L:/127.0.0.1:37842 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:06.189 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361268494336001) for scanner KuduScanner(table=replication_test_table, tablet=088641b735ea44c68946bc19f249c6ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.190 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [3c6e068691a71f4b2a9fdae2932f1100e4128caa4bdd0f2830c805a9d8ce22b2]
18:31:06.190 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [3c6e068691a71f4b2a9fdae2932f1100e4128caa4bdd0f2830c805a9d8ce22b2]
18:31:06.190 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:31:06.190 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:31:06.191 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:06.191 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 3c6e068691a71f4b2a9fdae2932f1100e4128caa4bdd0f2830c805a9d8ce22b2 finished by subtask 2; deferring removal (restored in pending)
18:31:06.192 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=088641b735ea44c68946bc19f249c6ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.192 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 088641b735ea44c68946bc19f249c6ef for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:06.193 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='0d6de82a20a15b5b1448568131bfa7a3f8e64a4a19a2008afb432a0ee845ef49'}]
18:31:06.193 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:06.195 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:06.195 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc32d7a09, L:/127.0.0.1:37820 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:06.228 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
18:31:06.232 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361268494336001) for scanner KuduScanner(table=replication_test_table, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.233 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [b2cbc670d9db7e4bcb4b94f19a10811b1e602164526ff9cad35bab83b79da846]
18:31:06.233 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [b2cbc670d9db7e4bcb4b94f19a10811b1e602164526ff9cad35bab83b79da846]
18:31:06.234 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split b2cbc670d9db7e4bcb4b94f19a10811b1e602164526ff9cad35bab83b79da846 finished by subtask 3; deferring removal (restored in pending)
18:31:06.239 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0d7d727e45674353a019fb4400b5b816, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.245 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361268494336001) for scanner KuduScanner(table=replication_test_table, tablet=0d7d727e45674353a019fb4400b5b816, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.245 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [886b75e3a73a8332e93c59a12656124ab5f97c856d3a998ccd80e34c57652f9d]
18:31:06.245 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [886b75e3a73a8332e93c59a12656124ab5f97c856d3a998ccd80e34c57652f9d]
18:31:06.246 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:31:06.246 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:31:06.247 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 886b75e3a73a8332e93c59a12656124ab5f97c856d3a998ccd80e34c57652f9d finished by subtask 1; deferring removal (restored in pending)
18:31:06.247 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:06.247 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:06.252 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:31:06.252 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:31:06.252 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:06.253 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:06.253 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0d7d727e45674353a019fb4400b5b816 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:06.270 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=bc0990262e854002be30002e55828c42@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}]
18:31:06.280 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:06.280 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:06.280 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:06.280 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:31:06.285 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.286 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet fc2c4cc9a9e04c2ab9e58e687df02d61 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:06.297 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1596d99b6178400ca4f4e37e3cbfe9aa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.298 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 1596d99b6178400ca4f4e37e3cbfe9aa for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:06.305 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bc0990262e854002be30002e55828c42, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.315 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ff9c2a0cb1740a5b71ab9fb4f503bf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.315 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 2ff9c2a0cb1740a5b71ab9fb4f503bf1 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
18:31:06.333 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d5ce817a84a143078ef0f217b48456d4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.333 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d5ce817a84a143078ef0f217b48456d4 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
18:31:06.337 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535466335 for job f6e63683f34d031c5da392b08baea20c.
18:31:06.349 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job f6e63683f34d031c5da392b08baea20c (4499 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
18:31:06.353 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
18:31:06.353 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split b2cbc670d9db7e4bcb4b94f19a10811b1e602164526ff9cad35bab83b79da846 from pending
18:31:06.353 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split 3c6e068691a71f4b2a9fdae2932f1100e4128caa4bdd0f2830c805a9d8ce22b2 from pending
18:31:06.353 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split 886b75e3a73a8332e93c59a12656124ab5f97c856d3a998ccd80e34c57652f9d from pending
18:31:06.353 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 4 complete: removed 3 finished splits from enumerator state
18:31:06.360 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6c11de6974dc43b2a66d04f951efa20f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.360 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:06.360 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6c11de6974dc43b2a66d04f951efa20f for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
18:31:06.361 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:06.361 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:06.362 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:06.362 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:06.362 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:06.363 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:06.363 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:06.363 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:06.364 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:06.364 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:06.364 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:06.364 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:06.367 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361268494336001) for scanner KuduScanner(table=replication_test_table, tablet=1596d99b6178400ca4f4e37e3cbfe9aa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.368 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [d146a942d31f3a76f4f83e72529ac213138e749996b4c651020e67e6291133fc]
18:31:06.368 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d146a942d31f3a76f4f83e72529ac213138e749996b4c651020e67e6291133fc]
18:31:06.369 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
18:31:06.369 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
18:31:06.370 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d146a942d31f3a76f4f83e72529ac213138e749996b4c651020e67e6291133fc finished by subtask 0; deferring removal (restored in pending)
18:31:06.370 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:06.371 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:06.375 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:06.375 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:06.375 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:06.376 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:06.376 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:06.376 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:06.376 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:06.376 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:06.376 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:06.377 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:06.378 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:06.378 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:06.378 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:06.399 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=73cd0ad62a2a4f54b07484a5c1388f8d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.399 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 73cd0ad62a2a4f54b07484a5c1388f8d for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
18:31:06.406 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=105acef0326e4306a624e1f62425453b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.407 [DEBUG - main] (Connection.java:575) [peer master-127.30.195.124:38627(127.30.195.124:38627)] disconnecting while in state READY
18:31:06.407 [DEBUG - main] (Connection.java:575) [peer 8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)] disconnecting while in state READY
18:31:06.407 [DEBUG - main] (Connection.java:575) [peer master-127.30.195.125:40423(127.30.195.125:40423)] disconnecting while in state READY
18:31:06.407 [DEBUG - main] (Connection.java:575) [peer master-127.30.195.126:33747(127.30.195.126:33747)] disconnecting while in state READY
18:31:06.407 [DEBUG - main] (Connection.java:575) [peer 848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)] disconnecting while in state READY
18:31:06.408 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.30.195.124:38627(127.30.195.124:38627)] handling channelInactive
18:31:06.408 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.30.195.125:40423(127.30.195.125:40423)] handling channelInactive
18:31:06.408 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state READY due to: connection closed
18:31:06.408 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state READY due to: connection closed
18:31:06.408 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.30.195.126:33747(127.30.195.126:33747)] handling channelInactive
18:31:06.408 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state READY due to: connection closed
18:31:06.409 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)] handling channelInactive
18:31:06.409 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)] cleaning up while in state READY due to: connection closed
18:31:06.409 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:06.410 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
18:31:06.410 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
18:31:06.411 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:31:06.411 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-3
18:31:06.428 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:06.467 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:06.467 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:06.468 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:06.468 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
18:31:06.479 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)] handling channelInactive
18:31:06.479 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)] cleaning up while in state READY due to: connection closed
18:31:06.479 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-4
18:31:06.480 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:06.480 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:06.481 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:06.481 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:31:06.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:06.480613 31501 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 31798
18:31:06.511 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:06.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:06.519 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:06.543 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:06.543 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:06.543 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:06.544 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:31:06.574 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:06.580 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb345ef53, L:/127.0.0.1:37848 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:06.589 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361268494336001) for scanner KuduScanner(table=replication_test_table, tablet=bc0990262e854002be30002e55828c42, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:06.589 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [0d6de82a20a15b5b1448568131bfa7a3f8e64a4a19a2008afb432a0ee845ef49]
18:31:06.589 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [0d6de82a20a15b5b1448568131bfa7a3f8e64a4a19a2008afb432a0ee845ef49]
18:31:06.590 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
18:31:06.590 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
18:31:06.591 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 0d6de82a20a15b5b1448568131bfa7a3f8e64a4a19a2008afb432a0ee845ef49 finished by subtask 2; deferring removal (restored in pending)
18:31:06.591 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:06.593 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:06.627 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:06.627 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:06.627 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:06.628 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
18:31:06.747 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)] handling channelInactive
18:31:06.747 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)] cleaning up while in state READY due to: connection closed
18:31:06.748 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)] handling channelInactive
18:31:06.748 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)] cleaning up while in state READY due to: connection closed
18:31:06.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:06.750592 32071 connection.cc:573] client connection to 127.30.195.65:33277 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:31:06.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:06.751067 32071 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:31:06.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:06.777616 31501 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 32040
18:31:06.808 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:06.808 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:06.809 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:06.810 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:06.810 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:06.810 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:06.811 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:06.811 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:06.811 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:06.815 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:06.816 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:06.816 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:06.816 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:06.837 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535466836 for job f6e63683f34d031c5da392b08baea20c.
18:31:06.858 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job f6e63683f34d031c5da392b08baea20c (2378 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
18:31:06.859 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
18:31:06.859 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 0d6de82a20a15b5b1448568131bfa7a3f8e64a4a19a2008afb432a0ee845ef49 from pending
18:31:06.859 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split d146a942d31f3a76f4f83e72529ac213138e749996b4c651020e67e6291133fc from pending
18:31:06.859 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 2 finished splits from enumerator state
18:31:06.913 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)] handling channelInactive
18:31:06.913 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)] cleaning up while in state READY due to: connection closed
18:31:06.914 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)] handling channelInactive
18:31:06.914 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)] cleaning up while in state READY due to: connection closed
18:31:06.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:06.916622 31501 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 32190
18:31:07.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:07.005715 31501 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 31514
18:31:07.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:07.045 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.30.195.126:33747(127.30.195.126:33747)] handling channelInactive
18:31:07.045 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state READY due to: connection closed
18:31:07.046 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.30.195.126:33747(127.30.195.126:33747)] handling channelInactive
18:31:07.046 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state READY due to: connection closed
18:31:07.046 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.30.195.126:33747(127.30.195.126:33747)] handling channelInactive
18:31:07.046 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state READY due to: connection closed
18:31:07.047 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.30.195.126:33747(127.30.195.126:33747)] handling channelInactive
18:31:07.047 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state READY due to: connection closed
18:31:07.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:07.051174 31501 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 31587
18:31:07.107 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.30.195.125:40423(127.30.195.125:40423)] handling channelInactive
18:31:07.107 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state READY due to: connection closed
18:31:07.108 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.30.195.125:40423(127.30.195.125:40423)] handling channelInactive
18:31:07.108 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state READY due to: connection closed
18:31:07.108 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.30.195.125:40423(127.30.195.125:40423)] handling channelInactive
18:31:07.108 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state READY due to: connection closed
18:31:07.107 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.30.195.125:40423(127.30.195.125:40423)] handling channelInactive
18:31:07.109 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state READY due to: connection closed
18:31:07.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:07.111177 31501 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 31664
18:31:07.160 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.30.195.124:38627(127.30.195.124:38627)] handling channelInactive
18:31:07.160 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state READY due to: connection closed
18:31:07.160 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.30.195.124:38627(127.30.195.124:38627)] handling channelInactive
18:31:07.160 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state READY due to: connection closed
18:31:07.161 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.30.195.124:38627(127.30.195.124:38627)] handling channelInactive
18:31:07.161 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state READY due to: connection closed
18:31:07.161 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.30.195.124:38627(127.30.195.124:38627)] handling channelInactive
18:31:07.161 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state READY due to: connection closed
18:31:07.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535467335 for job f6e63683f34d031c5da392b08baea20c.
18:31:07.348 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:31:07.350 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
18:31:07.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:07.740 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:07.741 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:07.741 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:07.742 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:07.742 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:07.742 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:07.743 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:07.743 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:07.743 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:07.743 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:07.743 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:07.743 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:07.744 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:07.775 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:07.775 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:07.775 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:07.776 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:07.776 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:07.777 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:07.777 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:07.777 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:07.777 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:07.777 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:07.778 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:07.778 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:07.778 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:07.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535467835 for job f6e63683f34d031c5da392b08baea20c.
18:31:07.857 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
18:31:07.859 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
18:31:07.886 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:07.886 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:07.887 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:07.887 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:07.887 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:07.887 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:07.887 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:07.887 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:07.887 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:07.887 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:07.887 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:07.887 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:07.887 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:07.945 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 18b53ee8d31d4c50837c15cc6e9b9583
18:31:07.955 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 088641b735ea44c68946bc19f249c6ef for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
18:31:07.955 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0d7d727e45674353a019fb4400b5b816 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
18:31:07.955 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet fc2c4cc9a9e04c2ab9e58e687df02d61 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:31:07.955 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 1596d99b6178400ca4f4e37e3cbfe9aa for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:31:07.955 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bc0990262e854002be30002e55828c42 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:31:07.956 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=088641b735ea44c68946bc19f249c6ef@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=0d7d727e45674353a019fb4400b5b816@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=1596d99b6178400ca4f4e37e3cbfe9aa@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bc0990262e854002be30002e55828c42@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:31:07.960 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='0392547c020771406fea5ec14edc9d36539f7ba2833f07ba944413b0886bed63'}]
18:31:07.963 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='2244234f2577a37822669519ea82ac8d59f6687bbcb6fa1cb44e6541d552b0e3'}]
18:31:07.965 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:07.965 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
18:31:07.966 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='54bcebb5ee005a7bbdeff775afa9c56974b912778d0a623f0128bb3ada460fb9'}]
18:31:07.966 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299998, tablet=0d7d727e45674353a019fb4400b5b816@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}]
18:31:07.967 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:07.968 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='f587e861f5640b73eabf9985bdacb50bd68a1944c089424250c342308bddb26f'}]
18:31:07.970 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:07.971 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
18:31:07.972 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299997, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}]
18:31:07.979 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
18:31:07.980 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299997, tablet=1596d99b6178400ca4f4e37e3cbfe9aa@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}]
18:31:07.981 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:07.981 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
18:31:07.982 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299998, tablet=088641b735ea44c68946bc19f249c6ef@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}]
18:31:08.006 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:08.010 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:08.011 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:08.011 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:08.012 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:08.012 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:08.012 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:08.012 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:08.012 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:08.012 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:08.012 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:08.013 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:08.013 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:08.013 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:08.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:08.024 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:08.028 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:08.042 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:08.063 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:08.069 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:08.076 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:08.085 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:08.099 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf188a9b7, L:/127.0.0.1:37854 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:08.104 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:08.106 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361276686336001) for scanner KuduScanner(table=replication_test_table, tablet=0d7d727e45674353a019fb4400b5b816, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:08.107 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [2244234f2577a37822669519ea82ac8d59f6687bbcb6fa1cb44e6541d552b0e3]
18:31:08.107 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [2244234f2577a37822669519ea82ac8d59f6687bbcb6fa1cb44e6541d552b0e3]
18:31:08.108 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
18:31:08.108 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
18:31:08.109 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 2244234f2577a37822669519ea82ac8d59f6687bbcb6fa1cb44e6541d552b0e3 finished by subtask 1; deferring removal (restored in pending)
18:31:08.110 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:08.111 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:08.235 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='36347ea8df228c4b2bca26046c1dbcdce5bbfaeaf1effd1def467304e02cffd4'}]
18:31:08.236 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:08.238 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:08.240 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:08.247 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:08.265 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:08.275 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:08.280 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x62e5ddc1, L:/127.0.0.1:37864 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:08.288 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:08.291 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361276686336001) for scanner KuduScanner(table=replication_test_table, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:08.292 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [54bcebb5ee005a7bbdeff775afa9c56974b912778d0a623f0128bb3ada460fb9]
18:31:08.292 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [54bcebb5ee005a7bbdeff775afa9c56974b912778d0a623f0128bb3ada460fb9]
18:31:08.292 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
18:31:08.292 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
18:31:08.293 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 54bcebb5ee005a7bbdeff775afa9c56974b912778d0a623f0128bb3ada460fb9 finished by subtask 0; deferring removal (restored in pending)
18:31:08.294 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:08.294 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:08.295 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:08.297 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x49956fc0, L:/127.0.0.1:37880 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:08.310 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361276686336001) for scanner KuduScanner(table=replication_test_table, tablet=088641b735ea44c68946bc19f249c6ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:08.311 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7e83e465, L:/127.0.0.1:37884 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:08.311 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [0392547c020771406fea5ec14edc9d36539f7ba2833f07ba944413b0886bed63]
18:31:08.311 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [0392547c020771406fea5ec14edc9d36539f7ba2833f07ba944413b0886bed63]
18:31:08.311 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
18:31:08.311 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
18:31:08.312 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 0392547c020771406fea5ec14edc9d36539f7ba2833f07ba944413b0886bed63 finished by subtask 3; deferring removal (restored in pending)
18:31:08.313 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:08.313 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:08.327 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
18:31:08.328 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=bc0990262e854002be30002e55828c42@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}]
18:31:08.335 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:08.335 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:08.335 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:08.336 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
18:31:08.337 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535468336 for job f6e63683f34d031c5da392b08baea20c.
18:31:08.349 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job f6e63683f34d031c5da392b08baea20c (4499 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
18:31:08.351 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
18:31:08.352 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 0392547c020771406fea5ec14edc9d36539f7ba2833f07ba944413b0886bed63 from pending
18:31:08.352 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 2244234f2577a37822669519ea82ac8d59f6687bbcb6fa1cb44e6541d552b0e3 from pending
18:31:08.352 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 54bcebb5ee005a7bbdeff775afa9c56974b912778d0a623f0128bb3ada460fb9 from pending
18:31:08.352 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 3 finished splits from enumerator state
18:31:08.407 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:08.407 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:08.407 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:08.407 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
18:31:08.413 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:08.427 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:08.427 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:08.427 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
18:31:08.428 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:08.498 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:08.498 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:08.498 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:08.500 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361276686336001) for scanner KuduScanner(table=replication_test_table, tablet=1596d99b6178400ca4f4e37e3cbfe9aa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:08.500 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:08.501 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:08.501 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:08.501 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:08.501 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:08.501 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:08.502 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:08.502 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:08.502 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:08.503 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:08.505 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [f587e861f5640b73eabf9985bdacb50bd68a1944c089424250c342308bddb26f]
18:31:08.505 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [f587e861f5640b73eabf9985bdacb50bd68a1944c089424250c342308bddb26f]
18:31:08.505 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
18:31:08.505 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
18:31:08.506 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split f587e861f5640b73eabf9985bdacb50bd68a1944c089424250c342308bddb26f finished by subtask 2; deferring removal (restored in pending)
18:31:08.506 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:08.507 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:08.511 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:08.516 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:08.526 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:08.529 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:08.544 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc7b831bf, L:/127.0.0.1:37890 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:08.551 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361276686336001) for scanner KuduScanner(table=replication_test_table, tablet=bc0990262e854002be30002e55828c42, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:08.552 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [36347ea8df228c4b2bca26046c1dbcdce5bbfaeaf1effd1def467304e02cffd4]
18:31:08.552 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [36347ea8df228c4b2bca26046c1dbcdce5bbfaeaf1effd1def467304e02cffd4]
18:31:08.552 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
18:31:08.553 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
18:31:08.554 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 36347ea8df228c4b2bca26046c1dbcdce5bbfaeaf1effd1def467304e02cffd4 finished by subtask 1; deferring removal (restored in pending)
18:31:08.556 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:08.558 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:08.568 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
18:31:08.568 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:08.568 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:08.568 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:08.600 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:08.601 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:08.601 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:08.601 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
18:31:08.837 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535468835 for job f6e63683f34d031c5da392b08baea20c.
18:31:08.850 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job f6e63683f34d031c5da392b08baea20c (2378 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
18:31:08.851 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
18:31:08.852 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 36347ea8df228c4b2bca26046c1dbcdce5bbfaeaf1effd1def467304e02cffd4 from pending
18:31:08.852 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split f587e861f5640b73eabf9985bdacb50bd68a1944c089424250c342308bddb26f from pending
18:31:08.852 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 9 complete: removed 2 finished splits from enumerator state
18:31:09.019 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:09.294 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:09.294 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:09.295 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:09.295 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:09.295 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:09.295 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:09.295 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:09.295 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:09.295 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:09.296 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:09.296 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:09.296 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:09.296 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:09.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:31:09Z chronyd exiting
18:31:09.337 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535469335 for job f6e63683f34d031c5da392b08baea20c.
18:31:09.350 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:09.350 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:09.350 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:09.351 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:09.351 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:09.351 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:09.351 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:09.351 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:09.352 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:09.352 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:09.352 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:09.351 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:09.352 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:09.354 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
18:31:09.356 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
18:31:09.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:09.680 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:09.681 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:09.681 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:09.682 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:09.682 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:09.682 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:09.683 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:09.683 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:09.683 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:09.684 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:09.684 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:09.684 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:09.684 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:09.837 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535469836 for job f6e63683f34d031c5da392b08baea20c.
18:31:09.866 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=29 ms, finalizationTime=1 ms).
18:31:09.867 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
18:31:09.946 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 18b53ee8d31d4c50837c15cc6e9b9583
18:31:09.953 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 088641b735ea44c68946bc19f249c6ef for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
18:31:09.954 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0d7d727e45674353a019fb4400b5b816 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
18:31:09.954 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet fc2c4cc9a9e04c2ab9e58e687df02d61 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
18:31:09.954 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 1596d99b6178400ca4f4e37e3cbfe9aa for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
18:31:09.954 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bc0990262e854002be30002e55828c42 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
18:31:09.954 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=088641b735ea44c68946bc19f249c6ef@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=0d7d727e45674353a019fb4400b5b816@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=1596d99b6178400ca4f4e37e3cbfe9aa@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bc0990262e854002be30002e55828c42@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
18:31:09.958 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='91f00ddc3350a4c28f1f5d2aded42f40463675fbb5a8da927ecba371548574ad'}]
18:31:09.959 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='86cbd84da028a9a5f60781a5d85bb7b6b5fe20506404f139ff54029fe9973766'}]
18:31:09.960 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:09.961 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='983760c9927ffc8b7ab4012375ee3b7f0de7089513aebd22bb6300de874441ad'}]
18:31:09.962 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:09.963 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8d1af0f2fc29a03fa32f37a2ccb1dad89ae422de9a11bcf41823a124d852472e'}]
18:31:09.964 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:09.964 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
18:31:09.965 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299998, tablet=0d7d727e45674353a019fb4400b5b816@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}]
18:31:09.966 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
18:31:09.966 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299997, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)[L],fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}]
18:31:09.966 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
18:31:09.967 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299997, tablet=1596d99b6178400ca4f4e37e3cbfe9aa@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)[L],9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)]}]
18:31:09.971 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:09.971 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
18:31:09.972 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299998, tablet=088641b735ea44c68946bc19f249c6ef@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}]
18:31:09.977 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:09.988 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:09.989 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:09.996 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:10.006 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:10.006 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:10.006 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:10.007 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:10.007 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:10.007 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:10.007 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:10.007 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:10.007 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:10.008 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:10.008 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:10.008 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:10.008 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:10.010 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:10.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:10.017 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:10.027 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:10.040 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:10.045 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xcd79f04c, L:/127.0.0.1:37904 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:10.048 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:10.051 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:10.057 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:10.060 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361284878336001) for scanner KuduScanner(table=replication_test_table, tablet=0d7d727e45674353a019fb4400b5b816, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:10.061 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [86cbd84da028a9a5f60781a5d85bb7b6b5fe20506404f139ff54029fe9973766]
18:31:10.061 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [86cbd84da028a9a5f60781a5d85bb7b6b5fe20506404f139ff54029fe9973766]
18:31:10.061 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
18:31:10.061 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
18:31:10.062 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 86cbd84da028a9a5f60781a5d85bb7b6b5fe20506404f139ff54029fe9973766 finished by subtask 3; deferring removal (restored in pending)
18:31:10.063 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:10.064 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='33fb5d3f76e7c825aa828314dd3657280eedfd7224a94047dff5aeefed727f18'}]
18:31:10.064 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:10.065 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:10.075 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:10.083 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:10.089 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:10.089 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4cb420cb, L:/127.0.0.1:37908 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:10.108 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361284878336001) for scanner KuduScanner(table=replication_test_table, tablet=1596d99b6178400ca4f4e37e3cbfe9aa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:10.108 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [8d1af0f2fc29a03fa32f37a2ccb1dad89ae422de9a11bcf41823a124d852472e]
18:31:10.108 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8d1af0f2fc29a03fa32f37a2ccb1dad89ae422de9a11bcf41823a124d852472e]
18:31:10.109 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
18:31:10.109 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
18:31:10.109 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8d1af0f2fc29a03fa32f37a2ccb1dad89ae422de9a11bcf41823a124d852472e finished by subtask 1; deferring removal (restored in pending)
18:31:10.110 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:10.114 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:10.116 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:10.124 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x283eaa71, L:/127.0.0.1:37924 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:10.135 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
18:31:10.135 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:10.135 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:10.136 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:10.153 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:10.178 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361284878336001) for scanner KuduScanner(table=replication_test_table, tablet=fc2c4cc9a9e04c2ab9e58e687df02d61, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:10.178 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [983760c9927ffc8b7ab4012375ee3b7f0de7089513aebd22bb6300de874441ad]
18:31:10.178 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [983760c9927ffc8b7ab4012375ee3b7f0de7089513aebd22bb6300de874441ad]
18:31:10.179 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
18:31:10.179 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
18:31:10.180 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 983760c9927ffc8b7ab4012375ee3b7f0de7089513aebd22bb6300de874441ad finished by subtask 2; deferring removal (restored in pending)
18:31:10.180 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:10.181 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:10.188 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x139b837e, L:/127.0.0.1:37940 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:10.189 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
18:31:10.228 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=bc0990262e854002be30002e55828c42@[65f318326a6a4a469ec95434167d0082(127.30.11.193:33411),9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295),fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)[L]]}]
18:31:10.236 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361284878336001) for scanner KuduScanner(table=replication_test_table, tablet=088641b735ea44c68946bc19f249c6ef, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:10.236 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [91f00ddc3350a4c28f1f5d2aded42f40463675fbb5a8da927ecba371548574ad]
18:31:10.236 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [91f00ddc3350a4c28f1f5d2aded42f40463675fbb5a8da927ecba371548574ad]
18:31:10.237 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
18:31:10.237 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
18:31:10.238 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 91f00ddc3350a4c28f1f5d2aded42f40463675fbb5a8da927ecba371548574ad finished by subtask 0; deferring removal (restored in pending)
18:31:10.238 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:10.239 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:10.247 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:10.247 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:10.247 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:31:10.248 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
18:31:10.251 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:10.251 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:10.251 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:10.252 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
18:31:10.253 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] connecting to peer
18:31:10.257 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:10.257 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:10.257 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:10.258 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
18:31:10.259 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] Successfully connected to peer
18:31:10.264 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.11.193
18:31:10.294 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:10.298 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x44545073, L:/127.0.0.1:37946 - R:/127.30.11.193:33411] using SASL/PLAIN
18:31:10.306 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361284878336001) for scanner KuduScanner(table=replication_test_table, tablet=bc0990262e854002be30002e55828c42, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:10.306 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [33fb5d3f76e7c825aa828314dd3657280eedfd7224a94047dff5aeefed727f18]
18:31:10.306 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [33fb5d3f76e7c825aa828314dd3657280eedfd7224a94047dff5aeefed727f18]
18:31:10.307 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
18:31:10.307 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
18:31:10.308 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 33fb5d3f76e7c825aa828314dd3657280eedfd7224a94047dff5aeefed727f18 finished by subtask 3; deferring removal (restored in pending)
18:31:10.309 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:10.309 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:10.315 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:10.315 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:10.315 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:10.316 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:10.316 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:10.316 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:10.316 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:10.316 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:10.316 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:10.316 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:10.316 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:10.316 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:10.316 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:10.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535470335 for job f6e63683f34d031c5da392b08baea20c.
18:31:10.343 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:10.344 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:10.344 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
18:31:10.344 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:10.355 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job f6e63683f34d031c5da392b08baea20c (4499 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
18:31:10.356 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
18:31:10.356 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 33fb5d3f76e7c825aa828314dd3657280eedfd7224a94047dff5aeefed727f18 from pending
18:31:10.356 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 86cbd84da028a9a5f60781a5d85bb7b6b5fe20506404f139ff54029fe9973766 from pending
18:31:10.357 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 91f00ddc3350a4c28f1f5d2aded42f40463675fbb5a8da927ecba371548574ad from pending
18:31:10.357 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 8d1af0f2fc29a03fa32f37a2ccb1dad89ae422de9a11bcf41823a124d852472e from pending
18:31:10.357 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 983760c9927ffc8b7ab4012375ee3b7f0de7089513aebd22bb6300de874441ad from pending
18:31:10.357 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 12 complete: removed 5 finished splits from enumerator state
18:31:10.405 [DEBUG - main] (Connection.java:575) [peer master-127.30.11.253:35677(127.30.11.253:35677)] disconnecting while in state READY
18:31:10.405 [DEBUG - main] (Connection.java:575) [peer master-127.30.11.252:39405(127.30.11.252:39405)] disconnecting while in state READY
18:31:10.405 [DEBUG - main] (Connection.java:575) [peer 9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)] disconnecting while in state READY
18:31:10.405 [DEBUG - main] (Connection.java:575) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] disconnecting while in state READY
18:31:10.405 [DEBUG - main] (Connection.java:575) [peer fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)] disconnecting while in state READY
18:31:10.405 [DEBUG - main] (Connection.java:575) [peer master-127.30.11.254:41811(127.30.11.254:41811)] disconnecting while in state READY
18:31:10.405 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.30.11.253:35677(127.30.11.253:35677)] handling channelInactive
18:31:10.405 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state READY due to: connection closed
18:31:10.406 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)] handling channelInactive
18:31:10.406 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 9528f2c8dcc74589a5fd8b8b121d42c0(127.30.11.194:38295)] cleaning up while in state READY due to: connection closed
18:31:10.406 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.30.11.254:41811(127.30.11.254:41811)] handling channelInactive
18:31:10.406 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state READY due to: connection closed
18:31:10.406 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] handling channelInactive
18:31:10.406 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 65f318326a6a4a469ec95434167d0082(127.30.11.193:33411)] cleaning up while in state READY due to: connection closed
18:31:10.407 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:10.408 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
18:31:10.408 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
18:31:10.409 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-5
18:31:10.409 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:31:10.405 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.30.11.252:39405(127.30.11.252:39405)] handling channelInactive
18:31:10.413 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state READY due to: connection closed
18:31:10.413 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-1
18:31:10.423 [DEBUG - kudu-nio-4] (Connection.java:239) [peer fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)] handling channelInactive
18:31:10.423 [DEBUG - kudu-nio-4] (Connection.java:709) [peer fe8cc76985484cc7badb53158fdd508c(127.30.11.195:42383)] cleaning up while in state READY due to: connection closed
18:31:10.423 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-4
18:31:10.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:10.424466 30767 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 31068
18:31:10.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:10.487022 30767 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 31210
18:31:10.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:10.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:10.530203 30767 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 31359
18:31:10.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:10.573019 30767 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 30779
18:31:10.609 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.30.11.254:41811(127.30.11.254:41811)] handling channelInactive
18:31:10.609 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state READY due to: connection closed
18:31:10.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:10.609637 30767 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 30849
18:31:10.642 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.30.11.253:35677(127.30.11.253:35677)] handling channelInactive
18:31:10.642 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state READY due to: connection closed
18:31:10.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:10.641601 30957 connection.cc:573] client connection to 127.30.11.253:35677 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:31:10.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:10.642179 30957 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:31:10.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:10.642575 30767 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 30926
18:31:10.677 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.30.11.252:39405(127.30.11.252:39405)] handling channelInactive
18:31:10.677 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state READY due to: connection closed
18:31:10.747 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:10.748 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:10.748 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:10.748 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:10.748 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:10.748 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:10.749 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:10.749 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:10.749 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:10.749 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:10.749 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:10.749 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:10.750 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:10.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535470835 for job f6e63683f34d031c5da392b08baea20c.
18:31:10.852 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
18:31:10.853 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
18:31:10.985 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:10.986 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:10.987 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:10.987 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:10.987 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:10.987 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:10.987 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:10.987 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:10.987 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:10.988 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:10.988 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:10.988 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:10.989 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:11.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:11.027 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:11.028 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:11.028 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:11.029 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:11.029 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:11.029 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:11.030 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:11.030 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:11.030 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:11.030 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:11.030 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:11.031 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:11.031 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:11.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535471335 for job f6e63683f34d031c5da392b08baea20c.
18:31:11.348 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:31:11.349 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
18:31:11.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:11.811 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:11.812 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:11.812 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:11.812 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:11.812 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:11.812 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:11.813 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:11.813 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:11.813 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:11.813 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:11.813 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:11.813 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:11.813 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:11.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535471835 for job f6e63683f34d031c5da392b08baea20c.
18:31:11.847 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:31:11.847 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
18:31:11.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:31:11Z chronyd exiting
18:31:11.941 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:11.943 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:11.943 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:11.944 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.30.11.252:39405(127.30.11.252:39405) for tablet Kudu Master: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:11.960 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:11.961 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:11.961 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:11.961 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:11.961 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:11.961 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:11.961 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:11.962 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:11.962 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:11.962 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:11.962 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:11.962 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:11.962 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:11.964 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:11.965 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:11.966 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:11.966 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:11.966 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:11.966 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:11.966 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:11.966 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:11.966 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:11.967 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:11.967 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:11.967 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:11.967 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:11.985 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:11.985 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:11.986 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:11.986 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:11.986 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:11.986 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:11.986 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:11.986 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:11.986 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:11.987 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:11.987 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:11.987 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:11.987 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:12.005 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:12.006 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:12.006 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:12.006 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.006 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.006 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.006 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.006 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.007 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.007 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.007 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.007 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.007 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:12.016 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:12.025 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:12.025 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:12.025 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:12.025 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.025 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.026 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.026 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.026 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.026 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.026 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.026 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.026 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.026 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:12.065 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:12.065 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:12.066 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:12.066 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.066 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.066 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.066 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.066 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.066 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.066 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.066 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.067 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.067 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:12.125 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:12.125 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:12.126 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.126 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:12.126 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.126 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.126 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.126 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.126 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.126 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.126 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.126 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.126 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:12.205 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:12.205 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:12.206 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:12.206 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.206 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.206 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.206 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.206 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.206 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.206 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.206 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.207 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.207 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:12.335 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:12.335 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:12.335 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:12.336 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:12.336 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:12.336 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:12.335 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:12.336 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:12.336 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:12.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535472336 for job f6e63683f34d031c5da392b08baea20c.
18:31:12.336 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:12.336 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:12.337 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:12.337 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:12.345 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
18:31:12.345 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
18:31:12.405 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:12.405 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:12.406 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:12.406 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.406 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.406 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.406 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.406 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.406 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.406 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.406 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.407 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.407 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:12.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:12.620 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:12.621 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:12.621 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:12.621 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:12.622 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:12.622 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:12.622 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:12.622 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:12.622 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:12.622 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:12.622 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:12.622 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:12.622 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:12.665 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:12.665 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:12.666 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:12.667 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.667 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.667 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.667 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.667 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.667 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.667 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.667 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.667 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.667 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:12.804 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:12.805 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:12.805 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:12.805 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.805 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.805 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.805 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.805 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:12.806 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:12.806 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.806 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.806 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:12.806 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:12.835 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535472835 for job f6e63683f34d031c5da392b08baea20c.
18:31:12.844 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
18:31:12.845 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
.18:31:12.923 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783535472923
18:31:12.923 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783535472923
18:31:12.926 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
18:31:12.929 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
18:31:12.930 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
18:31:12.930 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskSwO0Je/test-tmp
18:31:12.930 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
18:31:12.930 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskSwO0Je/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
18:31:12.933 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

18:31:12.990 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:12.991 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:12.991 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:12.991 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:12.991 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:12.991 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:12.991 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:12.991 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:12.991 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:12.991 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:12.991 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:12.992 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:12.992 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:13.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:13.264 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:31:13.264 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

18:31:13.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:13.267699   427 mini_oidc.cc:150] Starting JWKS server
18:31:13.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:13.270922   427 webserver.cc:534] Webserver started at http://127.0.0.1:36431/ using document root <none> and password file <none>
18:31:13.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:13.271327   427 mini_oidc.cc:186] Starting OIDC Discovery server
18:31:13.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:13.273088   427 webserver.cc:534] Webserver started at http://127.0.0.1:45551/ using document root <none> and password file <none>
18:31:13.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:31:13Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
18:31:13.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:31:13Z Disabled control of system clock
18:31:13.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535473335 for job f6e63683f34d031c5da392b08baea20c.
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:13.338629   427 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/wal
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/data
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/logs
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/data/info.pb
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.106.254:32967
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.106.254
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.106.212:34665
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:31:13.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705
18:31:13.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:31:13.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36431/jwks.json with env {}
18:31:13.347 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:31:13.347 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
18:31:13.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:13.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:13.652863   439 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:31:13.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:13.653419   439 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:31:13.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:13.653878   439 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:31:13.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:13.688234   439 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:31:13.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:13.688525   439 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:31:13.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:13.688723   439 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:31:13.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:13.688938   439 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:31:13.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:13.689224   439 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:31:13.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:13.689395   439 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36431/jwks.json
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:13.727252   439 master_runner.cc:387] Master server non-default flags:
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.106.212:34665
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/data
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/wal
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.106.254:32967
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36431/jwks.json
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/data/info.pb
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.106.254
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/logs
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:31:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:13.728588   439 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:31:13.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:13.730224   439 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:31:13.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:13.740940   445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:13.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535473835 for job f6e63683f34d031c5da392b08baea20c.
18:31:13.847 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:31:13.850 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
18:31:14.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:14.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535474335 for job f6e63683f34d031c5da392b08baea20c.
18:31:14.351 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:14.352 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:14.352 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:14.353 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:14.353 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:14.353 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:14.354 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:14.354 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:14.355 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:14.355 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:14.355 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:14.355 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:14.355 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:14.360 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=24 ms, finalizationTime=0 ms).
18:31:14.362 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
18:31:14.519 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:14.705 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:14.705 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:14.706 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:14.707 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:14.707 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:14.707 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:14.708 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:14.708 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:14.708 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:14.709 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:14.709 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:14.709 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:14.709 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:14.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535474835 for job f6e63683f34d031c5da392b08baea20c.
18:31:14.857 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=22 ms, finalizationTime=0 ms).
18:31:14.859 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
18:31:14.925 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:14.926 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:14.926 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:14.926 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:14.926 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:14.926 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:14.927 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:14.927 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:14.927 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:14.927 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:14.927 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:14.927 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:14.928 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:15.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:15.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:13.742480   446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:15.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.094478   448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:15.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.097451   447 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1349 milliseconds
18:31:15.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.097525   439 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:31:15.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.098945   439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:31:15.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.102123   439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:31:15.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.103597   439 hybrid_clock.cc:648] HybridClock initialized: now 1783535475103534 us; error 65 us; skew 500 ppm
18:31:15.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.104553   439 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:31:15.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.112200   439 webserver.cc:534] Webserver started at http://127.0.106.254:37699/ using document root <none> and password file <none>
18:31:15.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.113245   439 fs_manager.cc:362] Metadata directory not provided
18:31:15.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.113488   439 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:31:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.113993   439 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:31:15.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.119021   439 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/data/instance:
18:31:15.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3cf7c90f4a1d45f89335c940fae15a1e"
18:31:15.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:15 on dist-test-slave-dxnw"
18:31:15.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.120133   439 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/wal/instance:
18:31:15.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3cf7c90f4a1d45f89335c940fae15a1e"
18:31:15.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:15 on dist-test-slave-dxnw"
18:31:15.126 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:15.126 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:15.127 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:15.127 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:15.127 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:15.127 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:15.127 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:15.127 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:15.127 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:15.128 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:15.128 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:15.128 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:15.128 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:15.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.128551   439 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.002s	sys 0.006s
18:31:15.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.134995   455 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:31:15.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.136119   439 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
18:31:15.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.136485   439 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/wal
18:31:15.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3cf7c90f4a1d45f89335c940fae15a1e"
18:31:15.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:15 on dist-test-slave-dxnw"
18:31:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.136837   439 fs_report.cc:389] FS layout report
18:31:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:31:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/wal
18:31:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/wal
18:31:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/data/data
18:31:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:31:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:31:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:31:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:31:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:31:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:31:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:31:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:31:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:31:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:31:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:31:15.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.198148   439 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:31:15.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.199788   439 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:31:15.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.200291   439 kserver.cc:163] Server-wide thread pool size limit: 3276
18:31:15.270 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:15.270 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:15.271 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:15.271 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:15.271 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:15.271 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:15.271 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:15.271 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:15.271 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:15.271 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:15.271 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:15.271 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:15.272 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:15.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.276351   439 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.254:32967
18:31:15.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.276438   506 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.254:32967 every 8 connection(s)
18:31:15.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.279140   439 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/data/info.pb
18:31:15.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.285028   507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:31:15.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.289737   427 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 439
18:31:15.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.290189   427 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-0/wal/instance
18:31:15.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.293673   427 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/wal
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/data
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/logs
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/data/info.pb
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.106.253:45189
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.106.253
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.106.212:34665
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:31:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36431/jwks.json with env {}
18:31:15.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.295578   507 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } has no permanent_uuid. Determining permanent_uuid...
18:31:15.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.331123   507 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } has no permanent_uuid. Determining permanent_uuid...
18:31:15.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.333925   456 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.106.253:45189: connect: Connection refused (error 111)
18:31:15.337 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535475336 for job f6e63683f34d031c5da392b08baea20c.
18:31:15.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.339778   507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.253:45189: Network error: Client connection negotiation failed: client connection to 127.0.106.253:45189: connect: Connection refused (error 111)
18:31:15.347 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:31:15.347 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
18:31:15.380 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:15.381 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:15.381 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:15.381 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:15.381 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:15.381 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:15.381 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:15.381 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:15.381 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:15.381 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:15.381 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:15.382 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:15.382 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:15.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.389360   507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } attempt: 1
18:31:15.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.393891   507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.253:45189: Network error: Client connection negotiation failed: client connection to 127.0.106.253:45189: connect: Connection refused (error 111)
18:31:15.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.462304   507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } attempt: 2
18:31:15.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.466826   507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.253:45189: Network error: Client connection negotiation failed: client connection to 127.0.106.253:45189: connect: Connection refused (error 111)
18:31:15.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:15.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.558281   507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } attempt: 3
18:31:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.563174   507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.253:45189: Network error: Client connection negotiation failed: client connection to 127.0.106.253:45189: connect: Connection refused (error 111)
18:31:15.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.613605   509 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:31:15.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.614284   509 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:31:15.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.614902   509 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:31:15.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.647146   509 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:31:15.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.647523   509 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:31:15.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.647861   509 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:31:15.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.648171   509 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:31:15.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.648469   509 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:31:15.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.648716   509 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36431/jwks.json
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.686079   509 master_runner.cc:387] Master server non-default flags:
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.106.212:34665
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/data
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/wal
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.106.253:45189
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36431/jwks.json
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/data/info.pb
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.106.253
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/logs
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:31:15.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:31:15.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.687748   509 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:31:15.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.689343   509 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:31:15.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.700346   519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:15.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:15.706631   507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } attempt: 4
18:31:15.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.714243   507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.253:45189: Network error: Client connection negotiation failed: client connection to 127.0.106.253:45189: connect: Connection refused (error 111)
18:31:15.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535475835 for job f6e63683f34d031c5da392b08baea20c.
18:31:15.854 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
18:31:15.856 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
18:31:16.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:16.013859   507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } attempt: 5
18:31:16.021 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:16.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:16.026736   507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.253:45189: Network error: Client connection negotiation failed: client connection to 127.0.106.253:45189: connect: Connection refused (error 111)
18:31:16.285 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:16.285 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:16.286 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:16.287 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:16.287 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:16.287 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:16.288 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:16.288 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:16.288 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:16.288 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:16.288 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:16.289 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:16.289 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:16.334 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:16.335 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:16.335 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:16.336 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:16.336 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:16.336 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:16.339 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:16.339 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:16.340 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:16.340 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:16.340 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:16.340 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:16.341 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:16.342 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535476341 for job f6e63683f34d031c5da392b08baea20c.
18:31:16.368 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=25 ms, finalizationTime=1 ms).
18:31:16.369 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
18:31:16.517 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:16.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:16.574322   507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } attempt: 6
18:31:16.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:16.607227   507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.253:45189: Network error: Client connection negotiation failed: client connection to 127.0.106.253:45189: connect: Connection refused (error 111)
18:31:16.686 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:16.686 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:16.687 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:16.687 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:16.688 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:16.688 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:16.688 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:16.688 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:16.688 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:16.689 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:16.689 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:16.689 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:16.689 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:16.837 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535476835 for job f6e63683f34d031c5da392b08baea20c.
18:31:16.853 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
18:31:16.855 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
18:31:17.017 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:17.338 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535477335 for job f6e63683f34d031c5da392b08baea20c.
18:31:17.357 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=21 ms, finalizationTime=0 ms).
18:31:17.363 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
18:31:17.516 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:17.540 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:17.541 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:17.541 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:17.542 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:17.542 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:17.542 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:17.542 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:17.542 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:17.542 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:17.543 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:17.543 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:17.543 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:17.543 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:17.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:15.700856   520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:17.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:17.553995   522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:17.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:17.105443   518 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 509
18:31:17.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:17.551416   509 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.851s	user 0.674s	sys 1.173s
18:31:17.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:17.554710   521 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1853 milliseconds
18:31:17.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:17.555053   509 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.855s	user 0.675s	sys 1.173s
18:31:17.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.555361   509 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:31:17.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.559648   509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:31:17.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.562660   509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:31:17.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.564254   509 hybrid_clock.cc:648] HybridClock initialized: now 1783535477564216 us; error 27 us; skew 500 ppm
18:31:17.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.565318   509 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:31:17.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.572302   509 webserver.cc:534] Webserver started at http://127.0.106.253:33705/ using document root <none> and password file <none>
18:31:17.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.573506   509 fs_manager.cc:362] Metadata directory not provided
18:31:17.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.573730   509 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:31:17.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.574129   509 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:31:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.578429   509 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/data/instance:
18:31:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cf66be7e06d9465c8f7e07783e0d6654"
18:31:17.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:17 on dist-test-slave-dxnw"
18:31:17.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.579581   509 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/wal/instance:
18:31:17.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cf66be7e06d9465c8f7e07783e0d6654"
18:31:17.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:17 on dist-test-slave-dxnw"
18:31:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.587364   509 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.002s
18:31:17.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.593740   532 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:31:17.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.595049   509 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.001s
18:31:17.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.595364   509 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/wal
18:31:17.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cf66be7e06d9465c8f7e07783e0d6654"
18:31:17.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:17 on dist-test-slave-dxnw"
18:31:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.595677   509 fs_report.cc:389] FS layout report
18:31:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:31:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/wal
18:31:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/wal
18:31:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/data/data
18:31:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:31:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:31:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:31:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:31:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:31:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:31:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:31:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:31:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:31:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:31:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:31:17.640 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:17.640 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:17.641 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:17.641 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:17.641 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:17.641 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:17.641 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:17.642 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:17.642 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:17.642 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:17.642 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:17.642 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:17.642 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:17.643 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27621), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [139ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [226ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [228ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [234ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [234ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [304ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [305ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [305ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [324ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [325ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [325ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [343ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [343ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [344ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [383ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [424ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [424ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [425ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [563ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [563ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [564ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [564ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [620ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [623ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [624ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [624ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [663ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [664ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [665ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [666ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1120ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1124ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1126ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1126ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2161ms] refreshing cache from master, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2164ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2166ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3921ms] refreshing cache from master, [3921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3923ms] too many traces: truncated at 100 traces, deferred=Deferred@1844393927(state=PENDING, result=null, callback=(continuation of Deferred@368550058 after retry RPC after error@1956924830) -> (continuation of Deferred@537004073 after retry RPC after error@885478113) -> (continuation of Deferred@471680547 after retry RPC after error@1250107523) -> (continuation of Deferred@2062564026 after retry RPC after error@1949183839) -> (continuation of Deferred@41178023 after retry RPC after error@1361112146) -> (continuation of Deferred@712915238 after retry RPC after error@791654369) -> (continuation of Deferred@258357448 after retry RPC after error@1509033738) -> (continuation of Deferred@35562011 after retry RPC after error@1352418590) -> (continuation of Deferred@1845663677 after retry RPC after error@662767392) -> (continuation of Deferred@1358460849 after retry RPC after error@1660845061) -> (continuation of Deferred@406560920 after retry RPC after error@934022328) -> (continuation of Deferred@612016131 after retry RPC after error@896921309) -> (continuation of Deferred@1880078219 after retry RPC after error@655473918) -> (continuation of Deferred@1452960423 after retry RPC after error@1275291055) -> (continuation of Deferred@1102913611 after retry RPC after error@1801552590) -> (continuation of Deferred@1848312407 after retry RPC after error@970079264) -> (continuation of Deferred@289795113 after retry RPC after error@1993702205) -> (continuation of Deferred@1088091658 after retry RPC after error@1757540621) -> (continuation of Deferred@1448836248 after retry RPC after error@193657341) -> (continuation of Deferred@477574176 after retry RPC after error@2069493562) -> (continuation of Deferred@1995172725 after retry RPC after error@720544068) -> (continuation of Deferred@251745806 after retry RPC after error@1003847923) -> (continuation of Deferred@315385023 after retry RPC after error@755703587) -> (continuation of Deferred@675253674 after retry RPC after error@1073369670) -> (continuation of Deferred@1315057818 after retry RPC after error@1004919922), errback=(continuation of Deferred@368550058 after retry RPC after error@1956924830) -> (continuation of Deferred@537004073 after retry RPC after error@885478113) -> (continuation of Deferred@471680547 after retry RPC after error@1250107523) -> (continuation of Deferred@2062564026 after retry RPC after error@1949183839) -> (continuation of Deferred@41178023 after retry RPC after error@1361112146) -> (continuation of Deferred@712915238 after retry RPC after error@791654369) -> (continuation of Deferred@258357448 after retry RPC after error@1509033738) -> (continuation of Deferred@35562011 after retry RPC after error@1352418590) -> (continuation of Deferred@1845663677 after retry RPC after error@662767392) -> (continuation of Deferred@1358460849 after retry RPC after error@1660845061) -> (continuation of Deferred@406560920 after retry RPC after error@934022328) -> (continuation of Deferred@612016131 after retry RPC after error@896921309) -> (continuation of Deferred@1880078219 after retry RPC after error@655473918) -> (continuation of Deferred@1452960423 after retry RPC after error@1275291055) -> (continuation of Deferred@1102913611 after retry RPC after error@1801552590) -> (continuation of Deferred@1848312407 after retry RPC after error@970079264) -> (continuation of Deferred@289795113 after retry RPC after error@1993702205) -> (continuation of Deferred@1088091658 after retry RPC after error@1757540621) -> (continuation of Deferred@1448836248 after retry RPC after error@193657341) -> (continuation of Deferred@477574176 after retry RPC after error@2069493562) -> (continuation of Deferred@1995172725 after retry RPC after error@720544068) -> (continuation of Deferred@251745806 after retry RPC after error@1003847923) -> (continuation of Deferred@315385023 after retry RPC after error@755703587) -> (continuation of Deferred@675253674 after retry RPC after error@1073369670) -> (continuation of Deferred@1315057818 after retry RPC after error@1004919922)))
18:31:17.644 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:31:17.644 [WARN - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27621), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [139ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [226ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [228ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [234ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [234ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [304ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [305ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [305ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [324ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [325ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [325ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [343ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [343ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [344ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [383ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [424ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [424ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [425ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [563ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [563ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [564ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [564ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [620ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [623ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [624ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [624ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [663ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [664ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [665ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [666ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1120ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1124ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1126ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1126ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2161ms] refreshing cache from master, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2164ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2166ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3921ms] refreshing cache from master, [3921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3923ms] too many traces: truncated at 100 traces, deferred=Deferred@1844393927(state=PENDING, result=null, callback=(continuation of Deferred@368550058 after retry RPC after error@1956924830) -> (continuation of Deferred@537004073 after retry RPC after error@885478113) -> (continuation of Deferred@471680547 after retry RPC after error@1250107523) -> (continuation of Deferred@2062564026 after retry RPC after error@1949183839) -> (continuation of Deferred@41178023 after retry RPC after error@1361112146) -> (continuation of Deferred@712915238 after retry RPC after error@791654369) -> (continuation of Deferred@258357448 after retry RPC after error@1509033738) -> (continuation of Deferred@35562011 after retry RPC after error@1352418590) -> (continuation of Deferred@1845663677 after retry RPC after error@662767392) -> (continuation of Deferred@1358460849 after retry RPC after error@1660845061) -> (continuation of Deferred@406560920 after retry RPC after error@934022328) -> (continuation of Deferred@612016131 after retry RPC after error@896921309) -> (continuation of Deferred@1880078219 after retry RPC after error@655473918) -> (continuation of Deferred@1452960423 after retry RPC after error@1275291055) -> (continuation of Deferred@1102913611 after retry RPC after error@1801552590) -> (continuation of Deferred@1848312407 after retry RPC after error@970079264) -> (continuation of Deferred@289795113 after retry RPC after error@1993702205) -> (continuation of Deferred@1088091658 after retry RPC after error@1757540621) -> (continuation of Deferred@1448836248 after retry RPC after error@193657341) -> (continuation of Deferred@477574176 after retry RPC after error@2069493562) -> (continuation of Deferred@1995172725 after retry RPC after error@720544068) -> (continuation of Deferred@251745806 after retry RPC after error@1003847923) -> (continuation of Deferred@315385023 after retry RPC after error@755703587) -> (continuation of Deferred@675253674 after retry RPC after error@1073369670) -> (continuation of Deferred@1315057818 after retry RPC after error@1004919922), errback=(continuation of Deferred@368550058 after retry RPC after error@1956924830) -> (continuation of Deferred@537004073 after retry RPC after error@885478113) -> (continuation of Deferred@471680547 after retry RPC after error@1250107523) -> (continuation of Deferred@2062564026 after retry RPC after error@1949183839) -> (continuation of Deferred@41178023 after retry RPC after error@1361112146) -> (continuation of Deferred@712915238 after retry RPC after error@791654369) -> (continuation of Deferred@258357448 after retry RPC after error@1509033738) -> (continuation of Deferred@35562011 after retry RPC after error@1352418590) -> (continuation of Deferred@1845663677 after retry RPC after error@662767392) -> (continuation of Deferred@1358460849 after retry RPC after error@1660845061) -> (continuation of Deferred@406560920 after retry RPC after error@934022328) -> (continuation of Deferred@612016131 after retry RPC after error@896921309) -> (continuation of Deferred@1880078219 after retry RPC after error@655473918) -> (continuation of Deferred@1452960423 after retry RPC after error@1275291055) -> (continuation of Deferred@1102913611 after retry RPC after error@1801552590) -> (continuation of Deferred@1848312407 after retry RPC after error@970079264) -> (continuation of Deferred@289795113 after retry RPC after error@1993702205) -> (continuation of Deferred@1088091658 after retry RPC after error@1757540621) -> (continuation of Deferred@1448836248 after retry RPC after error@193657341) -> (continuation of Deferred@477574176 after retry RPC after error@2069493562) -> (continuation of Deferred@1995172725 after retry RPC after error@720544068) -> (continuation of Deferred@251745806 after retry RPC after error@1003847923) -> (continuation of Deferred@315385023 after retry RPC after error@755703587) -> (continuation of Deferred@675253674 after retry RPC after error@1073369670) -> (continuation of Deferred@1315057818 after retry RPC after error@1004919922)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.124:38123
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:17.645 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
18:31:17.647 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
18:31:17.650 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27621), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [139ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [226ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [228ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [234ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [234ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [304ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [305ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [305ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [324ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [325ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [325ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [343ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [343ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [344ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [383ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [424ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [424ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [425ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [563ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [563ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [564ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [564ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [620ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [623ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [624ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [624ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [663ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [664ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [665ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [666ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1120ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1124ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1126ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1126ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2161ms] refreshing cache from master, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2164ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2166ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3921ms] refreshing cache from master, [3921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3923ms] too many traces: truncated at 100 traces, deferred=Deferred@1844393927(state=PENDING, result=null, callback=(continuation of Deferred@368550058 after retry RPC after error@1956924830) -> (continuation of Deferred@537004073 after retry RPC after error@885478113) -> (continuation of Deferred@471680547 after retry RPC after error@1250107523) -> (continuation of Deferred@2062564026 after retry RPC after error@1949183839) -> (continuation of Deferred@41178023 after retry RPC after error@1361112146) -> (continuation of Deferred@712915238 after retry RPC after error@791654369) -> (continuation of Deferred@258357448 after retry RPC after error@1509033738) -> (continuation of Deferred@35562011 after retry RPC after error@1352418590) -> (continuation of Deferred@1845663677 after retry RPC after error@662767392) -> (continuation of Deferred@1358460849 after retry RPC after error@1660845061) -> (continuation of Deferred@406560920 after retry RPC after error@934022328) -> (continuation of Deferred@612016131 after retry RPC after error@896921309) -> (continuation of Deferred@1880078219 after retry RPC after error@655473918) -> (continuation of Deferred@1452960423 after retry RPC after error@1275291055) -> (continuation of Deferred@1102913611 after retry RPC after error@1801552590) -> (continuation of Deferred@1848312407 after retry RPC after error@970079264) -> (continuation of Deferred@289795113 after retry RPC after error@1993702205) -> (continuation of Deferred@1088091658 after retry RPC after error@1757540621) -> (continuation of Deferred@1448836248 after retry RPC after error@193657341) -> (continuation of Deferred@477574176 after retry RPC after error@2069493562) -> (continuation of Deferred@1995172725 after retry RPC after error@720544068) -> (continuation of Deferred@251745806 after retry RPC after error@1003847923) -> (continuation of Deferred@315385023 after retry RPC after error@755703587) -> (continuation of Deferred@675253674 after retry RPC after error@1073369670) -> (continuation of Deferred@1315057818 after retry RPC after error@1004919922), errback=(continuation of Deferred@368550058 after retry RPC after error@1956924830) -> (continuation of Deferred@537004073 after retry RPC after error@885478113) -> (continuation of Deferred@471680547 after retry RPC after error@1250107523) -> (continuation of Deferred@2062564026 after retry RPC after error@1949183839) -> (continuation of Deferred@41178023 after retry RPC after error@1361112146) -> (continuation of Deferred@712915238 after retry RPC after error@791654369) -> (continuation of Deferred@258357448 after retry RPC after error@1509033738) -> (continuation of Deferred@35562011 after retry RPC after error@1352418590) -> (continuation of Deferred@1845663677 after retry RPC after error@662767392) -> (continuation of Deferred@1358460849 after retry RPC after error@1660845061) -> (continuation of Deferred@406560920 after retry RPC after error@934022328) -> (continuation of Deferred@612016131 after retry RPC after error@896921309) -> (continuation of Deferred@1880078219 after retry RPC after error@655473918) -> (continuation of Deferred@1452960423 after retry RPC after error@1275291055) -> (continuation of Deferred@1102913611 after retry RPC after error@1801552590) -> (continuation of Deferred@1848312407 after retry RPC after error@970079264) -> (continuation of Deferred@289795113 after retry RPC after error@1993702205) -> (continuation of Deferred@1088091658 after retry RPC after error@1757540621) -> (continuation of Deferred@1448836248 after retry RPC after error@193657341) -> (continuation of Deferred@477574176 after retry RPC after error@2069493562) -> (continuation of Deferred@1995172725 after retry RPC after error@720544068) -> (continuation of Deferred@251745806 after retry RPC after error@1003847923) -> (continuation of Deferred@315385023 after retry RPC after error@755703587) -> (continuation of Deferred@675253674 after retry RPC after error@1073369670) -> (continuation of Deferred@1315057818 after retry RPC after error@1004919922)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.124:38123
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:17.651 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:31:17.652 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
18:31:17.653 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
18:31:17.653 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RUNNING to RESTARTING.
18:31:17.654 [WARN - flink-pekko.actor.default-dispatcher-9] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
18:31:17.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.654502   509 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:31:17.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.656178   509 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:31:17.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.656688   509 kserver.cc:163] Server-wide thread pool size limit: 3276
18:31:17.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.667802   507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } attempt: 7
18:31:17.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:17.676396   507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.253:45189: Network error: Client connection negotiation failed: client connection to 127.0.106.253:45189: connect: Connection refused (error 111)
18:31:17.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.749081   509 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.253:45189
18:31:17.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.749197   586 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.253:45189 every 8 connection(s)
18:31:17.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.752071   509 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/data/info.pb
18:31:17.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.757216   427 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 509
18:31:17.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.757591   427 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-1/wal/instance
18:31:17.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.758483   587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.759845   427 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/wal
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/data
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/logs
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/data/info.pb
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.106.252:46705
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.106.252
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.106.212:34665
18:31:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:17.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:17.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:17.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:31:17.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705
18:31:17.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:31:17.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36431/jwks.json with env {}
18:31:17.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.773319   587 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } has no permanent_uuid. Determining permanent_uuid...
18:31:17.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.802006   587 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } has no permanent_uuid. Determining permanent_uuid...
18:31:17.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.818521   587 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } has no permanent_uuid. Determining permanent_uuid...
18:31:17.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:17.821295   535 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.106.252:46705: connect: Connection refused (error 111)
18:31:17.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:17.826496   587 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.252:46705: Network error: Client connection negotiation failed: client connection to 127.0.106.252:46705: connect: Connection refused (error 111)
18:31:17.835 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535477835 for job f6e63683f34d031c5da392b08baea20c.
18:31:17.845 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:31:17.846 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
18:31:17.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.876129   587 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } attempt: 1
18:31:17.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:17.880729   587 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.252:46705: Network error: Client connection negotiation failed: client connection to 127.0.106.252:46705: connect: Connection refused (error 111)
18:31:17.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:17.949126   587 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } attempt: 2
18:31:17.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:17.953642   587 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.252:46705: Network error: Client connection negotiation failed: client connection to 127.0.106.252:46705: connect: Connection refused (error 111)
18:31:18.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:18.045070   587 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } attempt: 3
18:31:18.047 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:18.047 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:18.048 [DEBUG - pool-39-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:18.048 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:18.048 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:18.048 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:18.048 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:18.048 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:18.048 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:18.049 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:18.049 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:18.049 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:18.049 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:18.050 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28042), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [79ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [175ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [175ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [207ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [211ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [218ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [230ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [231ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [304ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [313ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [314ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [315ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [316ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [323ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [341ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [342ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [363ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [363ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [424ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [425ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [425ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [544ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [720ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [723ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [724ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [724ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [725ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [864ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [865ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [865ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1164ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1165ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1165ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2581ms] refreshing cache from master, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2583ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2584ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2588ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2588ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5301ms] refreshing cache from master, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5303ms] too many traces: truncated at 100 traces, deferred=Deferred@1072280694(state=PENDING, result=null, callback=(continuation of Deferred@801681254 after retry RPC after error@507013924) -> (continuation of Deferred@403840828 after retry RPC after error@1781154380) -> (continuation of Deferred@7566320 after retry RPC after error@1565481361) -> (continuation of Deferred@1437353723 after retry RPC after error@1831622176) -> (continuation of Deferred@1985696902 after retry RPC after error@1375668237) -> (continuation of Deferred@1716717399 after retry RPC after error@1765916907) -> (continuation of Deferred@1158825505 after retry RPC after error@1812238830) -> (continuation of Deferred@311646854 after retry RPC after error@1966245543) -> (continuation of Deferred@583464302 after retry RPC after error@1787140921) -> (continuation of Deferred@1649060741 after retry RPC after error@53223125) -> (continuation of Deferred@374666843 after retry RPC after error@1355742203) -> (continuation of Deferred@1743746276 after retry RPC after error@72746106) -> (continuation of Deferred@889314437 after retry RPC after error@314042621) -> (continuation of Deferred@241427995 after retry RPC after error@975324793) -> (continuation of Deferred@33312844 after retry RPC after error@740401294) -> (continuation of Deferred@1029949487 after retry RPC after error@358240372) -> (continuation of Deferred@1992760483 after retry RPC after error@1472460581) -> (continuation of Deferred@1958903618 after retry RPC after error@870074462) -> (continuation of Deferred@2100324482 after retry RPC after error@897766110) -> (continuation of Deferred@1381860163 after retry RPC after error@51560430) -> (continuation of Deferred@2098770806 after retry RPC after error@1580173865) -> (continuation of Deferred@1616272692 after retry RPC after error@1982690079) -> (continuation of Deferred@1310125487 after retry RPC after error@1816811654), errback=(continuation of Deferred@801681254 after retry RPC after error@507013924) -> (continuation of Deferred@403840828 after retry RPC after error@1781154380) -> (continuation of Deferred@7566320 after retry RPC after error@1565481361) -> (continuation of Deferred@1437353723 after retry RPC after error@1831622176) -> (continuation of Deferred@1985696902 after retry RPC after error@1375668237) -> (continuation of Deferred@1716717399 after retry RPC after error@1765916907) -> (continuation of Deferred@1158825505 after retry RPC after error@1812238830) -> (continuation of Deferred@311646854 after retry RPC after error@1966245543) -> (continuation of Deferred@583464302 after retry RPC after error@1787140921) -> (continuation of Deferred@1649060741 after retry RPC after error@53223125) -> (continuation of Deferred@374666843 after retry RPC after error@1355742203) -> (continuation of Deferred@1743746276 after retry RPC after error@72746106) -> (continuation of Deferred@889314437 after retry RPC after error@314042621) -> (continuation of Deferred@241427995 after retry RPC after error@975324793) -> (continuation of Deferred@33312844 after retry RPC after error@740401294) -> (continuation of Deferred@1029949487 after retry RPC after error@358240372) -> (continuation of Deferred@1992760483 after retry RPC after error@1472460581) -> (continuation of Deferred@1958903618 after retry RPC after error@870074462) -> (continuation of Deferred@2100324482 after retry RPC after error@897766110) -> (continuation of Deferred@1381860163 after retry RPC after error@51560430) -> (continuation of Deferred@2098770806 after retry RPC after error@1580173865) -> (continuation of Deferred@1616272692 after retry RPC after error@1982690079) -> (continuation of Deferred@1310125487 after retry RPC after error@1816811654)))
18:31:18.051 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:31:18.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:18.050578   587 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.252:46705: Network error: Client connection negotiation failed: client connection to 127.0.106.252:46705: connect: Connection refused (error 111)
18:31:18.051 [WARN - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28042), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [79ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [175ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [175ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [207ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [211ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [218ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [230ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [231ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [304ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [313ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [314ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [315ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [316ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [323ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [341ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [342ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [363ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [363ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [424ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [425ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [425ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [544ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [720ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [723ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [724ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [724ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [725ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [864ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [865ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [865ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1164ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1165ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1165ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2581ms] refreshing cache from master, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2583ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2584ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2588ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2588ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5301ms] refreshing cache from master, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5303ms] too many traces: truncated at 100 traces, deferred=Deferred@1072280694(state=PENDING, result=null, callback=(continuation of Deferred@801681254 after retry RPC after error@507013924) -> (continuation of Deferred@403840828 after retry RPC after error@1781154380) -> (continuation of Deferred@7566320 after retry RPC after error@1565481361) -> (continuation of Deferred@1437353723 after retry RPC after error@1831622176) -> (continuation of Deferred@1985696902 after retry RPC after error@1375668237) -> (continuation of Deferred@1716717399 after retry RPC after error@1765916907) -> (continuation of Deferred@1158825505 after retry RPC after error@1812238830) -> (continuation of Deferred@311646854 after retry RPC after error@1966245543) -> (continuation of Deferred@583464302 after retry RPC after error@1787140921) -> (continuation of Deferred@1649060741 after retry RPC after error@53223125) -> (continuation of Deferred@374666843 after retry RPC after error@1355742203) -> (continuation of Deferred@1743746276 after retry RPC after error@72746106) -> (continuation of Deferred@889314437 after retry RPC after error@314042621) -> (continuation of Deferred@241427995 after retry RPC after error@975324793) -> (continuation of Deferred@33312844 after retry RPC after error@740401294) -> (continuation of Deferred@1029949487 after retry RPC after error@358240372) -> (continuation of Deferred@1992760483 after retry RPC after error@1472460581) -> (continuation of Deferred@1958903618 after retry RPC after error@870074462) -> (continuation of Deferred@2100324482 after retry RPC after error@897766110) -> (continuation of Deferred@1381860163 after retry RPC after error@51560430) -> (continuation of Deferred@2098770806 after retry RPC after error@1580173865) -> (continuation of Deferred@1616272692 after retry RPC after error@1982690079) -> (continuation of Deferred@1310125487 after retry RPC after error@1816811654), errback=(continuation of Deferred@801681254 after retry RPC after error@507013924) -> (continuation of Deferred@403840828 after retry RPC after error@1781154380) -> (continuation of Deferred@7566320 after retry RPC after error@1565481361) -> (continuation of Deferred@1437353723 after retry RPC after error@1831622176) -> (continuation of Deferred@1985696902 after retry RPC after error@1375668237) -> (continuation of Deferred@1716717399 after retry RPC after error@1765916907) -> (continuation of Deferred@1158825505 after retry RPC after error@1812238830) -> (continuation of Deferred@311646854 after retry RPC after error@1966245543) -> (continuation of Deferred@583464302 after retry RPC after error@1787140921) -> (continuation of Deferred@1649060741 after retry RPC after error@53223125) -> (continuation of Deferred@374666843 after retry RPC after error@1355742203) -> (continuation of Deferred@1743746276 after retry RPC after error@72746106) -> (continuation of Deferred@889314437 after retry RPC after error@314042621) -> (continuation of Deferred@241427995 after retry RPC after error@975324793) -> (continuation of Deferred@33312844 after retry RPC after error@740401294) -> (continuation of Deferred@1029949487 after retry RPC after error@358240372) -> (continuation of Deferred@1992760483 after retry RPC after error@1472460581) -> (continuation of Deferred@1958903618 after retry RPC after error@870074462) -> (continuation of Deferred@2100324482 after retry RPC after error@897766110) -> (continuation of Deferred@1381860163 after retry RPC after error@51560430) -> (continuation of Deferred@2098770806 after retry RPC after error@1580173865) -> (continuation of Deferred@1616272692 after retry RPC after error@1982690079) -> (continuation of Deferred@1310125487 after retry RPC after error@1816811654)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:18.052 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
18:31:18.054 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
18:31:18.056 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28042), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [65ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [79ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [175ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [175ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [207ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [211ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [218ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [230ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [231ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [304ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [313ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [314ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [315ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [316ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [323ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [341ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [342ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [363ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [363ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [424ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [425ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [425ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [544ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [720ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [723ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [724ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [724ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [725ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [864ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [865ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [865ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1164ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1165ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1165ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2581ms] refreshing cache from master, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2583ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2584ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2588ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2588ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5301ms] refreshing cache from master, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5303ms] too many traces: truncated at 100 traces, deferred=Deferred@1072280694(state=PENDING, result=null, callback=(continuation of Deferred@801681254 after retry RPC after error@507013924) -> (continuation of Deferred@403840828 after retry RPC after error@1781154380) -> (continuation of Deferred@7566320 after retry RPC after error@1565481361) -> (continuation of Deferred@1437353723 after retry RPC after error@1831622176) -> (continuation of Deferred@1985696902 after retry RPC after error@1375668237) -> (continuation of Deferred@1716717399 after retry RPC after error@1765916907) -> (continuation of Deferred@1158825505 after retry RPC after error@1812238830) -> (continuation of Deferred@311646854 after retry RPC after error@1966245543) -> (continuation of Deferred@583464302 after retry RPC after error@1787140921) -> (continuation of Deferred@1649060741 after retry RPC after error@53223125) -> (continuation of Deferred@374666843 after retry RPC after error@1355742203) -> (continuation of Deferred@1743746276 after retry RPC after error@72746106) -> (continuation of Deferred@889314437 after retry RPC after error@314042621) -> (continuation of Deferred@241427995 after retry RPC after error@975324793) -> (continuation of Deferred@33312844 after retry RPC after error@740401294) -> (continuation of Deferred@1029949487 after retry RPC after error@358240372) -> (continuation of Deferred@1992760483 after retry RPC after error@1472460581) -> (continuation of Deferred@1958903618 after retry RPC after error@870074462) -> (continuation of Deferred@2100324482 after retry RPC after error@897766110) -> (continuation of Deferred@1381860163 after retry RPC after error@51560430) -> (continuation of Deferred@2098770806 after retry RPC after error@1580173865) -> (continuation of Deferred@1616272692 after retry RPC after error@1982690079) -> (continuation of Deferred@1310125487 after retry RPC after error@1816811654), errback=(continuation of Deferred@801681254 after retry RPC after error@507013924) -> (continuation of Deferred@403840828 after retry RPC after error@1781154380) -> (continuation of Deferred@7566320 after retry RPC after error@1565481361) -> (continuation of Deferred@1437353723 after retry RPC after error@1831622176) -> (continuation of Deferred@1985696902 after retry RPC after error@1375668237) -> (continuation of Deferred@1716717399 after retry RPC after error@1765916907) -> (continuation of Deferred@1158825505 after retry RPC after error@1812238830) -> (continuation of Deferred@311646854 after retry RPC after error@1966245543) -> (continuation of Deferred@583464302 after retry RPC after error@1787140921) -> (continuation of Deferred@1649060741 after retry RPC after error@53223125) -> (continuation of Deferred@374666843 after retry RPC after error@1355742203) -> (continuation of Deferred@1743746276 after retry RPC after error@72746106) -> (continuation of Deferred@889314437 after retry RPC after error@314042621) -> (continuation of Deferred@241427995 after retry RPC after error@975324793) -> (continuation of Deferred@33312844 after retry RPC after error@740401294) -> (continuation of Deferred@1029949487 after retry RPC after error@358240372) -> (continuation of Deferred@1992760483 after retry RPC after error@1472460581) -> (continuation of Deferred@1958903618 after retry RPC after error@870074462) -> (continuation of Deferred@2100324482 after retry RPC after error@897766110) -> (continuation of Deferred@1381860163 after retry RPC after error@51560430) -> (continuation of Deferred@2098770806 after retry RPC after error@1580173865) -> (continuation of Deferred@1616272692 after retry RPC after error@1982690079) -> (continuation of Deferred@1310125487 after retry RPC after error@1816811654)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:18.057 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:31:18.057 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
18:31:18.058 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
18:31:18.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:18.100601   589 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:31:18.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:18.101166   589 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:31:18.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:18.101621   589 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:31:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:18.135043   589 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:31:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:18.135318   589 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:31:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:18.135533   589 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:31:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:18.135735   589 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:31:18.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:18.135931   589 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:31:18.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:18.136078   589 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36431/jwks.json
18:31:18.146 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:18.146 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:18.146 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:18.147 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:18.147 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:18.147 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:18.147 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:18.147 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:18.147 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:18.147 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:18.147 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:18.147 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:18.147 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:18.173928   589 master_runner.cc:387] Master server non-default flags:
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.106.212:34665
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/data
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/wal
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.106.252:46705
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36431/jwks.json
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/data/info.pb
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.106.252
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:31:18.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:18.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/logs
18:31:18.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:18.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:31:18.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:31:18.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:31:18.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:31:18.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:31:18.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:31:18.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:31:18.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:31:18.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:31:18.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:18.175307   589 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:31:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:18.176836   589 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:31:18.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:18.188748   599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:18.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:18.194747   587 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } attempt: 4
18:31:18.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:18.202845   587 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.252:46705: Network error: Client connection negotiation failed: client connection to 127.0.106.252:46705: connect: Connection refused (error 111)
18:31:18.205 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:18.205 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:18.206 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:18.206 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:18.206 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:18.207 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:18.207 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:18.207 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:18.207 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:18.207 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:18.206 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:18.207 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:18.207 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:18.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535478335 for job f6e63683f34d031c5da392b08baea20c.
18:31:18.355 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
18:31:18.357 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
18:31:18.490 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:18.491 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:18.491 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:18.492 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:18.492 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:18.492 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:18.493 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:18.493 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:18.493 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:18.494 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:18.494 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:18.494 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:18.494 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:18.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:18.502384   587 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } attempt: 5
18:31:18.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:18.511395   587 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.252:46705: Network error: Client connection negotiation failed: client connection to 127.0.106.252:46705: connect: Connection refused (error 111)
18:31:18.614 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:18.615 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:18.615 [DEBUG - pool-44-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:18.616 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:18.616 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:18.616 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:18.617 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:18.617 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:18.617 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:18.618 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:18.618 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:18.618 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:18.618 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:18.619 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28580), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [144ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [147ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [147ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [210ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [240ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [247ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [247ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [273ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [274ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [277ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [282ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [304ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [323ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [343ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [343ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [344ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [406ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [406ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [480ms] refreshing cache from master, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [483ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [484ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [484ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [484ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [564ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [565ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [565ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [566ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1024ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1025ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1025ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1025ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1261ms] refreshing cache from master, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1265ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1265ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3061ms] refreshing cache from master, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3063ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3064ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3065ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3065ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [6502ms] refreshing cache from master, [6502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [6503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [6503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [6504ms] too many traces: truncated at 100 traces, deferred=Deferred@1173850883(state=PENDING, result=null, callback=(continuation of Deferred@1316867447 after retry RPC after error@1034468932) -> (continuation of Deferred@1834985697 after retry RPC after error@344558042) -> (continuation of Deferred@884996169 after retry RPC after error@1276979716) -> (continuation of Deferred@1544920006 after retry RPC after error@67768007) -> (continuation of Deferred@1329386431 after retry RPC after error@1792314710) -> (continuation of Deferred@451928161 after retry RPC after error@1313323469) -> (continuation of Deferred@1741634193 after retry RPC after error@700429571) -> (continuation of Deferred@1287038141 after retry RPC after error@1062008119) -> (continuation of Deferred@558455805 after retry RPC after error@1963648378) -> (continuation of Deferred@207631402 after retry RPC after error@1423805916) -> (continuation of Deferred@1059107337 after retry RPC after error@488878498) -> (continuation of Deferred@275711816 after retry RPC after error@686087156) -> (continuation of Deferred@317625371 after retry RPC after error@314607941) -> (continuation of Deferred@2063440146 after retry RPC after error@1959319234) -> (continuation of Deferred@308337164 after retry RPC after error@83682212) -> (continuation of Deferred@308268832 after retry RPC after error@538146159) -> (continuation of Deferred@876051419 after retry RPC after error@1471500090) -> (continuation of Deferred@998226979 after retry RPC after error@8130094) -> (continuation of Deferred@261772377 after retry RPC after error@1915426319) -> (continuation of Deferred@879964877 after retry RPC after error@1411270419) -> (continuation of Deferred@159115605 after retry RPC after error@592059675) -> (continuation of Deferred@235058917 after retry RPC after error@679628521), errback=(continuation of Deferred@1316867447 after retry RPC after error@1034468932) -> (continuation of Deferred@1834985697 after retry RPC after error@344558042) -> (continuation of Deferred@884996169 after retry RPC after error@1276979716) -> (continuation of Deferred@1544920006 after retry RPC after error@67768007) -> (continuation of Deferred@1329386431 after retry RPC after error@1792314710) -> (continuation of Deferred@451928161 after retry RPC after error@1313323469) -> (continuation of Deferred@1741634193 after retry RPC after error@700429571) -> (continuation of Deferred@1287038141 after retry RPC after error@1062008119) -> (continuation of Deferred@558455805 after retry RPC after error@1963648378) -> (continuation of Deferred@207631402 after retry RPC after error@1423805916) -> (continuation of Deferred@1059107337 after retry RPC after error@488878498) -> (continuation of Deferred@275711816 after retry RPC after error@686087156) -> (continuation of Deferred@317625371 after retry RPC after error@314607941) -> (continuation of Deferred@2063440146 after retry RPC after error@1959319234) -> (continuation of Deferred@308337164 after retry RPC after error@83682212) -> (continuation of Deferred@308268832 after retry RPC after error@538146159) -> (continuation of Deferred@876051419 after retry RPC after error@1471500090) -> (continuation of Deferred@998226979 after retry RPC after error@8130094) -> (continuation of Deferred@261772377 after retry RPC after error@1915426319) -> (continuation of Deferred@879964877 after retry RPC after error@1411270419) -> (continuation of Deferred@159115605 after retry RPC after error@592059675) -> (continuation of Deferred@235058917 after retry RPC after error@679628521)))
18:31:18.620 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:31:18.620 [WARN - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28580), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [144ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [147ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [147ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [210ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [240ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [247ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [247ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [273ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [274ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [277ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [282ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [304ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [323ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [343ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [343ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [344ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [406ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [406ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [480ms] refreshing cache from master, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [483ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [484ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [484ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [484ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [564ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [565ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [565ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [566ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1024ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1025ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1025ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1025ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1261ms] refreshing cache from master, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1265ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1265ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3061ms] refreshing cache from master, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3063ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3064ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3065ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3065ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [6502ms] refreshing cache from master, [6502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [6503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [6503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [6504ms] too many traces: truncated at 100 traces, deferred=Deferred@1173850883(state=PENDING, result=null, callback=(continuation of Deferred@1316867447 after retry RPC after error@1034468932) -> (continuation of Deferred@1834985697 after retry RPC after error@344558042) -> (continuation of Deferred@884996169 after retry RPC after error@1276979716) -> (continuation of Deferred@1544920006 after retry RPC after error@67768007) -> (continuation of Deferred@1329386431 after retry RPC after error@1792314710) -> (continuation of Deferred@451928161 after retry RPC after error@1313323469) -> (continuation of Deferred@1741634193 after retry RPC after error@700429571) -> (continuation of Deferred@1287038141 after retry RPC after error@1062008119) -> (continuation of Deferred@558455805 after retry RPC after error@1963648378) -> (continuation of Deferred@207631402 after retry RPC after error@1423805916) -> (continuation of Deferred@1059107337 after retry RPC after error@488878498) -> (continuation of Deferred@275711816 after retry RPC after error@686087156) -> (continuation of Deferred@317625371 after retry RPC after error@314607941) -> (continuation of Deferred@2063440146 after retry RPC after error@1959319234) -> (continuation of Deferred@308337164 after retry RPC after error@83682212) -> (continuation of Deferred@308268832 after retry RPC after error@538146159) -> (continuation of Deferred@876051419 after retry RPC after error@1471500090) -> (continuation of Deferred@998226979 after retry RPC after error@8130094) -> (continuation of Deferred@261772377 after retry RPC after error@1915426319) -> (continuation of Deferred@879964877 after retry RPC after error@1411270419) -> (continuation of Deferred@159115605 after retry RPC after error@592059675) -> (continuation of Deferred@235058917 after retry RPC after error@679628521), errback=(continuation of Deferred@1316867447 after retry RPC after error@1034468932) -> (continuation of Deferred@1834985697 after retry RPC after error@344558042) -> (continuation of Deferred@884996169 after retry RPC after error@1276979716) -> (continuation of Deferred@1544920006 after retry RPC after error@67768007) -> (continuation of Deferred@1329386431 after retry RPC after error@1792314710) -> (continuation of Deferred@451928161 after retry RPC after error@1313323469) -> (continuation of Deferred@1741634193 after retry RPC after error@700429571) -> (continuation of Deferred@1287038141 after retry RPC after error@1062008119) -> (continuation of Deferred@558455805 after retry RPC after error@1963648378) -> (continuation of Deferred@207631402 after retry RPC after error@1423805916) -> (continuation of Deferred@1059107337 after retry RPC after error@488878498) -> (continuation of Deferred@275711816 after retry RPC after error@686087156) -> (continuation of Deferred@317625371 after retry RPC after error@314607941) -> (continuation of Deferred@2063440146 after retry RPC after error@1959319234) -> (continuation of Deferred@308337164 after retry RPC after error@83682212) -> (continuation of Deferred@308268832 after retry RPC after error@538146159) -> (continuation of Deferred@876051419 after retry RPC after error@1471500090) -> (continuation of Deferred@998226979 after retry RPC after error@8130094) -> (continuation of Deferred@261772377 after retry RPC after error@1915426319) -> (continuation of Deferred@879964877 after retry RPC after error@1411270419) -> (continuation of Deferred@159115605 after retry RPC after error@592059675) -> (continuation of Deferred@235058917 after retry RPC after error@679628521)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:18.621 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
18:31:18.623 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
18:31:18.626 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28580), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [144ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [147ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [147ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [210ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [240ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [247ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [247ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [273ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [274ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [277ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [282ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [304ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [323ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [343ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [343ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [344ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [406ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [406ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [480ms] refreshing cache from master, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [483ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [484ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [484ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [484ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [564ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [565ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [565ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [566ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1024ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1025ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1025ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1025ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1261ms] refreshing cache from master, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1265ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1265ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3061ms] refreshing cache from master, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3063ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3064ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3065ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3065ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [6502ms] refreshing cache from master, [6502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [6503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [6503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [6504ms] too many traces: truncated at 100 traces, deferred=Deferred@1173850883(state=PENDING, result=null, callback=(continuation of Deferred@1316867447 after retry RPC after error@1034468932) -> (continuation of Deferred@1834985697 after retry RPC after error@344558042) -> (continuation of Deferred@884996169 after retry RPC after error@1276979716) -> (continuation of Deferred@1544920006 after retry RPC after error@67768007) -> (continuation of Deferred@1329386431 after retry RPC after error@1792314710) -> (continuation of Deferred@451928161 after retry RPC after error@1313323469) -> (continuation of Deferred@1741634193 after retry RPC after error@700429571) -> (continuation of Deferred@1287038141 after retry RPC after error@1062008119) -> (continuation of Deferred@558455805 after retry RPC after error@1963648378) -> (continuation of Deferred@207631402 after retry RPC after error@1423805916) -> (continuation of Deferred@1059107337 after retry RPC after error@488878498) -> (continuation of Deferred@275711816 after retry RPC after error@686087156) -> (continuation of Deferred@317625371 after retry RPC after error@314607941) -> (continuation of Deferred@2063440146 after retry RPC after error@1959319234) -> (continuation of Deferred@308337164 after retry RPC after error@83682212) -> (continuation of Deferred@308268832 after retry RPC after error@538146159) -> (continuation of Deferred@876051419 after retry RPC after error@1471500090) -> (continuation of Deferred@998226979 after retry RPC after error@8130094) -> (continuation of Deferred@261772377 after retry RPC after error@1915426319) -> (continuation of Deferred@879964877 after retry RPC after error@1411270419) -> (continuation of Deferred@159115605 after retry RPC after error@592059675) -> (continuation of Deferred@235058917 after retry RPC after error@679628521), errback=(continuation of Deferred@1316867447 after retry RPC after error@1034468932) -> (continuation of Deferred@1834985697 after retry RPC after error@344558042) -> (continuation of Deferred@884996169 after retry RPC after error@1276979716) -> (continuation of Deferred@1544920006 after retry RPC after error@67768007) -> (continuation of Deferred@1329386431 after retry RPC after error@1792314710) -> (continuation of Deferred@451928161 after retry RPC after error@1313323469) -> (continuation of Deferred@1741634193 after retry RPC after error@700429571) -> (continuation of Deferred@1287038141 after retry RPC after error@1062008119) -> (continuation of Deferred@558455805 after retry RPC after error@1963648378) -> (continuation of Deferred@207631402 after retry RPC after error@1423805916) -> (continuation of Deferred@1059107337 after retry RPC after error@488878498) -> (continuation of Deferred@275711816 after retry RPC after error@686087156) -> (continuation of Deferred@317625371 after retry RPC after error@314607941) -> (continuation of Deferred@2063440146 after retry RPC after error@1959319234) -> (continuation of Deferred@308337164 after retry RPC after error@83682212) -> (continuation of Deferred@308268832 after retry RPC after error@538146159) -> (continuation of Deferred@876051419 after retry RPC after error@1471500090) -> (continuation of Deferred@998226979 after retry RPC after error@8130094) -> (continuation of Deferred@261772377 after retry RPC after error@1915426319) -> (continuation of Deferred@879964877 after retry RPC after error@1411270419) -> (continuation of Deferred@159115605 after retry RPC after error@592059675) -> (continuation of Deferred@235058917 after retry RPC after error@679628521)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:18.628 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
18:31:18.628 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
18:31:18.628 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:31:18.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535478835 for job f6e63683f34d031c5da392b08baea20c.
18:31:18.852 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
18:31:18.854 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
18:31:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:19.058966   587 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } attempt: 6
18:31:19.085 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:19.086 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:19.086 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:19.087 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:19.087 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:19.087 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:19.088 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:19.088 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:19.088 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:19.088 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:19.088 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:19.088 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:19.089 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:19.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:19.093137   587 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.252:46705: Network error: Client connection negotiation failed: client connection to 127.0.106.252:46705: connect: Connection refused (error 111)
18:31:19.291 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job fa73e37017778341a79e5b3ef3d55eb9 from Checkpoint 69 @ 1783535448409 for fa73e37017778341a79e5b3ef3d55eb9 located at file:/tmp/junit12731664100414606042/checkpoints/fa73e37017778341a79e5b3ef3d55eb9/chk-69.
18:31:19.292 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
18:31:19.296 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 3 to checkpoint 69 for source Source: KuduSource to checkpoint.
18:31:19.297 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
18:31:19.299 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:31:19.300 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
18:31:19.300 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 1623ba59e704d1676486c6f13d60068c
18:31:19.301 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 1623ba59e704d1676486c6f13d60068c.
18:31:19.302 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id 1623ba59e704d1676486c6f13d60068c.
18:31:19.303 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job fa73e37017778341a79e5b3ef3d55eb9 from Checkpoint 69 @ 1783535448409 for fa73e37017778341a79e5b3ef3d55eb9 located at file:/tmp/junit12731664100414606042/checkpoints/fa73e37017778341a79e5b3ef3d55eb9/chk-69.
18:31:19.305 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
18:31:19.305 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 69 for source Source: KuduSource to checkpoint.
18:31:19.305 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
18:31:19.306 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:31:19.307 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
18:31:19.307 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 409256c48f07c3602c01f545df4e7b3c
18:31:19.307 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RESTARTING to RUNNING.
18:31:19.307 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job fa73e37017778341a79e5b3ef3d55eb9 from Checkpoint 69 @ 1783535448409 for fa73e37017778341a79e5b3ef3d55eb9 located at file:/tmp/junit12731664100414606042/checkpoints/fa73e37017778341a79e5b3ef3d55eb9/chk-69.
18:31:19.308 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
18:31:19.308 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 69 for source Source: KuduSource to checkpoint.
18:31:19.309 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
18:31:19.309 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:31:19.310 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 409256c48f07c3602c01f545df4e7b3c.
18:31:19.311 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id 409256c48f07c3602c01f545df4e7b3c.
18:31:19.312 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
18:31:19.312 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
18:31:19.313 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7b47efb6
18:31:19.313 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:19.315 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
18:31:19.315 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d
18:31:19.315 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
18:31:19.315 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
18:31:19.315 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:31:19.316 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
18:31:19.316 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot fe2a3c24d55fce5c8d5a55c4e880b53d.
18:31:19.316 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4fdd5ff7
18:31:19.316 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:19.316 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:31:19.317 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
18:31:19.317 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d.
18:31:19.320 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1c96a275
18:31:19.320 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
18:31:19.323 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:19.323 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
18:31:19.327 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3bf702df
18:31:19.329 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
18:31:19.329 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
18:31:19.329 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7e063356
18:31:19.330 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:19.330 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:31:19.330 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
18:31:19.330 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
18:31:19.333 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:19.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535479335 for job f6e63683f34d031c5da392b08baea20c.
18:31:19.345 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@351ba09f
18:31:19.347 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:31:19.348 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
18:31:19.350 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:19.351 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.355 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.357 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.362 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.366 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.367 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.367 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.370 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.373 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.373 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.373 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.376 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.378 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.378 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.378 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.391 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.393 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.393 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.393 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.401 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.401 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.401 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.401 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.404 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.405 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.405 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.406 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.407 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.407 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.407 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.407 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.408 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.409 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.409 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.409 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.410 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.410 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.411 [DEBUG - pool-41-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.411 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.411 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.412 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.412 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.412 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.412 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.412 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.413 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.413 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.413 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.413 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.414 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29387), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [66ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [87ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [103ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [103ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [150ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [156ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [172ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [172ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [215ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [241ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [242ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [264ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [264ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [264ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [303ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [363ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [363ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [364ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [364ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [463ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [464ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [465ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [465ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [603ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [604ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [604ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [605ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [880ms] refreshing cache from master, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [884ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [884ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1381ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1384ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1384ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1384ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3241ms] refreshing cache from master, [3241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3243ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [4681ms] refreshing cache from master, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [4682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4684ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [4685ms] too many traces: truncated at 100 traces, deferred=Deferred@2069891590(state=PENDING, result=null, callback=(continuation of Deferred@1732058933 after retry RPC after error@1645366582) -> (continuation of Deferred@2115890995 after retry RPC after error@89582284) -> (continuation of Deferred@169712100 after retry RPC after error@2056654444) -> (continuation of Deferred@1801654906 after retry RPC after error@1506903376) -> (continuation of Deferred@1063642423 after retry RPC after error@1967811033) -> (continuation of Deferred@105465288 after retry RPC after error@1399307092) -> (continuation of Deferred@1127985234 after retry RPC after error@1704529229) -> (continuation of Deferred@699556659 after retry RPC after error@1205977162) -> (continuation of Deferred@1497776580 after retry RPC after error@1947782340) -> (continuation of Deferred@1309250191 after retry RPC after error@119797908) -> (continuation of Deferred@1820381653 after retry RPC after error@1582063213) -> (continuation of Deferred@1548952257 after retry RPC after error@1152157319) -> (continuation of Deferred@776530366 after retry RPC after error@315319596) -> (continuation of Deferred@1472923806 after retry RPC after error@2012423262) -> (continuation of Deferred@513746439 after retry RPC after error@1463079677) -> (continuation of Deferred@1488240509 after retry RPC after error@906732001) -> (continuation of Deferred@1371735609 after retry RPC after error@538019270) -> (continuation of Deferred@1562610158 after retry RPC after error@919355138) -> (continuation of Deferred@2146895148 after retry RPC after error@1407488161) -> (continuation of Deferred@306782154 after retry RPC after error@1160382126) -> (continuation of Deferred@45331778 after retry RPC after error@1965378605) -> (continuation of Deferred@801679884 after retry RPC after error@985847341) -> (continuation of Deferred@625245586 after retry RPC after error@2061441331), errback=(continuation of Deferred@1732058933 after retry RPC after error@1645366582) -> (continuation of Deferred@2115890995 after retry RPC after error@89582284) -> (continuation of Deferred@169712100 after retry RPC after error@2056654444) -> (continuation of Deferred@1801654906 after retry RPC after error@1506903376) -> (continuation of Deferred@1063642423 after retry RPC after error@1967811033) -> (continuation of Deferred@105465288 after retry RPC after error@1399307092) -> (continuation of Deferred@1127985234 after retry RPC after error@1704529229) -> (continuation of Deferred@699556659 after retry RPC after error@1205977162) -> (continuation of Deferred@1497776580 after retry RPC after error@1947782340) -> (continuation of Deferred@1309250191 after retry RPC after error@119797908) -> (continuation of Deferred@1820381653 after retry RPC after error@1582063213) -> (continuation of Deferred@1548952257 after retry RPC after error@1152157319) -> (continuation of Deferred@776530366 after retry RPC after error@315319596) -> (continuation of Deferred@1472923806 after retry RPC after error@2012423262) -> (continuation of Deferred@513746439 after retry RPC after error@1463079677) -> (continuation of Deferred@1488240509 after retry RPC after error@906732001) -> (continuation of Deferred@1371735609 after retry RPC after error@538019270) -> (continuation of Deferred@1562610158 after retry RPC after error@919355138) -> (continuation of Deferred@2146895148 after retry RPC after error@1407488161) -> (continuation of Deferred@306782154 after retry RPC after error@1160382126) -> (continuation of Deferred@45331778 after retry RPC after error@1965378605) -> (continuation of Deferred@801679884 after retry RPC after error@985847341) -> (continuation of Deferred@625245586 after retry RPC after error@2061441331)))
18:31:19.415 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.415 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:31:19.416 [WARN - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29387), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [66ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [87ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [103ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [103ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [150ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [156ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [172ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [172ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [215ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [241ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [242ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [264ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [264ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [264ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [303ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [363ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [363ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [364ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [364ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [463ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [464ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [465ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [465ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [603ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [604ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [604ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [605ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [880ms] refreshing cache from master, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [884ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [884ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1381ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1384ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1384ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1384ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3241ms] refreshing cache from master, [3241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3243ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [4681ms] refreshing cache from master, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [4682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4684ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [4685ms] too many traces: truncated at 100 traces, deferred=Deferred@2069891590(state=PENDING, result=null, callback=(continuation of Deferred@1732058933 after retry RPC after error@1645366582) -> (continuation of Deferred@2115890995 after retry RPC after error@89582284) -> (continuation of Deferred@169712100 after retry RPC after error@2056654444) -> (continuation of Deferred@1801654906 after retry RPC after error@1506903376) -> (continuation of Deferred@1063642423 after retry RPC after error@1967811033) -> (continuation of Deferred@105465288 after retry RPC after error@1399307092) -> (continuation of Deferred@1127985234 after retry RPC after error@1704529229) -> (continuation of Deferred@699556659 after retry RPC after error@1205977162) -> (continuation of Deferred@1497776580 after retry RPC after error@1947782340) -> (continuation of Deferred@1309250191 after retry RPC after error@119797908) -> (continuation of Deferred@1820381653 after retry RPC after error@1582063213) -> (continuation of Deferred@1548952257 after retry RPC after error@1152157319) -> (continuation of Deferred@776530366 after retry RPC after error@315319596) -> (continuation of Deferred@1472923806 after retry RPC after error@2012423262) -> (continuation of Deferred@513746439 after retry RPC after error@1463079677) -> (continuation of Deferred@1488240509 after retry RPC after error@906732001) -> (continuation of Deferred@1371735609 after retry RPC after error@538019270) -> (continuation of Deferred@1562610158 after retry RPC after error@919355138) -> (continuation of Deferred@2146895148 after retry RPC after error@1407488161) -> (continuation of Deferred@306782154 after retry RPC after error@1160382126) -> (continuation of Deferred@45331778 after retry RPC after error@1965378605) -> (continuation of Deferred@801679884 after retry RPC after error@985847341) -> (continuation of Deferred@625245586 after retry RPC after error@2061441331), errback=(continuation of Deferred@1732058933 after retry RPC after error@1645366582) -> (continuation of Deferred@2115890995 after retry RPC after error@89582284) -> (continuation of Deferred@169712100 after retry RPC after error@2056654444) -> (continuation of Deferred@1801654906 after retry RPC after error@1506903376) -> (continuation of Deferred@1063642423 after retry RPC after error@1967811033) -> (continuation of Deferred@105465288 after retry RPC after error@1399307092) -> (continuation of Deferred@1127985234 after retry RPC after error@1704529229) -> (continuation of Deferred@699556659 after retry RPC after error@1205977162) -> (continuation of Deferred@1497776580 after retry RPC after error@1947782340) -> (continuation of Deferred@1309250191 after retry RPC after error@119797908) -> (continuation of Deferred@1820381653 after retry RPC after error@1582063213) -> (continuation of Deferred@1548952257 after retry RPC after error@1152157319) -> (continuation of Deferred@776530366 after retry RPC after error@315319596) -> (continuation of Deferred@1472923806 after retry RPC after error@2012423262) -> (continuation of Deferred@513746439 after retry RPC after error@1463079677) -> (continuation of Deferred@1488240509 after retry RPC after error@906732001) -> (continuation of Deferred@1371735609 after retry RPC after error@538019270) -> (continuation of Deferred@1562610158 after retry RPC after error@919355138) -> (continuation of Deferred@2146895148 after retry RPC after error@1407488161) -> (continuation of Deferred@306782154 after retry RPC after error@1160382126) -> (continuation of Deferred@45331778 after retry RPC after error@1965378605) -> (continuation of Deferred@801679884 after retry RPC after error@985847341) -> (continuation of Deferred@625245586 after retry RPC after error@2061441331)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:19.417 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
18:31:19.418 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.419 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
18:31:19.423 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29387), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [66ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [87ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [103ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [103ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [150ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [156ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [172ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [172ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [215ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [241ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [242ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [264ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [264ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [264ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [303ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [363ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [363ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [364ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [364ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [463ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [464ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [465ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [465ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [603ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [604ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [604ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [605ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [880ms] refreshing cache from master, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [884ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [884ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1381ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1384ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1384ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1384ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3241ms] refreshing cache from master, [3241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3243ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [4681ms] refreshing cache from master, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [4682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4684ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [4685ms] too many traces: truncated at 100 traces, deferred=Deferred@2069891590(state=PENDING, result=null, callback=(continuation of Deferred@1732058933 after retry RPC after error@1645366582) -> (continuation of Deferred@2115890995 after retry RPC after error@89582284) -> (continuation of Deferred@169712100 after retry RPC after error@2056654444) -> (continuation of Deferred@1801654906 after retry RPC after error@1506903376) -> (continuation of Deferred@1063642423 after retry RPC after error@1967811033) -> (continuation of Deferred@105465288 after retry RPC after error@1399307092) -> (continuation of Deferred@1127985234 after retry RPC after error@1704529229) -> (continuation of Deferred@699556659 after retry RPC after error@1205977162) -> (continuation of Deferred@1497776580 after retry RPC after error@1947782340) -> (continuation of Deferred@1309250191 after retry RPC after error@119797908) -> (continuation of Deferred@1820381653 after retry RPC after error@1582063213) -> (continuation of Deferred@1548952257 after retry RPC after error@1152157319) -> (continuation of Deferred@776530366 after retry RPC after error@315319596) -> (continuation of Deferred@1472923806 after retry RPC after error@2012423262) -> (continuation of Deferred@513746439 after retry RPC after error@1463079677) -> (continuation of Deferred@1488240509 after retry RPC after error@906732001) -> (continuation of Deferred@1371735609 after retry RPC after error@538019270) -> (continuation of Deferred@1562610158 after retry RPC after error@919355138) -> (continuation of Deferred@2146895148 after retry RPC after error@1407488161) -> (continuation of Deferred@306782154 after retry RPC after error@1160382126) -> (continuation of Deferred@45331778 after retry RPC after error@1965378605) -> (continuation of Deferred@801679884 after retry RPC after error@985847341) -> (continuation of Deferred@625245586 after retry RPC after error@2061441331), errback=(continuation of Deferred@1732058933 after retry RPC after error@1645366582) -> (continuation of Deferred@2115890995 after retry RPC after error@89582284) -> (continuation of Deferred@169712100 after retry RPC after error@2056654444) -> (continuation of Deferred@1801654906 after retry RPC after error@1506903376) -> (continuation of Deferred@1063642423 after retry RPC after error@1967811033) -> (continuation of Deferred@105465288 after retry RPC after error@1399307092) -> (continuation of Deferred@1127985234 after retry RPC after error@1704529229) -> (continuation of Deferred@699556659 after retry RPC after error@1205977162) -> (continuation of Deferred@1497776580 after retry RPC after error@1947782340) -> (continuation of Deferred@1309250191 after retry RPC after error@119797908) -> (continuation of Deferred@1820381653 after retry RPC after error@1582063213) -> (continuation of Deferred@1548952257 after retry RPC after error@1152157319) -> (continuation of Deferred@776530366 after retry RPC after error@315319596) -> (continuation of Deferred@1472923806 after retry RPC after error@2012423262) -> (continuation of Deferred@513746439 after retry RPC after error@1463079677) -> (continuation of Deferred@1488240509 after retry RPC after error@906732001) -> (continuation of Deferred@1371735609 after retry RPC after error@538019270) -> (continuation of Deferred@1562610158 after retry RPC after error@919355138) -> (continuation of Deferred@2146895148 after retry RPC after error@1407488161) -> (continuation of Deferred@306782154 after retry RPC after error@1160382126) -> (continuation of Deferred@45331778 after retry RPC after error@1965378605) -> (continuation of Deferred@801679884 after retry RPC after error@985847341) -> (continuation of Deferred@625245586 after retry RPC after error@2061441331)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:19.424 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
18:31:19.424 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RUNNING to RESTARTING.
18:31:19.425 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:31:19.426 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
18:31:19.433 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.434 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.434 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.435 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.435 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.435 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.436 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.436 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.438 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.438 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.438 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.438 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.439 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.439 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.439 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.440 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.440 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.441 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.441 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.444 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.444 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.444 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.444 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.447 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.447 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.447 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.447 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.451 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.452 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.453 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.453 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.453 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.454 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.455 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.455 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.455 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.455 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.456 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.456 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.456 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.456 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.456 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.457 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.458 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.458 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.458 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.458 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.462 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.463 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.463 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.463 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.465 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.465 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.465 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.465 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.466 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.466 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.466 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.466 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.467 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.468 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.468 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.469 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.469 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.469 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.469 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.472 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.472 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.472 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.473 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.473 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.473 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.473 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.473 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.473 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.474 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.474 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.474 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.474 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.478 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.479 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.479 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.479 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.479 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.479 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.479 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.480 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.480 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.480 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.480 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.480 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.481 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.481 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.491 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.491 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.491 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.491 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.491 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.492 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.492 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.492 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.492 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.492 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.492 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.492 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.492 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.492 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.492 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.492 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.492 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.493 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.493 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.493 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.493 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.494 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.494 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.494 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.494 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.498 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.498 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.498 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.499 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.499 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.499 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.500 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.500 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.500 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.500 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.501 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.501 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.501 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.506 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:19.506 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:19.506 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:19.507 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.507 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.507 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.507 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.507 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.507 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.507 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.559 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.560 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.560 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.560 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.560 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.560 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.561 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.561 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.561 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.561 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.561 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.561 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.561 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.561 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.561 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.562 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.562 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.562 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.562 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.562 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.562 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.562 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.562 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.562 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.562 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.562 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.563 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.563 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.563 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.563 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:19.563 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.563 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.563 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.563 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.563 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.564 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29536), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [125ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [131ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [134ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [134ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [141ms] refreshing cache from master, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [167ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [172ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [175ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [193ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [195ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [195ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [196ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [197ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [204ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [221ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [244ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [264ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [304ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [384ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [384ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [527ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [527ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [700ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [703ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [703ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [704ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [704ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [803ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [804ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [805ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [806ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [806ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [807ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1300ms] refreshing cache from master, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1305ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1305ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3600ms] refreshing cache from master, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3602ms] too many traces: truncated at 100 traces, deferred=Deferred@921986510(state=PENDING, result=null, callback=(continuation of Deferred@376998463 after retry RPC after error@1901074083) -> (continuation of Deferred@2114639069 after retry RPC after error@1808073927) -> (continuation of Deferred@968770290 after retry RPC after error@1219149416) -> (continuation of Deferred@1622026140 after retry RPC after error@596567154) -> (continuation of Deferred@1751948067 after retry RPC after error@1965568440) -> (continuation of Deferred@1680566854 after retry RPC after error@819113925) -> (continuation of Deferred@1013682047 after retry RPC after error@150654139) -> (continuation of Deferred@926744248 after retry RPC after error@313905949) -> (continuation of Deferred@1917171267 after retry RPC after error@746857380) -> (continuation of Deferred@2090713522 after retry RPC after error@1074583559) -> (continuation of Deferred@522492395 after retry RPC after error@305135784) -> (continuation of Deferred@3330829 after retry RPC after error@643366892) -> (continuation of Deferred@495501581 after retry RPC after error@263169876) -> (continuation of Deferred@429106967 after retry RPC after error@2018876502) -> (continuation of Deferred@588167928 after retry RPC after error@1365851338) -> (continuation of Deferred@1430684399 after retry RPC after error@19202877) -> (continuation of Deferred@1462411419 after retry RPC after error@1337809368) -> (continuation of Deferred@772664122 after retry RPC after error@119028013) -> (continuation of Deferred@95711021 after retry RPC after error@551720410) -> (continuation of Deferred@1643638471 after retry RPC after error@669020805) -> (continuation of Deferred@17546323 after retry RPC after error@905164269) -> (continuation of Deferred@1798108226 after retry RPC after error@1333577720) -> (continuation of Deferred@331944800 after retry RPC after error@1002274857) -> (continuation of Deferred@935329272 after retry RPC after error@517324784), errback=(continuation of Deferred@376998463 after retry RPC after error@1901074083) -> (continuation of Deferred@2114639069 after retry RPC after error@1808073927) -> (continuation of Deferred@968770290 after retry RPC after error@1219149416) -> (continuation of Deferred@1622026140 after retry RPC after error@596567154) -> (continuation of Deferred@1751948067 after retry RPC after error@1965568440) -> (continuation of Deferred@1680566854 after retry RPC after error@819113925) -> (continuation of Deferred@1013682047 after retry RPC after error@150654139) -> (continuation of Deferred@926744248 after retry RPC after error@313905949) -> (continuation of Deferred@1917171267 after retry RPC after error@746857380) -> (continuation of Deferred@2090713522 after retry RPC after error@1074583559) -> (continuation of Deferred@522492395 after retry RPC after error@305135784) -> (continuation of Deferred@3330829 after retry RPC after error@643366892) -> (continuation of Deferred@495501581 after retry RPC after error@263169876) -> (continuation of Deferred@429106967 after retry RPC after error@2018876502) -> (continuation of Deferred@588167928 after retry RPC after error@1365851338) -> (continuation of Deferred@1430684399 after retry RPC after error@19202877) -> (continuation of Deferred@1462411419 after retry RPC after error@1337809368) -> (continuation of Deferred@772664122 after retry RPC after error@119028013) -> (continuation of Deferred@95711021 after retry RPC after error@551720410) -> (continuation of Deferred@1643638471 after retry RPC after error@669020805) -> (continuation of Deferred@17546323 after retry RPC after error@905164269) -> (continuation of Deferred@1798108226 after retry RPC after error@1333577720) -> (continuation of Deferred@331944800 after retry RPC after error@1002274857) -> (continuation of Deferred@935329272 after retry RPC after error@517324784)))
18:31:19.565 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:19.565 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.565 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.565 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:19.565 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.565 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:19.565 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.565 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.566 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.566 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.566 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.566 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.566 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.566 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29536), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [125ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [131ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [134ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [134ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [141ms] refreshing cache from master, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [167ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [172ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [175ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [193ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [195ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [195ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [196ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [197ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [204ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [221ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [244ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [264ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [304ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [384ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [384ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [527ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [527ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [700ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [703ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [703ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [704ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [704ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [803ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [804ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [805ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [806ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [806ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [807ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1300ms] refreshing cache from master, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1305ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1305ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3600ms] refreshing cache from master, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3602ms] too many traces: truncated at 100 traces, deferred=Deferred@921986510(state=PENDING, result=null, callback=(continuation of Deferred@376998463 after retry RPC after error@1901074083) -> (continuation of Deferred@2114639069 after retry RPC after error@1808073927) -> (continuation of Deferred@968770290 after retry RPC after error@1219149416) -> (continuation of Deferred@1622026140 after retry RPC after error@596567154) -> (continuation of Deferred@1751948067 after retry RPC after error@1965568440) -> (continuation of Deferred@1680566854 after retry RPC after error@819113925) -> (continuation of Deferred@1013682047 after retry RPC after error@150654139) -> (continuation of Deferred@926744248 after retry RPC after error@313905949) -> (continuation of Deferred@1917171267 after retry RPC after error@746857380) -> (continuation of Deferred@2090713522 after retry RPC after error@1074583559) -> (continuation of Deferred@522492395 after retry RPC after error@305135784) -> (continuation of Deferred@3330829 after retry RPC after error@643366892) -> (continuation of Deferred@495501581 after retry RPC after error@263169876) -> (continuation of Deferred@429106967 after retry RPC after error@2018876502) -> (continuation of Deferred@588167928 after retry RPC after error@1365851338) -> (continuation of Deferred@1430684399 after retry RPC after error@19202877) -> (continuation of Deferred@1462411419 after retry RPC after error@1337809368) -> (continuation of Deferred@772664122 after retry RPC after error@119028013) -> (continuation of Deferred@95711021 after retry RPC after error@551720410) -> (continuation of Deferred@1643638471 after retry RPC after error@669020805) -> (continuation of Deferred@17546323 after retry RPC after error@905164269) -> (continuation of Deferred@1798108226 after retry RPC after error@1333577720) -> (continuation of Deferred@331944800 after retry RPC after error@1002274857) -> (continuation of Deferred@935329272 after retry RPC after error@517324784), errback=(continuation of Deferred@376998463 after retry RPC after error@1901074083) -> (continuation of Deferred@2114639069 after retry RPC after error@1808073927) -> (continuation of Deferred@968770290 after retry RPC after error@1219149416) -> (continuation of Deferred@1622026140 after retry RPC after error@596567154) -> (continuation of Deferred@1751948067 after retry RPC after error@1965568440) -> (continuation of Deferred@1680566854 after retry RPC after error@819113925) -> (continuation of Deferred@1013682047 after retry RPC after error@150654139) -> (continuation of Deferred@926744248 after retry RPC after error@313905949) -> (continuation of Deferred@1917171267 after retry RPC after error@746857380) -> (continuation of Deferred@2090713522 after retry RPC after error@1074583559) -> (continuation of Deferred@522492395 after retry RPC after error@305135784) -> (continuation of Deferred@3330829 after retry RPC after error@643366892) -> (continuation of Deferred@495501581 after retry RPC after error@263169876) -> (continuation of Deferred@429106967 after retry RPC after error@2018876502) -> (continuation of Deferred@588167928 after retry RPC after error@1365851338) -> (continuation of Deferred@1430684399 after retry RPC after error@19202877) -> (continuation of Deferred@1462411419 after retry RPC after error@1337809368) -> (continuation of Deferred@772664122 after retry RPC after error@119028013) -> (continuation of Deferred@95711021 after retry RPC after error@551720410) -> (continuation of Deferred@1643638471 after retry RPC after error@669020805) -> (continuation of Deferred@17546323 after retry RPC after error@905164269) -> (continuation of Deferred@1798108226 after retry RPC after error@1333577720) -> (continuation of Deferred@331944800 after retry RPC after error@1002274857) -> (continuation of Deferred@935329272 after retry RPC after error@517324784)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29536), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [125ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [131ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [134ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [134ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [141ms] refreshing cache from master, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [167ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [172ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [175ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [193ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [195ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [195ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [196ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [197ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [204ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [221ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [244ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [264ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [304ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [384ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [384ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [527ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [527ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [700ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [703ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [703ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [704ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [704ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [803ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [804ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [805ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [806ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [806ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [807ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1300ms] refreshing cache from master, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1305ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1305ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3600ms] refreshing cache from master, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3602ms] too many traces: truncated at 100 traces, deferred=Deferred@921986510(state=PENDING, result=null, callback=(continuation of Deferred@376998463 after retry RPC after error@1901074083) -> (continuation of Deferred@2114639069 after retry RPC after error@1808073927) -> (continuation of Deferred@968770290 after retry RPC after error@1219149416) -> (continuation of Deferred@1622026140 after retry RPC after error@596567154) -> (continuation of Deferred@1751948067 after retry RPC after error@1965568440) -> (continuation of Deferred@1680566854 after retry RPC after error@819113925) -> (continuation of Deferred@1013682047 after retry RPC after error@150654139) -> (continuation of Deferred@926744248 after retry RPC after error@313905949) -> (continuation of Deferred@1917171267 after retry RPC after error@746857380) -> (continuation of Deferred@2090713522 after retry RPC after error@1074583559) -> (continuation of Deferred@522492395 after retry RPC after error@305135784) -> (continuation of Deferred@3330829 after retry RPC after error@643366892) -> (continuation of Deferred@495501581 after retry RPC after error@263169876) -> (continuation of Deferred@429106967 after retry RPC after error@2018876502) -> (continuation of Deferred@588167928 after retry RPC after error@1365851338) -> (continuation of Deferred@1430684399 after retry RPC after error@19202877) -> (continuation of Deferred@1462411419 after retry RPC after error@1337809368) -> (continuation of Deferred@772664122 after retry RPC after error@119028013) -> (continuation of Deferred@95711021 after retry RPC after error@551720410) -> (continuation of Deferred@1643638471 after retry RPC after error@669020805) -> (continuation of Deferred@17546323 after retry RPC after error@905164269) -> (continuation of Deferred@1798108226 after retry RPC after error@1333577720) -> (continuation of Deferred@331944800 after retry RPC after error@1002274857) -> (continuation of Deferred@935329272 after retry RPC after error@517324784), errback=(continuation of Deferred@376998463 after retry RPC after error@1901074083) -> (continuation of Deferred@2114639069 after retry RPC after error@1808073927) -> (continuation of Deferred@968770290 after retry RPC after error@1219149416) -> (continuation of Deferred@1622026140 after retry RPC after error@596567154) -> (continuation of Deferred@1751948067 after retry RPC after error@1965568440) -> (continuation of Deferred@1680566854 after retry RPC after error@819113925) -> (continuation of Deferred@1013682047 after retry RPC after error@150654139) -> (continuation of Deferred@926744248 after retry RPC after error@313905949) -> (continuation of Deferred@1917171267 after retry RPC after error@746857380) -> (continuation of Deferred@2090713522 after retry RPC after error@1074583559) -> (continuation of Deferred@522492395 after retry RPC after error@305135784) -> (continuation of Deferred@3330829 after retry RPC after error@643366892) -> (continuation of Deferred@495501581 after retry RPC after error@263169876) -> (continuation of Deferred@429106967 after retry RPC after error@2018876502) -> (continuation of Deferred@588167928 after retry RPC after error@1365851338) -> (continuation of Deferred@1430684399 after retry RPC after error@19202877) -> (continuation of Deferred@1462411419 after retry RPC after error@1337809368) -> (continuation of Deferred@772664122 after retry RPC after error@119028013) -> (continuation of Deferred@95711021 after retry RPC after error@551720410) -> (continuation of Deferred@1643638471 after retry RPC after error@669020805) -> (continuation of Deferred@17546323 after retry RPC after error@905164269) -> (continuation of Deferred@1798108226 after retry RPC after error@1333577720) -> (continuation of Deferred@331944800 after retry RPC after error@1002274857) -> (continuation of Deferred@935329272 after retry RPC after error@517324784)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.68.188:38393
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:19.567 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.567 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.567 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.571 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29536), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [125ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [131ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [134ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [134ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [141ms] refreshing cache from master, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [167ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [172ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [175ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [193ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [195ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [195ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [196ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [197ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [204ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [221ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [244ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [264ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [304ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [384ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [384ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [527ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [527ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [700ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [703ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [703ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [704ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [704ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [803ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [804ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [805ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [806ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [806ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [807ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1300ms] refreshing cache from master, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1305ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1305ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3600ms] refreshing cache from master, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3602ms] too many traces: truncated at 100 traces, deferred=Deferred@921986510(state=PENDING, result=null, callback=(continuation of Deferred@376998463 after retry RPC after error@1901074083) -> (continuation of Deferred@2114639069 after retry RPC after error@1808073927) -> (continuation of Deferred@968770290 after retry RPC after error@1219149416) -> (continuation of Deferred@1622026140 after retry RPC after error@596567154) -> (continuation of Deferred@1751948067 after retry RPC after error@1965568440) -> (continuation of Deferred@1680566854 after retry RPC after error@819113925) -> (continuation of Deferred@1013682047 after retry RPC after error@150654139) -> (continuation of Deferred@926744248 after retry RPC after error@313905949) -> (continuation of Deferred@1917171267 after retry RPC after error@746857380) -> (continuation of Deferred@2090713522 after retry RPC after error@1074583559) -> (continuation of Deferred@522492395 after retry RPC after error@305135784) -> (continuation of Deferred@3330829 after retry RPC after error@643366892) -> (continuation of Deferred@495501581 after retry RPC after error@263169876) -> (continuation of Deferred@429106967 after retry RPC after error@2018876502) -> (continuation of Deferred@588167928 after retry RPC after error@1365851338) -> (continuation of Deferred@1430684399 after retry RPC after error@19202877) -> (continuation of Deferred@1462411419 after retry RPC after error@1337809368) -> (continuation of Deferred@772664122 after retry RPC after error@119028013) -> (continuation of Deferred@95711021 after retry RPC after error@551720410) -> (continuation of Deferred@1643638471 after retry RPC after error@669020805) -> (continuation of Deferred@17546323 after retry RPC after error@905164269) -> (continuation of Deferred@1798108226 after retry RPC after error@1333577720) -> (continuation of Deferred@331944800 after retry RPC after error@1002274857) -> (continuation of Deferred@935329272 after retry RPC after error@517324784), errback=(continuation of Deferred@376998463 after retry RPC after error@1901074083) -> (continuation of Deferred@2114639069 after retry RPC after error@1808073927) -> (continuation of Deferred@968770290 after retry RPC after error@1219149416) -> (continuation of Deferred@1622026140 after retry RPC after error@596567154) -> (continuation of Deferred@1751948067 after retry RPC after error@1965568440) -> (continuation of Deferred@1680566854 after retry RPC after error@819113925) -> (continuation of Deferred@1013682047 after retry RPC after error@150654139) -> (continuation of Deferred@926744248 after retry RPC after error@313905949) -> (continuation of Deferred@1917171267 after retry RPC after error@746857380) -> (continuation of Deferred@2090713522 after retry RPC after error@1074583559) -> (continuation of Deferred@522492395 after retry RPC after error@305135784) -> (continuation of Deferred@3330829 after retry RPC after error@643366892) -> (continuation of Deferred@495501581 after retry RPC after error@263169876) -> (continuation of Deferred@429106967 after retry RPC after error@2018876502) -> (continuation of Deferred@588167928 after retry RPC after error@1365851338) -> (continuation of Deferred@1430684399 after retry RPC after error@19202877) -> (continuation of Deferred@1462411419 after retry RPC after error@1337809368) -> (continuation of Deferred@772664122 after retry RPC after error@119028013) -> (continuation of Deferred@95711021 after retry RPC after error@551720410) -> (continuation of Deferred@1643638471 after retry RPC after error@669020805) -> (continuation of Deferred@17546323 after retry RPC after error@905164269) -> (continuation of Deferred@1798108226 after retry RPC after error@1333577720) -> (continuation of Deferred@331944800 after retry RPC after error@1002274857) -> (continuation of Deferred@935329272 after retry RPC after error@517324784)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29536), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [125ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [131ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [134ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [134ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [141ms] refreshing cache from master, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [167ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [172ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [175ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [193ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [195ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [195ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [196ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [197ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [204ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [221ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [244ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [264ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [304ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [384ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [384ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [527ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [527ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [700ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [703ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [703ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [704ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [704ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [803ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [804ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [805ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [806ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [806ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [807ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1300ms] refreshing cache from master, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1305ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1305ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3600ms] refreshing cache from master, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3602ms] too many traces: truncated at 100 traces, deferred=Deferred@921986510(state=PENDING, result=null, callback=(continuation of Deferred@376998463 after retry RPC after error@1901074083) -> (continuation of Deferred@2114639069 after retry RPC after error@1808073927) -> (continuation of Deferred@968770290 after retry RPC after error@1219149416) -> (continuation of Deferred@1622026140 after retry RPC after error@596567154) -> (continuation of Deferred@1751948067 after retry RPC after error@1965568440) -> (continuation of Deferred@1680566854 after retry RPC after error@819113925) -> (continuation of Deferred@1013682047 after retry RPC after error@150654139) -> (continuation of Deferred@926744248 after retry RPC after error@313905949) -> (continuation of Deferred@1917171267 after retry RPC after error@746857380) -> (continuation of Deferred@2090713522 after retry RPC after error@1074583559) -> (continuation of Deferred@522492395 after retry RPC after error@305135784) -> (continuation of Deferred@3330829 after retry RPC after error@643366892) -> (continuation of Deferred@495501581 after retry RPC after error@263169876) -> (continuation of Deferred@429106967 after retry RPC after error@2018876502) -> (continuation of Deferred@588167928 after retry RPC after error@1365851338) -> (continuation of Deferred@1430684399 after retry RPC after error@19202877) -> (continuation of Deferred@1462411419 after retry RPC after error@1337809368) -> (continuation of Deferred@772664122 after retry RPC after error@119028013) -> (continuation of Deferred@95711021 after retry RPC after error@551720410) -> (continuation of Deferred@1643638471 after retry RPC after error@669020805) -> (continuation of Deferred@17546323 after retry RPC after error@905164269) -> (continuation of Deferred@1798108226 after retry RPC after error@1333577720) -> (continuation of Deferred@331944800 after retry RPC after error@1002274857) -> (continuation of Deferred@935329272 after retry RPC after error@517324784), errback=(continuation of Deferred@376998463 after retry RPC after error@1901074083) -> (continuation of Deferred@2114639069 after retry RPC after error@1808073927) -> (continuation of Deferred@968770290 after retry RPC after error@1219149416) -> (continuation of Deferred@1622026140 after retry RPC after error@596567154) -> (continuation of Deferred@1751948067 after retry RPC after error@1965568440) -> (continuation of Deferred@1680566854 after retry RPC after error@819113925) -> (continuation of Deferred@1013682047 after retry RPC after error@150654139) -> (continuation of Deferred@926744248 after retry RPC after error@313905949) -> (continuation of Deferred@1917171267 after retry RPC after error@746857380) -> (continuation of Deferred@2090713522 after retry RPC after error@1074583559) -> (continuation of Deferred@522492395 after retry RPC after error@305135784) -> (continuation of Deferred@3330829 after retry RPC after error@643366892) -> (continuation of Deferred@495501581 after retry RPC after error@263169876) -> (continuation of Deferred@429106967 after retry RPC after error@2018876502) -> (continuation of Deferred@588167928 after retry RPC after error@1365851338) -> (continuation of Deferred@1430684399 after retry RPC after error@19202877) -> (continuation of Deferred@1462411419 after retry RPC after error@1337809368) -> (continuation of Deferred@772664122 after retry RPC after error@119028013) -> (continuation of Deferred@95711021 after retry RPC after error@551720410) -> (continuation of Deferred@1643638471 after retry RPC after error@669020805) -> (continuation of Deferred@17546323 after retry RPC after error@905164269) -> (continuation of Deferred@1798108226 after retry RPC after error@1333577720) -> (continuation of Deferred@331944800 after retry RPC after error@1002274857) -> (continuation of Deferred@935329272 after retry RPC after error@517324784)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.68.188:38393
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:19.572 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:31:19.572 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#2) of source Source: KuduSource.
18:31:19.566 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.572 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.572 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.573 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:19.577 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to CANCELING.
18:31:19.577 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
18:31:19.577 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
18:31:19.577 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to CANCELING.
18:31:19.577 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
18:31:19.577 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
18:31:19.578 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
18:31:19.577 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
18:31:19.584 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:31:19.585 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CANCELING to CANCELED.
18:31:19.585 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
18:31:19.587 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:19.587 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:19.588 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:19.588 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.588 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.589 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.589 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.589 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.589 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.590 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.590 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.590 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.590 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:19.591 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.592 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.592 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.592 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.592 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.592 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.593 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.593 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.593 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.593 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.593 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.593 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.593 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.596 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.596 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.596 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.596 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.596 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.596 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.597 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.597 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.597 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.597 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.597 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.597 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.597 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.597 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
18:31:19.597 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
18:31:19.597 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
18:31:19.598 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.599 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.599 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.599 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:31:19.599 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
18:31:19.599 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
18:31:19.599 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.600 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.600 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.600 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.600 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.600 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.601 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.601 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.601 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.601 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.605 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:19.606 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:19.606 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:19.606 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.606 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.607 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.607 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.607 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.607 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.608 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.608 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.608 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.608 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:19.611 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
18:31:19.611 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
18:31:19.611 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
18:31:19.616 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.617 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.617 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.617 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.617 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.617 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.617 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.618 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.618 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.618 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.618 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.618 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.619 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.619 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.619 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.619 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.619 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.619 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.620 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.620 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.620 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.620 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.621 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.621 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.621 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.621 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.623 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:31:19.623 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
18:31:19.623 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
18:31:19.625 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:19.626 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:19.626 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.626 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.626 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:19.626 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.626 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.626 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.626 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.626 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.626 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.627 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.627 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:19.630 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#2 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
18:31:19.630 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
18:31:19.631 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
18:31:19.631 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CANCELING to CANCELED.
18:31:19.632 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:31:19.632 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
18:31:19.633 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
18:31:19.634 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:31:19.634 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:318) Clearing resource requirements of job fa73e37017778341a79e5b3ef3d55eb9
18:31:19.645 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:19.646 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:19.646 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:19.647 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.647 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.647 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.648 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.648 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.648 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.648 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.648 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.648 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.649 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:19.651 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.651 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.651 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.652 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.652 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.652 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.652 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.652 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.651 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.652 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.652 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.652 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.652 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.666 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:19.666 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:19.667 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.667 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.667 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.668 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.668 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.668 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.668 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:19.669 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.669 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.669 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.669 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:19.696 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.697 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.697 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.697 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.697 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.697 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.698 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.698 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.698 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.698 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.698 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.698 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.698 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.706 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:19.706 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:19.706 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.706 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.706 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:19.706 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.707 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.707 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.707 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.708 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.708 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.708 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.708 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:19.712 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.712 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.712 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.713 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.713 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.713 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.713 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.713 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.714 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.714 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.714 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.714 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.714 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.758 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.759 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.759 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.760 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.760 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.760 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.760 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.760 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.760 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.761 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.761 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.761 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.761 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:19.766899   507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } attempt: 8
18:31:19.796 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.797 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.797 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:19.798 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.798 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.798 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:19.799 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.799 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.799 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:19.800 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.800 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.800 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:19.800 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:19.806 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:19.806 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:19.807 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:19.807 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.807 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.808 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:19.808 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.808 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.808 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:19.809 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.809 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.809 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:19.809 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:19.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535479835 for job f6e63683f34d031c5da392b08baea20c.
18:31:19.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:19.840272   507 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } has no permanent_uuid. Determining permanent_uuid...
18:31:19.852 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
18:31:19.854 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
18:31:19.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:19.865842   507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.252:46705: Network error: Client connection negotiation failed: client connection to 127.0.106.252:46705: connect: Connection refused (error 111)
18:31:19.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:19.931443   507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } attempt: 1
18:31:19.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:19.939380   507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.252:46705: Network error: Client connection negotiation failed: client connection to 127.0.106.252:46705: connect: Connection refused (error 111)
18:31:19.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:19.992969   507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } attempt: 2
18:31:19.998 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:19.998 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:19.998 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:20.000 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.000 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.000 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.000 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.000 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.000 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.001 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.001 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.001 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.001 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:20.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:20.003552   507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.252:46705: Network error: Client connection negotiation failed: client connection to 127.0.106.252:46705: connect: Connection refused (error 111)
18:31:20.005 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:20.005 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:20.006 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:20.007 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:20.007 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:20.007 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:20.007 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:20.007 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:20.007 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:20.013 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:20.013 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:20.013 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:20.013 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:20.016 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:20.016 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:20.017 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:20.018 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.018 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.018 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.018 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.019 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.019 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.019 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.019 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.019 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.019 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:20.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:19.595861   598 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 589
18:31:20.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:20.028290   589 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.840s	user 0.557s	sys 1.104s
18:31:20.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:20.028625   589 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.840s	user 0.557s	sys 1.104s
18:31:20.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:18.189734   600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:20.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:20.032095   602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:20.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:20.034607   601 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1840 milliseconds
18:31:20.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.034673   589 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:31:20.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.036042   589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:31:20.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.039218   589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:31:20.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.040776   589 hybrid_clock.cc:648] HybridClock initialized: now 1783535480040732 us; error 53 us; skew 500 ppm
18:31:20.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.041638   589 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:31:20.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.049293   589 webserver.cc:534] Webserver started at http://127.0.106.252:42751/ using document root <none> and password file <none>
18:31:20.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.050329   589 fs_manager.cc:362] Metadata directory not provided
18:31:20.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.050614   589 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:31:20.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.051232   589 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:31:20.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.056116   589 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/data/instance:
18:31:20.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d1b63bb0040b46fa84e308804e4dd4b6"
18:31:20.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:20 on dist-test-slave-dxnw"
18:31:20.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.057512   589 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/wal/instance:
18:31:20.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d1b63bb0040b46fa84e308804e4dd4b6"
18:31:20.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:20 on dist-test-slave-dxnw"
18:31:20.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.066452   589 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.010s	sys 0.000s
18:31:20.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.073618   656 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:31:20.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.074952   589 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.007s	sys 0.000s
18:31:20.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.075264   589 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/wal
18:31:20.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d1b63bb0040b46fa84e308804e4dd4b6"
18:31:20.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:20 on dist-test-slave-dxnw"
18:31:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.075596   589 fs_report.cc:389] FS layout report
18:31:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:31:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/wal
18:31:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/wal
18:31:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/data/data
18:31:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:31:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:31:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:31:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:31:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:31:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:31:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:31:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:31:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:31:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:31:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:31:20.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.080120   507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } attempt: 3
18:31:20.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:20.085666   507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.252:46705: Network error: Client connection negotiation failed: client connection to 127.0.106.252:46705: connect: Connection refused (error 111)
18:31:20.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.153743   587 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } attempt: 7
18:31:20.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.156710   589 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:31:20.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.158892   589 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:31:20.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.159835   589 kserver.cc:163] Server-wide thread pool size limit: 3276
18:31:20.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:20.163502   587 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.252:46705: Network error: Client connection negotiation failed: client connection to 127.0.106.252:46705: connect: Connection refused (error 111)
18:31:20.212 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:20.212 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:20.212 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:20.213 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.214 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.214 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.214 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.214 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.214 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.214 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.214 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.214 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.214 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:20.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.241128   507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } attempt: 4
18:31:20.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:20.247125   507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.106.252:46705: Network error: Client connection negotiation failed: client connection to 127.0.106.252:46705: connect: Connection refused (error 111)
18:31:20.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.262516   589 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.252:46705
18:31:20.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.262605   709 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.252:46705 every 8 connection(s)
18:31:20.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.265306   589 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/data/info.pb
18:31:20.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.267927   427 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 589
18:31:20.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.268446   427 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/master-2/wal/instance
18:31:20.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.274299   710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:31:20.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.300484   710 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } has no permanent_uuid. Determining permanent_uuid...
18:31:20.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.325522   710 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } has no permanent_uuid. Determining permanent_uuid...
18:31:20.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535480336 for job f6e63683f34d031c5da392b08baea20c.
18:31:20.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.343487   710 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } has no permanent_uuid. Determining permanent_uuid...
18:31:20.345 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
18:31:20.346 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
18:31:20.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.361841   710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6: Bootstrap starting.
18:31:20.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.367758   710 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6: Neither blocks nor log segments found. Creating new log.
18:31:20.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.369480   710 log.cc:826] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6: Log is configured to *not* fsync() on all Append() calls
18:31:20.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.374809   710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6: No bootstrap required, opened a new log
18:31:20.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.394320   710 raft_consensus.cc:359] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } }
18:31:20.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.395092   710 raft_consensus.cc:385] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:20.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.395313   710 raft_consensus.cc:740] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1b63bb0040b46fa84e308804e4dd4b6, State: Initialized, Role: FOLLOWER
18:31:20.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.396026   710 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } }
18:31:20.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.398626   718 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } } }
18:31:20.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.399399   718 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6 [sys.catalog]: This master's current role is: FOLLOWER
18:31:20.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.399767   710 sys_catalog.cc:565] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6 [sys.catalog]: configured and running, proceeding with master startup.
18:31:20.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:20.416906   664 tablet.cc:2406] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:31:20.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:20.427464   729 catalog_manager.cc:1593] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:31:20.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:20.428026   729 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:31:20.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.423100   589 master_runner.cc:187] Error getting master registration for 127.0.106.254:32967: OK, instance_id { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" instance_seqno: 1783535475255610 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:31:20.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.456918   589 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:31:20.486 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:20.486 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:20.486 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:20.486 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:20.486 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:20.486 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:20.487 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:20.487 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:20.487 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:20.487 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:20.487 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:20.487 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:20.487 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:20.536 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:20.537 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:20.537 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.537 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:20.538 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.538 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.538 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.538 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.538 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.538 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.538 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.538 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.538 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:20.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.543562   507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } attempt: 5
18:31:20.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.560910   507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e: Bootstrap starting.
18:31:20.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.569129   507 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e: Neither blocks nor log segments found. Creating new log.
18:31:20.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.571481   507 log.cc:826] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e: Log is configured to *not* fsync() on all Append() calls
18:31:20.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.576236   507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e: No bootstrap required, opened a new log
18:31:20.578 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:20.578 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:20.578 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:20.579 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.579 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.579 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.579 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.579 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.579 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.579 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.580 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.580 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.580 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:20.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.596480   507 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } }
18:31:20.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.597149   507 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:20.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.597361   507 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cf7c90f4a1d45f89335c940fae15a1e, State: Initialized, Role: FOLLOWER
18:31:20.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.598124   507 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } }
18:31:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.601413   732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } } }
18:31:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.602207   732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [sys.catalog]: This master's current role is: FOLLOWER
18:31:20.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.603163   507 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [sys.catalog]: configured and running, proceeding with master startup.
18:31:20.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.614387   732 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:31:20.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.614945   732 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } }
18:31:20.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.618105   732 leader_election.cc:290] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf66be7e06d9465c8f7e07783e0d6654 (127.0.106.253:45189), d1b63bb0040b46fa84e308804e4dd4b6 (127.0.106.252:46705)
18:31:20.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.619199   685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" is_pre_election: true
18:31:20.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.620240   685 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cf7c90f4a1d45f89335c940fae15a1e in term 0.
18:31:20.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.621827   458 leader_election.cc:304] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cf7c90f4a1d45f89335c940fae15a1e, d1b63bb0040b46fa84e308804e4dd4b6; no voters: 
18:31:20.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.622723   732 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [term 0 FOLLOWER]: Leader pre-election won for term 1
18:31:20.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.623088   732 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:31:20.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.623382   732 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [term 0 FOLLOWER]: Advancing to term 1
18:31:20.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.630726   732 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } }
18:31:20.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.635955   685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1b63bb0040b46fa84e308804e4dd4b6"
18:31:20.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.636482   685 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6 [term 0 FOLLOWER]: Advancing to term 1
18:31:20.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.636318   732 leader_election.cc:290] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [CANDIDATE]: Term 1 election: Requested vote from peers cf66be7e06d9465c8f7e07783e0d6654 (127.0.106.253:45189), d1b63bb0040b46fa84e308804e4dd4b6 (127.0.106.252:46705)
18:31:20.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.653200   685 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cf7c90f4a1d45f89335c940fae15a1e in term 1.
18:31:20.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.661916   458 leader_election.cc:304] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cf7c90f4a1d45f89335c940fae15a1e, d1b63bb0040b46fa84e308804e4dd4b6; no voters: 
18:31:20.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.663412   732 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [term 1 FOLLOWER]: Leader election won for term 1
18:31:20.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.679431   732 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [term 1 LEADER]: Becoming Leader. State: Replica: 3cf7c90f4a1d45f89335c940fae15a1e, State: Running, Role: LEADER
18:31:20.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.680823   732 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } }
18:31:20.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:20.684034   743 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:31:20.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:20.684368   743 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:31:20.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.712352   745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3cf7c90f4a1d45f89335c940fae15a1e. Latest consensus state: current_term: 1 leader_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } } }
18:31:20.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.713204   745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [sys.catalog]: This master's current role is: LEADER
18:31:20.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:20.720119   461 tablet.cc:2406] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:31:20.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.650348   439 master_runner.cc:187] Error getting master registration for 127.0.106.253:45189: OK, instance_id { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" instance_seqno: 1783535477726465 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:31:20.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.726432   439 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:31:20.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.728354   747 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:31:20.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.736393   747 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:31:20.776 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:20.776 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:20.776 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:20.777 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.777 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.777 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:20.778 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.778 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.778 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:20.778 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.778 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.778 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:20.779 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:20.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.804697   685 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6 [term 1 FOLLOWER]: Refusing update from remote peer 3cf7c90f4a1d45f89335c940fae15a1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:31:20.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.806416   745 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:31:20.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535480835 for job f6e63683f34d031c5da392b08baea20c.
18:31:20.845 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:20.846 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:20.846 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:20.847 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:20.848 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:20.847 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:20.848 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:20.848 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:20.848 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:20.847 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:20.848 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:20.848 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:20.848 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:20.849 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
18:31:20.853 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
18:31:20.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.871132   718 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3cf7c90f4a1d45f89335c940fae15a1e. Latest consensus state: current_term: 1 leader_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } } }
18:31:20.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.871927   718 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6 [sys.catalog]: This master's current role is: FOLLOWER
18:31:20.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.878762   748 mvcc.cc:204] Tried to move back new op lower bound from 7305361329359347712 to 7305361328907149312. Current Snapshot: MvccSnapshot[applied={T|T < 7305361329359347712}]
18:31:20.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.880793   745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } } }
18:31:20.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.881518   745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [sys.catalog]: This master's current role is: LEADER
18:31:20.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.885810   747 catalog_manager.cc:1382] Generated new cluster ID: 3df74bdcca9245fb8dd4898a5ac7ab28
18:31:20.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.886091   747 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:31:20.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.903800   718 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } } }
18:31:20.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.904567   718 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6 [sys.catalog]: This master's current role is: FOLLOWER
18:31:20.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.919981   747 catalog_manager.cc:1405] Generated new certificate authority record
18:31:20.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.922459   747 catalog_manager.cc:1539] Loading token signing keys...
18:31:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.952282   747 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e: Generated new TSK 0
18:31:20.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.953666   747 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:20.987741   427 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/wal
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/data
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/logs
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/data/info.pb
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.106.193:0
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.0.106.193
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.106.193
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.106.212:34665
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:20.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:31:21.192 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:21.192 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:21.192 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:21.193 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.193 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.193 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.193 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.193 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.193 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.193 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.193 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.193 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.194 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:21.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535481335 for job f6e63683f34d031c5da392b08baea20c.
18:31:21.348 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:31:21.349 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
18:31:21.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:21.433838   729 catalog_manager.cc:1294] Loaded cluster ID: 3df74bdcca9245fb8dd4898a5ac7ab28
18:31:21.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:21.434358   729 catalog_manager.cc:1587] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6: loading cluster ID for follower catalog manager: success
18:31:21.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:21.441375   729 catalog_manager.cc:1609] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6: acquiring CA information for follower catalog manager: success
18:31:21.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:21.455940   729 catalog_manager.cc:1637] T 00000000000000000000000000000000 P d1b63bb0040b46fa84e308804e4dd4b6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:31:21.539 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RESTARTING to RUNNING.
18:31:21.539 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job fa73e37017778341a79e5b3ef3d55eb9 from Checkpoint 69 @ 1783535448409 for fa73e37017778341a79e5b3ef3d55eb9 located at file:/tmp/junit12731664100414606042/checkpoints/fa73e37017778341a79e5b3ef3d55eb9/chk-69.
18:31:21.540 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
18:31:21.540 [INFO - flink-pekko.actor.default-dispatcher-5] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:31:21.551 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED.
18:31:21.552 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING.
18:31:21.552 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #3) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 1623ba59e704d1676486c6f13d60068c
18:31:21.552 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
18:31:21.553 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
18:31:21.553 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 409256c48f07c3602c01f545df4e7b3c
18:31:21.553 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
18:31:21.554 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:31:21.554 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:31:21.554 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
18:31:21.554 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 120c9de24dd4d7d83c84cb1a65b36252
18:31:21.554 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:31:21.555 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to SCHEDULED.
18:31:21.555 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:31:21.555 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from SCHEDULED to DEPLOYING.
18:31:21.555 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #3) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d
18:31:21.556 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 1623ba59e704d1676486c6f13d60068c.
18:31:21.556 [INFO - Thread-18] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:31:21.556 [DEBUG - Thread-18] (Connection.java:575) [peer master-127.28.68.190:40429(127.28.68.190:40429)] disconnecting while in state TERMINATED
18:31:21.556 [DEBUG - Thread-18] (Connection.java:575) [peer master-127.28.68.188:38393(127.28.68.188:38393)] disconnecting while in state TERMINATED
18:31:21.556 [DEBUG - Thread-18] (Connection.java:575) [peer master-127.28.68.189:33753(127.28.68.189:33753)] disconnecting while in state TERMINATED
18:31:21.557 [DEBUG - Thread-18] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:21.557 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id 1623ba59e704d1676486c6f13d60068c.
18:31:21.559 [INFO - Thread-18] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:31:21.559 [INFO - Thread-18] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:31:21.561 [DEBUG - Thread-18] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:21.561 [INFO - Thread-18] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:31:21.600 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 409256c48f07c3602c01f545df4e7b3c.
18:31:21.601 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id 409256c48f07c3602c01f545df4e7b3c.
18:31:21.605 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
18:31:21.607 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 120c9de24dd4d7d83c84cb1a65b36252.
18:31:21.608 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id 120c9de24dd4d7d83c84cb1a65b36252.
18:31:21.608 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
18:31:21.608 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
18:31:21.609 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@20be4dc4
18:31:21.609 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:21.609 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
18:31:21.609 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:31:21.610 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
18:31:21.610 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
18:31:21.614 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6daa8440
18:31:21.616 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:21.620 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:31:21.620 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:31:21.620 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:31:21.620 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:31:21.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:21.621212   753 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:31:21.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:21.621910   753 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:31:21.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:21.622679   753 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:31:21.631 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot fe2a3c24d55fce5c8d5a55c4e880b53d.
18:31:21.632 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_3), deploy into slot with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d.
18:31:21.633 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
18:31:21.633 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
18:31:21.634 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@273f58c6
18:31:21.634 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:21.634 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:31:21.634 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
18:31:21.634 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
18:31:21.638 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7ed51d34
18:31:21.640 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:21.642 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3bd72526
18:31:21.643 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:21.643 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:21.646 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:31:21.652 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
18:31:21.653 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
18:31:21.655 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to DEPLOYING.
18:31:21.656 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) [DEPLOYING].
18:31:21.656 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6fd3a8a9
18:31:21.656 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:21.657 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:31:21.657 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
18:31:21.657 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
18:31:21.660 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@692eab2b
18:31:21.662 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:21.671 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:21.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:21.685274   753 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:31:21.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:21.686743   753 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.106.193
18:31:21.708 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3fecaca9
18:31:21.717 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:21.727 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:21.729 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.731 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:21.731 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.734 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.747 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:21.748 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.748 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.748 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.748 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:21.749 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.749 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.749 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.750 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:21.763 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:21.764 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:21.764 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:21.764 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:21.768643   753 tablet_server_runner.cc:78] Tablet server non-default flags:
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.106.212:34665
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/data
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/wal
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.106.193:0
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/data/info.pb
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.106.193
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.0.106.193
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/logs
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:31:21.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:31:21.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:21.770452   753 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:31:21.780 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:21.782 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:21.782 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:21.782 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:21.783 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:21.783 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:21.783 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:21.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:21.785548   753 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:31:21.790 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:21.807 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:21.819 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.823 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:21.824368   780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:21.827 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:21.829 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.831 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:21.831 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:21.832 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.832 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.833 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535481835 for job f6e63683f34d031c5da392b08baea20c.
18:31:21.847 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:21.848 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.848 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.848 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.849 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.849 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.849 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.850 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:21.851 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
18:31:21.852 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:21.852 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
18:31:21.869 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:21.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:21.871 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:21.892 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:21.889 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.898 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.903 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:21.904 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.904 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.904 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.905 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.905 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.906 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.906 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:21.908 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.917 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:21.918 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.918 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.918 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:21.919 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:21.919 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.920 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.920 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.923 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.923 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.923 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.923 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:21.924 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:21.916 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.932 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:21.932 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.941 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:21.966 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.966 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.966 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:21.967 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:21.968 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:21.968 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:21.968 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:21.976 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:21.987 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:21.999 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:22.008 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.008 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.008 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.011 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.012 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.012 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.012 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.012 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.013 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.013 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.013 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.019 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.019 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.019 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.019 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.032 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.052 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.056 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.077 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.078 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.078 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.081 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.084 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.085 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:22.085 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:22.085 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:22.086 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:22.086 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:22.086 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:22.087 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:22.087 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:22.087 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:22.087 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:22.087 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:22.088 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:22.088 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:22.085 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.090 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.091 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.091 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.092 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.092 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.092 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.094 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.094 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.095 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.095 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.095 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.095 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.095 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.095 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:22.102 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.103 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.103 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.107 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:22.134 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.135 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.135 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.135 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.135 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.135 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.136 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.136 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.136 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.136 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.137 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.137 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.137 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.137 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.137 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.138 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.138 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.139 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.139 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.139 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.139 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.139 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.139 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.140 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.140 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.141 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.141 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.141 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.141 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:22.142 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:22.142 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.142 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.143 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.143 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.143 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.143 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.144 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.144 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.144 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.144 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:22.145 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.145 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.145 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.146 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.146 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.146 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.146 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.138 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.147 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.147 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.147 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.139 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.147 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.151 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.151 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.151 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.151 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.152 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.152 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.152 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.152 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.152 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.152 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.152 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.152 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.152 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.152 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.152 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.152 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.152 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.152 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.153 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.153 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.153 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.153 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.153 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.154 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.154 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.154 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.164 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.164 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.165 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.165 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.165 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.165 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.166 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.166 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.166 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.166 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.166 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.166 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.166 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.167 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:22.168 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:22.168 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:22.168 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.168 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.168 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.168 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.168 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.168 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.168 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.169 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.169 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.169 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.169 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:22.172 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.172 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.172 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.172 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.172 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.172 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.172 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.172 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.172 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.172 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.173 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.173 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.172 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.173 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.173 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.173 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.173 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.173 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.173 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.173 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.173 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.173 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.174 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.174 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.174 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.174 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.178 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.181 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.183 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.183 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.184 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.184 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.184 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.184 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.184 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.184 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.184 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.184 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.184 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.184 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.184 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.184 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.185 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.187 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.187 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:22.187 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.187 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.187 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:22.188 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:22.188 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.188 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.188 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.188 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.188 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.188 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.188 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.188 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.188 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.188 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:22.200 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.203 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.203 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.203 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.204 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.204 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.204 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.204 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.204 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.205 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.205 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.205 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.205 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.205 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.205 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.205 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.206 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.212 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.212 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.212 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.212 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.212 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.212 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.212 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.213 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.213 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.213 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.213 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.213 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.213 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.213 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.213 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.214 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.214 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.214 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.214 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.215 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.215 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.215 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.215 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.215 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.215 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.215 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.227 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:22.227 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.227 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.228 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.228 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.228 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.228 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.227 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:22.228 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.228 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.228 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.228 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:22.229 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.229 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.229 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.229 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.229 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.229 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.229 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.229 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.229 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.229 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.229 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.229 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:22.229 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.229 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.247 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.248 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.248 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.248 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.248 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.248 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.248 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.248 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.249 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.249 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.249 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.249 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.249 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.252 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.252 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.252 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.252 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.252 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.252 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.252 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.252 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.252 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.252 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.252 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.252 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.253 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.253965   587 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } attempt: 8
18:31:22.258 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.258 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.258 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.259 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.259 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.259 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.259 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.260 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.260 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.260 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.260 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.260 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.261 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.263 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.263 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.264 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.264 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.264 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.264 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.265 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.265 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.265 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.265 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.265 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.265 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.265 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.268 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:22.268 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:22.268 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:22.268 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.268 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.269 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.269 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.269 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.269 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.269 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.269 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.269 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.269 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:22.271 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.271 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.271 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.272 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.272 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.272 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.272 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.272 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.272 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.273 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.273 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.273 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.273 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.283 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.283 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.284 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.284 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.284 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.284 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.284 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.285 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.285 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.285 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.285 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.285 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.285 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.287 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.287 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:22.288 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.288 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:22.288 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.288 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.288 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.288 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.288 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.288 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.288 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.288 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.288 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.288 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:22.288 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.289 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.289 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.289 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.289 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.289 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.289 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:22.289 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.289 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.289 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.289 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.289 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.311 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.312 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.312 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.313 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.313 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.313 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.314 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.314 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.314 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.315 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.315 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.315 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.315 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.332 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.332 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.332 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.332 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.332 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.332 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.332 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.333 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.333 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.333 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.333 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.333 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.333 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.333 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.333 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.333 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.333 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.333 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.333 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.333 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.333 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.333 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.333 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.333 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.333 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.334 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535482335 for job f6e63683f34d031c5da392b08baea20c.
18:31:22.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.336695   587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654: Bootstrap starting.
18:31:22.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.344185   587 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654: Neither blocks nor log segments found. Creating new log.
18:31:22.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.346398   587 log.cc:826] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654: Log is configured to *not* fsync() on all Append() calls
18:31:22.351 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.352 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.352 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.353 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.353 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.353 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.353 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.353 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.354 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.354 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.354 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.354 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.354 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.359 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=24 ms, finalizationTime=0 ms).
18:31:22.360 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
18:31:22.368 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.368 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.368 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.369 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.369 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.369 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.369 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.370 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.370 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.370 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.370 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.370 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.370 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.365363   587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654: No bootstrap required, opened a new log
18:31:22.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:22.391 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.391 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.392 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.392 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.392 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.392 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.393 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.393 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.393 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.393 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.393 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.393 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.393 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.416337   587 raft_consensus.cc:359] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } }
18:31:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.423010   587 raft_consensus.cc:385] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.423521   587 raft_consensus.cc:740] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf66be7e06d9465c8f7e07783e0d6654, State: Initialized, Role: FOLLOWER
18:31:22.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.424778   587 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } }
18:31:22.427 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:22.428 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:22.428 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:22.428 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.429 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.429 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.429 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.429 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.429 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.429 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.430 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.430 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.430 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:22.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.436800   587 sys_catalog.cc:565] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [sys.catalog]: configured and running, proceeding with master startup.
18:31:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.438508   561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf66be7e06d9465c8f7e07783e0d6654"
18:31:22.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.437085   562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf66be7e06d9465c8f7e07783e0d6654" is_pre_election: true
18:31:22.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.440969   823 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } } }
18:31:22.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.441759   560 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [term 0 FOLLOWER]: Advancing to term 1
18:31:22.451 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.452 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.452 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.452 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.452 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.452 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.452 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.453 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.453 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.453 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.453 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.453 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.453 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:22.441250   562 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 1) took 1823 ms (client timeout 2098 ms). Trace:
18:31:22.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.453837   823 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [sys.catalog]: This master's current role is: FOLLOWER
18:31:22.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:22.452044   562 rpcz_store.cc:269] 0708 18:31:20.618305 (+     0us) service_pool.cc:167] Inserting onto call queue
18:31:22.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:20.618444 (+   139us) service_pool.cc:224] Handling call
18:31:22.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:22.441171 (+1822727us) inbound_call.cc:177] Queueing success response
18:31:22.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
18:31:22.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:22.440039   561 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58708 (request call id 2) took 1807 ms (client timeout 1836 ms). Trace:
18:31:22.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:22.456344   561 rpcz_store.cc:269] 0708 18:31:20.633146 (+     0us) service_pool.cc:167] Inserting onto call queue
18:31:22.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:20.633395 (+   249us) service_pool.cc:224] Handling call
18:31:22.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:22.439937 (+1806542us) inbound_call.cc:177] Queueing success response
18:31:22.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
18:31:22.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.466744   560 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [term 1 FOLLOWER]: Refusing update from remote peer 3cf7c90f4a1d45f89335c940fae15a1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:31:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.473330   823 raft_consensus.cc:493] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:31:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.473871   823 raft_consensus.cc:515] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } }
18:31:22.484 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.484 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.484 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.485 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.485 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.485 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.486 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.486 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.486 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.486 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.486 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.486 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.486 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.495430   482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cf66be7e06d9465c8f7e07783e0d6654" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" is_pre_election: true
18:31:22.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.499040   684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cf66be7e06d9465c8f7e07783e0d6654" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" is_pre_election: true
18:31:22.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.499307   560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58708 (request call id 4) took 1692 ms. Trace:
18:31:22.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.500783   535 leader_election.cc:304] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf66be7e06d9465c8f7e07783e0d6654; no voters: 3cf7c90f4a1d45f89335c940fae15a1e, d1b63bb0040b46fa84e308804e4dd4b6
18:31:22.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.502727   823 leader_election.cc:290] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3cf7c90f4a1d45f89335c940fae15a1e (127.0.106.254:32967), d1b63bb0040b46fa84e308804e4dd4b6 (127.0.106.252:46705)
18:31:22.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.503307   823 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
18:31:22.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.499825   560 rpcz_store.cc:276] 0708 18:31:20.805003 (+     0us) service_pool.cc:167] Inserting onto call queue
18:31:22.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:20.805367 (+   364us) service_pool.cc:224] Handling call
18:31:22.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:22.438007 (+1632640us) raft_consensus.cc:1471] Updating replica for 0 ops
18:31:22.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:22.472792 (+ 34785us) raft_consensus.cc:1697] Filling consensus response to leader.
18:31:22.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:22.497239 (+ 24447us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b54000203d4. stack: 00007efe471b2803 00007efe471b2700 00007efe46d634b4 000000000050eb44 000000000050ead9 00007efe4e297891 00007efe4e32f121 00007efe4e32db5e 00007efe4f35e9c9 00007efe4da10cf4 00007efe4da10c82 00007efe4da10bb1 00007efe4da10b2c 00007efe4da0fde2 00007efe4bffdaac 00007efe4bffcee6
18:31:22.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:22.497600 (+   361us) inbound_call.cc:177] Queueing success response
18:31:22.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"spinlock_wait_cycles":7621888}
18:31:22.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.507419   800 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:31:22.587 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.588 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.588 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.589 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.589 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.589 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.590 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.590 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.590 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.590 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.590 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.590 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.591 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.592 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.592 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.592 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.593 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.593 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.593 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.593 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.593 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.593 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.594 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.594 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.594 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.594 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.615 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.616 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.616 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.620 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.620 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.621 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.621 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.621 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.621 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.622 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.622 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.622 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.622 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.632 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.632 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.632 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.633 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.633 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.633 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.634 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.634 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.634 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.635 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.635 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.635 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.635 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.647 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:22.648 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:22.648 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:22.648 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.648 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.648 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:22.649 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.649 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.649 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:22.649 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.649 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.649 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:22.649 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:22.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.668692   829 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3cf7c90f4a1d45f89335c940fae15a1e. Latest consensus state: current_term: 1 leader_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } } }
18:31:22.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.669510   829 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [sys.catalog]: This master's current role is: FOLLOWER
18:31:22.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.670431   823 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } } }
18:31:22.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.672169   823 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654 [sys.catalog]: This master's current role is: FOLLOWER
18:31:22.684 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.684 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.684 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.685 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.685 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.685 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.685 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.686 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.686 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.686 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.686 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.686 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.686 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.689308   840 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
18:31:22.711 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.712 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.712 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.713 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.713 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.713 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.713 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.713 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.713 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.713 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.713 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.713 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.713 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.792 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.792 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.792 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.793 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.793 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.793 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.793 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.793 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.793 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.793 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.793 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.793 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.794 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535482835 for job f6e63683f34d031c5da392b08baea20c.
18:31:22.845 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:31:22.846 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
18:31:22.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:22.871 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:22.872 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:22.872 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:22.872 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.873 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.873 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:22.873 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.873 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.873 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:22.873 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.874 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.874 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:22.874 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:22.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.981712   800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cf7c90f4a1d45f89335c940fae15a1e" member_type: VOTER last_known_addr { host: "127.0.106.254" port: 32967 } } peers { permanent_uuid: "cf66be7e06d9465c8f7e07783e0d6654" member_type: VOTER last_known_addr { host: "127.0.106.253" port: 45189 } } peers { permanent_uuid: "d1b63bb0040b46fa84e308804e4dd4b6" member_type: VOTER last_known_addr { host: "127.0.106.252" port: 46705 } } }
18:31:22.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:22.982981   800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cf7c90f4a1d45f89335c940fae15a1e [sys.catalog]: This master's current role is: LEADER
18:31:23.008 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:23.008 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:23.008 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:23.009 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:23.009 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:23.009 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:23.010 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:23.010 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:23.010 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:23.011 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:23.011 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:23.011 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:23.011 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:23.104 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:23.104 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:23.104 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:23.105 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:23.105 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:23.105 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:23.106 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:23.106 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:23.106 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:23.106 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:23.106 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:23.106 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:23.106 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:23.108 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:23.108 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:23.108 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:23.109 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:23.109 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:23.109 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:23.109 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:23.109 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:23.110 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:23.110 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:23.110 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:23.110 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:23.111 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:23.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535483335 for job f6e63683f34d031c5da392b08baea20c.
18:31:23.345 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:31:23.347 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
18:31:23.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:23.432 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:23.432 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:23.433 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:23.433 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:23.433 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:23.433 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:23.434 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:23.434 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:23.434 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:23.434 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:23.434 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:23.434 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:23.434 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:23.496 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:23.496 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:23.497 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:23.498 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:23.498 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:23.498 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:23.499 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:23.499 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:23.499 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:23.499 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:23.499 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:23.499 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:23.499 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:23.551 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:23.552 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:23.552 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:23.552 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:23.552 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:23.552 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:23.553 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:23.553 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:23.553 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:23.553 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:23.553 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:23.553 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:23.553 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:23.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:23.711866   840 catalog_manager.cc:1294] Loaded cluster ID: 3df74bdcca9245fb8dd4898a5ac7ab28
18:31:23.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:23.712150   840 catalog_manager.cc:1587] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654: loading cluster ID for follower catalog manager: success
18:31:23.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:23.724941   840 catalog_manager.cc:1609] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654: acquiring CA information for follower catalog manager: success
18:31:23.728 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:23.728 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:23.728 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:23.729 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:23.729 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:23.729 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:23.729 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:23.729 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:23.730 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:23.730 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:23.730 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:23.730 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:23.730 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:23.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:23.741366   840 catalog_manager.cc:1637] T 00000000000000000000000000000000 P cf66be7e06d9465c8f7e07783e0d6654: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:31:23.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535483836 for job f6e63683f34d031c5da392b08baea20c.
18:31:23.845 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:31:23.846 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
18:31:23.870 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:23.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:23.217770   779 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 753
18:31:23.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:23.960592   753 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.133s	user 0.430s	sys 0.754s
18:31:23.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:23.963641   753 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.136s	user 0.430s	sys 0.754s
18:31:23.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:21.829425   781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:23.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:23.975595   753 server_base.cc:1061] running on GCE node
18:31:23.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:23.976583   848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:23.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:23.978327   753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:31:23.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:23.981129   753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:31:23.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:23.982676   753 hybrid_clock.cc:648] HybridClock initialized: now 1783535483982545 us; error 103 us; skew 500 ppm
18:31:23.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:23.984328   753 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:31:23.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:23.993794   753 webserver.cc:534] Webserver started at http://127.0.106.193:41655/ using document root <none> and password file <none>
18:31:23.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:23.994800   753 fs_manager.cc:362] Metadata directory not provided
18:31:23.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:23.995110   753 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:31:23.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:23.995615   753 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:31:24.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.000476   753 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/data/instance:
18:31:24.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fa977f48a0f448969dae707cebb47d86"
18:31:24.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:23 on dist-test-slave-dxnw"
18:31:24.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.001714   753 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/wal/instance:
18:31:24.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fa977f48a0f448969dae707cebb47d86"
18:31:24.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:23 on dist-test-slave-dxnw"
18:31:24.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.009802   753 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
18:31:24.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.016211   853 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:31:24.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.017375   753 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
18:31:24.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.017753   753 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/wal
18:31:24.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fa977f48a0f448969dae707cebb47d86"
18:31:24.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:23 on dist-test-slave-dxnw"
18:31:24.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.018131   753 fs_report.cc:389] FS layout report
18:31:24.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:31:24.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/wal
18:31:24.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/wal
18:31:24.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/data/data
18:31:24.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:31:24.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:31:24.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:31:24.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:31:24.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:31:24.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:31:24.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:31:24.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:31:24.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:31:24.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:31:24.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:31:24.047 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:24.048 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:24.048 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:24.048 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:24.048 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:24.048 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:24.049 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:24.048 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:24.049 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:24.049 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:24.049 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:24.049 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:24.049 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:24.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.073624   753 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:31:24.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.075202   753 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:31:24.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.075692   753 kserver.cc:163] Server-wide thread pool size limit: 3276
18:31:24.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.078663   753 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:31:24.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.083755   753 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:31:24.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.083983   753 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:31:24.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.084295   753 ts_tablet_manager.cc:616] Registered 0 tablets
18:31:24.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.084496   753 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:31:24.163 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:24.164 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:24.164 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:24.164 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:24.164 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:24.164 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:24.164 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:24.164 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:24.165 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:24.165 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:24.165 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:24.165 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:24.165 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:24.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.269336   753 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.193:33681
18:31:24.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.269438   965 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.193:33681 every 8 connection(s)
18:31:24.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.272375   753 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/data/info.pb
18:31:24.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.277900   427 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 753
18:31:24.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.278515   427 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-0/wal/instance
18:31:24.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.296255   427 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:24.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:24.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/wal
18:31:24.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/data
18:31:24.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/logs
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/data/info.pb
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.106.194:0
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.0.106.194
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.106.194
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.106.212:34665
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:31:24.335 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535484335 for job f6e63683f34d031c5da392b08baea20c.
18:31:24.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.337373   967 heartbeater.cc:344] Connected to a master server at 127.0.106.253:45189
18:31:24.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.337931   967 heartbeater.cc:461] Registering TS with master...
18:31:24.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.339350   967 heartbeater.cc:507] Master 127.0.106.253:45189 requested a full tablet report, sending...
18:31:24.348 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
18:31:24.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.348390   552 ts_manager.cc:194] Registered new tserver with Master: fa977f48a0f448969dae707cebb47d86 (127.0.106.193:33681)
18:31:24.349 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
18:31:24.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.357241   972 heartbeater.cc:344] Connected to a master server at 127.0.106.254:32967
18:31:24.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.357643   972 heartbeater.cc:461] Registering TS with master...
18:31:24.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.358532   972 heartbeater.cc:507] Master 127.0.106.254:32967 requested a full tablet report, sending...
18:31:24.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.361268   472 ts_manager.cc:194] Registered new tserver with Master: fa977f48a0f448969dae707cebb47d86 (127.0.106.193:33681)
18:31:24.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.364251   472 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.106.193:55557
18:31:24.370 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:24.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.370179   966 heartbeater.cc:344] Connected to a master server at 127.0.106.252:46705
18:31:24.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.370519   966 heartbeater.cc:461] Registering TS with master...
18:31:24.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.371191   966 heartbeater.cc:507] Master 127.0.106.252:46705 requested a full tablet report, sending...
18:31:24.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.374915   675 ts_manager.cc:194] Registered new tserver with Master: fa977f48a0f448969dae707cebb47d86 (127.0.106.193:33681)
18:31:24.492 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:24.492 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:24.492 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:24.492 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:24.493 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:24.493 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:24.493 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:24.493 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:24.493 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:24.493 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:24.493 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:24.493 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:24.493 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:24.664 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:24.664 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:24.664 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:24.665 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:24.665 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:24.665 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:24.665 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:24.665 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:24.665 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:24.665 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:24.665 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:24.665 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:24.665 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:24.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:24.692176   974 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:31:24.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:24.692705   974 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:31:24.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:24.693135   974 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:31:24.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:24.729077   974 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:31:24.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:24.729872   974 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.106.194
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.785012   974 tablet_server_runner.cc:78] Tablet server non-default flags:
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.106.212:34665
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/data
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/wal
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.106.194:0
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/data/info.pb
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.106.194
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:24.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.0.106.194
18:31:24.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/logs
18:31:24.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:24.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:31:24.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:31:24.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:31:24.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:31:24.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:31:24.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:31:24.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:31:24.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:31:24.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:31:24.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.786643   974 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:31:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:24.788836   974 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:31:24.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:24.803792   983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:24.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535484835 for job f6e63683f34d031c5da392b08baea20c.
18:31:24.849 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
18:31:24.850 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
18:31:24.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:25.132 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:25.132 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:25.133 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:25.133 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.133 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.134 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.134 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.134 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.134 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.135 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.135 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.135 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.135 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:25.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535485335 for job f6e63683f34d031c5da392b08baea20c.
18:31:25.346 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:31:25.347 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
18:31:25.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:25.368027   972 heartbeater.cc:499] Master 127.0.106.254:32967 was elected leader, sending a full tablet report...
18:31:25.373 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:25.392 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:25.392 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:25.393 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:25.393 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.393 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.394 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.394 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.394 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.394 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.395 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.395 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.395 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.395 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:25.463 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:25.464 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:25.464 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:25.464 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.465 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.465 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.465 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.465 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.465 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.466 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.466 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.466 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.466 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:25.737 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:25.738 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:25.738 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:25.738 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.738 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.739 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.739 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.739 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.738 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.739 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.739 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.739 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.739 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:25.818 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:25.818 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:25.819 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:25.819 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.819 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.819 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.819 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.819 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.819 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.820 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.820 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.820 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.820 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:25.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535485835 for job f6e63683f34d031c5da392b08baea20c.
18:31:25.846 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:31:25.848 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
18:31:25.870 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:25.888 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:25.888 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:25.888 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:25.888 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.889 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.889 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:25.889 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.889 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.889 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:25.889 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.890 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.890 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:25.890 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:25.924 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:25.925 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:25.925 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:25.925 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:25.925 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:25.925 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:25.925 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:25.925 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:25.926 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:25.926 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:25.926 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:25.926 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:25.926 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:26.272 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:26.272 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:26.273 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:26.273 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:26.273 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:26.273 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:26.273 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:26.273 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:26.273 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:26.274 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:26.274 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:26.274 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:26.274 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:26.284 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:26.284 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:26.284 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:26.285 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:26.285 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:26.285 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:26.285 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:26.285 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:26.285 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:26.286 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:26.286 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:26.286 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:26.286 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:26.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535486335 for job f6e63683f34d031c5da392b08baea20c.
18:31:26.351 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
18:31:26.352 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
18:31:26.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:26.407 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:26.408 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:26.408 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:26.409 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:26.409 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:26.409 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:26.409 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:26.409 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:26.409 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:26.410 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:26.410 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:26.410 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:26.410 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:26.456 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:26.456 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:26.457 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:26.457 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:26.457 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:26.458 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:26.458 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:26.458 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:26.458 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:26.459 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:26.459 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:26.459 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:26.459 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:26.837 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535486835 for job f6e63683f34d031c5da392b08baea20c.
18:31:26.852 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
18:31:26.853 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
18:31:26.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:26.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:24.804410   984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:26.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:26.214226   982 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 974
18:31:26.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:26.907229   982 kernel_stack_watchdog.cc:198] Thread 974 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 398ms:
18:31:26.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:31:26.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:31:26.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:31:26.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:31:26.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:26.911305   974 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.106s	user 0.000s	sys 0.002s
18:31:26.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:26.911731   974 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.107s	user 0.000s	sys 0.002s
18:31:26.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:26.913403   985 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 2107 milliseconds
18:31:26.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:26.913853   986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:26.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:26.913722   974 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:31:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:26.915279   974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:31:26.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:26.918222   974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:31:26.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:26.919708   974 hybrid_clock.cc:648] HybridClock initialized: now 1783535486919626 us; error 74 us; skew 500 ppm
18:31:26.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:26.920619   974 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:31:26.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:26.932505   974 webserver.cc:534] Webserver started at http://127.0.106.194:33627/ using document root <none> and password file <none>
18:31:26.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:26.933449   974 fs_manager.cc:362] Metadata directory not provided
18:31:26.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:26.933715   974 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:31:26.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:26.934265   974 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:31:26.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:26.938691   974 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/data/instance:
18:31:26.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6f21d544834a406f92f688ea6d5a8dba"
18:31:26.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:26 on dist-test-slave-dxnw"
18:31:26.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:26.939872   974 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/wal/instance:
18:31:26.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6f21d544834a406f92f688ea6d5a8dba"
18:31:26.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:26 on dist-test-slave-dxnw"
18:31:26.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:26.947381   974 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
18:31:26.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:26.953538   996 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:31:26.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:26.954711   974 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.005s
18:31:26.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:26.955076   974 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/wal
18:31:26.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6f21d544834a406f92f688ea6d5a8dba"
18:31:26.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:26 on dist-test-slave-dxnw"
18:31:26.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:26.955412   974 fs_report.cc:389] FS layout report
18:31:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:31:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/wal
18:31:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/wal
18:31:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/data/data
18:31:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:31:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:31:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:31:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:31:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:31:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:31:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:31:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:31:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:31:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:31:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:31:26.978 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:26.979 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:26.979 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:26.980 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:26.980 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:26.980 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:26.981 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:26.981 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:26.981 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:26.982 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:26.982 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:26.982 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:26.982 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:26.983 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:26.984 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:26.984 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:26.984 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:26.984 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:26.984 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:26.984 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:26.984 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:26.984 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:26.985 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:26.985 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:26.985 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:26.985 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:27.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.024034   974 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:31:27.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.026249   974 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:31:27.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.026911   974 kserver.cc:163] Server-wide thread pool size limit: 3276
18:31:27.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.031006   974 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:31:27.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.035924   974 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:31:27.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.036207   974 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:31:27.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.036521   974 ts_tablet_manager.cc:616] Registered 0 tablets
18:31:27.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.036721   974 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:31:27.052 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:27.053 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:27.053 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:27.053 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:27.053 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:27.053 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:27.053 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:27.054 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:27.054 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:27.054 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:27.054 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:27.054 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:27.054 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:27.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.216526   974 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.194:45251
18:31:27.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.216639  1109 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.194:45251 every 8 connection(s)
18:31:27.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.219453   974 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/data/info.pb
18:31:27.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.223810   427 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 974
18:31:27.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.224296   427 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-1/wal/instance
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.247705   427 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/wal
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/data
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/logs
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/data/info.pb
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.106.195:0
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.0.106.195
18:31:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.106.195
18:31:27.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:27.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705
18:31:27.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.106.212:34665
18:31:27.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:27.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:27.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:31:27.288 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:27.288 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:27.289 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:27.289 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:27.289 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:27.289 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:27.289 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:27.289 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:27.290 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:27.290 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:27.290 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:27.290 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:27.290 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:27.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.324149  1110 heartbeater.cc:344] Connected to a master server at 127.0.106.252:46705
18:31:27.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.324657  1110 heartbeater.cc:461] Registering TS with master...
18:31:27.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.326004  1110 heartbeater.cc:507] Master 127.0.106.252:46705 requested a full tablet report, sending...
18:31:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.328598  1111 heartbeater.cc:344] Connected to a master server at 127.0.106.253:45189
18:31:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.328934  1111 heartbeater.cc:461] Registering TS with master...
18:31:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.329676   675 ts_manager.cc:194] Registered new tserver with Master: 6f21d544834a406f92f688ea6d5a8dba (127.0.106.194:45251)
18:31:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.329759  1111 heartbeater.cc:507] Master 127.0.106.253:45189 requested a full tablet report, sending...
18:31:27.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.332804   552 ts_manager.cc:194] Registered new tserver with Master: 6f21d544834a406f92f688ea6d5a8dba (127.0.106.194:45251)
18:31:27.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535487336 for job f6e63683f34d031c5da392b08baea20c.
18:31:27.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.337955  1112 heartbeater.cc:344] Connected to a master server at 127.0.106.254:32967
18:31:27.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.338342  1112 heartbeater.cc:461] Registering TS with master...
18:31:27.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.339344  1112 heartbeater.cc:507] Master 127.0.106.254:32967 requested a full tablet report, sending...
18:31:27.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.343319   472 ts_manager.cc:194] Registered new tserver with Master: 6f21d544834a406f92f688ea6d5a8dba (127.0.106.194:45251)
18:31:27.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.344697   472 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.106.194:42693
18:31:27.346 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:31:27.347 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
18:31:27.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:27.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:27.640280  1117 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:31:27.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:27.640785  1117 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:31:27.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:27.641209  1117 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:31:27.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:27.675179  1117 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:31:27.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:27.675953  1117 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.106.195
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.713788  1117 tablet_server_runner.cc:78] Tablet server non-default flags:
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.106.212:34665
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/data
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/wal
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.106.195:0
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/data/info.pb
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.106.195
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.0.106.195
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/logs
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:31:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:31:27.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.715204  1117 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:31:27.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:27.716761  1117 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:31:27.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:27.729728  1126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:27.831 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:27.832 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:27.832 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:27.832 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:27.832 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:27.833 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:27.833 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:27.833 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:27.833 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:27.834 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:27.834 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:27.834 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:27.834 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:27.838 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535487835 for job f6e63683f34d031c5da392b08baea20c.
18:31:27.849 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
18:31:27.851 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
18:31:27.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:28.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535488335 for job f6e63683f34d031c5da392b08baea20c.
18:31:28.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:28.348980  1112 heartbeater.cc:499] Master 127.0.106.254:32967 was elected leader, sending a full tablet report...
18:31:28.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:28.373 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:28.373 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:28.373 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:28.374 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:28.374 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:28.374 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:28.374 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:28.374 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:28.374 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:28.374 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:28.374 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:28.374 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:28.374 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:28.377 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=42 ms, finalizationTime=0 ms).
18:31:28.379 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
18:31:28.812 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:28.812 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:28.813 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:28.813 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:28.813 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:28.813 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:28.813 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:28.813 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:28.813 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:28.813 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:28.813 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:28.813 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:28.813 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:28.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535488835 for job f6e63683f34d031c5da392b08baea20c.
18:31:28.847 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:31:28.848 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
18:31:28.872 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:29.068 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:29.068 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:29.068 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:29.069 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:29.069 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:29.069 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:29.069 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:29.069 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:29.069 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:29.070 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:29.070 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:29.070 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:29.070 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:29.132 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:29.132 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:29.132 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:29.133 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:29.133 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:29.133 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:29.134 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:29.134 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:29.134 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:29.134 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:29.135 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:29.135 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:29.135 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:29.325 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:29.325 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:29.325 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:29.326 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:29.326 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:29.326 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:29.326 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:29.326 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:29.326 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:29.327 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:29.327 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:29.327 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:29.327 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:29.328 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:29.328 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:29.328 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:29.329 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:29.329 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:29.329 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:29.331 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:29.331 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:29.331 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:29.331 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:29.331 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:29.331 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:29.331 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:29.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535489335 for job f6e63683f34d031c5da392b08baea20c.
18:31:29.348 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:31:29.350 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
18:31:29.370 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:29.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:29.134289  1125 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 1117
18:31:29.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:29.491348  1117 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.762s	user 0.635s	sys 1.071s
18:31:29.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:29.491762  1117 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.762s	user 0.635s	sys 1.071s
18:31:29.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:27.730022  1127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:29.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:29.493098  1128 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1763 milliseconds
18:31:29.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:29.493790  1129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:29.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.493782  1117 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:31:29.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.497314  1117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:31:29.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.499665  1117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:31:29.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.501077  1117 hybrid_clock.cc:648] HybridClock initialized: now 1783535489501031 us; error 38 us; skew 500 ppm
18:31:29.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.501955  1117 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:31:29.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.509657  1117 webserver.cc:534] Webserver started at http://127.0.106.195:45317/ using document root <none> and password file <none>
18:31:29.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.510604  1117 fs_manager.cc:362] Metadata directory not provided
18:31:29.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.510846  1117 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:31:29.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.511369  1117 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:31:29.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.515599  1117 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/data/instance:
18:31:29.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0865e0f96b7348dfbf4a502a6d8151dd"
18:31:29.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:29 on dist-test-slave-dxnw"
18:31:29.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.516595  1117 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/wal/instance:
18:31:29.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0865e0f96b7348dfbf4a502a6d8151dd"
18:31:29.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:29 on dist-test-slave-dxnw"
18:31:29.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.524032  1117 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.006s
18:31:29.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.529623  1138 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:31:29.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.530718  1117 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.001s
18:31:29.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.531082  1117 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/wal
18:31:29.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0865e0f96b7348dfbf4a502a6d8151dd"
18:31:29.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:29 on dist-test-slave-dxnw"
18:31:29.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.531442  1117 fs_report.cc:389] FS layout report
18:31:29.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:31:29.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/wal
18:31:29.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/wal
18:31:29.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/data/data
18:31:29.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:31:29.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:31:29.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:31:29.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:31:29.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:31:29.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:31:29.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:31:29.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:31:29.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:31:29.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:31:29.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:31:29.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.588201  1117 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:31:29.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.589691  1117 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:31:29.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.590148  1117 kserver.cc:163] Server-wide thread pool size limit: 3276
18:31:29.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.593024  1117 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:31:29.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.597260  1117 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:31:29.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.597489  1117 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:31:29.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.597744  1117 ts_tablet_manager.cc:616] Registered 0 tablets
18:31:29.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.597965  1117 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:31:29.731 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:29.732 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:29.732 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:29.732 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:29.732 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:29.732 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:29.732 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:29.733 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:29.732 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:29.733 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:29.733 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:29.733 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:29.733 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:29.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.753769  1117 rpc_server.cc:307] RPC server started. Bound to: 127.0.106.195:46809
18:31:29.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.753880  1251 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.106.195:46809 every 8 connection(s)
18:31:29.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.756558  1117 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/data/info.pb
18:31:29.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.761775   427 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 1117
18:31:29.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.762235   427 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster7089895187958844291/ts-2/wal/instance
18:31:29.804 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:29.804 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:29.805 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:29.805 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:29.805 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:29.805 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:29.805 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:29.805 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:29.805 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:29.806 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:29.806 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:29.806 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:29.806 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:29.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.813340  1252 heartbeater.cc:344] Connected to a master server at 127.0.106.252:46705
18:31:29.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.813813  1252 heartbeater.cc:461] Registering TS with master...
18:31:29.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.815155  1252 heartbeater.cc:507] Master 127.0.106.252:46705 requested a full tablet report, sending...
18:31:29.817 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:29.818 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:29.818 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:29.818 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:29.818 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:29.818 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:29.818 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:29.818 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:29.818 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:29.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.819114   675 ts_manager.cc:194] Registered new tserver with Master: 0865e0f96b7348dfbf4a502a6d8151dd (127.0.106.195:46809)
18:31:29.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.819262  1253 heartbeater.cc:344] Connected to a master server at 127.0.106.253:45189
18:31:29.819 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:29.819 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:29.819 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:29.820 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:29.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.820149  1253 heartbeater.cc:461] Registering TS with master...
18:31:29.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.821128  1253 heartbeater.cc:507] Master 127.0.106.253:45189 requested a full tablet report, sending...
18:31:29.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.823820   552 ts_manager.cc:194] Registered new tserver with Master: 0865e0f96b7348dfbf4a502a6d8151dd (127.0.106.195:46809)
18:31:29.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.831037  1258 heartbeater.cc:344] Connected to a master server at 127.0.106.254:32967
18:31:29.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.831421  1258 heartbeater.cc:461] Registering TS with master...
18:31:29.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.832276  1258 heartbeater.cc:507] Master 127.0.106.254:32967 requested a full tablet report, sending...
18:31:29.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.834311   472 ts_manager.cc:194] Registered new tserver with Master: 0865e0f96b7348dfbf4a502a6d8151dd (127.0.106.195:46809)
18:31:29.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.836069   472 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.106.195:37063
18:31:29.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535489835 for job f6e63683f34d031c5da392b08baea20c.
18:31:29.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:29.841328   427 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
18:31:29.845 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:31:29.847 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
18:31:29.854 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:31:29.854 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

18:31:29.855 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.0.106.254"
      port: 32967
    }
    bound_http_address {
      host: "127.0.106.254"
      port: 37699
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.0.106.253"
      port: 45189
    }
    bound_http_address {
      host: "127.0.106.253"
      port: 33705
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.0.106.252"
      port: 46705
    }
    bound_http_address {
      host: "127.0.106.252"
      port: 42751
    }
  }
}

18:31:29.856 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

18:31:29.856 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.0.106.193"
      port: 33681
    }
    bound_http_address {
      host: "127.0.106.193"
      port: 41655
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.0.106.194"
      port: 45251
    }
    bound_http_address {
      host: "127.0.106.194"
      port: 33627
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.0.106.195"
      port: 46809
    }
    bound_http_address {
      host: "127.0.106.195"
      port: 45317
    }
  }
}

18:31:29.857 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
18:31:29.858 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:29.858 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
18:31:29.858 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskSwO0Je/test-tmp
18:31:29.859 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
18:31:29.859 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskSwO0Je/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
18:31:29.862 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

18:31:29.870 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:30.257 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:31:30.257 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

18:31:30.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:30.262446  1262 mini_oidc.cc:150] Starting JWKS server
18:31:30.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:30.267020  1262 webserver.cc:534] Webserver started at http://127.0.0.1:34289/ using document root <none> and password file <none>
18:31:30.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:30.267829  1262 mini_oidc.cc:186] Starting OIDC Discovery server
18:31:30.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:30.270841  1262 webserver.cc:534] Webserver started at http://127.0.0.1:38347/ using document root <none> and password file <none>
18:31:30.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:31:30Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
18:31:30.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:31:30Z Disabled control of system clock
18:31:30.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535490335 for job f6e63683f34d031c5da392b08baea20c.
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:30.343854  1262 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/wal
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/data
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/logs
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/data/info.pb
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:31:30.344 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.59.190:46863
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.59.190
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.59.148:39341
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:30.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:30.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:31:30.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901
18:31:30.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:31:30.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34289/jwks.json with env {}
18:31:30.345 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
18:31:30.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:30.464 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:30.465 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:30.465 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:30.465 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:30.465 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:30.465 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:30.465 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:30.465 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:30.465 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:30.466 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:30.466 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:30.466 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:30.466 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:30.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:30.680238  1275 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:31:30.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:30.680913  1275 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:31:30.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:30.681753  1275 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:31:30.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:30.714782  1275 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:31:30.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:30.715233  1275 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:31:30.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:30.715579  1275 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:31:30.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:30.715891  1275 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:31:30.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:30.716187  1275 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:31:30.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:30.716437  1275 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34289/jwks.json
18:31:30.732 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:30.732 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:30.732 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:30.732 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:30.733 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:30.733 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:30.733 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:30.733 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:30.733 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:30.733 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:30.733 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:30.733 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:30.733 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:30.759624  1275 master_runner.cc:387] Master server non-default flags:
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.59.148:39341
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/data
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/wal
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.59.190:46863
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34289/jwks.json
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/data/info.pb
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.59.190
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/logs
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:31:30.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:31:30.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:31:30.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:30.761183  1275 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:31:30.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:30.763165  1275 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:31:30.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:30.775808  1281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:30.798 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:30.798 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:30.799 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:30.799 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:30.799 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:30.800 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:30.800 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:30.800 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:30.800 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:30.801 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:30.801 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:30.801 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:30.801 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:30.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535490836 for job f6e63683f34d031c5da392b08baea20c.
18:31:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:30.845744  1258 heartbeater.cc:499] Master 127.0.106.254:32967 was elected leader, sending a full tablet report...
18:31:30.857 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
18:31:30.859 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
18:31:30.867 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:30.868 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:30.868 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:30.868 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:30.868 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:30.868 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:30.869 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:30.869 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:30.869 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:30.869 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:30.869 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:30.870 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:30.870 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:30.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:31.090 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:31.090 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:31.090 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:31.091 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:31.091 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:31.091 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:31.091 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:31.091 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:31.092 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:31.091 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:31.092 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:31.092 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:31.092 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:31.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:31.135661   503 debug-util.cc:398] Leaking SignalData structure 0x7b08000702a0 after lost signal to thread 440
18:31:31.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:31.136404   503 debug-util.cc:398] Leaking SignalData structure 0x7b080003f400 after lost signal to thread 506
18:31:31.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535491335 for job f6e63683f34d031c5da392b08baea20c.
18:31:31.361 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=25 ms, finalizationTime=1 ms).
18:31:31.365 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
18:31:31.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:31.531 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:31.531 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:31.532 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:31.532 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:31.532 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:31.532 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:31.533 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:31.533 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:31.533 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:31.533 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:31.533 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:31.533 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:31.533 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:31.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535491835 for job f6e63683f34d031c5da392b08baea20c.
18:31:31.860 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=23 ms, finalizationTime=2 ms).
18:31:31.861 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
18:31:31.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:32.271 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:32.272 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:32.272 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:32.272 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:32.273 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:32.273 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:32.273 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:32.273 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:32.273 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:32.273 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:32.273 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:32.273 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:32.273 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:32.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535492335 for job f6e63683f34d031c5da392b08baea20c.
18:31:32.348 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:31:32.349 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
18:31:32.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:32.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:32.180598  1280 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 1275
18:31:32.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:32.439822  1280 kernel_stack_watchdog.cc:198] Thread 1275 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 401ms:
18:31:32.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:31:32.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:31:32.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:31:32.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:31:32.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:30.778116  1282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:32.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:32.441529  1275 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.665s	user 0.490s	sys 0.945s
18:31:32.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:32.442113  1275 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.666s	user 0.490s	sys 0.945s
18:31:32.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:32.443264  1284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:32.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:32.445881  1283 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1664 milliseconds
18:31:32.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.445881  1275 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:31:32.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.447355  1275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:31:32.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.449932  1275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:31:32.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.451335  1275 hybrid_clock.cc:648] HybridClock initialized: now 1783535492451301 us; error 36 us; skew 500 ppm
18:31:32.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.452293  1275 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:31:32.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.460974  1275 webserver.cc:534] Webserver started at http://127.1.59.190:32775/ using document root <none> and password file <none>
18:31:32.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.462042  1275 fs_manager.cc:362] Metadata directory not provided
18:31:32.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.462298  1275 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:31:32.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.462910  1275 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:31:32.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.467968  1275 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/data/instance:
18:31:32.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0de3dc25a384406f8b7a6f7404cb492b"
18:31:32.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:32 on dist-test-slave-dxnw"
18:31:32.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.469146  1275 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/wal/instance:
18:31:32.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0de3dc25a384406f8b7a6f7404cb492b"
18:31:32.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:32 on dist-test-slave-dxnw"
18:31:32.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.477355  1275 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.005s
18:31:32.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.483690  1292 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:31:32.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.485028  1275 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.000s	sys 0.004s
18:31:32.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.485471  1275 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/wal
18:31:32.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0de3dc25a384406f8b7a6f7404cb492b"
18:31:32.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:32 on dist-test-slave-dxnw"
18:31:32.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.485917  1275 fs_report.cc:389] FS layout report
18:31:32.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:31:32.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/wal
18:31:32.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/wal
18:31:32.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/data/data
18:31:32.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:31:32.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:31:32.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:31:32.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:31:32.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:31:32.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:31:32.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:31:32.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:31:32.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:31:32.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:31:32.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:31:32.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.550452  1275 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:31:32.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.552479  1275 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:31:32.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.553084  1275 kserver.cc:163] Server-wide thread pool size limit: 3276
18:31:32.616 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:32.616 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:32.616 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:32.616 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:32.616 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:32.617 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:32.617 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:32.617 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:32.617 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:32.617 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:32.617 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:32.617 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:32.617 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:32.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.655814  1275 rpc_server.cc:307] RPC server started. Bound to: 127.1.59.190:46863
18:31:32.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.656231  1343 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.59.190:46863 every 8 connection(s)
18:31:32.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.658737  1275 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/data/info.pb
18:31:32.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.665689  1262 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 1275
18:31:32.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.666203  1344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:31:32.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.666246  1262 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-0/wal/instance
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.672708  1262 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/wal
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/data
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/logs
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/data/info.pb
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.59.189:42073
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.59.189
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.59.148:39341
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:31:32.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34289/jwks.json with env {}
18:31:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.679378  1344 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } has no permanent_uuid. Determining permanent_uuid...
18:31:32.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.726562  1344 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } has no permanent_uuid. Determining permanent_uuid...
18:31:32.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:32.729915  1296 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.59.189:42073: connect: Connection refused (error 111)
18:31:32.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:32.735710  1344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.189:42073: Network error: Client connection negotiation failed: client connection to 127.1.59.189:42073: connect: Connection refused (error 111)
18:31:32.784 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:32.784 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:32.784 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:32.784 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:32.785 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:32.785 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:32.785 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:32.785 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:32.785 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:32.785 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:32.785 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:32.785 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:32.785 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:32.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.785410  1344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } attempt: 1
18:31:32.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:32.789790  1344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.189:42073: Network error: Client connection negotiation failed: client connection to 127.1.59.189:42073: connect: Connection refused (error 111)
18:31:32.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535492835 for job f6e63683f34d031c5da392b08baea20c.
18:31:32.839 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:32.839 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:32.839 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:32.840 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:32.840 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:32.840 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:32.841 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:32.841 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:32.841 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:32.845 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:32.845 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:32.845 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:32.845 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:32.850 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
18:31:32.851 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
18:31:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.858155  1344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } attempt: 2
18:31:32.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:32.864566  1344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.189:42073: Network error: Client connection negotiation failed: client connection to 127.1.59.189:42073: connect: Connection refused (error 111)
18:31:32.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:32.912 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:32.912 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:32.913 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:32.913 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:32.913 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:32.913 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:32.913 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:32.914 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:32.914 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:32.914 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:32.914 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:32.914 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:32.914 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:32.956032  1344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } attempt: 3
18:31:32.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:32.963057  1344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.189:42073: Network error: Client connection negotiation failed: client connection to 127.1.59.189:42073: connect: Connection refused (error 111)
18:31:33.032 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:33.032 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:33.032 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:33.033 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:33.033 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:33.033 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:33.033 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:33.034 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:33.034 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:33.034 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:33.034 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:33.034 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:33.034 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:33.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:33.074110  1346 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:31:33.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:33.074878  1346 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:31:33.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:33.075503  1346 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:31:33.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:33.106515  1344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } attempt: 4
18:31:33.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:33.112174  1344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.189:42073: Network error: Client connection negotiation failed: client connection to 127.1.59.189:42073: connect: Connection refused (error 111)
18:31:33.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:33.115293  1346 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:31:33.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:33.115646  1346 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:31:33.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:33.115899  1346 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:31:33.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:33.116200  1346 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:31:33.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:33.116452  1346 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:31:33.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:33.116623  1346 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34289/jwks.json
18:31:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:33.160395  1346 master_runner.cc:387] Master server non-default flags:
18:31:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.59.148:39341
18:31:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/data
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/wal
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.59.189:42073
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34289/jwks.json
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/data/info.pb
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.59.189
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/logs
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:31:33.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:33.161695  1346 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:31:33.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:33.163301  1346 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:31:33.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:33.175220  1356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:33.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535493335 for job f6e63683f34d031c5da392b08baea20c.
18:31:33.347 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:31:33.348 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
18:31:33.370 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:33.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:33.411801  1344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } attempt: 5
18:31:33.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:33.429980  1344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.189:42073: Network error: Client connection negotiation failed: client connection to 127.1.59.189:42073: connect: Connection refused (error 111)
18:31:33.568 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:33.568 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:33.569 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:33.569 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:33.570 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:33.570 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:33.570 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:33.570 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:33.570 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:33.571 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:33.571 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:33.571 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:33.571 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:33.638 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:33.638 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:33.638 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:33.639 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:33.639 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:33.639 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:33.639 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:33.639 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:33.639 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:33.639 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:33.639 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:33.639 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:33.640 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:33.664 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:33.665 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:33.665 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:33.665 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:33.665 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:33.665 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:33.665 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:33.665 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:33.665 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:33.665 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:33.665 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:33.665 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:33.666 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:33.668 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:33.668 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:33.668 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:33.669 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:33.669 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:33.669 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:33.669 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:33.669 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:33.669 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:33.669 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:33.669 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:33.669 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:33.669 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:33.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535493835 for job f6e63683f34d031c5da392b08baea20c.
18:31:33.850 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
18:31:33.852 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
18:31:33.870 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:33.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:33.977552  1344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } attempt: 6
18:31:33.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:33.992872  1344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.189:42073: Network error: Client connection negotiation failed: client connection to 127.1.59.189:42073: connect: Connection refused (error 111)
18:31:34.024 [DEBUG - pool-54-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30008), Traces: [0ms] sending RPC to server master-127.30.11.252:39405, [6ms] received response from server master-127.30.11.252:39405: OK, deferred=null) with no deferred attached!
18:31:34.223 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:34.224 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:34.224 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:34.227 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:34.227 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:34.227 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:34.228 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:34.228 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:34.228 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:34.229 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:34.229 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:34.229 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:34.229 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:34.335 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535494335 for job f6e63683f34d031c5da392b08baea20c.
18:31:34.357 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=22 ms, finalizationTime=0 ms).
18:31:34.358 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
18:31:34.370 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:34.500 [DEBUG - pool-56-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30003), Traces: [0ms] sending RPC to server master-127.30.195.124:38627, [12ms] received response from server master-127.30.195.124:38627: OK, deferred=null) with no deferred attached!
18:31:34.500 [DEBUG - pool-56-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30002), Traces: [0ms] sending RPC to server master-127.30.195.124:38627, [8ms] received response from server master-127.30.195.124:38627: OK, deferred=null) with no deferred attached!
18:31:34.525 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:34.525 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:34.525 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:34.526 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:34.526 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:34.526 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:34.526 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:34.527 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:34.527 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:34.527 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:34.527 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:34.527 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:34.527 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:34.592 [DEBUG - pool-58-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30002), Traces: [0ms] sending RPC to server master-127.30.195.124:38627, [6ms] received response from server master-127.30.195.124:38627: OK, deferred=null) with no deferred attached!
18:31:34.628 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:34.628 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:34.629 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:34.629 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:34.629 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:34.629 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:34.629 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:34.629 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:34.629 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:34.630 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:34.630 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:34.630 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:34.630 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:34.764 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:34.764 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:34.764 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:34.765 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:34.765 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:34.765 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:34.765 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:34.766 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:34.766 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:34.765 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:34.766 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:34.766 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:34.766 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:34.847 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535494847 for job f6e63683f34d031c5da392b08baea20c.
18:31:34.858 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:31:34.859 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
18:31:34.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:34.943 [DEBUG - pool-60-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.30.195.124:38627, [5ms] received response from server master-127.30.195.124:38627: OK, deferred=null) with no deferred attached!
18:31:34.943 [DEBUG - pool-60-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.30.195.124:38627, [5ms] received response from server master-127.30.195.124:38627: OK, deferred=null) with no deferred attached!
18:31:35.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.053360  1344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } attempt: 7
18:31:35.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:35.083678  1344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.189:42073: Network error: Client connection negotiation failed: client connection to 127.1.59.189:42073: connect: Connection refused (error 111)
18:31:35.157 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:35.158 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:35.158 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:35.159 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:35.159 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:35.159 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:35.159 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:35.160 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:35.160 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:35.160 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:35.160 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:35.160 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:35.160 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:35.242 [DEBUG - pool-62-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30015), Traces: [0ms] sending RPC to server master-127.30.195.124:38627, [4ms] received response from server master-127.30.195.124:38627: OK, deferred=null) with no deferred attached!
18:31:35.335 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535495335 for job f6e63683f34d031c5da392b08baea20c.
18:31:35.347 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:31:35.348 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
18:31:35.372 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:35.554 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:35.555 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:35.555 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:35.555 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:35.556 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:35.556 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:35.556 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:35.556 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:35.557 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:35.557 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:35.557 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:35.557 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:35.557 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:35.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:34.578495  1355 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 1346
18:31:35.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:35.574223  1355 kernel_stack_watchdog.cc:198] Thread 1346 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 399ms:
18:31:35.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:31:35.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:31:35.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:31:35.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:31:35.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:35.579159  1346 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.402s	user 0.742s	sys 1.139s
18:31:35.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:33.176694  1357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:35.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:35.580134  1346 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.403s	user 0.742s	sys 1.139s
18:31:35.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:35.582613  1359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:35.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:35.586086  1358 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2404 milliseconds
18:31:35.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.586243  1346 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:31:35.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.587867  1346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:31:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.590407  1346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:31:35.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.591912  1346 hybrid_clock.cc:648] HybridClock initialized: now 1783535495591875 us; error 39 us; skew 500 ppm
18:31:35.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.592832  1346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:31:35.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.599449  1346 webserver.cc:534] Webserver started at http://127.1.59.189:35263/ using document root <none> and password file <none>
18:31:35.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.600543  1346 fs_manager.cc:362] Metadata directory not provided
18:31:35.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.600921  1346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:31:35.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.601451  1346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:31:35.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.606300  1346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/data/instance:
18:31:35.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8"
18:31:35.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:35 on dist-test-slave-dxnw"
18:31:35.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.607481  1346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/wal/instance:
18:31:35.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8"
18:31:35.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:35 on dist-test-slave-dxnw"
18:31:35.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.615545  1346 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.002s
18:31:35.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.621803  1373 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:31:35.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.622985  1346 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
18:31:35.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.623356  1346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/wal
18:31:35.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8"
18:31:35.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:35 on dist-test-slave-dxnw"
18:31:35.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.623687  1346 fs_report.cc:389] FS layout report
18:31:35.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:31:35.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/wal
18:31:35.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/wal
18:31:35.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/data/data
18:31:35.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:31:35.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:31:35.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:31:35.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:31:35.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:31:35.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:31:35.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:31:35.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:31:35.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:31:35.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:31:35.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:31:35.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.696323  1346 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:31:35.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.697780  1346 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:31:35.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.698249  1346 kserver.cc:163] Server-wide thread pool size limit: 3276
18:31:35.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.783542  1346 rpc_server.cc:307] RPC server started. Bound to: 127.1.59.189:42073
18:31:35.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.783615  1425 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.59.189:42073 every 8 connection(s)
18:31:35.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.786264  1346 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/data/info.pb
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.788897  1262 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 1346
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.789336  1262 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-1/wal/instance
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.792227  1262 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/wal
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/data
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/logs
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/data/info.pb
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:31:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:31:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:31:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:31:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.59.188:33901
18:31:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.59.188
18:31:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.59.148:39341
18:31:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:31:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901
18:31:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:31:35.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34289/jwks.json with env {}
18:31:35.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.795320  1426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:31:35.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.808009  1426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } has no permanent_uuid. Determining permanent_uuid...
18:31:35.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.830798  1426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } has no permanent_uuid. Determining permanent_uuid...
18:31:35.835 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535495835 for job f6e63683f34d031c5da392b08baea20c.
18:31:35.845 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:31:35.847 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
18:31:35.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.848169  1426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } has no permanent_uuid. Determining permanent_uuid...
18:31:35.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:35.851223  1374 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.59.188:33901: connect: Connection refused (error 111)
18:31:35.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:35.855845  1426 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.188:33901: Network error: Client connection negotiation failed: client connection to 127.1.59.188:33901: connect: Connection refused (error 111)
18:31:35.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:35.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.905403  1426 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } attempt: 1
18:31:35.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:35.910032  1426 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.188:33901: Network error: Client connection negotiation failed: client connection to 127.1.59.188:33901: connect: Connection refused (error 111)
18:31:35.964 [DEBUG - pool-54-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.30.11.252:39405, [8ms] received response from server master-127.30.11.252:39405: OK, deferred=null) with no deferred attached!
18:31:35.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:35.978495  1426 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } attempt: 2
18:31:35.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:35.983078  1426 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.188:33901: Network error: Client connection negotiation failed: client connection to 127.1.59.188:33901: connect: Connection refused (error 111)
18:31:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:36.057999   503 debug-util.cc:398] Leaking SignalData structure 0x7b0800070240 after lost signal to thread 440
18:31:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:36.058630   503 debug-util.cc:398] Leaking SignalData structure 0x7b08000a12e0 after lost signal to thread 506
18:31:36.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:36.074496  1426 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } attempt: 3
18:31:36.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:36.079236  1426 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.188:33901: Network error: Client connection negotiation failed: client connection to 127.1.59.188:33901: connect: Connection refused (error 111)
18:31:36.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:36.129853  1428 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:31:36.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:36.130491  1428 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:31:36.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:36.131079  1428 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:31:36.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:36.165244  1428 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:31:36.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:36.165606  1428 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:31:36.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:36.165856  1428 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:31:36.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:36.166066  1428 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:31:36.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:36.166266  1428 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:31:36.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:36.166410  1428 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34289/jwks.json
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:36.204823  1428 master_runner.cc:387] Master server non-default flags:
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.59.148:39341
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/data
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/wal
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.59.188:33901
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34289/jwks.json
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/data/info.pb
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.59.188
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:31:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:31:36.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:36.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/logs
18:31:36.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:36.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:31:36.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:31:36.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:31:36.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:31:36.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:31:36.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:31:36.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:31:36.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:31:36.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:31:36.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:36.206647  1428 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:31:36.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:36.208979  1428 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:31:36.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:36.220784  1438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:36.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:36.222652  1426 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } attempt: 4
18:31:36.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:36.236472  1426 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.188:33901: Network error: Client connection negotiation failed: client connection to 127.1.59.188:33901: connect: Connection refused (error 111)
18:31:36.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535496335 for job f6e63683f34d031c5da392b08baea20c.
18:31:36.349 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=12 ms, finalizationTime=2 ms).
18:31:36.350 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
18:31:36.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:36.455 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:36.456 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:36.456 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:36.456 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:36.456 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:36.456 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:36.457 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:36.457 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:36.457 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:36.457 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:36.457 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:36.457 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:36.457 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:36.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:36.536000  1426 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } attempt: 5
18:31:36.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:36.544149  1426 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.188:33901: Network error: Client connection negotiation failed: client connection to 127.1.59.188:33901: connect: Connection refused (error 111)
18:31:36.617 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:36.618 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:36.618 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:36.618 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:36.619 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:36.619 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:36.619 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:36.619 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:36.619 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:36.619 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:36.619 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:36.619 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:36.620 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:36.707 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:36.708 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:36.708 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:36.708 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:36.708 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:36.709 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:36.709 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:36.709 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:36.709 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:36.710 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:36.710 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:36.710 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:36.710 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:36.792 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:36.792 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:36.792 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:36.793 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:36.793 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:36.793 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:36.793 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:36.793 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:36.793 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:36.794 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:36.794 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:36.794 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:36.794 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:36.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535496835 for job f6e63683f34d031c5da392b08baea20c.
18:31:36.845 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:31:36.850 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
18:31:36.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:36.912 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:36.912 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:36.912 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:36.913 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:36.913 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:36.913 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:36.913 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:36.913 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:36.913 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:36.914 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:36.914 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:36.914 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:36.914 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:36.949 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:36.950 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:36.950 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:36.951 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:36.951 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:36.951 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:36.951 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:36.952 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:36.952 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:36.952 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:36.952 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:36.952 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:36.952 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:37.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:37.091660  1426 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } attempt: 6
18:31:37.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:37.131888  1426 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.188:33901: Network error: Client connection negotiation failed: client connection to 127.1.59.188:33901: connect: Connection refused (error 111)
18:31:37.151 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:37.152 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:37.152 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:37.152 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:37.152 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:37.153 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:37.153 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:37.153 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:37.153 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:37.153 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:37.153 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:37.153 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:37.153 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:37.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:37.174142  1344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } attempt: 8
18:31:37.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:37.228631  1344 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } has no permanent_uuid. Determining permanent_uuid...
18:31:37.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:37.291163  1344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.188:33901: Network error: Client connection negotiation failed: client connection to 127.1.59.188:33901: connect: Connection refused (error 111)
18:31:37.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535497335 for job f6e63683f34d031c5da392b08baea20c.
18:31:37.347 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:31:37.349 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
18:31:37.351 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:37.351 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:37.352 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:37.352 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:37.352 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:37.352 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:37.352 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:37.352 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:37.353 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:37.353 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:37.353 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:37.353 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:37.353 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:37.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:37.356781  1344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } attempt: 1
18:31:37.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:37.362751  1344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.188:33901: Network error: Client connection negotiation failed: client connection to 127.1.59.188:33901: connect: Connection refused (error 111)
18:31:37.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:37.416327  1344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } attempt: 2
18:31:37.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:37.426007  1344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.188:33901: Network error: Client connection negotiation failed: client connection to 127.1.59.188:33901: connect: Connection refused (error 111)
18:31:37.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:37.502934  1344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } attempt: 3
18:31:37.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:37.512602  1344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.188:33901: Network error: Client connection negotiation failed: client connection to 127.1.59.188:33901: connect: Connection refused (error 111)
18:31:37.588 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:37.588 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:37.588 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:37.589 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:37.589 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:37.589 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:37.589 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:37.589 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:37.589 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:37.589 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:37.589 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:37.589 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:37.589 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:37.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:37.668620  1344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } attempt: 4
18:31:37.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:37.675634  1344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.188:33901: Network error: Client connection negotiation failed: client connection to 127.1.59.188:33901: connect: Connection refused (error 111)
18:31:37.718 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:37.718 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:37.718 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:37.720 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:37.720 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:37.720 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:37.719 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:37.721 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:37.721 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:37.719 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:37.721 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:37.721 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:37.721 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:37.837 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535497835 for job f6e63683f34d031c5da392b08baea20c.
18:31:37.845 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:31:37.846 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
18:31:37.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:37.945 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:37.945 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:37.945 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:37.946 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:37.946 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:37.946 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:37.947 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:37.947 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:37.947 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:37.947 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:37.947 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:37.947 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:37.947 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:37.965 [DEBUG - pool-54-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30018), Traces: [0ms] sending RPC to server master-127.30.11.252:39405, [9ms] received response from server master-127.30.11.252:39405: OK, deferred=null) with no deferred attached!
18:31:37.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:37.972043  1344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } attempt: 5
18:31:37.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:37.975975  1293 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.59.188:33901: connect: Connection refused (error 111) [suppressed 12 similar messages]
18:31:37.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:37.979596  1344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.188:33901: Network error: Client connection negotiation failed: client connection to 127.1.59.188:33901: connect: Connection refused (error 111)
18:31:37.992 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:37.992 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:37.993 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:37.993 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:37.993 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:37.993 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:37.994 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:37.994 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:37.994 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:37.994 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:37.994 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:37.994 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:37.995 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:38.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:36.221911  1439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:38.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:38.033996  1428 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.813s	user 0.609s	sys 1.047s
18:31:38.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:37.626475  1437 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 1428
18:31:38.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:38.035223  1428 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.814s	user 0.609s	sys 1.047s
18:31:38.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:38.035981  1440 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1813 milliseconds
18:31:38.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.036881  1428 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:31:38.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:38.036955  1441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:38.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.040593  1428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:31:38.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.043123  1428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:31:38.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.044469  1428 hybrid_clock.cc:648] HybridClock initialized: now 1783535498044447 us; error 42 us; skew 500 ppm
18:31:38.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.045435  1428 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:31:38.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.051761  1428 webserver.cc:534] Webserver started at http://127.1.59.188:33163/ using document root <none> and password file <none>
18:31:38.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.052647  1428 fs_manager.cc:362] Metadata directory not provided
18:31:38.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.052834  1428 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:31:38.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.053213  1428 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:31:38.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.057582  1428 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/data/instance:
18:31:38.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "590bbf34b7134c5ebe58a522cda0136f"
18:31:38.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:38 on dist-test-slave-dxnw"
18:31:38.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.058598  1428 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/wal/instance:
18:31:38.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "590bbf34b7134c5ebe58a522cda0136f"
18:31:38.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:38 on dist-test-slave-dxnw"
18:31:38.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.067130  1428 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.003s
18:31:38.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.073908  1456 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:31:38.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.075184  1428 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.007s	sys 0.000s
18:31:38.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.075577  1428 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/wal
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "590bbf34b7134c5ebe58a522cda0136f"
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:38 on dist-test-slave-dxnw"
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.075997  1428 fs_report.cc:389] FS layout report
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/wal
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/wal
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/data/data
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:31:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:31:38.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.134380  1428 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:31:38.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.135838  1428 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:31:38.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.136238  1428 kserver.cc:163] Server-wide thread pool size limit: 3276
18:31:38.191 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:38.192 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:38.192 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:38.192 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:38.192 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:38.192 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:38.192 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:38.192 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:38.193 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:38.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.192453  1426 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } attempt: 7
18:31:38.193 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:38.193 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:38.193 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:38.193 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:38.199909  1426 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.59.188:33901: Network error: Client connection negotiation failed: client connection to 127.1.59.188:33901: connect: Connection refused (error 111)
18:31:38.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.223237  1428 rpc_server.cc:307] RPC server started. Bound to: 127.1.59.188:33901
18:31:38.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.223326  1510 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.59.188:33901 every 8 connection(s)
18:31:38.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.225929  1428 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/data/info.pb
18:31:38.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.232537  1511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:31:38.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.235786  1262 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 1428
18:31:38.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.236238  1262 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/master-2/wal/instance
18:31:38.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.244558  1511 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } has no permanent_uuid. Determining permanent_uuid...
18:31:38.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.278683  1511 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } has no permanent_uuid. Determining permanent_uuid...
18:31:38.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.295226  1511 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } has no permanent_uuid. Determining permanent_uuid...
18:31:38.312 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:38.312 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:38.313 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:38.313 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:38.313 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:38.313 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:38.314 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:38.314 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:38.314 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:38.314 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:38.314 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:38.315 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:38.315 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:38.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.316433  1511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f: Bootstrap starting.
18:31:38.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.323280  1511 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f: Neither blocks nor log segments found. Creating new log.
18:31:38.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.325420  1511 log.cc:826] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f: Log is configured to *not* fsync() on all Append() calls
18:31:38.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.330243  1511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f: No bootstrap required, opened a new log
18:31:38.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535498336 for job f6e63683f34d031c5da392b08baea20c.
18:31:38.344 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
18:31:38.344 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
18:31:38.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.354674  1511 raft_consensus.cc:359] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } }
18:31:38.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.355399  1511 raft_consensus.cc:385] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:38.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.355656  1511 raft_consensus.cc:740] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590bbf34b7134c5ebe58a522cda0136f, State: Initialized, Role: FOLLOWER
18:31:38.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.356463  1511 consensus_queue.cc:260] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } }
18:31:38.358 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:38.358 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:38.359 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:38.359 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:38.359 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:38.359 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:38.359 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:38.359 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:38.359 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:38.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.358707  1522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } } }
18:31:38.359 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:38.359 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:38.359 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:38.359 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:38.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.359611  1522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [sys.catalog]: This master's current role is: FOLLOWER
18:31:38.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.361056  1511 sys_catalog.cc:565] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [sys.catalog]: configured and running, proceeding with master startup.
18:31:38.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:38.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:38.389213  1533 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:31:38.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:38.389588  1533 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:31:38.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:38.391297  1462 tablet.cc:2406] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:31:38.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.401690  1522 raft_consensus.cc:493] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:31:38.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.402231  1522 raft_consensus.cc:515] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } }
18:31:38.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.404613  1522 leader_election.cc:290] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0de3dc25a384406f8b7a6f7404cb492b (127.1.59.190:46863), 7e1f8b75f6834d51a5bcc7ec7f4d6ed8 (127.1.59.189:42073)
18:31:38.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.384950  1428 master_runner.cc:187] Error getting master registration for 127.1.59.190:46863: OK, instance_id { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" instance_seqno: 1783535492628643 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:31:38.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.422672  1428 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:31:38.484 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:38.484 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:38.484 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:38.485 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:38.485 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:38.485 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:38.485 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:38.485 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:38.485 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:38.485 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:38.485 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:38.485 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:38.486 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:38.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.500973  1344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } attempt: 6
18:31:38.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.526770  1344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b: Bootstrap starting.
18:31:38.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.532496  1344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b: Neither blocks nor log segments found. Creating new log.
18:31:38.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.534634  1344 log.cc:826] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b: Log is configured to *not* fsync() on all Append() calls
18:31:38.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.545451  1344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b: No bootstrap required, opened a new log
18:31:38.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.575091  1344 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } }
18:31:38.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.575945  1344 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:38.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.576260  1344 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0de3dc25a384406f8b7a6f7404cb492b, State: Initialized, Role: FOLLOWER
18:31:38.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.577224  1344 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } }
18:31:38.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.582940  1344 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b [sys.catalog]: configured and running, proceeding with master startup.
18:31:38.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.580814  1537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } } }
18:31:38.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.583951  1537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b [sys.catalog]: This master's current role is: FOLLOWER
18:31:38.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.585971  1319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "590bbf34b7134c5ebe58a522cda0136f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0de3dc25a384406f8b7a6f7404cb492b" is_pre_election: true
18:31:38.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.587340  1319 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590bbf34b7134c5ebe58a522cda0136f in term 0.
18:31:38.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.589190  1457 leader_election.cc:304] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0de3dc25a384406f8b7a6f7404cb492b, 590bbf34b7134c5ebe58a522cda0136f; no voters: 
18:31:38.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.590185  1522 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [term 0 FOLLOWER]: Leader pre-election won for term 1
18:31:38.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.590715  1522 raft_consensus.cc:493] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:31:38.591 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:38.592 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:38.592 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:38.592 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:38.593 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:38.593 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:38.593 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:38.593 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:38.593 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:38.594 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:38.594 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:38.594 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:38.594 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:38.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.591202  1522 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [term 0 FOLLOWER]: Advancing to term 1
18:31:38.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.618695  1522 raft_consensus.cc:515] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } }
18:31:38.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.622160  1522 leader_election.cc:290] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [CANDIDATE]: Term 1 election: Requested vote from peers 0de3dc25a384406f8b7a6f7404cb492b (127.1.59.190:46863), 7e1f8b75f6834d51a5bcc7ec7f4d6ed8 (127.1.59.189:42073)
18:31:38.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.636374  1319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "590bbf34b7134c5ebe58a522cda0136f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0de3dc25a384406f8b7a6f7404cb492b"
18:31:38.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.636948  1319 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b [term 0 FOLLOWER]: Advancing to term 1
18:31:38.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.660806  1319 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590bbf34b7134c5ebe58a522cda0136f in term 1.
18:31:38.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.686935  1457 leader_election.cc:304] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0de3dc25a384406f8b7a6f7404cb492b, 590bbf34b7134c5ebe58a522cda0136f; no voters: 
18:31:38.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.688190  1522 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [term 1 FOLLOWER]: Leader election won for term 1
18:31:38.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.695290  1522 raft_consensus.cc:697] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [term 1 LEADER]: Becoming Leader. State: Replica: 590bbf34b7134c5ebe58a522cda0136f, State: Running, Role: LEADER
18:31:38.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.697288  1522 consensus_queue.cc:237] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } }
18:31:38.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.726174  1547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 590bbf34b7134c5ebe58a522cda0136f. Latest consensus state: current_term: 1 leader_uuid: "590bbf34b7134c5ebe58a522cda0136f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } } }
18:31:38.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.727015  1547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [sys.catalog]: This master's current role is: LEADER
18:31:38.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.731477  1550 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
18:31:38.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.734465  1551 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:31:38.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.742709  1551 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:31:38.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.738672  1275 master_runner.cc:187] Error getting master registration for 127.1.59.189:42073: OK, instance_id { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" instance_seqno: 1783535495757276 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:31:38.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.785753  1275 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:31:38.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.788363  1319 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b [term 1 FOLLOWER]: Refusing update from remote peer 590bbf34b7134c5ebe58a522cda0136f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:31:38.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.789960  1522 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:31:38.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:38.819726  1298 tablet.cc:2406] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:31:38.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.825145  1552 mvcc.cc:204] Tried to move back new op lower bound from 7305361402990297088 to 7305361402719748096. Current Snapshot: MvccSnapshot[applied={T|T < 7305361402990297088}]
18:31:38.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.827721  1547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "590bbf34b7134c5ebe58a522cda0136f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } } }
18:31:38.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.828401  1551 catalog_manager.cc:1382] Generated new cluster ID: ec6a0dd7a3dd4011a86ffbbf8784e850
18:31:38.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.828706  1551 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:31:38.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.828459  1547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [sys.catalog]: This master's current role is: LEADER
18:31:38.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.831193  1537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 590bbf34b7134c5ebe58a522cda0136f. Latest consensus state: current_term: 1 leader_uuid: "590bbf34b7134c5ebe58a522cda0136f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } } }
18:31:38.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.832427  1537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b [sys.catalog]: This master's current role is: FOLLOWER
18:31:38.835 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 69 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535498835 for job f6e63683f34d031c5da392b08baea20c.
18:31:38.845 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 69 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:31:38.845 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 69 as completed for source Source: KuduSource.
18:31:38.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.850265  1537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "590bbf34b7134c5ebe58a522cda0136f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } } }
18:31:38.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.850975  1537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b [sys.catalog]: This master's current role is: FOLLOWER
18:31:38.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:38.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.889253  1551 catalog_manager.cc:1405] Generated new certificate authority record
18:31:38.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.891310  1551 catalog_manager.cc:1539] Loading token signing keys...
18:31:38.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.926777  1551 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f: Generated new TSK 0
18:31:38.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.927918  1551 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:31:38.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:38.954994  1262 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:38.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:38.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/wal
18:31:38.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/data
18:31:38.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:31:38.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:31:38.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:31:38.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:38.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:38.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:38.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/logs
18:31:38.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/data/info.pb
18:31:38.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:38.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:31:38.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:31:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:31:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:31:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:31:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:31:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.59.129:0
18:31:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.59.129
18:31:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.59.129
18:31:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901
18:31:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.59.148:39341
18:31:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:31:39.212 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:39.212 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:39.212 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:39.212 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:39.212 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:39.213 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:39.213 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:39.213 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:39.213 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:39.213 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:39.213 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:39.213 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:39.213 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:39.252 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:39.252 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:39.252 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:39.253 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:39.253 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:39.253 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:39.253 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:39.253 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:39.254 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:39.254 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:39.254 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:39.254 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:39.254 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:39.328 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:39.328 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:39.328 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:39.328 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:39.328 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:39.329 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:39.329 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:39.329 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:39.329 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:39.329 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:39.329 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:39.329 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:39.329 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:39.335 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 70 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535499335 for job f6e63683f34d031c5da392b08baea20c.
18:31:39.345 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 70 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:31:39.345 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 70 as completed for source Source: KuduSource.
18:31:39.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:39.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:39.465817  1559 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:31:39.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:39.468199  1559 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:31:39.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:39.469798  1559 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:31:39.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:39.530241  1559 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:31:39.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:39.531646  1559 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.59.129
18:31:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:39.597091  1559 tablet_server_runner.cc:78] Tablet server non-default flags:
18:31:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.59.148:39341
18:31:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/data
18:31:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/wal
18:31:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.59.129:0
18:31:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:31:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/data/info.pb
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.59.129
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.59.129
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/logs
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:31:39.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:31:39.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:39.598888  1559 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:31:39.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:39.601013  1559 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:31:39.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:39.618486  1565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:39.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:39.686012   583 debug-util.cc:398] Leaking SignalData structure 0x7b080007f920 after lost signal to thread 514
18:31:39.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:39.686794   583 debug-util.cc:398] Leaking SignalData structure 0x7b08000985e0 after lost signal to thread 586
18:31:39.724 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:39.725 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:39.725 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:39.725 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:39.725 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:39.725 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:39.725 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:39.726 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:39.726 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:39.726 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:39.726 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:39.726 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:39.726 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:39.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:39.769102  1550 catalog_manager.cc:1294] Loaded cluster ID: ec6a0dd7a3dd4011a86ffbbf8784e850
18:31:39.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:39.769595  1550 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b: loading cluster ID for follower catalog manager: success
18:31:39.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:39.789620  1550 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b: acquiring CA information for follower catalog manager: success
18:31:39.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:39.808652  1550 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 0de3dc25a384406f8b7a6f7404cb492b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:31:39.812 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:39.813 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:39.813 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:39.813 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:39.814 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:39.814 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:39.818 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:39.818 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:39.818 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:39.819 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:39.819 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:39.819 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:39.819 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:39.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 71 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535499835 for job f6e63683f34d031c5da392b08baea20c.
18:31:39.844 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 71 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:31:39.846 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 71 as completed for source Source: KuduSource.
18:31:39.868 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:39.868 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:39.868 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:39.868 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:39.871 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:39.871 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:39.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:39.871 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:39.872 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:39.872 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:39.868 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:39.872 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:39.872 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:39.872 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:39.965 [DEBUG - pool-54-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30018), Traces: [0ms] sending RPC to server master-127.30.11.252:39405, [7ms] received response from server master-127.30.11.252:39405: OK, deferred=null) with no deferred attached!
18:31:40.156 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:40.156 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:40.156 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:40.157 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:40.157 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:40.157 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:40.158 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:40.158 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:40.158 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:40.159 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:40.159 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:40.159 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:40.159 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:40.212 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:40.213 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:40.213 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:40.213 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:40.213 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:40.213 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:40.214 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:40.214 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:40.214 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:40.222 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:40.222 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:40.222 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:40.222 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:40.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:40.223002  1460 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.1.59.189:42073 timed out after 1.810s (SENT)
18:31:40.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.290293  1426 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } attempt: 8
18:31:40.336 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 72 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535500335 for job f6e63683f34d031c5da392b08baea20c.
18:31:40.345 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 72 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:31:40.346 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 72 as completed for source Source: KuduSource.
18:31:40.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:40.391 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:40.391 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:40.392 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:40.392 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:40.393 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:40.393 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:40.393 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:40.393 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:40.393 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:40.394 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:40.394 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:40.394 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:40.394 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:40.412 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:40.412 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:40.413 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:40.413 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:40.414 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:40.414 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:40.414 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:40.414 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:40.414 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:40.415 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:40.415 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:40.415 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:40.415 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:40.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.487525  1426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8: Bootstrap starting.
18:31:40.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.590008  1426 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8: Neither blocks nor log segments found. Creating new log.
18:31:40.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.633313  1426 log.cc:826] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8: Log is configured to *not* fsync() on all Append() calls
18:31:40.667 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:40.668 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:40.668 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:40.669 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:40.669 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:40.669 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:40.670 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:40.670 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:40.670 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:40.670 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:40.670 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:40.671 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:40.671 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:40.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.695211  1426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8: No bootstrap required, opened a new log
18:31:40.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.798790  1426 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } }
18:31:40.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.799826  1426 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:40.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.800118  1426 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e1f8b75f6834d51a5bcc7ec7f4d6ed8, State: Initialized, Role: FOLLOWER
18:31:40.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.804723  1426 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } }
18:31:40.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.818735  1426 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8 [sys.catalog]: configured and running, proceeding with master startup.
18:31:40.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.818935  1398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "590bbf34b7134c5ebe58a522cda0136f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" is_pre_election: true
18:31:40.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.819766  1398 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590bbf34b7134c5ebe58a522cda0136f in term 0.
18:31:40.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.822989  1401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "590bbf34b7134c5ebe58a522cda0136f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" is_pre_election: true
18:31:40.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.822278  1400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "590bbf34b7134c5ebe58a522cda0136f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8"
18:31:40.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.824959  1399 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8 [term 0 FOLLOWER]: Advancing to term 1
18:31:40.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:40.826112  1401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1) took 2420 ms (client timeout 1810 ms). Trace:
18:31:40.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.827314  1397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "590bbf34b7134c5ebe58a522cda0136f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8"
18:31:40.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:40.826735  1401 rpcz_store.cc:269] 0708 18:31:38.405418 (+     0us) service_pool.cc:167] Inserting onto call queue
18:31:40.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:38.405550 (+   132us) service_pool.cc:224] Handling call
18:31:40.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:40.826045 (+2420495us) inbound_call.cc:177] Queueing success response
18:31:40.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
18:31:40.836 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 73 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535500835 for job f6e63683f34d031c5da392b08baea20c.
18:31:40.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:40.824960  1400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2) took 2195 ms (client timeout 1922 ms). Trace:
18:31:40.848 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 73 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
18:31:40.849 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 73 as completed for source Source: KuduSource.
18:31:40.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:40.846335  1400 rpcz_store.cc:269] 0708 18:31:38.629602 (+     0us) service_pool.cc:167] Inserting onto call queue
18:31:40.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:38.631044 (+  1442us) service_pool.cc:224] Handling call
18:31:40.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:40.824870 (+2193826us) inbound_call.cc:177] Queueing success response
18:31:40.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
18:31:40.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.852172  1399 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8 [term 1 FOLLOWER]: Refusing update from remote peer 590bbf34b7134c5ebe58a522cda0136f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:31:40.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.855312  1399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 3) took 2075 ms. Trace:
18:31:40.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.855665  1399 rpcz_store.cc:276] 0708 18:31:38.780084 (+     0us) service_pool.cc:167] Inserting onto call queue
18:31:40.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:38.780222 (+   138us) service_pool.cc:224] Handling call
18:31:40.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:40.824550 (+2044328us) raft_consensus.cc:1471] Updating replica for 0 ops
18:31:40.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:40.854904 (+ 30354us) raft_consensus.cc:1697] Filling consensus response to leader.
18:31:40.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:31:40.855226 (+   322us) inbound_call.cc:177] Queueing success response
18:31:40.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
18:31:40.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.860560  1575 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:31:40.872 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:40.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.871846  1578 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } } }
18:31:40.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:40.879887  1578 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8 [sys.catalog]: This master's current role is: FOLLOWER
18:31:40.956 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:40.957 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:40.957 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:40.959 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:40.959 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:40.959 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:40.964 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:40.964 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:40.964 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:40.964 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:40.964 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:40.964 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:40.964 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:40.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:40.966811  1380 tablet.cc:2406] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:31:41.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:41.022724  1578 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 590bbf34b7134c5ebe58a522cda0136f. Latest consensus state: current_term: 1 leader_uuid: "590bbf34b7134c5ebe58a522cda0136f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } } }
18:31:41.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:41.023679  1578 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8 [sys.catalog]: This master's current role is: FOLLOWER
18:31:41.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:41.025250  1581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "590bbf34b7134c5ebe58a522cda0136f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } } }
18:31:41.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:41.026129  1581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8 [sys.catalog]: This master's current role is: FOLLOWER
18:31:41.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:41.039754  1594 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
18:31:41.223 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:41.224 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:41.224 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:41.225 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:41.225 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:41.225 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:41.225 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:41.225 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:41.225 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:41.226 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:41.226 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:41.226 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:41.226 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:41.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:41.310731  1575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "590bbf34b7134c5ebe58a522cda0136f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de3dc25a384406f8b7a6f7404cb492b" member_type: VOTER last_known_addr { host: "127.1.59.190" port: 46863 } } peers { permanent_uuid: "7e1f8b75f6834d51a5bcc7ec7f4d6ed8" member_type: VOTER last_known_addr { host: "127.1.59.189" port: 42073 } } peers { permanent_uuid: "590bbf34b7134c5ebe58a522cda0136f" member_type: VOTER last_known_addr { host: "127.1.59.188" port: 33901 } } }
18:31:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:41.311731  1575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 590bbf34b7134c5ebe58a522cda0136f [sys.catalog]: This master's current role is: LEADER
18:31:41.335 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 74 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535501335 for job f6e63683f34d031c5da392b08baea20c.
18:31:41.350 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 74 for job f6e63683f34d031c5da392b08baea20c (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
18:31:41.351 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 74 as completed for source Source: KuduSource.
18:31:41.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:41.508 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:41.508 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:41.509 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:41.509 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:41.509 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:41.509 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:41.509 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:41.509 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:41.509 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:41.509 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:41.509 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:41.510 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:41.510 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:41.618 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:41.618 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:41.619 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:41.619 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:41.619 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:41.619 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:41.619 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:41.619 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:41.619 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:41.620 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:41.620 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:41.620 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:41.620 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:41.745 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:41.745 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:41.746 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:41.746 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.746 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.746 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.746 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.746 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.747 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.747 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.747 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.747 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.747 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:41.749 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=29806), Traces: [0ms] sending RPC to server master-127.30.11.252:39405, [3ms] received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [23ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [26ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [43ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [45ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [45ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [46ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [46ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [65ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [65ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [66ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [66ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [83ms] refreshing cache from master, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [85ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [124ms] refreshing cache from master, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [126ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [126ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [183ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [185ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [185ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [185ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [185ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [263ms] refreshing cache from master, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [265ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [265ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [265ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [266ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [463ms] refreshing cache from master, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [465ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [465ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [465ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [466ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [724ms] refreshing cache from master, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [725ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [726ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [726ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [726ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [726ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [863ms] refreshing cache from master, [863ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [864ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [864ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [864ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [864ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [865ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [865ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2763ms] refreshing cache from master, [2763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2765ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2766ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2767ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2768ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2768ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [4343ms] refreshing cache from master, [4344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [4344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [4345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [4346ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [4347ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [4347ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [4348ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [6264ms] refreshing cache from master, [6264ms] too many traces: truncated at 100 traces, deferred=Deferred@1383115678(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@6311eb9b -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1315880248 after retry RPC after error@1866426802) -> (continuation of Deferred@952374160 after retry RPC after error@1424325152) -> (continuation of Deferred@1876531961 after retry RPC after error@2067733577) -> (continuation of Deferred@1677707309 after retry RPC after error@473205256) -> (continuation of Deferred@1067042085 after retry RPC after error@1011305419) -> (continuation of Deferred@560222926 after retry RPC after error@423159840) -> (continuation of Deferred@1752803023 after retry RPC after error@1852219672) -> (continuation of Deferred@1830255672 after retry RPC after error@858845266) -> (continuation of Deferred@383416101 after retry RPC after error@1307540103) -> (continuation of Deferred@458176958 after retry RPC after error@801761509) -> (continuation of Deferred@1785712998 after retry RPC after error@1549972974) -> (continuation of Deferred@1048765717 after retry RPC after error@1584184544) -> (continuation of Deferred@1243390634 after retry RPC after error@51946434) -> (continuation of Deferred@706434297 after retry RPC after error@288057062) -> (continuation of Deferred@1049464731 after retry RPC after error@2026716475) -> (continuation of Deferred@142676551 after retry RPC after error@1113016807) -> (continuation of Deferred@284485473 after retry RPC after error@29435041) -> (continuation of Deferred@22158836 after retry RPC after error@2041734216) -> (continuation of Deferred@1321880560 after retry RPC after error@1176935076) -> (continuation of Deferred@1468695081 after retry RPC after error@1039150260) -> (continuation of Deferred@569996593 after retry RPC after error@1408772112) -> (continuation of Deferred@1356886924 after retry RPC after error@1825140904), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1315880248 after retry RPC after error@1866426802) -> (continuation of Deferred@952374160 after retry RPC after error@1424325152) -> (continuation of Deferred@1876531961 after retry RPC after error@2067733577) -> (continuation of Deferred@1677707309 after retry RPC after error@473205256) -> (continuation of Deferred@1067042085 after retry RPC after error@1011305419) -> (continuation of Deferred@560222926 after retry RPC after error@423159840) -> (continuation of Deferred@1752803023 after retry RPC after error@1852219672) -> (continuation of Deferred@1830255672 after retry RPC after error@858845266) -> (continuation of Deferred@383416101 after retry RPC after error@1307540103) -> (continuation of Deferred@458176958 after retry RPC after error@801761509) -> (continuation of Deferred@1785712998 after retry RPC after error@1549972974) -> (continuation of Deferred@1048765717 after retry RPC after error@1584184544) -> (continuation of Deferred@1243390634 after retry RPC after error@51946434) -> (continuation of Deferred@706434297 after retry RPC after error@288057062) -> (continuation of Deferred@1049464731 after retry RPC after error@2026716475) -> (continuation of Deferred@142676551 after retry RPC after error@1113016807) -> (continuation of Deferred@284485473 after retry RPC after error@29435041) -> (continuation of Deferred@22158836 after retry RPC after error@2041734216) -> (continuation of Deferred@1321880560 after retry RPC after error@1176935076) -> (continuation of Deferred@1468695081 after retry RPC after error@1039150260) -> (continuation of Deferred@569996593 after retry RPC after error@1408772112) -> (continuation of Deferred@1356886924 after retry RPC after error@1825140904)))
18:31:41.750 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:41.750 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:41.751 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.751 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.751 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.751 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.751 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.751 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.751 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:41.751 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=29806), Traces: [0ms] sending RPC to server master-127.30.11.252:39405, [3ms] received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [23ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [26ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [43ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [45ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [45ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [46ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [46ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [65ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [65ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [66ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [66ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [83ms] refreshing cache from master, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [85ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [124ms] refreshing cache from master, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [126ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [126ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [183ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [185ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [185ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [185ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [185ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [263ms] refreshing cache from master, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [265ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [265ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [265ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [266ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [463ms] refreshing cache from master, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [465ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [465ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [465ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [466ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [724ms] refreshing cache from master, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [725ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [726ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [726ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [726ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [726ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [863ms] refreshing cache from master, [863ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [864ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [864ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [864ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [864ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [865ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [865ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2763ms] refreshing cache from master, [2763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2765ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2766ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2767ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2768ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2768ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [4343ms] refreshing cache from master, [4344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [4344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [4345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [4346ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [4347ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [4347ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [4348ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [6264ms] refreshing cache from master, [6264ms] too many traces: truncated at 100 traces, deferred=Deferred@1383115678(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@6311eb9b -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1315880248 after retry RPC after error@1866426802) -> (continuation of Deferred@952374160 after retry RPC after error@1424325152) -> (continuation of Deferred@1876531961 after retry RPC after error@2067733577) -> (continuation of Deferred@1677707309 after retry RPC after error@473205256) -> (continuation of Deferred@1067042085 after retry RPC after error@1011305419) -> (continuation of Deferred@560222926 after retry RPC after error@423159840) -> (continuation of Deferred@1752803023 after retry RPC after error@1852219672) -> (continuation of Deferred@1830255672 after retry RPC after error@858845266) -> (continuation of Deferred@383416101 after retry RPC after error@1307540103) -> (continuation of Deferred@458176958 after retry RPC after error@801761509) -> (continuation of Deferred@1785712998 after retry RPC after error@1549972974) -> (continuation of Deferred@1048765717 after retry RPC after error@1584184544) -> (continuation of Deferred@1243390634 after retry RPC after error@51946434) -> (continuation of Deferred@706434297 after retry RPC after error@288057062) -> (continuation of Deferred@1049464731 after retry RPC after error@2026716475) -> (continuation of Deferred@142676551 after retry RPC after error@1113016807) -> (continuation of Deferred@284485473 after retry RPC after error@29435041) -> (continuation of Deferred@22158836 after retry RPC after error@2041734216) -> (continuation of Deferred@1321880560 after retry RPC after error@1176935076) -> (continuation of Deferred@1468695081 after retry RPC after error@1039150260) -> (continuation of Deferred@569996593 after retry RPC after error@1408772112) -> (continuation of Deferred@1356886924 after retry RPC after error@1825140904), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1315880248 after retry RPC after error@1866426802) -> (continuation of Deferred@952374160 after retry RPC after error@1424325152) -> (continuation of Deferred@1876531961 after retry RPC after error@2067733577) -> (continuation of Deferred@1677707309 after retry RPC after error@473205256) -> (continuation of Deferred@1067042085 after retry RPC after error@1011305419) -> (continuation of Deferred@560222926 after retry RPC after error@423159840) -> (continuation of Deferred@1752803023 after retry RPC after error@1852219672) -> (continuation of Deferred@1830255672 after retry RPC after error@858845266) -> (continuation of Deferred@383416101 after retry RPC after error@1307540103) -> (continuation of Deferred@458176958 after retry RPC after error@801761509) -> (continuation of Deferred@1785712998 after retry RPC after error@1549972974) -> (continuation of Deferred@1048765717 after retry RPC after error@1584184544) -> (continuation of Deferred@1243390634 after retry RPC after error@51946434) -> (continuation of Deferred@706434297 after retry RPC after error@288057062) -> (continuation of Deferred@1049464731 after retry RPC after error@2026716475) -> (continuation of Deferred@142676551 after retry RPC after error@1113016807) -> (continuation of Deferred@284485473 after retry RPC after error@29435041) -> (continuation of Deferred@22158836 after retry RPC after error@2041734216) -> (continuation of Deferred@1321880560 after retry RPC after error@1176935076) -> (continuation of Deferred@1468695081 after retry RPC after error@1039150260) -> (continuation of Deferred@569996593 after retry RPC after error@1408772112) -> (continuation of Deferred@1356886924 after retry RPC after error@1825140904)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=29806), Traces: [0ms] sending RPC to server master-127.30.11.252:39405, [3ms] received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [23ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [26ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [43ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [45ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [45ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [46ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [46ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [65ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [65ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [66ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [66ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [83ms] refreshing cache from master, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [85ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [124ms] refreshing cache from master, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [126ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [126ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [183ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [185ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [185ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [185ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [185ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [263ms] refreshing cache from master, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [265ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [265ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [265ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [266ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [463ms] refreshing cache from master, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [465ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [465ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [465ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [466ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [724ms] refreshing cache from master, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [725ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [726ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [726ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [726ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [726ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [863ms] refreshing cache from master, [863ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [864ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [864ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [864ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [864ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [865ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [865ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2763ms] refreshing cache from master, [2763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2765ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2766ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2767ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2768ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2768ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [4343ms] refreshing cache from master, [4344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [4344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [4345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [4346ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [4347ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [4347ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [4348ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [6264ms] refreshing cache from master, [6264ms] too many traces: truncated at 100 traces, deferred=Deferred@1383115678(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@6311eb9b -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1315880248 after retry RPC after error@1866426802) -> (continuation of Deferred@952374160 after retry RPC after error@1424325152) -> (continuation of Deferred@1876531961 after retry RPC after error@2067733577) -> (continuation of Deferred@1677707309 after retry RPC after error@473205256) -> (continuation of Deferred@1067042085 after retry RPC after error@1011305419) -> (continuation of Deferred@560222926 after retry RPC after error@423159840) -> (continuation of Deferred@1752803023 after retry RPC after error@1852219672) -> (continuation of Deferred@1830255672 after retry RPC after error@858845266) -> (continuation of Deferred@383416101 after retry RPC after error@1307540103) -> (continuation of Deferred@458176958 after retry RPC after error@801761509) -> (continuation of Deferred@1785712998 after retry RPC after error@1549972974) -> (continuation of Deferred@1048765717 after retry RPC after error@1584184544) -> (continuation of Deferred@1243390634 after retry RPC after error@51946434) -> (continuation of Deferred@706434297 after retry RPC after error@288057062) -> (continuation of Deferred@1049464731 after retry RPC after error@2026716475) -> (continuation of Deferred@142676551 after retry RPC after error@1113016807) -> (continuation of Deferred@284485473 after retry RPC after error@29435041) -> (continuation of Deferred@22158836 after retry RPC after error@2041734216) -> (continuation of Deferred@1321880560 after retry RPC after error@1176935076) -> (continuation of Deferred@1468695081 after retry RPC after error@1039150260) -> (continuation of Deferred@569996593 after retry RPC after error@1408772112) -> (continuation of Deferred@1356886924 after retry RPC after error@1825140904), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1315880248 after retry RPC after error@1866426802) -> (continuation of Deferred@952374160 after retry RPC after error@1424325152) -> (continuation of Deferred@1876531961 after retry RPC after error@2067733577) -> (continuation of Deferred@1677707309 after retry RPC after error@473205256) -> (continuation of Deferred@1067042085 after retry RPC after error@1011305419) -> (continuation of Deferred@560222926 after retry RPC after error@423159840) -> (continuation of Deferred@1752803023 after retry RPC after error@1852219672) -> (continuation of Deferred@1830255672 after retry RPC after error@858845266) -> (continuation of Deferred@383416101 after retry RPC after error@1307540103) -> (continuation of Deferred@458176958 after retry RPC after error@801761509) -> (continuation of Deferred@1785712998 after retry RPC after error@1549972974) -> (continuation of Deferred@1048765717 after retry RPC after error@1584184544) -> (continuation of Deferred@1243390634 after retry RPC after error@51946434) -> (continuation of Deferred@706434297 after retry RPC after error@288057062) -> (continuation of Deferred@1049464731 after retry RPC after error@2026716475) -> (continuation of Deferred@142676551 after retry RPC after error@1113016807) -> (continuation of Deferred@284485473 after retry RPC after error@29435041) -> (continuation of Deferred@22158836 after retry RPC after error@2041734216) -> (continuation of Deferred@1321880560 after retry RPC after error@1176935076) -> (continuation of Deferred@1468695081 after retry RPC after error@1039150260) -> (continuation of Deferred@569996593 after retry RPC after error@1408772112) -> (continuation of Deferred@1356886924 after retry RPC after error@1825140904)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.11.252:39405
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:41.759 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.759 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.759 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.759 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:41.764 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:41.765 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:41.765 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:41.764 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=29806), Traces: [0ms] sending RPC to server master-127.30.11.252:39405, [3ms] received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [23ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [26ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [43ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [45ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [45ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [46ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [46ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [65ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [65ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [66ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [66ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [83ms] refreshing cache from master, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [85ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [124ms] refreshing cache from master, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [126ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [126ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [183ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [185ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [185ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [185ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [185ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [263ms] refreshing cache from master, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [265ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [265ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [265ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [266ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [463ms] refreshing cache from master, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [465ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [465ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [465ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [466ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [724ms] refreshing cache from master, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [725ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [726ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [726ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [726ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [726ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [863ms] refreshing cache from master, [863ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [864ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [864ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [864ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [864ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [865ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [865ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2763ms] refreshing cache from master, [2763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2765ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2766ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2767ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2768ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2768ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [4343ms] refreshing cache from master, [4344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [4344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [4345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [4346ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [4347ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [4347ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [4348ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [6264ms] refreshing cache from master, [6264ms] too many traces: truncated at 100 traces, deferred=Deferred@1383115678(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@6311eb9b -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1315880248 after retry RPC after error@1866426802) -> (continuation of Deferred@952374160 after retry RPC after error@1424325152) -> (continuation of Deferred@1876531961 after retry RPC after error@2067733577) -> (continuation of Deferred@1677707309 after retry RPC after error@473205256) -> (continuation of Deferred@1067042085 after retry RPC after error@1011305419) -> (continuation of Deferred@560222926 after retry RPC after error@423159840) -> (continuation of Deferred@1752803023 after retry RPC after error@1852219672) -> (continuation of Deferred@1830255672 after retry RPC after error@858845266) -> (continuation of Deferred@383416101 after retry RPC after error@1307540103) -> (continuation of Deferred@458176958 after retry RPC after error@801761509) -> (continuation of Deferred@1785712998 after retry RPC after error@1549972974) -> (continuation of Deferred@1048765717 after retry RPC after error@1584184544) -> (continuation of Deferred@1243390634 after retry RPC after error@51946434) -> (continuation of Deferred@706434297 after retry RPC after error@288057062) -> (continuation of Deferred@1049464731 after retry RPC after error@2026716475) -> (continuation of Deferred@142676551 after retry RPC after error@1113016807) -> (continuation of Deferred@284485473 after retry RPC after error@29435041) -> (continuation of Deferred@22158836 after retry RPC after error@2041734216) -> (continuation of Deferred@1321880560 after retry RPC after error@1176935076) -> (continuation of Deferred@1468695081 after retry RPC after error@1039150260) -> (continuation of Deferred@569996593 after retry RPC after error@1408772112) -> (continuation of Deferred@1356886924 after retry RPC after error@1825140904), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1315880248 after retry RPC after error@1866426802) -> (continuation of Deferred@952374160 after retry RPC after error@1424325152) -> (continuation of Deferred@1876531961 after retry RPC after error@2067733577) -> (continuation of Deferred@1677707309 after retry RPC after error@473205256) -> (continuation of Deferred@1067042085 after retry RPC after error@1011305419) -> (continuation of Deferred@560222926 after retry RPC after error@423159840) -> (continuation of Deferred@1752803023 after retry RPC after error@1852219672) -> (continuation of Deferred@1830255672 after retry RPC after error@858845266) -> (continuation of Deferred@383416101 after retry RPC after error@1307540103) -> (continuation of Deferred@458176958 after retry RPC after error@801761509) -> (continuation of Deferred@1785712998 after retry RPC after error@1549972974) -> (continuation of Deferred@1048765717 after retry RPC after error@1584184544) -> (continuation of Deferred@1243390634 after retry RPC after error@51946434) -> (continuation of Deferred@706434297 after retry RPC after error@288057062) -> (continuation of Deferred@1049464731 after retry RPC after error@2026716475) -> (continuation of Deferred@142676551 after retry RPC after error@1113016807) -> (continuation of Deferred@284485473 after retry RPC after error@29435041) -> (continuation of Deferred@22158836 after retry RPC after error@2041734216) -> (continuation of Deferred@1321880560 after retry RPC after error@1176935076) -> (continuation of Deferred@1468695081 after retry RPC after error@1039150260) -> (continuation of Deferred@569996593 after retry RPC after error@1408772112) -> (continuation of Deferred@1356886924 after retry RPC after error@1825140904)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=29806), Traces: [0ms] sending RPC to server master-127.30.11.252:39405, [3ms] received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [23ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [26ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [43ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [45ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [45ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [46ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [46ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [65ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [65ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [66ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [66ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [83ms] refreshing cache from master, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [85ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [124ms] refreshing cache from master, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [126ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [126ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [183ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [185ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [185ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [185ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [185ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [263ms] refreshing cache from master, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [265ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [265ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [265ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [266ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [463ms] refreshing cache from master, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [465ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [465ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [465ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [466ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [724ms] refreshing cache from master, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [725ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [726ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [726ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [726ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [726ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [863ms] refreshing cache from master, [863ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [864ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [864ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [864ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [864ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [865ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [865ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2763ms] refreshing cache from master, [2763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2765ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2766ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2767ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2768ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2768ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [4343ms] refreshing cache from master, [4344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [4344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [4345ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [4346ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [4347ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [4347ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [4348ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [6264ms] refreshing cache from master, [6264ms] too many traces: truncated at 100 traces, deferred=Deferred@1383115678(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@6311eb9b -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1315880248 after retry RPC after error@1866426802) -> (continuation of Deferred@952374160 after retry RPC after error@1424325152) -> (continuation of Deferred@1876531961 after retry RPC after error@2067733577) -> (continuation of Deferred@1677707309 after retry RPC after error@473205256) -> (continuation of Deferred@1067042085 after retry RPC after error@1011305419) -> (continuation of Deferred@560222926 after retry RPC after error@423159840) -> (continuation of Deferred@1752803023 after retry RPC after error@1852219672) -> (continuation of Deferred@1830255672 after retry RPC after error@858845266) -> (continuation of Deferred@383416101 after retry RPC after error@1307540103) -> (continuation of Deferred@458176958 after retry RPC after error@801761509) -> (continuation of Deferred@1785712998 after retry RPC after error@1549972974) -> (continuation of Deferred@1048765717 after retry RPC after error@1584184544) -> (continuation of Deferred@1243390634 after retry RPC after error@51946434) -> (continuation of Deferred@706434297 after retry RPC after error@288057062) -> (continuation of Deferred@1049464731 after retry RPC after error@2026716475) -> (continuation of Deferred@142676551 after retry RPC after error@1113016807) -> (continuation of Deferred@284485473 after retry RPC after error@29435041) -> (continuation of Deferred@22158836 after retry RPC after error@2041734216) -> (continuation of Deferred@1321880560 after retry RPC after error@1176935076) -> (continuation of Deferred@1468695081 after retry RPC after error@1039150260) -> (continuation of Deferred@569996593 after retry RPC after error@1408772112) -> (continuation of Deferred@1356886924 after retry RPC after error@1825140904), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1315880248 after retry RPC after error@1866426802) -> (continuation of Deferred@952374160 after retry RPC after error@1424325152) -> (continuation of Deferred@1876531961 after retry RPC after error@2067733577) -> (continuation of Deferred@1677707309 after retry RPC after error@473205256) -> (continuation of Deferred@1067042085 after retry RPC after error@1011305419) -> (continuation of Deferred@560222926 after retry RPC after error@423159840) -> (continuation of Deferred@1752803023 after retry RPC after error@1852219672) -> (continuation of Deferred@1830255672 after retry RPC after error@858845266) -> (continuation of Deferred@383416101 after retry RPC after error@1307540103) -> (continuation of Deferred@458176958 after retry RPC after error@801761509) -> (continuation of Deferred@1785712998 after retry RPC after error@1549972974) -> (continuation of Deferred@1048765717 after retry RPC after error@1584184544) -> (continuation of Deferred@1243390634 after retry RPC after error@51946434) -> (continuation of Deferred@706434297 after retry RPC after error@288057062) -> (continuation of Deferred@1049464731 after retry RPC after error@2026716475) -> (continuation of Deferred@142676551 after retry RPC after error@1113016807) -> (continuation of Deferred@284485473 after retry RPC after error@29435041) -> (continuation of Deferred@22158836 after retry RPC after error@2041734216) -> (continuation of Deferred@1321880560 after retry RPC after error@1176935076) -> (continuation of Deferred@1468695081 after retry RPC after error@1039150260) -> (continuation of Deferred@569996593 after retry RPC after error@1408772112) -> (continuation of Deferred@1356886924 after retry RPC after error@1825140904)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.11.252:39405
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:41.765 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.765 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.765 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.765 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.765 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.766 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.766 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:31:41.766 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state RUNNING to RESTARTING.
18:31:41.766 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.766 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.766 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.766 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:41.768 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
18:31:41.768 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
18:31:41.768 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
18:31:41.769 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
18:31:41.769 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
18:31:41.769 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
18:31:41.769 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
18:31:41.769 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
18:31:41.771 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:41.771 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:41.772 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.30.195.124:38627(127.30.195.124:38627)] disconnecting while in state TERMINATED
18:31:41.772 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:41.772 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:41.772 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:41.772 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:41.772 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:41.772 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:41.772 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:41.772 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:41.772 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:41.772 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:41.773 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:41.772 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.30.195.125:40423(127.30.195.125:40423)] disconnecting while in state TERMINATED
18:31:41.773 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.30.195.126:33747(127.30.195.126:33747)] disconnecting while in state TERMINATED
18:31:41.773 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)] disconnecting while in state TERMINATED
18:31:41.773 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:41.774 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
18:31:41.774 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
18:31:41.775 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-1
18:31:41.778 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
18:31:41.778 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
18:31:41.778 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
18:31:41.784 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:41.785 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:41.785 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:41.785 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.785 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.785 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.785 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.785 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.785 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.786 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.786 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.786 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.786 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:41.791 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
18:31:41.791 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
18:31:41.791 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
18:31:41.800 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
18:31:41.801 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:31:41.802 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
18:31:41.802 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
18:31:41.805 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
18:31:41.805 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
18:31:41.805 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:41.805 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
18:31:41.805 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:41.805 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:41.806 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.806 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.806 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.806 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.806 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.806 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.806 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.806 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.806 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.806 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:41.810 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.30.195.124:38627(127.30.195.124:38627)] disconnecting while in state TERMINATED
18:31:41.810 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.30.195.125:40423(127.30.195.125:40423)] disconnecting while in state TERMINATED
18:31:41.810 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.30.195.126:33747(127.30.195.126:33747)] disconnecting while in state TERMINATED
18:31:41.810 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 848a93fc4b3244bd88f2910885d4bd9f(127.30.195.66:40191)] disconnecting while in state TERMINATED
18:31:41.810 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:41.811 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
18:31:41.811 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
18:31:41.811 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
18:31:41.824 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.30.195.124:38627(127.30.195.124:38627)] disconnecting while in state TERMINATED
18:31:41.824 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)] disconnecting while in state TERMINATED
18:31:41.824 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.30.195.125:40423(127.30.195.125:40423)] disconnecting while in state TERMINATED
18:31:41.824 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.30.195.126:33747(127.30.195.126:33747)] disconnecting while in state TERMINATED
18:31:41.824 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:41.825 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:41.825 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:31:41.825 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:41.825 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:41.826 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
18:31:41.826 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
18:31:41.826 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.826 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.826 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.827 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.827 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.827 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.826 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.827 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.827 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.827 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:41.835 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
18:31:41.835 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
18:31:41.835 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
18:31:41.844 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.30.195.124:38627(127.30.195.124:38627)] disconnecting while in state TERMINATED
18:31:41.844 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 8aca7da9f7ca4619ad516415905960e6(127.30.195.65:33277)] disconnecting while in state TERMINATED
18:31:41.844 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.30.195.125:40423(127.30.195.125:40423)] disconnecting while in state TERMINATED
18:31:41.844 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.30.195.126:33747(127.30.195.126:33747)] disconnecting while in state TERMINATED
18:31:41.844 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:41.845 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:41.845 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
18:31:41.845 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:31:41.845 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:41.846 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
18:31:41.846 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:41.846 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.847 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.847 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.847 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.847 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.848 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.848 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.848 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.848 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.848 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:41.860 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:31:41.861 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:31:41.863 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
18:31:41.863 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
18:31:41.871 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:41.872 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:41.872 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:41.872 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:41.872 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:41.872 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:41.873 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:41.873 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:41.873 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:41.873 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:41.873 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:41.873 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:41.873 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:41.874 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:41.880 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
18:31:41.880 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
18:31:41.881 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
18:31:41.882 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
18:31:41.883 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:31:41.884 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:31:41.895 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
18:31:41.896 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:31:41.896 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
18:31:41.896 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
18:31:41.896 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-1
18:31:41.897 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
18:31:41.897 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:31:41.897 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
18:31:41.897 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
18:31:41.898 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
18:31:41.898 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
18:31:41.898 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:31:41.898 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
18:31:41.899 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job f6e63683f34d031c5da392b08baea20c
18:31:41.904 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:41.905 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:41.905 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:41.905 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.905 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.905 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.906 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.906 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.906 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.906 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.906 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.906 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.907 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:41.985 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:41.985 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:41.985 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:41.986 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.987 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.987 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.987 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:41.988 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.988 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.988 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:41.988 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.988 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:41.988 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:42.012 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:42.012 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:42.012 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:42.013 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:42.013 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:42.013 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:42.015 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:42.015 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:42.015 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:42.016 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:42.016 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:42.016 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:42.016 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:42.044 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:42.045 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:42.045 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:42.046 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:42.046 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:42.046 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:42.046 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:42.046 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:42.046 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:42.046 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:42.046 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:42.047 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:42.047 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:42.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.133940  1594 catalog_manager.cc:1294] Loaded cluster ID: ec6a0dd7a3dd4011a86ffbbf8784e850
18:31:42.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.139374  1594 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8: loading cluster ID for follower catalog manager: success
18:31:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.292882  1594 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8: acquiring CA information for follower catalog manager: success
18:31:42.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.350988  1594 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 7e1f8b75f6834d51a5bcc7ec7f4d6ed8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:31:42.351 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:42.352 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:42.352 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:42.352 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:42.353 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:42.353 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:42.353 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:42.353 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:42.353 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:42.353 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:42.353 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:42.353 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:42.353 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:42.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:42.424 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:42.424 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:42.425 [DEBUG - pool-54-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:42.425 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:42.425 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:42.425 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:42.426 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:42.426 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:42.426 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:42.426 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:42.426 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:42.426 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:42.426 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:42.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:41.031504  1564 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 1559
18:31:42.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:39.619395  1566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:42.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:42.639518  1564 kernel_stack_watchdog.cc:198] Thread 1559 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 413ms:
18:31:42.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:31:42.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:31:42.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:31:42.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:31:42.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:42.640196  1559 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 3.024s	user 0.824s	sys 1.308s
18:31:42.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:42.640614  1559 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 3.025s	user 0.824s	sys 1.308s
18:31:42.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.655453  1559 server_base.cc:1061] running on GCE node
18:31:42.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:42.659374  1619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:42.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.663316  1559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:31:42.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.687865  1559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:31:42.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.704522  1559 hybrid_clock.cc:648] HybridClock initialized: now 1783535502704407 us; error 100 us; skew 500 ppm
18:31:42.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.705780  1559 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:31:42.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.743670  1559 webserver.cc:534] Webserver started at http://127.1.59.129:34005/ using document root <none> and password file <none>
18:31:42.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.745175  1559 fs_manager.cc:362] Metadata directory not provided
18:31:42.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.745621  1559 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:31:42.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.746268  1559 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:31:42.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.768920  1559 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/data/instance:
18:31:42.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5a4601fd26394edfbfbe4479bc35fd3f"
18:31:42.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:42 on dist-test-slave-dxnw"
18:31:42.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.770685  1559 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/wal/instance:
18:31:42.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5a4601fd26394edfbfbe4479bc35fd3f"
18:31:42.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:42 on dist-test-slave-dxnw"
18:31:42.813 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state RESTARTING to RUNNING.
18:31:42.813 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job f6e63683f34d031c5da392b08baea20c from Checkpoint 74 @ 1783535501335 for f6e63683f34d031c5da392b08baea20c located at file:/tmp/junit4154231101817438778/checkpoints/f6e63683f34d031c5da392b08baea20c/chk-74.
18:31:42.814 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
18:31:42.814 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:31:42.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.817510  1559 fs_manager.cc:696] Time spent creating directory manager: real 0.035s	user 0.007s	sys 0.003s
18:31:42.821 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
18:31:42.822 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
18:31:42.822 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 13a0441c1420d35b57a28ebd584f9846
18:31:42.822 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
18:31:42.823 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
18:31:42.823 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:391) Activate slot 13a0441c1420d35b57a28ebd584f9846.
18:31:42.823 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id e5ed6e64fe4e0a504f52a2cb8573a359
18:31:42.823 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
18:31:42.824 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
18:31:42.824 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8c518d750e8767059e15b0e0577096dd
18:31:42.824 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
18:31:42.825 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 13a0441c1420d35b57a28ebd584f9846.
18:31:42.825 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
18:31:42.825 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8ff5a8fd5a1d7f8775f563b9a37bf60a
18:31:42.825 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:31:42.825 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:31:42.826 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:31:42.826 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:31:42.826 [INFO - Thread-20] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:31:42.826 [DEBUG - Thread-20] (Connection.java:575) [peer master-127.30.11.253:35677(127.30.11.253:35677)] disconnecting while in state TERMINATED
18:31:42.827 [DEBUG - Thread-20] (Connection.java:575) [peer master-127.30.11.252:39405(127.30.11.252:39405)] disconnecting while in state TERMINATED
18:31:42.827 [DEBUG - Thread-20] (Connection.java:575) [peer master-127.30.11.254:41811(127.30.11.254:41811)] disconnecting while in state TERMINATED
18:31:42.827 [DEBUG - Thread-20] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:42.828 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:31:42.828 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
18:31:42.828 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
18:31:42.829 [INFO - Thread-20] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:31:42.829 [INFO - Thread-20] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:31:42.831 [DEBUG - Thread-20] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:42.835 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:391) Activate slot e5ed6e64fe4e0a504f52a2cb8573a359.
18:31:42.836 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id e5ed6e64fe4e0a504f52a2cb8573a359.
18:31:42.837 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
18:31:42.837 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
18:31:42.840 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@386738ce
18:31:42.840 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:42.843 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:31:42.843 [INFO - Thread-20] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:31:42.843 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
18:31:42.843 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
18:31:42.846 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3bc95052
18:31:42.847 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:391) Activate slot 8c518d750e8767059e15b0e0577096dd.
18:31:42.848 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 8c518d750e8767059e15b0e0577096dd.
18:31:42.849 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
18:31:42.849 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
18:31:42.850 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@cf0f3fa
18:31:42.850 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:42.850 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:31:42.850 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
18:31:42.850 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
18:31:42.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.854620  1626 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:31:42.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.863917  1559 fs_manager.cc:730] Time spent opening block manager: real 0.037s	user 0.001s	sys 0.002s
18:31:42.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.864454  1559 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/wal
18:31:42.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5a4601fd26394edfbfbe4479bc35fd3f"
18:31:42.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:42 on dist-test-slave-dxnw"
18:31:42.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:42.864925  1559 fs_report.cc:389] FS layout report
18:31:42.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:31:42.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/wal
18:31:42.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/wal
18:31:42.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/data/data
18:31:42.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:31:42.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:31:42.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:31:42.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:31:42.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:31:42.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:31:42.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:31:42.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:31:42.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:31:42.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:31:42.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:31:42.867 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:31:42.868 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:31:42.868 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:31:42.868 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:31:42.869 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@159b9ae5
18:31:42.871 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:42.872 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:42.879 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:391) Activate slot 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:31:42.880 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:31:42.881 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
18:31:42.881 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
18:31:42.881 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2f9da350
18:31:42.881 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:42.882 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:31:42.882 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
18:31:42.882 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
18:31:42.884 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@70175161
18:31:42.887 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:42.888 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:42.891 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:42.910 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
18:31:42.911 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
18:31:42.919 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@f07d125
18:31:42.919 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:42.920 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:31:42.920 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
18:31:42.921 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
18:31:42.929 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:42.932 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6f5f929f
18:31:42.939 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:42.940 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:42.941 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:42.941 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:42.941 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:42.952 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:42.952 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:42.953 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:42.955 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:42.956 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:42.957 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:42.960 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:42.961 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:42.961 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:42.963 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:42.978 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:42.978 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:42.979 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:42.979 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:42.979 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:42.979 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:42.979 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:42.980 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:42.980 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:42.980 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:42.980 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:42.980 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:42.980 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:42.980 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:42.980 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:42.980 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:42.980 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:42.991 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:42.992 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:42.992 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:42.992 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.000 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:43.003 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.003 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.003 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.009 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.010 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.010 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.010 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:43.021 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.022 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.023 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.023 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.027 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.027 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.027 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.027 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.032 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.032 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:43.042 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.043 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.043 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.043 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.048 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.057 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.057 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.057 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.057 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.059 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.060 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.061 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.061 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.061 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.071 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:43.072 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.072 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.072 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.072 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:43.073 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.073 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.073 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.083 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.083 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.083 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.083 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:43.091 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.092 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:43.093 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.093 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.094 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.130 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.135 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.135 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.135 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.149 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:43.149569  1559 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:31:43.150 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.150 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.150 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.150 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.151 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.151 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.151 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:43.151970  1559 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:31:43.152 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.153 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.153 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.153 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.159 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:43.152644  1559 kserver.cc:163] Server-wide thread pool size limit: 3276
18:31:43.162 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.162 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.162 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.162 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.163 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.163 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.163 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.163 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.168 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.168 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.170 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.171 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.171 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.171 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.173 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.173 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.173 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.173 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:43.182 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.183 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.183 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.183 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:43.184108  1559 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:31:43.188 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.188 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.188 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.188 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.191 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.191 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.191 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.191 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.191 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.199 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.199 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.200 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.200 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.200 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.200 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.200 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.200 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.200 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.200 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.200 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.200 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.200 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.201 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.202 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.203 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.203 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.206 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.207 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.207 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.208 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.208 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.208 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.208 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.208 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.208 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:43.213073  1559 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:31:43.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:43.213424  1559 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:31:43.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:43.213871  1559 ts_tablet_manager.cc:616] Registered 0 tablets
18:31:43.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:43.214107  1559 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:31:43.215 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.216 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.216 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.211 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.216 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.216 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.216 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.210 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.216 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.216 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.216 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.210 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.209 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:43.209 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.208 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.217 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.217 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.217 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.217 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.220 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.220 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.220 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.221 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.221 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.221 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.221 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.221 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.221 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.221 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.221 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.221 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.221 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.222 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:43.223 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.223 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.223 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.223 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.224 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.228 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.228 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.228 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:43.232 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.232 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.232 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.232 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.232 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.233 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.233 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.233 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.233 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.235 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.235 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.235 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.235 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.251 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.251 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.252 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.252 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.252 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.252 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.252 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.252 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:43.252 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.252 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.252 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:43.252 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.252 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.252 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.252 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.252 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:43.253 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.253 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.253 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.254 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.254 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.254 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.254 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.254 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.254 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.254 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:43.255 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.255 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.255 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.255 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.260 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.260 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.260 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.261 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.261 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.261 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.261 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.261 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.261 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.262 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.262 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.262 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.262 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.265 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.265 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.265 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.265 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.267 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.268 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.268 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.268 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.268 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.272 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:43.272 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:43.272 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:43.272 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.272 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.272 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.273 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.273 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.273 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.273 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.273 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.273 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.273 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:43.280 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.280 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.280 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.280 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.281 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.281 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.281 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.281 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.281 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.281 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.281 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.281 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.281 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.281 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.281 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.281 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.281 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.281 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.281 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.282 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.282 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.282 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.283 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.283 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.283 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.284 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.284 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.284 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.284 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.288 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.288 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.288 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.288 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.288 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.288 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.289 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.289 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.284 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.289 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.289 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.289 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.289 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.289 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.289 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.289 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.289 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.291 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.292 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.292 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.293 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.293 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.293 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.293 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.293 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.293 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.293 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.294 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.294 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.294 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.308 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.308 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.308 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.308 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.308 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.308 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.309 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.309 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.309 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.309 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.309 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.309 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.309 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.309 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.309 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.309 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.309 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.309 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.310 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.310 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.310 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.310 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.310 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.310 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.310 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.310 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.311 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:43.312 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:43.312 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:43.312 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.312 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.313 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.313 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.313 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.313 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.313 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.313 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.314 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.314 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:43.328 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.328 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.328 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.328 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.328 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.328 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.329 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.329 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.329 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.329 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.329 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.329 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.329 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.348 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.348 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.348 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.349 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.349 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.349 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.349 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.349 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.349 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.350 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.350 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.350 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.350 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.352 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.352 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.352 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.352 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.352 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.353 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.353 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.353 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.353 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.353 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.353 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.353 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.353 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.360 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.360 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.360 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.361 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.361 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.361 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.361 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.361 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.361 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.361 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.361 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.361 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.361 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.368 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.368 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.368 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.368 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.368 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.369 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.369 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.369 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.369 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.369 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.370 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.370 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.370 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.370 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.370 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.370 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.370 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.370 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.370 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.371 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.371 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.371 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.371 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.371 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.371 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.371 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.371 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.372 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.372 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:43.372 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.372 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:43.372 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:43.372 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:43.373 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.373 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.373 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.373 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.373 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.373 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.374 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.374 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.374 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.374 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.374 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.374 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.374 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.375 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.375 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.375 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.375 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.375 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.375 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.375 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:43.428 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.428 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.429 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.429 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.429 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.429 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.430 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.430 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.430 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.430 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.430 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.430 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.430 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.448 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.448 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.448 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.449 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.449 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.449 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.449 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.449 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.449 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.450 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.450 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.450 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.450 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.471 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:43.472 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:43.472 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:43.472 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.473 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.473 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.473 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.473 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.473 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.474 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.474 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.474 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.474 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:43.480 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.480 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.480 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.481 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.481 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.481 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.481 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.481 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.481 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.482 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.482 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.482 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.482 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.528 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.528 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.529 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.529 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.529 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.529 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.530 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.530 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.530 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.530 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.530 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.530 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.530 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.531 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.532 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.532 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.532 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.532 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.532 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.533 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.533 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.533 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.533 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.533 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.533 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.533 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.548 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.548 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.548 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.548 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.549 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.549 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.549 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.549 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.549 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.549 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.549 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.549 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.549 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.572 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.572 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.572 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.573 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.573 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.573 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.574 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.574 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.574 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.574 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.574 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.574 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.574 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.588 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.588 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.588 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.589 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.589 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.589 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.589 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.589 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.589 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.590 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.590 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.590 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.590 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.599 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.599 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.600 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.600 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.600 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.600 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.600 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.601 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.601 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.601 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.601 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.601 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.601 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.652 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:43.653 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:43.653 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:43.653 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.653 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.654 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.654 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.654 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.654 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.654 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.654 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.654 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.654 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:43.683 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:43.688 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:43.689 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:43.689 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:43.690 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:43.690 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:43.690 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:43.690 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:43.690 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:43.691 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:43.691 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:43.691 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:43.691 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:43.691 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:43.691 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:43.691 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:43.691 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:43.692 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.692 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.692 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:43.692 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.692 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.692 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:43.693 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.693 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.693 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:43.693 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:43.809 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:43.809 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:43.809 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:43.810 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.810 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.810 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:43.810 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.810 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.810 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:43.811 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.811 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.811 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:43.811 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:43.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:44.028 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:44.028 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:44.029 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:44.029 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.029 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.029 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.030 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.030 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.030 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.030 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.030 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.030 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.031 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:44.136 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:44.136 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:44.136 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:44.137 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.137 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.137 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.138 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.138 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.138 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.138 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.138 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.138 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.138 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:44.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:44.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.263880  1799 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.59.129:44129 every 8 connection(s)
18:31:44.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.273059  1559 rpc_server.cc:307] RPC server started. Bound to: 127.1.59.129:44129
18:31:44.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.284381  1559 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/data/info.pb
18:31:44.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.285126  1262 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 1559
18:31:44.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.285823  1262 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-0/wal/instance
18:31:44.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.309700  1262 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:44.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:44.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/wal
18:31:44.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/data
18:31:44.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:31:44.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/logs
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/data/info.pb
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.59.130:0
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.59.130
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.59.130
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.59.148:39341
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:44.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:31:44.332 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:44.332 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:44.332 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:44.333 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:44.333 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:44.333 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:44.333 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:44.333 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:44.333 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:44.334 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:44.334 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:44.334 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:44.334 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:44.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.369947  1800 heartbeater.cc:344] Connected to a master server at 127.1.59.188:33901
18:31:44.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.370491  1800 heartbeater.cc:461] Registering TS with master...
18:31:44.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:44.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.371846  1800 heartbeater.cc:507] Master 127.1.59.188:33901 requested a full tablet report, sending...
18:31:44.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.375372  1474 ts_manager.cc:194] Registered new tserver with Master: 5a4601fd26394edfbfbe4479bc35fd3f (127.1.59.129:44129)
18:31:44.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.378119  1474 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.59.129:53103
18:31:44.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.387686  1803 heartbeater.cc:344] Connected to a master server at 127.1.59.189:42073
18:31:44.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.388046  1803 heartbeater.cc:461] Registering TS with master...
18:31:44.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.388685  1803 heartbeater.cc:507] Master 127.1.59.189:42073 requested a full tablet report, sending...
18:31:44.391 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:44.391 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:44.392 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:44.392 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.392 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.392 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.392 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.391777  1391 ts_manager.cc:194] Registered new tserver with Master: 5a4601fd26394edfbfbe4479bc35fd3f (127.1.59.129:44129)
18:31:44.392 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.392 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.393 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.393 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.393 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.393 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:44.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.396086  1806 heartbeater.cc:344] Connected to a master server at 127.1.59.190:46863
18:31:44.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.396446  1806 heartbeater.cc:461] Registering TS with master...
18:31:44.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.397090  1806 heartbeater.cc:507] Master 127.1.59.190:46863 requested a full tablet report, sending...
18:31:44.401 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:44.401 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:44.401 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:44.401 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.402 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.400161  1309 ts_manager.cc:194] Registered new tserver with Master: 5a4601fd26394edfbfbe4479bc35fd3f (127.1.59.129:44129)
18:31:44.402 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.402 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.402 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.402 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.402 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.404 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.404 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.404 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:44.437 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:44.438 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:44.438 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:44.438 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.438 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.439 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.439 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.439 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.439 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.439 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.439 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.440 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.440 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:44.472 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:44.473 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:44.473 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:44.474 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.474 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.474 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.474 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.474 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.475 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.475 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.475 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.475 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.475 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:44.551 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:44.552 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:44.552 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:44.552 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.553 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.553 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.553 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.553 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.553 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.554 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.554 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.554 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.554 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:44.579 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:44.580 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:44.580 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:44.580 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.580 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.581 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.581 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.581 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.581 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.581 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.581 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.581 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.582 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:44.608 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:44.608 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:44.609 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:44.610 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.610 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.610 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.610 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.611 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.611 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.611 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.611 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.611 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.612 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:44.668 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:44.669 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:44.669 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:44.669 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.669 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.670 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.670 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.670 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.670 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.670 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.671 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.671 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.671 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:44.683 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:44.687 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:44.687 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:44.688 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:44.688 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.688 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.688 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.688 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.688 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.688 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.688 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.688 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.689 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.689 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:44.729 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:44.729 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:44.729 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:44.730 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.730 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.730 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.739 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:44.740 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:44.740 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:44.740 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:44.740 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:44.740 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:44.741 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:44.741 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:44.741 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:44.741 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:44.741 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:44.741 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:44.741 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:44.739 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.742 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.742 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.738 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.742 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.742 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.743 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:44.812 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:44.812 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:44.812 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:44.813 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.813 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.813 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:44.814 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.814 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.814 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:44.814 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.814 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.814 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:44.814 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:44.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:44.848608  1807 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:31:44.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:44.849236  1807 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:31:44.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:44.849777  1807 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:31:44.870 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:44.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:44.887217  1807 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:31:44.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:44.888299  1807 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.59.130
18:31:44.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:44.891935  1340 debug-util.cc:398] Leaking SignalData structure 0x7b0800082ba0 after lost signal to thread 1276
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.966449  1807 tablet_server_runner.cc:78] Tablet server non-default flags:
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.59.148:39341
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/data
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/wal
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.59.130:0
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/data/info.pb
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.59.130
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.59.130
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/logs
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:31:44.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:31:44.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.968374  1807 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:31:44.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:44.970806  1807 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:31:44.983 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:44.983 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:44.984 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:44.984 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.984 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.984 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:44.984 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.984 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.984 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:44.985 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.985 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.985 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:44.985 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:45.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:45.014061  1818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:45.048 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:45.048 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:45.049 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:45.049 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:45.049 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:45.049 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:45.049 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:45.049 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:45.049 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:45.050 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:45.050 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:45.050 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:45.050 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:45.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:45.312 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:45.313 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:45.313 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:45.314 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:45.314 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:45.314 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:45.315 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:45.315 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:45.315 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:45.316 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:45.316 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:45.316 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:45.316 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:45.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:45.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:45.383186  1800 heartbeater.cc:499] Master 127.1.59.188:33901 was elected leader, sending a full tablet report...
18:31:45.597 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:45.598 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:45.598 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:45.599 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:45.599 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:45.599 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:45.600 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:45.600 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:45.600 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:45.601 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:45.601 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:45.601 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:45.602 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:45.684 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:45.691 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:45.692 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:45.692 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:45.693 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:45.693 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:45.693 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:45.694 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:45.694 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:45.694 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:45.695 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:45.695 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:45.695 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:45.695 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:45.878 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:46.132 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:46.132 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:46.132 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:46.132 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:46.132 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:46.133 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:46.133 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:46.133 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:46.133 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:46.133 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:46.133 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:46.133 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:46.133 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:46.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:46.228 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:46.229 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:46.229 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:46.230 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:46.230 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:46.230 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:46.231 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:46.231 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:46.231 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:46.232 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:46.232 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:46.232 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:46.232 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:46.372 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:46.548 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:46.549 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:46.549 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:46.549 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:46.549 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:46.549 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:46.549 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:46.549 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:46.549 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:46.549 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:46.549 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:46.550 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:46.550 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:46.596 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:46.597 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:46.597 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:46.600 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:46.600 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:46.600 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:46.600 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:46.600 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:46.600 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:46.601 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:46.601 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:46.601 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:46.602 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:46.602 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:46.602 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:46.602 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:46.602 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:46.603 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:46.603 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:46.603 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:46.603 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:46.603 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:46.603 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:46.603 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:46.603 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:46.603 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:46.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:46.872 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:46.952 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:46.952 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:46.952 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:46.952 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:46.953 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:46.953 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:46.953 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:46.953 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:46.953 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:46.953 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:46.953 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:46.953 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:46.953 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:47.039 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:47.040 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:47.040 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:47.040 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:47.041 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:47.041 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:47.041 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:47.041 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:47.041 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:47.042 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:47.042 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:47.042 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:47.042 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:47.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:46.399906  1817 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 1807
18:31:47.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:47.042177  1817 kernel_stack_watchdog.cc:198] Thread 1807 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 374ms:
18:31:47.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:31:47.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:31:47.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:31:47.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:31:47.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:45.022495  1819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:47.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:47.043869  1807 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.026s	user 0.441s	sys 0.962s
18:31:47.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:47.044292  1807 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.026s	user 0.441s	sys 0.962s
18:31:47.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:47.057634  1826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:47.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.060777  1807 server_base.cc:1061] running on GCE node
18:31:47.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.062273  1807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:31:47.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.081928  1807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:31:47.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.085795  1807 hybrid_clock.cc:648] HybridClock initialized: now 1783535507085733 us; error 69 us; skew 500 ppm
18:31:47.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.087074  1807 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:31:47.091 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:47.091 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:47.092 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:47.092 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:47.092 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:47.092 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:47.093 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:47.093 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:47.093 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:47.093 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:47.093 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:47.093 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:47.093 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:47.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.112166  1807 webserver.cc:534] Webserver started at http://127.1.59.130:36727/ using document root <none> and password file <none>
18:31:47.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.113891  1807 fs_manager.cc:362] Metadata directory not provided
18:31:47.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.114161  1807 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:31:47.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.114845  1807 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:31:47.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.122812  1807 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/data/instance:
18:31:47.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7acd6e8275eb45be929bf583441c7eee"
18:31:47.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:47 on dist-test-slave-dxnw"
18:31:47.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.124421  1807 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/wal/instance:
18:31:47.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7acd6e8275eb45be929bf583441c7eee"
18:31:47.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:47 on dist-test-slave-dxnw"
18:31:47.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.133845  1807 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.005s	sys 0.003s
18:31:47.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.145427  1831 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:31:47.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.147205  1807 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.004s	sys 0.000s
18:31:47.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.147624  1807 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/wal
18:31:47.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7acd6e8275eb45be929bf583441c7eee"
18:31:47.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:47 on dist-test-slave-dxnw"
18:31:47.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.148082  1807 fs_report.cc:389] FS layout report
18:31:47.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:31:47.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/wal
18:31:47.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/wal
18:31:47.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/data/data
18:31:47.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:31:47.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:31:47.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:31:47.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:31:47.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:31:47.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:31:47.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:31:47.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:31:47.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:31:47.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:31:47.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:31:47.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:47.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.236779  1807 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:31:47.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.238935  1807 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:31:47.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.239539  1807 kserver.cc:163] Server-wide thread pool size limit: 3276
18:31:47.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.253335  1807 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:31:47.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.260609  1807 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:31:47.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.260972  1807 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:31:47.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.261332  1807 ts_tablet_manager.cc:616] Registered 0 tablets
18:31:47.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.261582  1807 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:31:47.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:47.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.484592  1807 rpc_server.cc:307] RPC server started. Bound to: 127.1.59.130:36365
18:31:47.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.484766  1944 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.59.130:36365 every 8 connection(s)
18:31:47.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.487265  1807 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/data/info.pb
18:31:47.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.490688  1262 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 1807
18:31:47.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.491235  1262 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-1/wal/instance
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.519860  1262 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/wal
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/data
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/logs
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/data/info.pb
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:31:47.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:31:47.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.59.131:0
18:31:47.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.59.131
18:31:47.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.59.131
18:31:47.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:47.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901
18:31:47.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.59.148:39341
18:31:47.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:47.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:47.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:31:47.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.542678  1946 heartbeater.cc:344] Connected to a master server at 127.1.59.189:42073
18:31:47.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.543249  1946 heartbeater.cc:461] Registering TS with master...
18:31:47.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.544649  1946 heartbeater.cc:507] Master 127.1.59.189:42073 requested a full tablet report, sending...
18:31:47.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.550259  1391 ts_manager.cc:194] Registered new tserver with Master: 7acd6e8275eb45be929bf583441c7eee (127.1.59.130:36365)
18:31:47.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.552433  1945 heartbeater.cc:344] Connected to a master server at 127.1.59.188:33901
18:31:47.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.552749  1945 heartbeater.cc:461] Registering TS with master...
18:31:47.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.553686  1945 heartbeater.cc:507] Master 127.1.59.188:33901 requested a full tablet report, sending...
18:31:47.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.555922  1474 ts_manager.cc:194] Registered new tserver with Master: 7acd6e8275eb45be929bf583441c7eee (127.1.59.130:36365)
18:31:47.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.556587  1951 heartbeater.cc:344] Connected to a master server at 127.1.59.190:46863
18:31:47.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.556924  1951 heartbeater.cc:461] Registering TS with master...
18:31:47.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.557832  1951 heartbeater.cc:507] Master 127.1.59.190:46863 requested a full tablet report, sending...
18:31:47.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.557775  1474 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.59.130:50121
18:31:47.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:47.560549  1309 ts_manager.cc:194] Registered new tserver with Master: 7acd6e8275eb45be929bf583441c7eee (127.1.59.130:36365)
18:31:47.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:47.839 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:47.840 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:47.840 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:47.847 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:47.847 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:47.847 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:47.848 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:47.848 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:47.848 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:47.848 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:47.848 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:47.848 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:47.848 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:47.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:47.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:47.941452  1955 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:31:47.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:47.941900  1955 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:31:47.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:47.942322  1955 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:31:47.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:47.982219  1955 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:31:47.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:47.983165  1955 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.59.131
18:31:48.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:48.026432  1955 tablet_server_runner.cc:78] Tablet server non-default flags:
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.59.148:39341
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/data
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/wal
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.59.131:0
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/data/info.pb
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.59.131
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.59.131
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/logs
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:31:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:31:48.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:48.027961  1955 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:31:48.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:48.029759  1955 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:31:48.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:48.044162  1962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:48.148 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:48.149 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:48.149 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:48.149 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:48.149 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:48.150 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:48.150 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:48.150 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:48.150 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:48.150 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:48.151 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:48.151 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:48.151 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:48.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:48.188 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:48.188 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:48.188 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:48.188 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.188 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.188 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.189 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.189 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.189 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.189 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.189 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.189 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.189 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:48.228 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:48.228 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:48.228 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:48.229 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:48.229 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:48.229 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:48.229 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:48.229 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:48.229 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:48.229 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:48.230 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:48.230 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:48.230 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:48.244 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:48.244 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:48.244 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:48.244 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.244 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.244 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.244 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.245 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.245 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.245 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.245 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.245 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.248 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:48.268 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:48.268 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:48.268 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:48.268 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.269 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.269 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.269 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.269 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.269 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.270 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.270 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.270 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.270 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:48.371 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:48.372 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:48.372 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:48.372 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:48.373 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:48.373 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:48.373 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:48.373 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:48.373 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:48.373 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:48.374 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:48.374 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:48.374 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:48.374 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:48.532 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:48.532 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:48.532 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:48.533 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:48.533 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:48.533 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:48.534 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:48.534 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:48.534 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:48.534 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:48.534 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:48.534 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:48.534 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:48.538 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:48.538 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:48.538 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:48.539 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.539 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.539 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.539 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.540 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.540 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.540 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.540 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.540 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.540 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:48.541 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29189), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [36ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [50ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [87ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [88ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [108ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [109ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [110ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [111ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [121ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [124ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [143ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [144ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [144ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [204ms] refreshing cache from master, [204ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [205ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [206ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [206ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [206ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [244ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [244ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [263ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [400ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [404ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [404ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [643ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [643ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [644ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [644ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1220ms] refreshing cache from master, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1223ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1223ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2900ms] refreshing cache from master, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2902ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2903ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2903ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2904ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [6461ms] refreshing cache from master, [6461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [6461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [6462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [6462ms] too many traces: truncated at 100 traces, deferred=Deferred@1026804908(state=PENDING, result=null, callback=(continuation of Deferred@1137935471 after retry RPC after error@1019640898) -> (continuation of Deferred@269504714 after retry RPC after error@862304456) -> (continuation of Deferred@1816830519 after retry RPC after error@1675749264) -> (continuation of Deferred@1902472486 after retry RPC after error@1868048442) -> (continuation of Deferred@1446667516 after retry RPC after error@973853900) -> (continuation of Deferred@1625133814 after retry RPC after error@1315602223) -> (continuation of Deferred@1274216346 after retry RPC after error@800845724) -> (continuation of Deferred@595432127 after retry RPC after error@1047724792) -> (continuation of Deferred@1654731907 after retry RPC after error@303493188) -> (continuation of Deferred@1563521235 after retry RPC after error@2071186767) -> (continuation of Deferred@270400398 after retry RPC after error@892120345) -> (continuation of Deferred@1674441863 after retry RPC after error@112284676) -> (continuation of Deferred@2031034071 after retry RPC after error@689647754) -> (continuation of Deferred@629051618 after retry RPC after error@702804285) -> (continuation of Deferred@672906096 after retry RPC after error@1484018073) -> (continuation of Deferred@157033461 after retry RPC after error@1065370106) -> (continuation of Deferred@1245035841 after retry RPC after error@808965383) -> (continuation of Deferred@1478232959 after retry RPC after error@1705905687) -> (continuation of Deferred@43415638 after retry RPC after error@201788142) -> (continuation of Deferred@880328674 after retry RPC after error@557044172) -> (continuation of Deferred@282483060 after retry RPC after error@615674362) -> (continuation of Deferred@1438932257 after retry RPC after error@1782991844) -> (continuation of Deferred@1224323617 after retry RPC after error@2138253157) -> (continuation of Deferred@145309951 after retry RPC after error@1349006181) -> (continuation of Deferred@1434844147 after retry RPC after error@866891305) -> (continuation of Deferred@1900520987 after retry RPC after error@1613054029), errback=(continuation of Deferred@1137935471 after retry RPC after error@1019640898) -> (continuation of Deferred@269504714 after retry RPC after error@862304456) -> (continuation of Deferred@1816830519 after retry RPC after error@1675749264) -> (continuation of Deferred@1902472486 after retry RPC after error@1868048442) -> (continuation of Deferred@1446667516 after retry RPC after error@973853900) -> (continuation of Deferred@1625133814 after retry RPC after error@1315602223) -> (continuation of Deferred@1274216346 after retry RPC after error@800845724) -> (continuation of Deferred@595432127 after retry RPC after error@1047724792) -> (continuation of Deferred@1654731907 after retry RPC after error@303493188) -> (continuation of Deferred@1563521235 after retry RPC after error@2071186767) -> (continuation of Deferred@270400398 after retry RPC after error@892120345) -> (continuation of Deferred@1674441863 after retry RPC after error@112284676) -> (continuation of Deferred@2031034071 after retry RPC after error@689647754) -> (continuation of Deferred@629051618 after retry RPC after error@702804285) -> (continuation of Deferred@672906096 after retry RPC after error@1484018073) -> (continuation of Deferred@157033461 after retry RPC after error@1065370106) -> (continuation of Deferred@1245035841 after retry RPC after error@808965383) -> (continuation of Deferred@1478232959 after retry RPC after error@1705905687) -> (continuation of Deferred@43415638 after retry RPC after error@201788142) -> (continuation of Deferred@880328674 after retry RPC after error@557044172) -> (continuation of Deferred@282483060 after retry RPC after error@615674362) -> (continuation of Deferred@1438932257 after retry RPC after error@1782991844) -> (continuation of Deferred@1224323617 after retry RPC after error@2138253157) -> (continuation of Deferred@145309951 after retry RPC after error@1349006181) -> (continuation of Deferred@1434844147 after retry RPC after error@866891305) -> (continuation of Deferred@1900520987 after retry RPC after error@1613054029)))
18:31:48.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:48.561690  1945 heartbeater.cc:499] Master 127.1.59.188:33901 was elected leader, sending a full tablet report...
18:31:48.595 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:48.596 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:48.596 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:48.597 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.597 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.597 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.598 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.598 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.598 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.598 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.598 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.598 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.598 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:48.599 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29274), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [54ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [79ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [79ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [103ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [108ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [114ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [114ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [123ms] refreshing cache from master, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [138ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [139ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [139ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [205ms] refreshing cache from master, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [206ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [206ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [207ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [210ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [211ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [211ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [241ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [242ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [266ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [266ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [343ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [343ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [343ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [443ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [444ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [445ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [445ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [663ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [664ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [664ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [665ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1183ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1420ms] refreshing cache from master, [1420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1423ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1423ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1424ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3260ms] refreshing cache from master, [3260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3265ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3266ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3267ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3267ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [4141ms] refreshing cache from master, [4141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [4141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [4143ms] too many traces: truncated at 100 traces, deferred=Deferred@671424733(state=PENDING, result=null, callback=(continuation of Deferred@1367283881 after retry RPC after error@588268609) -> (continuation of Deferred@317306123 after retry RPC after error@334199875) -> (continuation of Deferred@980980935 after retry RPC after error@468446597) -> (continuation of Deferred@1156928030 after retry RPC after error@213133223) -> (continuation of Deferred@1922319450 after retry RPC after error@920062024) -> (continuation of Deferred@1490868526 after retry RPC after error@1970820237) -> (continuation of Deferred@622749932 after retry RPC after error@730181967) -> (continuation of Deferred@363727032 after retry RPC after error@575007420) -> (continuation of Deferred@1959444240 after retry RPC after error@1925408527) -> (continuation of Deferred@390945319 after retry RPC after error@441471608) -> (continuation of Deferred@1002654749 after retry RPC after error@1389473653) -> (continuation of Deferred@800082794 after retry RPC after error@929767286) -> (continuation of Deferred@384376354 after retry RPC after error@1226617229) -> (continuation of Deferred@1683638495 after retry RPC after error@195390349) -> (continuation of Deferred@1440967893 after retry RPC after error@2044673853) -> (continuation of Deferred@1341496425 after retry RPC after error@1873571609) -> (continuation of Deferred@568800253 after retry RPC after error@557958699) -> (continuation of Deferred@1119097022 after retry RPC after error@1324116822) -> (continuation of Deferred@1452069293 after retry RPC after error@2035492297) -> (continuation of Deferred@461437885 after retry RPC after error@916161856) -> (continuation of Deferred@103431047 after retry RPC after error@1723284454) -> (continuation of Deferred@2054584734 after retry RPC after error@271405589), errback=(continuation of Deferred@1367283881 after retry RPC after error@588268609) -> (continuation of Deferred@317306123 after retry RPC after error@334199875) -> (continuation of Deferred@980980935 after retry RPC after error@468446597) -> (continuation of Deferred@1156928030 after retry RPC after error@213133223) -> (continuation of Deferred@1922319450 after retry RPC after error@920062024) -> (continuation of Deferred@1490868526 after retry RPC after error@1970820237) -> (continuation of Deferred@622749932 after retry RPC after error@730181967) -> (continuation of Deferred@363727032 after retry RPC after error@575007420) -> (continuation of Deferred@1959444240 after retry RPC after error@1925408527) -> (continuation of Deferred@390945319 after retry RPC after error@441471608) -> (continuation of Deferred@1002654749 after retry RPC after error@1389473653) -> (continuation of Deferred@800082794 after retry RPC after error@929767286) -> (continuation of Deferred@384376354 after retry RPC after error@1226617229) -> (continuation of Deferred@1683638495 after retry RPC after error@195390349) -> (continuation of Deferred@1440967893 after retry RPC after error@2044673853) -> (continuation of Deferred@1341496425 after retry RPC after error@1873571609) -> (continuation of Deferred@568800253 after retry RPC after error@557958699) -> (continuation of Deferred@1119097022 after retry RPC after error@1324116822) -> (continuation of Deferred@1452069293 after retry RPC after error@2035492297) -> (continuation of Deferred@461437885 after retry RPC after error@916161856) -> (continuation of Deferred@103431047 after retry RPC after error@1723284454) -> (continuation of Deferred@2054584734 after retry RPC after error@271405589)))
18:31:48.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:48.731 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:48.732 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:48.732 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:48.733 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.733 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.733 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.733 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.733 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.733 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.734 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.734 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.734 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.734 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:48.735 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29400), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [16ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [22ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [50ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [85ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [90ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [96ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [96ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [104ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [105ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [105ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [128ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [208ms] refreshing cache from master, [208ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [209ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [210ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [210ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [211ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [241ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [242ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [363ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [363ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [863ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1840ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1843ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2960ms] refreshing cache from master, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2962ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2963ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2964ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2964ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3280ms] refreshing cache from master, [3280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3282ms] too many traces: truncated at 100 traces, deferred=Deferred@911078469(state=PENDING, result=null, callback=(continuation of Deferred@820038141 after retry RPC after error@1050953178) -> (continuation of Deferred@1105108178 after retry RPC after error@409511792) -> (continuation of Deferred@779168417 after retry RPC after error@854007840) -> (continuation of Deferred@124388002 after retry RPC after error@1516533272) -> (continuation of Deferred@2103933911 after retry RPC after error@1980412539) -> (continuation of Deferred@555925770 after retry RPC after error@1485813632) -> (continuation of Deferred@510711429 after retry RPC after error@1028273754) -> (continuation of Deferred@181897832 after retry RPC after error@792796933) -> (continuation of Deferred@933044374 after retry RPC after error@1527331033) -> (continuation of Deferred@1841003802 after retry RPC after error@1244003999) -> (continuation of Deferred@342032093 after retry RPC after error@113234808) -> (continuation of Deferred@811220248 after retry RPC after error@1441721482) -> (continuation of Deferred@1459184892 after retry RPC after error@782584136) -> (continuation of Deferred@1341526905 after retry RPC after error@1834888369) -> (continuation of Deferred@1889368930 after retry RPC after error@1962316592) -> (continuation of Deferred@191118092 after retry RPC after error@398697845) -> (continuation of Deferred@203332228 after retry RPC after error@1278338852) -> (continuation of Deferred@1722223093 after retry RPC after error@1824907353) -> (continuation of Deferred@351768063 after retry RPC after error@1463566466) -> (continuation of Deferred@160043825 after retry RPC after error@1250880881) -> (continuation of Deferred@1656621482 after retry RPC after error@1471380783) -> (continuation of Deferred@242872179 after retry RPC after error@866217640) -> (continuation of Deferred@557892143 after retry RPC after error@1834391853) -> (continuation of Deferred@748020099 after retry RPC after error@343477911) -> (continuation of Deferred@856684429 after retry RPC after error@1783205680) -> (continuation of Deferred@1775493635 after retry RPC after error@897733656) -> (continuation of Deferred@2046656186 after retry RPC after error@1609260730), errback=(continuation of Deferred@820038141 after retry RPC after error@1050953178) -> (continuation of Deferred@1105108178 after retry RPC after error@409511792) -> (continuation of Deferred@779168417 after retry RPC after error@854007840) -> (continuation of Deferred@124388002 after retry RPC after error@1516533272) -> (continuation of Deferred@2103933911 after retry RPC after error@1980412539) -> (continuation of Deferred@555925770 after retry RPC after error@1485813632) -> (continuation of Deferred@510711429 after retry RPC after error@1028273754) -> (continuation of Deferred@181897832 after retry RPC after error@792796933) -> (continuation of Deferred@933044374 after retry RPC after error@1527331033) -> (continuation of Deferred@1841003802 after retry RPC after error@1244003999) -> (continuation of Deferred@342032093 after retry RPC after error@113234808) -> (continuation of Deferred@811220248 after retry RPC after error@1441721482) -> (continuation of Deferred@1459184892 after retry RPC after error@782584136) -> (continuation of Deferred@1341526905 after retry RPC after error@1834888369) -> (continuation of Deferred@1889368930 after retry RPC after error@1962316592) -> (continuation of Deferred@191118092 after retry RPC after error@398697845) -> (continuation of Deferred@203332228 after retry RPC after error@1278338852) -> (continuation of Deferred@1722223093 after retry RPC after error@1824907353) -> (continuation of Deferred@351768063 after retry RPC after error@1463566466) -> (continuation of Deferred@160043825 after retry RPC after error@1250880881) -> (continuation of Deferred@1656621482 after retry RPC after error@1471380783) -> (continuation of Deferred@242872179 after retry RPC after error@866217640) -> (continuation of Deferred@557892143 after retry RPC after error@1834391853) -> (continuation of Deferred@748020099 after retry RPC after error@343477911) -> (continuation of Deferred@856684429 after retry RPC after error@1783205680) -> (continuation of Deferred@1775493635 after retry RPC after error@897733656) -> (continuation of Deferred@2046656186 after retry RPC after error@1609260730)))
18:31:48.772 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:48.772 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:48.772 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:48.773 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.773 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.774 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:48.775 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.775 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.775 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:48.775 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.776 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.776 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:48.776 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:48.871 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:49.008 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:49.009 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:49.009 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:49.009 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:49.009 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:49.009 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:49.010 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:49.010 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:49.010 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:49.010 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:49.010 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:49.010 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:49.010 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:49.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:49.188 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:49.188 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:49.189 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:49.189 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:49.189 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:49.190 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:49.190 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:49.190 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:49.190 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:49.191 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:49.191 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:49.191 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:49.191 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:49.292 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:49.292 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:49.292 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:49.292 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:49.292 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:49.293 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:49.293 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:49.293 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:49.293 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:49.293 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:49.293 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:49.293 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:49.293 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:49.327 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:49.328 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:49.328 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:49.329 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:49.329 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:49.329 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:49.330 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:49.330 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:49.330 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:49.330 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:49.330 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:49.330 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:49.330 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:49.332 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:49.332 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:49.332 [DEBUG - pool-116-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:49.332 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:49.332 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:49.332 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:49.332 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:49.332 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:49.332 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:49.332 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:49.333 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:49.333 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:49.333 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:49.334 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=30, TimeoutTracker(timeout=30000, elapsed=27670), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [118ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [119ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [282ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [288ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [288ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [409ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [409ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [410ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [414ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [415ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [415ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [423ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [443ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [443ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [483ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [483ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [542ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [602ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [602ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [602ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [603ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [661ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [662ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [982ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [982ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [982ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [982ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1140ms] refreshing cache from master, [1140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1143ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1143ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2760ms] refreshing cache from master, [2760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2762ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3401ms] refreshing cache from master, [3401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3402ms] too many traces: truncated at 100 traces, deferred=Deferred@154978386(state=PENDING, result=null, callback=(continuation of Deferred@825746175 after retry RPC after error@1098974803) -> (continuation of Deferred@1010389315 after retry RPC after error@1395155150) -> (continuation of Deferred@1569079374 after retry RPC after error@352085555) -> (continuation of Deferred@1647939238 after retry RPC after error@1921494079) -> (continuation of Deferred@493622801 after retry RPC after error@1792419441) -> (continuation of Deferred@1152702771 after retry RPC after error@186475470) -> (continuation of Deferred@1992040482 after retry RPC after error@763520298) -> (continuation of Deferred@1327320296 after retry RPC after error@805197270) -> (continuation of Deferred@953470267 after retry RPC after error@113333310) -> (continuation of Deferred@589181442 after retry RPC after error@2115208018) -> (continuation of Deferred@1613767870 after retry RPC after error@1826421794) -> (continuation of Deferred@1048599961 after retry RPC after error@1550536712) -> (continuation of Deferred@1025481455 after retry RPC after error@917064834) -> (continuation of Deferred@175743835 after retry RPC after error@211048716) -> (continuation of Deferred@1302164115 after retry RPC after error@833420030) -> (continuation of Deferred@1980294379 after retry RPC after error@1492819743) -> (continuation of Deferred@2127918969 after retry RPC after error@687343959) -> (continuation of Deferred@426155807 after retry RPC after error@367585611) -> (continuation of Deferred@1079196208 after retry RPC after error@671687132) -> (continuation of Deferred@87743909 after retry RPC after error@1472913144) -> (continuation of Deferred@236059787 after retry RPC after error@1870080852) -> (continuation of Deferred@1022563562 after retry RPC after error@1028595858) -> (continuation of Deferred@1018918420 after retry RPC after error@1791022940) -> (continuation of Deferred@1320209066 after retry RPC after error@180303966) -> (continuation of Deferred@1834214603 after retry RPC after error@21345290) -> (continuation of Deferred@1231608594 after retry RPC after error@988178345) -> (continuation of Deferred@1222752642 after retry RPC after error@1688772976) -> (continuation of Deferred@1796691644 after retry RPC after error@1648734040) -> (continuation of Deferred@665663291 after retry RPC after error@103788959), errback=(continuation of Deferred@825746175 after retry RPC after error@1098974803) -> (continuation of Deferred@1010389315 after retry RPC after error@1395155150) -> (continuation of Deferred@1569079374 after retry RPC after error@352085555) -> (continuation of Deferred@1647939238 after retry RPC after error@1921494079) -> (continuation of Deferred@493622801 after retry RPC after error@1792419441) -> (continuation of Deferred@1152702771 after retry RPC after error@186475470) -> (continuation of Deferred@1992040482 after retry RPC after error@763520298) -> (continuation of Deferred@1327320296 after retry RPC after error@805197270) -> (continuation of Deferred@953470267 after retry RPC after error@113333310) -> (continuation of Deferred@589181442 after retry RPC after error@2115208018) -> (continuation of Deferred@1613767870 after retry RPC after error@1826421794) -> (continuation of Deferred@1048599961 after retry RPC after error@1550536712) -> (continuation of Deferred@1025481455 after retry RPC after error@917064834) -> (continuation of Deferred@175743835 after retry RPC after error@211048716) -> (continuation of Deferred@1302164115 after retry RPC after error@833420030) -> (continuation of Deferred@1980294379 after retry RPC after error@1492819743) -> (continuation of Deferred@2127918969 after retry RPC after error@687343959) -> (continuation of Deferred@426155807 after retry RPC after error@367585611) -> (continuation of Deferred@1079196208 after retry RPC after error@671687132) -> (continuation of Deferred@87743909 after retry RPC after error@1472913144) -> (continuation of Deferred@236059787 after retry RPC after error@1870080852) -> (continuation of Deferred@1022563562 after retry RPC after error@1028595858) -> (continuation of Deferred@1018918420 after retry RPC after error@1791022940) -> (continuation of Deferred@1320209066 after retry RPC after error@180303966) -> (continuation of Deferred@1834214603 after retry RPC after error@21345290) -> (continuation of Deferred@1231608594 after retry RPC after error@988178345) -> (continuation of Deferred@1222752642 after retry RPC after error@1688772976) -> (continuation of Deferred@1796691644 after retry RPC after error@1648734040) -> (continuation of Deferred@665663291 after retry RPC after error@103788959)))
18:31:49.335 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
18:31:49.336 [WARN - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=30, TimeoutTracker(timeout=30000, elapsed=27670), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [118ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [119ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [282ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [288ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [288ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [409ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [409ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [410ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [414ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [415ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [415ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [423ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [443ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [443ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [483ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [483ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [542ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [602ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [602ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [602ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [603ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [661ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [662ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [982ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [982ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [982ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [982ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1140ms] refreshing cache from master, [1140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1143ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1143ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2760ms] refreshing cache from master, [2760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2762ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3401ms] refreshing cache from master, [3401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3402ms] too many traces: truncated at 100 traces, deferred=Deferred@154978386(state=PENDING, result=null, callback=(continuation of Deferred@825746175 after retry RPC after error@1098974803) -> (continuation of Deferred@1010389315 after retry RPC after error@1395155150) -> (continuation of Deferred@1569079374 after retry RPC after error@352085555) -> (continuation of Deferred@1647939238 after retry RPC after error@1921494079) -> (continuation of Deferred@493622801 after retry RPC after error@1792419441) -> (continuation of Deferred@1152702771 after retry RPC after error@186475470) -> (continuation of Deferred@1992040482 after retry RPC after error@763520298) -> (continuation of Deferred@1327320296 after retry RPC after error@805197270) -> (continuation of Deferred@953470267 after retry RPC after error@113333310) -> (continuation of Deferred@589181442 after retry RPC after error@2115208018) -> (continuation of Deferred@1613767870 after retry RPC after error@1826421794) -> (continuation of Deferred@1048599961 after retry RPC after error@1550536712) -> (continuation of Deferred@1025481455 after retry RPC after error@917064834) -> (continuation of Deferred@175743835 after retry RPC after error@211048716) -> (continuation of Deferred@1302164115 after retry RPC after error@833420030) -> (continuation of Deferred@1980294379 after retry RPC after error@1492819743) -> (continuation of Deferred@2127918969 after retry RPC after error@687343959) -> (continuation of Deferred@426155807 after retry RPC after error@367585611) -> (continuation of Deferred@1079196208 after retry RPC after error@671687132) -> (continuation of Deferred@87743909 after retry RPC after error@1472913144) -> (continuation of Deferred@236059787 after retry RPC after error@1870080852) -> (continuation of Deferred@1022563562 after retry RPC after error@1028595858) -> (continuation of Deferred@1018918420 after retry RPC after error@1791022940) -> (continuation of Deferred@1320209066 after retry RPC after error@180303966) -> (continuation of Deferred@1834214603 after retry RPC after error@21345290) -> (continuation of Deferred@1231608594 after retry RPC after error@988178345) -> (continuation of Deferred@1222752642 after retry RPC after error@1688772976) -> (continuation of Deferred@1796691644 after retry RPC after error@1648734040) -> (continuation of Deferred@665663291 after retry RPC after error@103788959), errback=(continuation of Deferred@825746175 after retry RPC after error@1098974803) -> (continuation of Deferred@1010389315 after retry RPC after error@1395155150) -> (continuation of Deferred@1569079374 after retry RPC after error@352085555) -> (continuation of Deferred@1647939238 after retry RPC after error@1921494079) -> (continuation of Deferred@493622801 after retry RPC after error@1792419441) -> (continuation of Deferred@1152702771 after retry RPC after error@186475470) -> (continuation of Deferred@1992040482 after retry RPC after error@763520298) -> (continuation of Deferred@1327320296 after retry RPC after error@805197270) -> (continuation of Deferred@953470267 after retry RPC after error@113333310) -> (continuation of Deferred@589181442 after retry RPC after error@2115208018) -> (continuation of Deferred@1613767870 after retry RPC after error@1826421794) -> (continuation of Deferred@1048599961 after retry RPC after error@1550536712) -> (continuation of Deferred@1025481455 after retry RPC after error@917064834) -> (continuation of Deferred@175743835 after retry RPC after error@211048716) -> (continuation of Deferred@1302164115 after retry RPC after error@833420030) -> (continuation of Deferred@1980294379 after retry RPC after error@1492819743) -> (continuation of Deferred@2127918969 after retry RPC after error@687343959) -> (continuation of Deferred@426155807 after retry RPC after error@367585611) -> (continuation of Deferred@1079196208 after retry RPC after error@671687132) -> (continuation of Deferred@87743909 after retry RPC after error@1472913144) -> (continuation of Deferred@236059787 after retry RPC after error@1870080852) -> (continuation of Deferred@1022563562 after retry RPC after error@1028595858) -> (continuation of Deferred@1018918420 after retry RPC after error@1791022940) -> (continuation of Deferred@1320209066 after retry RPC after error@180303966) -> (continuation of Deferred@1834214603 after retry RPC after error@21345290) -> (continuation of Deferred@1231608594 after retry RPC after error@988178345) -> (continuation of Deferred@1222752642 after retry RPC after error@1688772976) -> (continuation of Deferred@1796691644 after retry RPC after error@1648734040) -> (continuation of Deferred@665663291 after retry RPC after error@103788959)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:49.336 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
18:31:49.340 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#3 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
18:31:49.343 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=30, TimeoutTracker(timeout=30000, elapsed=27670), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [118ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [119ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [282ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [288ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [288ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [409ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [409ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [410ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [414ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [415ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [415ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [423ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [443ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [443ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [483ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [483ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [542ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [602ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [602ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [602ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [603ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [661ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [662ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [982ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [982ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [982ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [982ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1140ms] refreshing cache from master, [1140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1143ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1143ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2760ms] refreshing cache from master, [2760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2762ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3401ms] refreshing cache from master, [3401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3402ms] too many traces: truncated at 100 traces, deferred=Deferred@154978386(state=PENDING, result=null, callback=(continuation of Deferred@825746175 after retry RPC after error@1098974803) -> (continuation of Deferred@1010389315 after retry RPC after error@1395155150) -> (continuation of Deferred@1569079374 after retry RPC after error@352085555) -> (continuation of Deferred@1647939238 after retry RPC after error@1921494079) -> (continuation of Deferred@493622801 after retry RPC after error@1792419441) -> (continuation of Deferred@1152702771 after retry RPC after error@186475470) -> (continuation of Deferred@1992040482 after retry RPC after error@763520298) -> (continuation of Deferred@1327320296 after retry RPC after error@805197270) -> (continuation of Deferred@953470267 after retry RPC after error@113333310) -> (continuation of Deferred@589181442 after retry RPC after error@2115208018) -> (continuation of Deferred@1613767870 after retry RPC after error@1826421794) -> (continuation of Deferred@1048599961 after retry RPC after error@1550536712) -> (continuation of Deferred@1025481455 after retry RPC after error@917064834) -> (continuation of Deferred@175743835 after retry RPC after error@211048716) -> (continuation of Deferred@1302164115 after retry RPC after error@833420030) -> (continuation of Deferred@1980294379 after retry RPC after error@1492819743) -> (continuation of Deferred@2127918969 after retry RPC after error@687343959) -> (continuation of Deferred@426155807 after retry RPC after error@367585611) -> (continuation of Deferred@1079196208 after retry RPC after error@671687132) -> (continuation of Deferred@87743909 after retry RPC after error@1472913144) -> (continuation of Deferred@236059787 after retry RPC after error@1870080852) -> (continuation of Deferred@1022563562 after retry RPC after error@1028595858) -> (continuation of Deferred@1018918420 after retry RPC after error@1791022940) -> (continuation of Deferred@1320209066 after retry RPC after error@180303966) -> (continuation of Deferred@1834214603 after retry RPC after error@21345290) -> (continuation of Deferred@1231608594 after retry RPC after error@988178345) -> (continuation of Deferred@1222752642 after retry RPC after error@1688772976) -> (continuation of Deferred@1796691644 after retry RPC after error@1648734040) -> (continuation of Deferred@665663291 after retry RPC after error@103788959), errback=(continuation of Deferred@825746175 after retry RPC after error@1098974803) -> (continuation of Deferred@1010389315 after retry RPC after error@1395155150) -> (continuation of Deferred@1569079374 after retry RPC after error@352085555) -> (continuation of Deferred@1647939238 after retry RPC after error@1921494079) -> (continuation of Deferred@493622801 after retry RPC after error@1792419441) -> (continuation of Deferred@1152702771 after retry RPC after error@186475470) -> (continuation of Deferred@1992040482 after retry RPC after error@763520298) -> (continuation of Deferred@1327320296 after retry RPC after error@805197270) -> (continuation of Deferred@953470267 after retry RPC after error@113333310) -> (continuation of Deferred@589181442 after retry RPC after error@2115208018) -> (continuation of Deferred@1613767870 after retry RPC after error@1826421794) -> (continuation of Deferred@1048599961 after retry RPC after error@1550536712) -> (continuation of Deferred@1025481455 after retry RPC after error@917064834) -> (continuation of Deferred@175743835 after retry RPC after error@211048716) -> (continuation of Deferred@1302164115 after retry RPC after error@833420030) -> (continuation of Deferred@1980294379 after retry RPC after error@1492819743) -> (continuation of Deferred@2127918969 after retry RPC after error@687343959) -> (continuation of Deferred@426155807 after retry RPC after error@367585611) -> (continuation of Deferred@1079196208 after retry RPC after error@671687132) -> (continuation of Deferred@87743909 after retry RPC after error@1472913144) -> (continuation of Deferred@236059787 after retry RPC after error@1870080852) -> (continuation of Deferred@1022563562 after retry RPC after error@1028595858) -> (continuation of Deferred@1018918420 after retry RPC after error@1791022940) -> (continuation of Deferred@1320209066 after retry RPC after error@180303966) -> (continuation of Deferred@1834214603 after retry RPC after error@21345290) -> (continuation of Deferred@1231608594 after retry RPC after error@988178345) -> (continuation of Deferred@1222752642 after retry RPC after error@1688772976) -> (continuation of Deferred@1796691644 after retry RPC after error@1648734040) -> (continuation of Deferred@665663291 after retry RPC after error@103788959)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:49.345 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
18:31:49.345 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RUNNING to RESTARTING.
18:31:49.346 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:31:49.346 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#3) of source Source: KuduSource.
18:31:49.412 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:49.412 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:49.412 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:49.413 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:49.413 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:49.413 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:49.413 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:49.413 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:49.413 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:49.413 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:49.413 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:49.413 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:49.413 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:49.491 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:49.492 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:49.492 [DEBUG - pool-114-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:49.493 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:49.493 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:49.493 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:49.493 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:49.494 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:49.494 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:49.494 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:49.494 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:49.494 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:49.494 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:49.495 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27853), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [78ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [155ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [162ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [246ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [247ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [248ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [249ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [252ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [252ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [464ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [465ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [466ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [466ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [481ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [500ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [502ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [544ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [544ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [544ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [581ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [581ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [581ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [582ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [660ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [663ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [781ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [782ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [782ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [782ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [922ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [922ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [923ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [923ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1761ms] refreshing cache from master, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1763ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1880ms] refreshing cache from master, [1880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1881ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1882ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1882ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1882ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3720ms] refreshing cache from master, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3722ms] too many traces: truncated at 100 traces, deferred=Deferred@1872061673(state=PENDING, result=null, callback=(continuation of Deferred@1951114290 after retry RPC after error@1966241994) -> (continuation of Deferred@459562060 after retry RPC after error@1595068901) -> (continuation of Deferred@1985053697 after retry RPC after error@281237033) -> (continuation of Deferred@704441921 after retry RPC after error@1621663586) -> (continuation of Deferred@438529786 after retry RPC after error@274403721) -> (continuation of Deferred@1587243813 after retry RPC after error@2062330907) -> (continuation of Deferred@2067355906 after retry RPC after error@866572469) -> (continuation of Deferred@912351143 after retry RPC after error@695378180) -> (continuation of Deferred@405933153 after retry RPC after error@492051618) -> (continuation of Deferred@569697480 after retry RPC after error@498211699) -> (continuation of Deferred@359353760 after retry RPC after error@677896867) -> (continuation of Deferred@775131587 after retry RPC after error@601321205) -> (continuation of Deferred@1813913954 after retry RPC after error@2071704760) -> (continuation of Deferred@1240768413 after retry RPC after error@1372381328) -> (continuation of Deferred@1287966458 after retry RPC after error@1782345134) -> (continuation of Deferred@123281155 after retry RPC after error@833074968) -> (continuation of Deferred@1534991560 after retry RPC after error@1386634004) -> (continuation of Deferred@499705668 after retry RPC after error@299601042) -> (continuation of Deferred@988301885 after retry RPC after error@1517738127) -> (continuation of Deferred@14607938 after retry RPC after error@1303135703) -> (continuation of Deferred@904742909 after retry RPC after error@1504924527) -> (continuation of Deferred@782783213 after retry RPC after error@25503762) -> (continuation of Deferred@1577600368 after retry RPC after error@493051381), errback=(continuation of Deferred@1951114290 after retry RPC after error@1966241994) -> (continuation of Deferred@459562060 after retry RPC after error@1595068901) -> (continuation of Deferred@1985053697 after retry RPC after error@281237033) -> (continuation of Deferred@704441921 after retry RPC after error@1621663586) -> (continuation of Deferred@438529786 after retry RPC after error@274403721) -> (continuation of Deferred@1587243813 after retry RPC after error@2062330907) -> (continuation of Deferred@2067355906 after retry RPC after error@866572469) -> (continuation of Deferred@912351143 after retry RPC after error@695378180) -> (continuation of Deferred@405933153 after retry RPC after error@492051618) -> (continuation of Deferred@569697480 after retry RPC after error@498211699) -> (continuation of Deferred@359353760 after retry RPC after error@677896867) -> (continuation of Deferred@775131587 after retry RPC after error@601321205) -> (continuation of Deferred@1813913954 after retry RPC after error@2071704760) -> (continuation of Deferred@1240768413 after retry RPC after error@1372381328) -> (continuation of Deferred@1287966458 after retry RPC after error@1782345134) -> (continuation of Deferred@123281155 after retry RPC after error@833074968) -> (continuation of Deferred@1534991560 after retry RPC after error@1386634004) -> (continuation of Deferred@499705668 after retry RPC after error@299601042) -> (continuation of Deferred@988301885 after retry RPC after error@1517738127) -> (continuation of Deferred@14607938 after retry RPC after error@1303135703) -> (continuation of Deferred@904742909 after retry RPC after error@1504924527) -> (continuation of Deferred@782783213 after retry RPC after error@25503762) -> (continuation of Deferred@1577600368 after retry RPC after error@493051381)))
18:31:49.496 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:31:49.496 [WARN - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27853), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [78ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [155ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [162ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [246ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [247ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [248ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [249ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [252ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [252ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [464ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [465ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [466ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [466ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [481ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [500ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [502ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [544ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [544ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [544ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [581ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [581ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [581ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [582ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [660ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [663ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [781ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [782ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [782ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [782ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [922ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [922ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [923ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [923ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1761ms] refreshing cache from master, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1763ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1880ms] refreshing cache from master, [1880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1881ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1882ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1882ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1882ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3720ms] refreshing cache from master, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3722ms] too many traces: truncated at 100 traces, deferred=Deferred@1872061673(state=PENDING, result=null, callback=(continuation of Deferred@1951114290 after retry RPC after error@1966241994) -> (continuation of Deferred@459562060 after retry RPC after error@1595068901) -> (continuation of Deferred@1985053697 after retry RPC after error@281237033) -> (continuation of Deferred@704441921 after retry RPC after error@1621663586) -> (continuation of Deferred@438529786 after retry RPC after error@274403721) -> (continuation of Deferred@1587243813 after retry RPC after error@2062330907) -> (continuation of Deferred@2067355906 after retry RPC after error@866572469) -> (continuation of Deferred@912351143 after retry RPC after error@695378180) -> (continuation of Deferred@405933153 after retry RPC after error@492051618) -> (continuation of Deferred@569697480 after retry RPC after error@498211699) -> (continuation of Deferred@359353760 after retry RPC after error@677896867) -> (continuation of Deferred@775131587 after retry RPC after error@601321205) -> (continuation of Deferred@1813913954 after retry RPC after error@2071704760) -> (continuation of Deferred@1240768413 after retry RPC after error@1372381328) -> (continuation of Deferred@1287966458 after retry RPC after error@1782345134) -> (continuation of Deferred@123281155 after retry RPC after error@833074968) -> (continuation of Deferred@1534991560 after retry RPC after error@1386634004) -> (continuation of Deferred@499705668 after retry RPC after error@299601042) -> (continuation of Deferred@988301885 after retry RPC after error@1517738127) -> (continuation of Deferred@14607938 after retry RPC after error@1303135703) -> (continuation of Deferred@904742909 after retry RPC after error@1504924527) -> (continuation of Deferred@782783213 after retry RPC after error@25503762) -> (continuation of Deferred@1577600368 after retry RPC after error@493051381), errback=(continuation of Deferred@1951114290 after retry RPC after error@1966241994) -> (continuation of Deferred@459562060 after retry RPC after error@1595068901) -> (continuation of Deferred@1985053697 after retry RPC after error@281237033) -> (continuation of Deferred@704441921 after retry RPC after error@1621663586) -> (continuation of Deferred@438529786 after retry RPC after error@274403721) -> (continuation of Deferred@1587243813 after retry RPC after error@2062330907) -> (continuation of Deferred@2067355906 after retry RPC after error@866572469) -> (continuation of Deferred@912351143 after retry RPC after error@695378180) -> (continuation of Deferred@405933153 after retry RPC after error@492051618) -> (continuation of Deferred@569697480 after retry RPC after error@498211699) -> (continuation of Deferred@359353760 after retry RPC after error@677896867) -> (continuation of Deferred@775131587 after retry RPC after error@601321205) -> (continuation of Deferred@1813913954 after retry RPC after error@2071704760) -> (continuation of Deferred@1240768413 after retry RPC after error@1372381328) -> (continuation of Deferred@1287966458 after retry RPC after error@1782345134) -> (continuation of Deferred@123281155 after retry RPC after error@833074968) -> (continuation of Deferred@1534991560 after retry RPC after error@1386634004) -> (continuation of Deferred@499705668 after retry RPC after error@299601042) -> (continuation of Deferred@988301885 after retry RPC after error@1517738127) -> (continuation of Deferred@14607938 after retry RPC after error@1303135703) -> (continuation of Deferred@904742909 after retry RPC after error@1504924527) -> (continuation of Deferred@782783213 after retry RPC after error@25503762) -> (continuation of Deferred@1577600368 after retry RPC after error@493051381)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:49.497 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
18:31:49.498 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
18:31:49.500 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27853), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [78ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [155ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [162ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [246ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [247ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [248ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [249ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [252ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [252ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [464ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [465ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [466ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [466ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [481ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [500ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [502ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [544ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [544ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [544ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [581ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [581ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [581ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [582ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [660ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [663ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [781ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [782ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [782ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [782ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [922ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [922ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [923ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [923ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1761ms] refreshing cache from master, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1763ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1880ms] refreshing cache from master, [1880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1881ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1882ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1882ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1882ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3720ms] refreshing cache from master, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3722ms] too many traces: truncated at 100 traces, deferred=Deferred@1872061673(state=PENDING, result=null, callback=(continuation of Deferred@1951114290 after retry RPC after error@1966241994) -> (continuation of Deferred@459562060 after retry RPC after error@1595068901) -> (continuation of Deferred@1985053697 after retry RPC after error@281237033) -> (continuation of Deferred@704441921 after retry RPC after error@1621663586) -> (continuation of Deferred@438529786 after retry RPC after error@274403721) -> (continuation of Deferred@1587243813 after retry RPC after error@2062330907) -> (continuation of Deferred@2067355906 after retry RPC after error@866572469) -> (continuation of Deferred@912351143 after retry RPC after error@695378180) -> (continuation of Deferred@405933153 after retry RPC after error@492051618) -> (continuation of Deferred@569697480 after retry RPC after error@498211699) -> (continuation of Deferred@359353760 after retry RPC after error@677896867) -> (continuation of Deferred@775131587 after retry RPC after error@601321205) -> (continuation of Deferred@1813913954 after retry RPC after error@2071704760) -> (continuation of Deferred@1240768413 after retry RPC after error@1372381328) -> (continuation of Deferred@1287966458 after retry RPC after error@1782345134) -> (continuation of Deferred@123281155 after retry RPC after error@833074968) -> (continuation of Deferred@1534991560 after retry RPC after error@1386634004) -> (continuation of Deferred@499705668 after retry RPC after error@299601042) -> (continuation of Deferred@988301885 after retry RPC after error@1517738127) -> (continuation of Deferred@14607938 after retry RPC after error@1303135703) -> (continuation of Deferred@904742909 after retry RPC after error@1504924527) -> (continuation of Deferred@782783213 after retry RPC after error@25503762) -> (continuation of Deferred@1577600368 after retry RPC after error@493051381), errback=(continuation of Deferred@1951114290 after retry RPC after error@1966241994) -> (continuation of Deferred@459562060 after retry RPC after error@1595068901) -> (continuation of Deferred@1985053697 after retry RPC after error@281237033) -> (continuation of Deferred@704441921 after retry RPC after error@1621663586) -> (continuation of Deferred@438529786 after retry RPC after error@274403721) -> (continuation of Deferred@1587243813 after retry RPC after error@2062330907) -> (continuation of Deferred@2067355906 after retry RPC after error@866572469) -> (continuation of Deferred@912351143 after retry RPC after error@695378180) -> (continuation of Deferred@405933153 after retry RPC after error@492051618) -> (continuation of Deferred@569697480 after retry RPC after error@498211699) -> (continuation of Deferred@359353760 after retry RPC after error@677896867) -> (continuation of Deferred@775131587 after retry RPC after error@601321205) -> (continuation of Deferred@1813913954 after retry RPC after error@2071704760) -> (continuation of Deferred@1240768413 after retry RPC after error@1372381328) -> (continuation of Deferred@1287966458 after retry RPC after error@1782345134) -> (continuation of Deferred@123281155 after retry RPC after error@833074968) -> (continuation of Deferred@1534991560 after retry RPC after error@1386634004) -> (continuation of Deferred@499705668 after retry RPC after error@299601042) -> (continuation of Deferred@988301885 after retry RPC after error@1517738127) -> (continuation of Deferred@14607938 after retry RPC after error@1303135703) -> (continuation of Deferred@904742909 after retry RPC after error@1504924527) -> (continuation of Deferred@782783213 after retry RPC after error@25503762) -> (continuation of Deferred@1577600368 after retry RPC after error@493051381)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:49.501 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:31:49.504 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
18:31:49.504 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
18:31:49.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:49.446699  1961 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 1955
18:31:49.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:48.045190  1963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:49.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:49.594229  1955 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.551s	user 0.518s	sys 0.997s
18:31:49.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:49.595105  1955 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.552s	user 0.519s	sys 0.997s
18:31:49.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.606510  1955 server_base.cc:1061] running on GCE node
18:31:49.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:49.606468  1969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:31:49.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.607879  1955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:31:49.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.610018  1955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:31:49.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.611349  1955 hybrid_clock.cc:648] HybridClock initialized: now 1783535509611319 us; error 51 us; skew 500 ppm
18:31:49.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.612092  1955 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:31:49.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.618153  1955 webserver.cc:534] Webserver started at http://127.1.59.131:42053/ using document root <none> and password file <none>
18:31:49.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.619077  1955 fs_manager.cc:362] Metadata directory not provided
18:31:49.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.619268  1955 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:31:49.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.619635  1955 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:31:49.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.624114  1955 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/data/instance:
18:31:49.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "34e313c9f2af4b09ac792b1d56430135"
18:31:49.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:49 on dist-test-slave-dxnw"
18:31:49.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.625119  1955 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/wal/instance:
18:31:49.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "34e313c9f2af4b09ac792b1d56430135"
18:31:49.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:49 on dist-test-slave-dxnw"
18:31:49.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.632645  1955 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
18:31:49.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.639780  1974 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:31:49.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.641356  1955 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.000s
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.641669  1955 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/wal
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "34e313c9f2af4b09ac792b1d56430135"
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:31:49 on dist-test-slave-dxnw"
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.642088  1955 fs_report.cc:389] FS layout report
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/wal
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/wal
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/data/data
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:31:49.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:31:49.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.694435  1955 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:31:49.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.696275  1955 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:31:49.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.696808  1955 kserver.cc:163] Server-wide thread pool size limit: 3276
18:31:49.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.699796  1955 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:31:49.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.703979  1955 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:31:49.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.704207  1955 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:31:49.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.704504  1955 ts_tablet_manager.cc:616] Registered 0 tablets
18:31:49.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.704730  1955 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:31:49.746 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:49.746 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:49.746 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:49.747 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:49.747 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:49.747 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:49.747 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:49.747 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:49.747 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:49.747 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:49.747 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:49.747 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:49.747 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:49.871 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:49.872 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:49.872 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:49.872 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:49.872 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:49.872 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:49.873 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:49.873 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:49.874 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:49.874 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:49.874 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:49.874 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:49.874 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:49.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.876003  1955 rpc_server.cc:307] RPC server started. Bound to: 127.1.59.131:46483
18:31:49.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.876134  2087 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.59.131:46483 every 8 connection(s)
18:31:49.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.879433  1955 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/data/info.pb
18:31:49.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.880169  1262 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 1955
18:31:49.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.880579  1262 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster5352149693503476068/ts-2/wal/instance
18:31:49.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.945492  2088 heartbeater.cc:344] Connected to a master server at 127.1.59.188:33901
18:31:49.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.945983  2088 heartbeater.cc:461] Registering TS with master...
18:31:49.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.947732  2092 heartbeater.cc:344] Connected to a master server at 127.1.59.190:46863
18:31:49.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.947747  2088 heartbeater.cc:507] Master 127.1.59.188:33901 requested a full tablet report, sending...
18:31:49.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.948153  2092 heartbeater.cc:461] Registering TS with master...
18:31:49.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.949049  2092 heartbeater.cc:507] Master 127.1.59.190:46863 requested a full tablet report, sending...
18:31:49.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.950619  2089 heartbeater.cc:344] Connected to a master server at 127.1.59.189:42073
18:31:49.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.950680  1474 ts_manager.cc:194] Registered new tserver with Master: 34e313c9f2af4b09ac792b1d56430135 (127.1.59.131:46483)
18:31:49.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.950968  2089 heartbeater.cc:461] Registering TS with master...
18:31:49.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.951814  2089 heartbeater.cc:507] Master 127.1.59.189:42073 requested a full tablet report, sending...
18:31:49.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.951898  1309 ts_manager.cc:194] Registered new tserver with Master: 34e313c9f2af4b09ac792b1d56430135 (127.1.59.131:46483)
18:31:49.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.952317  1474 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.59.131:45459
18:31:49.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.954676  1391 ts_manager.cc:194] Registered new tserver with Master: 34e313c9f2af4b09ac792b1d56430135 (127.1.59.131:46483)
18:31:49.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:49.965724  1262 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
18:31:49.977 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:31:49.977 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

18:31:49.978 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.1.59.190"
      port: 46863
    }
    bound_http_address {
      host: "127.1.59.190"
      port: 32775
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.1.59.189"
      port: 42073
    }
    bound_http_address {
      host: "127.1.59.189"
      port: 35263
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.1.59.188"
      port: 33901
    }
    bound_http_address {
      host: "127.1.59.188"
      port: 33163
    }
  }
}

18:31:49.979 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

18:31:49.980 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.1.59.129"
      port: 44129
    }
    bound_http_address {
      host: "127.1.59.129"
      port: 34005
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.1.59.130"
      port: 36365
    }
    bound_http_address {
      host: "127.1.59.130"
      port: 36727
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.1.59.131"
      port: 46483
    }
    bound_http_address {
      host: "127.1.59.131"
      port: 42053
    }
  }
}

18:31:49.980 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
18:31:49.982 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:49.983 [DEBUG - main] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:31:49.984 [DEBUG - main] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:31:49.985 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.0.106.254:32967(127.0.106.254:32967)] Successfully connected to peer
18:31:49.986 [DEBUG - main] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:31:49.990 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.0.106.253:45189(127.0.106.253:45189)] Successfully connected to peer
18:31:49.990 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.0.106.254
18:31:49.998 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.0.106.252:46705(127.0.106.252:46705)] Successfully connected to peer
18:31:50.002 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.0.106.253
18:31:50.003 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:50.003 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.0.106.252
18:31:50.010 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa32c9b54, L:/127.0.0.1:48538 - R:/127.0.106.254:32967] using SASL/PLAIN
18:31:50.014 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:50.016 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:31:50.016 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=33), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [32ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: OK, deferred=null) after lookup
18:31:50.018 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x95eb4a44, L:/127.0.0.1:35358 - R:/127.0.106.252:46705] using SASL/PLAIN
18:31:50.018 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:50.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.019527   471 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48538:
18:31:50.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
18:31:50.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
18:31:50.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:31:50.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
18:31:50.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:31:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:31:50.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:31:50.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:31:50.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
18:31:50.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
18:31:50.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:31:50.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:31:50.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:50.023281   471 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
18:31:50.030 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xf835347a, L:/127.0.0.1:53358 - R:/127.0.106.253:45189] using SASL/PLAIN
18:31:50.059 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 76bbf70ff510462a93a28833882099ea
18:31:50.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.117075  1044 tablet_service.cc:1511] Processing CreateTablet for tablet 577db455445946b4b3637f89e9e8da72 (DEFAULT_TABLE table=replication_test_table [id=76bbf70ff510462a93a28833882099ea]), partition=
18:31:50.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.119350  1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577db455445946b4b3637f89e9e8da72. 1 dirs total, 0 dirs full, 0 dirs failed
18:31:50.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.124878   901 tablet_service.cc:1511] Processing CreateTablet for tablet 577db455445946b4b3637f89e9e8da72 (DEFAULT_TABLE table=replication_test_table [id=76bbf70ff510462a93a28833882099ea]), partition=
18:31:50.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.126963   901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577db455445946b4b3637f89e9e8da72. 1 dirs total, 0 dirs full, 0 dirs failed
18:31:50.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.126441  1186 tablet_service.cc:1511] Processing CreateTablet for tablet 577db455445946b4b3637f89e9e8da72 (DEFAULT_TABLE table=replication_test_table [id=76bbf70ff510462a93a28833882099ea]), partition=
18:31:50.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.128675  1186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577db455445946b4b3637f89e9e8da72. 1 dirs total, 0 dirs full, 0 dirs failed
18:31:50.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.173331  2122 tablet_bootstrap.cc:492] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd: Bootstrap starting.
18:31:50.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:50.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.183879  2122 tablet_bootstrap.cc:654] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd: Neither blocks nor log segments found. Creating new log.
18:31:50.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.186262  2122 log.cc:826] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd: Log is configured to *not* fsync() on all Append() calls
18:31:50.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.197566  2123 tablet_bootstrap.cc:492] T 577db455445946b4b3637f89e9e8da72 P fa977f48a0f448969dae707cebb47d86: Bootstrap starting.
18:31:50.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.197767  2122 tablet_bootstrap.cc:492] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd: No bootstrap required, opened a new log
18:31:50.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.198343  2122 ts_tablet_manager.cc:1403] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
18:31:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.215620  2123 tablet_bootstrap.cc:654] T 577db455445946b4b3637f89e9e8da72 P fa977f48a0f448969dae707cebb47d86: Neither blocks nor log segments found. Creating new log.
18:31:50.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.218559  2123 log.cc:826] T 577db455445946b4b3637f89e9e8da72 P fa977f48a0f448969dae707cebb47d86: Log is configured to *not* fsync() on all Append() calls
18:31:50.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.224643  2125 tablet_bootstrap.cc:492] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba: Bootstrap starting.
18:31:50.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.239303  2125 tablet_bootstrap.cc:654] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba: Neither blocks nor log segments found. Creating new log.
18:31:50.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.243062  2125 log.cc:826] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba: Log is configured to *not* fsync() on all Append() calls
18:31:50.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.244004  2122 raft_consensus.cc:359] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f21d544834a406f92f688ea6d5a8dba" member_type: VOTER last_known_addr { host: "127.0.106.194" port: 45251 } } peers { permanent_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" member_type: VOTER last_known_addr { host: "127.0.106.195" port: 46809 } } peers { permanent_uuid: "fa977f48a0f448969dae707cebb47d86" member_type: VOTER last_known_addr { host: "127.0.106.193" port: 33681 } }
18:31:50.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.244871  2122 raft_consensus.cc:385] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:50.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.245172  2122 raft_consensus.cc:740] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0865e0f96b7348dfbf4a502a6d8151dd, State: Initialized, Role: FOLLOWER
18:31:50.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.246110  2122 consensus_queue.cc:260] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f21d544834a406f92f688ea6d5a8dba" member_type: VOTER last_known_addr { host: "127.0.106.194" port: 45251 } } peers { permanent_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" member_type: VOTER last_known_addr { host: "127.0.106.195" port: 46809 } } peers { permanent_uuid: "fa977f48a0f448969dae707cebb47d86" member_type: VOTER last_known_addr { host: "127.0.106.193" port: 33681 } }
18:31:50.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.250310  2123 tablet_bootstrap.cc:492] T 577db455445946b4b3637f89e9e8da72 P fa977f48a0f448969dae707cebb47d86: No bootstrap required, opened a new log
18:31:50.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.256712  2123 ts_tablet_manager.cc:1403] T 577db455445946b4b3637f89e9e8da72 P fa977f48a0f448969dae707cebb47d86: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.011s
18:31:50.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.261798  2122 ts_tablet_manager.cc:1434] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd: Time spent starting tablet: real 0.063s	user 0.036s	sys 0.007s
18:31:50.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.287119  2125 tablet_bootstrap.cc:492] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba: No bootstrap required, opened a new log
18:31:50.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.287652  2125 ts_tablet_manager.cc:1403] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.016s
18:31:50.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.318401  2123 raft_consensus.cc:359] T 577db455445946b4b3637f89e9e8da72 P fa977f48a0f448969dae707cebb47d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f21d544834a406f92f688ea6d5a8dba" member_type: VOTER last_known_addr { host: "127.0.106.194" port: 45251 } } peers { permanent_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" member_type: VOTER last_known_addr { host: "127.0.106.195" port: 46809 } } peers { permanent_uuid: "fa977f48a0f448969dae707cebb47d86" member_type: VOTER last_known_addr { host: "127.0.106.193" port: 33681 } }
18:31:50.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.319621  2123 raft_consensus.cc:385] T 577db455445946b4b3637f89e9e8da72 P fa977f48a0f448969dae707cebb47d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:50.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.320025  2123 raft_consensus.cc:740] T 577db455445946b4b3637f89e9e8da72 P fa977f48a0f448969dae707cebb47d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa977f48a0f448969dae707cebb47d86, State: Initialized, Role: FOLLOWER
18:31:50.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.321560  2123 consensus_queue.cc:260] T 577db455445946b4b3637f89e9e8da72 P fa977f48a0f448969dae707cebb47d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f21d544834a406f92f688ea6d5a8dba" member_type: VOTER last_known_addr { host: "127.0.106.194" port: 45251 } } peers { permanent_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" member_type: VOTER last_known_addr { host: "127.0.106.195" port: 46809 } } peers { permanent_uuid: "fa977f48a0f448969dae707cebb47d86" member_type: VOTER last_known_addr { host: "127.0.106.193" port: 33681 } }
18:31:50.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.333812  2128 raft_consensus.cc:493] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:31:50.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.334407  2128 raft_consensus.cc:515] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f21d544834a406f92f688ea6d5a8dba" member_type: VOTER last_known_addr { host: "127.0.106.194" port: 45251 } } peers { permanent_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" member_type: VOTER last_known_addr { host: "127.0.106.195" port: 46809 } } peers { permanent_uuid: "fa977f48a0f448969dae707cebb47d86" member_type: VOTER last_known_addr { host: "127.0.106.193" port: 33681 } }
18:31:50.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.340435  2128 leader_election.cc:290] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f21d544834a406f92f688ea6d5a8dba (127.0.106.194:45251), fa977f48a0f448969dae707cebb47d86 (127.0.106.193:33681)
18:31:50.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:50.340598  1261 tablet.cc:2406] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:31:50.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.363523  2123 ts_tablet_manager.cc:1434] T 577db455445946b4b3637f89e9e8da72 P fa977f48a0f448969dae707cebb47d86: Time spent starting tablet: real 0.106s	user 0.040s	sys 0.029s
18:31:50.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.373662  2125 raft_consensus.cc:359] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f21d544834a406f92f688ea6d5a8dba" member_type: VOTER last_known_addr { host: "127.0.106.194" port: 45251 } } peers { permanent_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" member_type: VOTER last_known_addr { host: "127.0.106.195" port: 46809 } } peers { permanent_uuid: "fa977f48a0f448969dae707cebb47d86" member_type: VOTER last_known_addr { host: "127.0.106.193" port: 33681 } }
18:31:50.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.374557  2125 raft_consensus.cc:385] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:50.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.374843  2125 raft_consensus.cc:740] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f21d544834a406f92f688ea6d5a8dba, State: Initialized, Role: FOLLOWER
18:31:50.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.376144  2125 consensus_queue.cc:260] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f21d544834a406f92f688ea6d5a8dba" member_type: VOTER last_known_addr { host: "127.0.106.194" port: 45251 } } peers { permanent_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" member_type: VOTER last_known_addr { host: "127.0.106.195" port: 46809 } } peers { permanent_uuid: "fa977f48a0f448969dae707cebb47d86" member_type: VOTER last_known_addr { host: "127.0.106.193" port: 33681 } }
18:31:50.384 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:50.384 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:50.384 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:50.385 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:50.385 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:50.385 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:50.385 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:50.385 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:50.385 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:50.385 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:50.386 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:50.385 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:50.386 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:50.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:50.391475   977 tablet.cc:2406] T 577db455445946b4b3637f89e9e8da72 P fa977f48a0f448969dae707cebb47d86: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:31:50.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.394778  2125 ts_tablet_manager.cc:1434] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba: Time spent starting tablet: real 0.107s	user 0.025s	sys 0.021s
18:31:50.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.402550  2131 raft_consensus.cc:493] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:31:50.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.403301  2131 raft_consensus.cc:515] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f21d544834a406f92f688ea6d5a8dba" member_type: VOTER last_known_addr { host: "127.0.106.194" port: 45251 } } peers { permanent_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" member_type: VOTER last_known_addr { host: "127.0.106.195" port: 46809 } } peers { permanent_uuid: "fa977f48a0f448969dae707cebb47d86" member_type: VOTER last_known_addr { host: "127.0.106.193" port: 33681 } }
18:31:50.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.413820  1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577db455445946b4b3637f89e9e8da72" candidate_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f21d544834a406f92f688ea6d5a8dba" is_pre_election: true
18:31:50.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.414820  1064 raft_consensus.cc:2468] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0865e0f96b7348dfbf4a502a6d8151dd in term 0.
18:31:50.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.415762  2131 leader_election.cc:290] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0865e0f96b7348dfbf4a502a6d8151dd (127.0.106.195:46809), fa977f48a0f448969dae707cebb47d86 (127.0.106.193:33681)
18:31:50.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.419241  1142 leader_election.cc:304] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0865e0f96b7348dfbf4a502a6d8151dd, 6f21d544834a406f92f688ea6d5a8dba; no voters: 
18:31:50.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.419682   921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577db455445946b4b3637f89e9e8da72" candidate_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa977f48a0f448969dae707cebb47d86" is_pre_election: true
18:31:50.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.420197  2128 raft_consensus.cc:2804] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [term 0 FOLLOWER]: Leader pre-election won for term 1
18:31:50.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.420596  2128 raft_consensus.cc:493] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:31:50.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.420589   921 raft_consensus.cc:2468] T 577db455445946b4b3637f89e9e8da72 P fa977f48a0f448969dae707cebb47d86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0865e0f96b7348dfbf4a502a6d8151dd in term 0.
18:31:50.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.420953  2128 raft_consensus.cc:3060] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [term 0 FOLLOWER]: Advancing to term 1
18:31:50.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.431926  2128 raft_consensus.cc:515] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f21d544834a406f92f688ea6d5a8dba" member_type: VOTER last_known_addr { host: "127.0.106.194" port: 45251 } } peers { permanent_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" member_type: VOTER last_known_addr { host: "127.0.106.195" port: 46809 } } peers { permanent_uuid: "fa977f48a0f448969dae707cebb47d86" member_type: VOTER last_known_addr { host: "127.0.106.193" port: 33681 } }
18:31:50.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.445706  2128 leader_election.cc:290] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [CANDIDATE]: Term 1 election: Requested vote from peers 6f21d544834a406f92f688ea6d5a8dba (127.0.106.194:45251), fa977f48a0f448969dae707cebb47d86 (127.0.106.193:33681)
18:31:50.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.447041   921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577db455445946b4b3637f89e9e8da72" candidate_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa977f48a0f448969dae707cebb47d86"
18:31:50.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.447645   921 raft_consensus.cc:3060] T 577db455445946b4b3637f89e9e8da72 P fa977f48a0f448969dae707cebb47d86 [term 0 FOLLOWER]: Advancing to term 1
18:31:50.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.448590  1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577db455445946b4b3637f89e9e8da72" candidate_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f21d544834a406f92f688ea6d5a8dba"
18:31:50.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.449168  1064 raft_consensus.cc:3060] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba [term 0 FOLLOWER]: Advancing to term 1
18:31:50.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.459149   921 raft_consensus.cc:2468] T 577db455445946b4b3637f89e9e8da72 P fa977f48a0f448969dae707cebb47d86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0865e0f96b7348dfbf4a502a6d8151dd in term 1.
18:31:50.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.459422  1064 raft_consensus.cc:2468] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0865e0f96b7348dfbf4a502a6d8151dd in term 1.
18:31:50.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.460973  1142 leader_election.cc:304] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0865e0f96b7348dfbf4a502a6d8151dd, 6f21d544834a406f92f688ea6d5a8dba; no voters: 
18:31:50.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.461856  2128 raft_consensus.cc:2804] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [term 1 FOLLOWER]: Leader election won for term 1
18:31:50.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.467494  2128 raft_consensus.cc:697] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [term 1 LEADER]: Becoming Leader. State: Replica: 0865e0f96b7348dfbf4a502a6d8151dd, State: Running, Role: LEADER
18:31:50.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.469712  1206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577db455445946b4b3637f89e9e8da72" candidate_uuid: "6f21d544834a406f92f688ea6d5a8dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" is_pre_election: true
18:31:50.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.470010  2128 consensus_queue.cc:237] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f21d544834a406f92f688ea6d5a8dba" member_type: VOTER last_known_addr { host: "127.0.106.194" port: 45251 } } peers { permanent_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" member_type: VOTER last_known_addr { host: "127.0.106.195" port: 46809 } } peers { permanent_uuid: "fa977f48a0f448969dae707cebb47d86" member_type: VOTER last_known_addr { host: "127.0.106.193" port: 33681 } }
18:31:50.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.479579   921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "577db455445946b4b3637f89e9e8da72" candidate_uuid: "6f21d544834a406f92f688ea6d5a8dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa977f48a0f448969dae707cebb47d86" is_pre_election: true
18:31:50.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.480410   921 raft_consensus.cc:2393] T 577db455445946b4b3637f89e9e8da72 P fa977f48a0f448969dae707cebb47d86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f21d544834a406f92f688ea6d5a8dba in current term 1: Already voted for candidate 0865e0f96b7348dfbf4a502a6d8151dd in this term.
18:31:50.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.481896  1000 leader_election.cc:304] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f21d544834a406f92f688ea6d5a8dba; no voters: 0865e0f96b7348dfbf4a502a6d8151dd, fa977f48a0f448969dae707cebb47d86
18:31:50.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.482770  2131 raft_consensus.cc:2749] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:31:50.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.487284   471 catalog_manager.cc:5696] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 0865e0f96b7348dfbf4a502a6d8151dd (127.0.106.195). New cstate: current_term: 1 leader_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f21d544834a406f92f688ea6d5a8dba" member_type: VOTER last_known_addr { host: "127.0.106.194" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0865e0f96b7348dfbf4a502a6d8151dd" member_type: VOTER last_known_addr { host: "127.0.106.195" port: 46809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa977f48a0f448969dae707cebb47d86" member_type: VOTER last_known_addr { host: "127.0.106.193" port: 33681 } health_report { overall_health: UNKNOWN } } }
18:31:50.579 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:50.580 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:50.580 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:50.580 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:50.580 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:50.580 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:50.580 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:50.580 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:50.580 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:50.580 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:50.580 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:50.580 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:50.580 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:50.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:50.582480  1118 tablet.cc:2406] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:31:50.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:50.789 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 76bbf70ff510462a93a28833882099ea
18:31:50.793 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 577db455445946b4b3637f89e9e8da72 for table 'replication_test_table' with partition [<start>, <end>)
18:31:50.793 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=577db455445946b4b3637f89e9e8da72@[0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)[L],6f21d544834a406f92f688ea6d5a8dba(127.0.106.194:45251),fa977f48a0f448969dae707cebb47d86(127.0.106.193:33681)]}]
18:31:50.793 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.106.254:32967, [4ms] Sub RPC GetTableLocations: received response from server master-127.0.106.254:32967: OK, deferred=null) after lookup
18:31:50.794 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)] connecting to peer
18:31:50.795 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)] Successfully connected to peer
18:31:50.807 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:50.808 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:50.808 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:50.808 [DEBUG - pool-118-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:50.808 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:50.808 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:50.808 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:50.808 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:50.808 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:50.808 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:50.809 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:50.809 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:50.809 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:50.809 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:50.810 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29055), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [75ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [111ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [139ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [150ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [225ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [250ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [251ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [275ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [310ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [313ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [355ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [358ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [360ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [377ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [379ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [402ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [422ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [462ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [524ms] refreshing cache from master, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [525ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [526ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [526ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [527ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [527ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [543ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [763ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [763ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [764ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1280ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1284ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2220ms] refreshing cache from master, [2220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2221ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2222ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [4060ms] refreshing cache from master, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [4062ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [4062ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [4063ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [4063ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5461ms] refreshing cache from master, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5462ms] too many traces: truncated at 100 traces, deferred=Deferred@678301185(state=PENDING, result=null, callback=(continuation of Deferred@687100613 after retry RPC after error@195792614) -> (continuation of Deferred@788800536 after retry RPC after error@2000824831) -> (continuation of Deferred@2099916712 after retry RPC after error@706826837) -> (continuation of Deferred@613128173 after retry RPC after error@1113612114) -> (continuation of Deferred@1855680473 after retry RPC after error@1309162405) -> (continuation of Deferred@918874486 after retry RPC after error@1981725235) -> (continuation of Deferred@1137637006 after retry RPC after error@1284782145) -> (continuation of Deferred@1560999932 after retry RPC after error@1581646156) -> (continuation of Deferred@1778972300 after retry RPC after error@120823228) -> (continuation of Deferred@218906545 after retry RPC after error@1663959869) -> (continuation of Deferred@1321153858 after retry RPC after error@1442484052) -> (continuation of Deferred@971490285 after retry RPC after error@709036039) -> (continuation of Deferred@492911912 after retry RPC after error@476090879) -> (continuation of Deferred@455070005 after retry RPC after error@690938209) -> (continuation of Deferred@1035079953 after retry RPC after error@633704497) -> (continuation of Deferred@1085696965 after retry RPC after error@516796251) -> (continuation of Deferred@861540106 after retry RPC after error@982992200) -> (continuation of Deferred@1233971612 after retry RPC after error@977809537) -> (continuation of Deferred@1493785245 after retry RPC after error@1496644081) -> (continuation of Deferred@2002402114 after retry RPC after error@208523536) -> (continuation of Deferred@522436530 after retry RPC after error@1629890262), errback=(continuation of Deferred@687100613 after retry RPC after error@195792614) -> (continuation of Deferred@788800536 after retry RPC after error@2000824831) -> (continuation of Deferred@2099916712 after retry RPC after error@706826837) -> (continuation of Deferred@613128173 after retry RPC after error@1113612114) -> (continuation of Deferred@1855680473 after retry RPC after error@1309162405) -> (continuation of Deferred@918874486 after retry RPC after error@1981725235) -> (continuation of Deferred@1137637006 after retry RPC after error@1284782145) -> (continuation of Deferred@1560999932 after retry RPC after error@1581646156) -> (continuation of Deferred@1778972300 after retry RPC after error@120823228) -> (continuation of Deferred@218906545 after retry RPC after error@1663959869) -> (continuation of Deferred@1321153858 after retry RPC after error@1442484052) -> (continuation of Deferred@971490285 after retry RPC after error@709036039) -> (continuation of Deferred@492911912 after retry RPC after error@476090879) -> (continuation of Deferred@455070005 after retry RPC after error@690938209) -> (continuation of Deferred@1035079953 after retry RPC after error@633704497) -> (continuation of Deferred@1085696965 after retry RPC after error@516796251) -> (continuation of Deferred@861540106 after retry RPC after error@982992200) -> (continuation of Deferred@1233971612 after retry RPC after error@977809537) -> (continuation of Deferred@1493785245 after retry RPC after error@1496644081) -> (continuation of Deferred@2002402114 after retry RPC after error@208523536) -> (continuation of Deferred@522436530 after retry RPC after error@1629890262)))
18:31:50.811 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
18:31:50.811 [WARN - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29055), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [75ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [111ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [139ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [150ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [225ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [250ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [251ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [275ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [310ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [313ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [355ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [358ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [360ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [377ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [379ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [402ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [422ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [462ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [524ms] refreshing cache from master, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [525ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [526ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [526ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [527ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [527ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [543ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [763ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [763ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [764ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1280ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1284ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2220ms] refreshing cache from master, [2220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2221ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2222ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [4060ms] refreshing cache from master, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [4062ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [4062ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [4063ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [4063ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5461ms] refreshing cache from master, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5462ms] too many traces: truncated at 100 traces, deferred=Deferred@678301185(state=PENDING, result=null, callback=(continuation of Deferred@687100613 after retry RPC after error@195792614) -> (continuation of Deferred@788800536 after retry RPC after error@2000824831) -> (continuation of Deferred@2099916712 after retry RPC after error@706826837) -> (continuation of Deferred@613128173 after retry RPC after error@1113612114) -> (continuation of Deferred@1855680473 after retry RPC after error@1309162405) -> (continuation of Deferred@918874486 after retry RPC after error@1981725235) -> (continuation of Deferred@1137637006 after retry RPC after error@1284782145) -> (continuation of Deferred@1560999932 after retry RPC after error@1581646156) -> (continuation of Deferred@1778972300 after retry RPC after error@120823228) -> (continuation of Deferred@218906545 after retry RPC after error@1663959869) -> (continuation of Deferred@1321153858 after retry RPC after error@1442484052) -> (continuation of Deferred@971490285 after retry RPC after error@709036039) -> (continuation of Deferred@492911912 after retry RPC after error@476090879) -> (continuation of Deferred@455070005 after retry RPC after error@690938209) -> (continuation of Deferred@1035079953 after retry RPC after error@633704497) -> (continuation of Deferred@1085696965 after retry RPC after error@516796251) -> (continuation of Deferred@861540106 after retry RPC after error@982992200) -> (continuation of Deferred@1233971612 after retry RPC after error@977809537) -> (continuation of Deferred@1493785245 after retry RPC after error@1496644081) -> (continuation of Deferred@2002402114 after retry RPC after error@208523536) -> (continuation of Deferred@522436530 after retry RPC after error@1629890262), errback=(continuation of Deferred@687100613 after retry RPC after error@195792614) -> (continuation of Deferred@788800536 after retry RPC after error@2000824831) -> (continuation of Deferred@2099916712 after retry RPC after error@706826837) -> (continuation of Deferred@613128173 after retry RPC after error@1113612114) -> (continuation of Deferred@1855680473 after retry RPC after error@1309162405) -> (continuation of Deferred@918874486 after retry RPC after error@1981725235) -> (continuation of Deferred@1137637006 after retry RPC after error@1284782145) -> (continuation of Deferred@1560999932 after retry RPC after error@1581646156) -> (continuation of Deferred@1778972300 after retry RPC after error@120823228) -> (continuation of Deferred@218906545 after retry RPC after error@1663959869) -> (continuation of Deferred@1321153858 after retry RPC after error@1442484052) -> (continuation of Deferred@971490285 after retry RPC after error@709036039) -> (continuation of Deferred@492911912 after retry RPC after error@476090879) -> (continuation of Deferred@455070005 after retry RPC after error@690938209) -> (continuation of Deferred@1035079953 after retry RPC after error@633704497) -> (continuation of Deferred@1085696965 after retry RPC after error@516796251) -> (continuation of Deferred@861540106 after retry RPC after error@982992200) -> (continuation of Deferred@1233971612 after retry RPC after error@977809537) -> (continuation of Deferred@1493785245 after retry RPC after error@1496644081) -> (continuation of Deferred@2002402114 after retry RPC after error@208523536) -> (continuation of Deferred@522436530 after retry RPC after error@1629890262)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:50.812 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
18:31:50.813 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x637d32db, L:/127.0.0.1:45630 - R:/127.0.106.195:46809] using TOKEN/null
18:31:50.814 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#3 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
18:31:50.821 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29055), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [75ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [111ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [139ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [150ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [225ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [250ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [251ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [275ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [310ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [313ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [355ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [358ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [360ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [377ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [379ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [402ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [422ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [462ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [524ms] refreshing cache from master, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [525ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [526ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [526ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [527ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [527ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [543ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [763ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [763ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [764ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1280ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1284ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2220ms] refreshing cache from master, [2220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2221ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2222ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [4060ms] refreshing cache from master, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [4062ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [4062ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [4063ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [4063ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5461ms] refreshing cache from master, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5462ms] too many traces: truncated at 100 traces, deferred=Deferred@678301185(state=PENDING, result=null, callback=(continuation of Deferred@687100613 after retry RPC after error@195792614) -> (continuation of Deferred@788800536 after retry RPC after error@2000824831) -> (continuation of Deferred@2099916712 after retry RPC after error@706826837) -> (continuation of Deferred@613128173 after retry RPC after error@1113612114) -> (continuation of Deferred@1855680473 after retry RPC after error@1309162405) -> (continuation of Deferred@918874486 after retry RPC after error@1981725235) -> (continuation of Deferred@1137637006 after retry RPC after error@1284782145) -> (continuation of Deferred@1560999932 after retry RPC after error@1581646156) -> (continuation of Deferred@1778972300 after retry RPC after error@120823228) -> (continuation of Deferred@218906545 after retry RPC after error@1663959869) -> (continuation of Deferred@1321153858 after retry RPC after error@1442484052) -> (continuation of Deferred@971490285 after retry RPC after error@709036039) -> (continuation of Deferred@492911912 after retry RPC after error@476090879) -> (continuation of Deferred@455070005 after retry RPC after error@690938209) -> (continuation of Deferred@1035079953 after retry RPC after error@633704497) -> (continuation of Deferred@1085696965 after retry RPC after error@516796251) -> (continuation of Deferred@861540106 after retry RPC after error@982992200) -> (continuation of Deferred@1233971612 after retry RPC after error@977809537) -> (continuation of Deferred@1493785245 after retry RPC after error@1496644081) -> (continuation of Deferred@2002402114 after retry RPC after error@208523536) -> (continuation of Deferred@522436530 after retry RPC after error@1629890262), errback=(continuation of Deferred@687100613 after retry RPC after error@195792614) -> (continuation of Deferred@788800536 after retry RPC after error@2000824831) -> (continuation of Deferred@2099916712 after retry RPC after error@706826837) -> (continuation of Deferred@613128173 after retry RPC after error@1113612114) -> (continuation of Deferred@1855680473 after retry RPC after error@1309162405) -> (continuation of Deferred@918874486 after retry RPC after error@1981725235) -> (continuation of Deferred@1137637006 after retry RPC after error@1284782145) -> (continuation of Deferred@1560999932 after retry RPC after error@1581646156) -> (continuation of Deferred@1778972300 after retry RPC after error@120823228) -> (continuation of Deferred@218906545 after retry RPC after error@1663959869) -> (continuation of Deferred@1321153858 after retry RPC after error@1442484052) -> (continuation of Deferred@971490285 after retry RPC after error@709036039) -> (continuation of Deferred@492911912 after retry RPC after error@476090879) -> (continuation of Deferred@455070005 after retry RPC after error@690938209) -> (continuation of Deferred@1035079953 after retry RPC after error@633704497) -> (continuation of Deferred@1085696965 after retry RPC after error@516796251) -> (continuation of Deferred@861540106 after retry RPC after error@982992200) -> (continuation of Deferred@1233971612 after retry RPC after error@977809537) -> (continuation of Deferred@1493785245 after retry RPC after error@1496644081) -> (continuation of Deferred@2002402114 after retry RPC after error@208523536) -> (continuation of Deferred@522436530 after retry RPC after error@1629890262)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:50.822 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
18:31:50.823 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#3) of source Source: KuduSource.
18:31:50.823 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:31:50.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.833341   921 raft_consensus.cc:1275] T 577db455445946b4b3637f89e9e8da72 P fa977f48a0f448969dae707cebb47d86 [term 1 FOLLOWER]: Refusing update from remote peer 0865e0f96b7348dfbf4a502a6d8151dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:31:50.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.835831  1064 raft_consensus.cc:1275] T 577db455445946b4b3637f89e9e8da72 P 6f21d544834a406f92f688ea6d5a8dba [term 1 FOLLOWER]: Refusing update from remote peer 0865e0f96b7348dfbf4a502a6d8151dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:31:50.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.836293  2137 consensus_queue.cc:1048] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa977f48a0f448969dae707cebb47d86" member_type: VOTER last_known_addr { host: "127.0.106.193" port: 33681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:31:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.837402  2128 consensus_queue.cc:1048] T 577db455445946b4b3637f89e9e8da72 P 0865e0f96b7348dfbf4a502a6d8151dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f21d544834a406f92f688ea6d5a8dba" member_type: VOTER last_known_addr { host: "127.0.106.194" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:31:50.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.864007  2142 mvcc.cc:204] Tried to move back new op lower bound from 7305361452354899968 to 7305361450898120704. Current Snapshot: MvccSnapshot[applied={T|T < 7305361452354899968}]
18:31:50.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.874105  2143 mvcc.cc:204] Tried to move back new op lower bound from 7305361452354899968 to 7305361450898120704. Current Snapshot: MvccSnapshot[applied={T|T < 7305361452354899968}]
18:31:50.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:50.955864  2088 heartbeater.cc:499] Master 127.1.59.188:33901 was elected leader, sending a full tablet report...
18:31:51.028 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:51.028 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:51.028 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:51.030 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.030 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.030 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.030 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.030 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.030 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.030 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.030 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.030 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.031 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:51.046 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:51.048 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:51.048 [DEBUG - main] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:31:51.049 [DEBUG - main] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:31:51.049 [DEBUG - main] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:31:51.049 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.1.59.190:46863(127.1.59.190:46863)] Successfully connected to peer
18:31:51.051 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.1.59.188:33901(127.1.59.188:33901)] Successfully connected to peer
18:31:51.055 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.1.59.189:42073(127.1.59.189:42073)] Successfully connected to peer
18:31:51.055 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.188
18:31:51.058 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.189
18:31:51.062 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.190
18:31:51.065 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:51.069 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xfa81046c, L:/127.0.0.1:34232 - R:/127.1.59.188:33901] using SASL/PLAIN
18:31:51.073 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:31:51.073 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=24), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [24ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: OK, deferred=null) after lookup
18:31:51.076 [DEBUG - main] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:31:51.077 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:51.077 [DEBUG - main] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:31:51.079 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.0.106.254:32967(127.0.106.254:32967)] Successfully connected to peer
18:31:51.079 [DEBUG - main] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:31:51.081 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:51.088 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.0.106.253:45189(127.0.106.253:45189)] Successfully connected to peer
18:31:51.088 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.0.106.252:46705(127.0.106.252:46705)] Successfully connected to peer
18:31:51.089 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x209dffec, L:/127.0.0.1:41072 - R:/127.1.59.190:46863] using SASL/PLAIN
18:31:51.090 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x13efe3f8, L:/127.0.0.1:45396 - R:/127.1.59.189:42073] using SASL/PLAIN
18:31:51.096 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.0.106.253
18:31:51.106 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:51.107 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.0.106.252
18:31:51.108 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.0.106.254
18:31:51.115 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:51.116 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:51.119 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6817c9a8, L:/127.0.0.1:48550 - R:/127.0.106.254:32967] using SASL/PLAIN
18:31:51.123 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:31:51.123 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=47), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [46ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: OK, deferred=null) after lookup
18:31:51.123 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xeedf303f, L:/127.0.0.1:35372 - R:/127.0.106.252:46705] using SASL/PLAIN
18:31:51.124 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x338f493d, L:/127.0.0.1:53372 - R:/127.0.106.253:45189] using SASL/PLAIN
18:31:51.127 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 76bbf70ff510462a93a28833882099ea
18:31:51.133 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 577db455445946b4b3637f89e9e8da72 for table 'replication_test_table' with partition [<start>, <end>)
18:31:51.133 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=577db455445946b4b3637f89e9e8da72@[0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)[L],6f21d544834a406f92f688ea6d5a8dba(127.0.106.194:45251),fa977f48a0f448969dae707cebb47d86(127.0.106.193:33681)]}]
18:31:51.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.135576  1474 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34232:
18:31:51.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
18:31:51.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
18:31:51.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:31:51.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
18:31:51.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:31:51.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:31:51.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:31:51.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:31:51.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:31:51.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:31:51.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:31:51.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:31:51.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\000"
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:31:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
18:31:51.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:51.139375  1474 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
18:31:51.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:51.241 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table e368137a0f9646a79dfbc36dd286c50c
18:31:51.268 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:51.268 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:51.269 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:51.269 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.269 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.269 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.270 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.270 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.270 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.284 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:51.284 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:51.285 [DEBUG - pool-112-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:51.285 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:51.285 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:51.285 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:51.286 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:51.286 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:51.286 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:51.291 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.291 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.291 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.291 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:51.292 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29636), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [37ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [55ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [56ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [64ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [368ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [369ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [414ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [415ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [415ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [416ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [417ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [417ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [442ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [461ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [502ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [542ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [562ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [562ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [703ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [703ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [920ms] refreshing cache from master, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [921ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [922ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [922ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [923ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1280ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1284ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1284ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2000ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2002ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2002ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2003ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [4680ms] refreshing cache from master, [4680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [4682ms] too many traces: truncated at 100 traces, deferred=Deferred@171617885(state=PENDING, result=null, callback=(continuation of Deferred@1693399612 after retry RPC after error@519751128) -> (continuation of Deferred@746235013 after retry RPC after error@1936572177) -> (continuation of Deferred@1850623386 after retry RPC after error@642943374) -> (continuation of Deferred@1601527629 after retry RPC after error@1098839685) -> (continuation of Deferred@1568676261 after retry RPC after error@1865217378) -> (continuation of Deferred@441864445 after retry RPC after error@749357036) -> (continuation of Deferred@1908031213 after retry RPC after error@2041926237) -> (continuation of Deferred@1372333102 after retry RPC after error@791125212) -> (continuation of Deferred@264929923 after retry RPC after error@1555959453) -> (continuation of Deferred@1818471536 after retry RPC after error@2142309468) -> (continuation of Deferred@615798707 after retry RPC after error@139624286) -> (continuation of Deferred@2040746504 after retry RPC after error@235369100) -> (continuation of Deferred@143172912 after retry RPC after error@331056112) -> (continuation of Deferred@1886105757 after retry RPC after error@1162690318) -> (continuation of Deferred@144810930 after retry RPC after error@1196037461) -> (continuation of Deferred@1787345529 after retry RPC after error@1183931753) -> (continuation of Deferred@1135139386 after retry RPC after error@1423941543) -> (continuation of Deferred@2066463799 after retry RPC after error@933088302) -> (continuation of Deferred@845265389 after retry RPC after error@451619489) -> (continuation of Deferred@1015539663 after retry RPC after error@1705160909) -> (continuation of Deferred@1521730373 after retry RPC after error@424559760) -> (continuation of Deferred@443838953 after retry RPC after error@1780518578) -> (continuation of Deferred@785236312 after retry RPC after error@1162635989) -> (continuation of Deferred@2081337516 after retry RPC after error@305525889) -> (continuation of Deferred@1387409566 after retry RPC after error@1947132639) -> (continuation of Deferred@2106369826 after retry RPC after error@1084282350) -> (continuation of Deferred@55913380 after retry RPC after error@13515019), errback=(continuation of Deferred@1693399612 after retry RPC after error@519751128) -> (continuation of Deferred@746235013 after retry RPC after error@1936572177) -> (continuation of Deferred@1850623386 after retry RPC after error@642943374) -> (continuation of Deferred@1601527629 after retry RPC after error@1098839685) -> (continuation of Deferred@1568676261 after retry RPC after error@1865217378) -> (continuation of Deferred@441864445 after retry RPC after error@749357036) -> (continuation of Deferred@1908031213 after retry RPC after error@2041926237) -> (continuation of Deferred@1372333102 after retry RPC after error@791125212) -> (continuation of Deferred@264929923 after retry RPC after error@1555959453) -> (continuation of Deferred@1818471536 after retry RPC after error@2142309468) -> (continuation of Deferred@615798707 after retry RPC after error@139624286) -> (continuation of Deferred@2040746504 after retry RPC after error@235369100) -> (continuation of Deferred@143172912 after retry RPC after error@331056112) -> (continuation of Deferred@1886105757 after retry RPC after error@1162690318) -> (continuation of Deferred@144810930 after retry RPC after error@1196037461) -> (continuation of Deferred@1787345529 after retry RPC after error@1183931753) -> (continuation of Deferred@1135139386 after retry RPC after error@1423941543) -> (continuation of Deferred@2066463799 after retry RPC after error@933088302) -> (continuation of Deferred@845265389 after retry RPC after error@451619489) -> (continuation of Deferred@1015539663 after retry RPC after error@1705160909) -> (continuation of Deferred@1521730373 after retry RPC after error@424559760) -> (continuation of Deferred@443838953 after retry RPC after error@1780518578) -> (continuation of Deferred@785236312 after retry RPC after error@1162635989) -> (continuation of Deferred@2081337516 after retry RPC after error@305525889) -> (continuation of Deferred@1387409566 after retry RPC after error@1947132639) -> (continuation of Deferred@2106369826 after retry RPC after error@1084282350) -> (continuation of Deferred@55913380 after retry RPC after error@13515019)))
18:31:51.292 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:51.292 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:51.293 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:51.293 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.293 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.293 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.293 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29636), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [37ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [55ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [56ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [64ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [368ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [369ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [414ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [415ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [415ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [416ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [417ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [417ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [442ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [461ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [502ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [542ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [562ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [562ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [703ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [703ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [920ms] refreshing cache from master, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [921ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [922ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [922ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [923ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1280ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1284ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1284ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2000ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2002ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2002ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2003ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [4680ms] refreshing cache from master, [4680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [4682ms] too many traces: truncated at 100 traces, deferred=Deferred@171617885(state=PENDING, result=null, callback=(continuation of Deferred@1693399612 after retry RPC after error@519751128) -> (continuation of Deferred@746235013 after retry RPC after error@1936572177) -> (continuation of Deferred@1850623386 after retry RPC after error@642943374) -> (continuation of Deferred@1601527629 after retry RPC after error@1098839685) -> (continuation of Deferred@1568676261 after retry RPC after error@1865217378) -> (continuation of Deferred@441864445 after retry RPC after error@749357036) -> (continuation of Deferred@1908031213 after retry RPC after error@2041926237) -> (continuation of Deferred@1372333102 after retry RPC after error@791125212) -> (continuation of Deferred@264929923 after retry RPC after error@1555959453) -> (continuation of Deferred@1818471536 after retry RPC after error@2142309468) -> (continuation of Deferred@615798707 after retry RPC after error@139624286) -> (continuation of Deferred@2040746504 after retry RPC after error@235369100) -> (continuation of Deferred@143172912 after retry RPC after error@331056112) -> (continuation of Deferred@1886105757 after retry RPC after error@1162690318) -> (continuation of Deferred@144810930 after retry RPC after error@1196037461) -> (continuation of Deferred@1787345529 after retry RPC after error@1183931753) -> (continuation of Deferred@1135139386 after retry RPC after error@1423941543) -> (continuation of Deferred@2066463799 after retry RPC after error@933088302) -> (continuation of Deferred@845265389 after retry RPC after error@451619489) -> (continuation of Deferred@1015539663 after retry RPC after error@1705160909) -> (continuation of Deferred@1521730373 after retry RPC after error@424559760) -> (continuation of Deferred@443838953 after retry RPC after error@1780518578) -> (continuation of Deferred@785236312 after retry RPC after error@1162635989) -> (continuation of Deferred@2081337516 after retry RPC after error@305525889) -> (continuation of Deferred@1387409566 after retry RPC after error@1947132639) -> (continuation of Deferred@2106369826 after retry RPC after error@1084282350) -> (continuation of Deferred@55913380 after retry RPC after error@13515019), errback=(continuation of Deferred@1693399612 after retry RPC after error@519751128) -> (continuation of Deferred@746235013 after retry RPC after error@1936572177) -> (continuation of Deferred@1850623386 after retry RPC after error@642943374) -> (continuation of Deferred@1601527629 after retry RPC after error@1098839685) -> (continuation of Deferred@1568676261 after retry RPC after error@1865217378) -> (continuation of Deferred@441864445 after retry RPC after error@749357036) -> (continuation of Deferred@1908031213 after retry RPC after error@2041926237) -> (continuation of Deferred@1372333102 after retry RPC after error@791125212) -> (continuation of Deferred@264929923 after retry RPC after error@1555959453) -> (continuation of Deferred@1818471536 after retry RPC after error@2142309468) -> (continuation of Deferred@615798707 after retry RPC after error@139624286) -> (continuation of Deferred@2040746504 after retry RPC after error@235369100) -> (continuation of Deferred@143172912 after retry RPC after error@331056112) -> (continuation of Deferred@1886105757 after retry RPC after error@1162690318) -> (continuation of Deferred@144810930 after retry RPC after error@1196037461) -> (continuation of Deferred@1787345529 after retry RPC after error@1183931753) -> (continuation of Deferred@1135139386 after retry RPC after error@1423941543) -> (continuation of Deferred@2066463799 after retry RPC after error@933088302) -> (continuation of Deferred@845265389 after retry RPC after error@451619489) -> (continuation of Deferred@1015539663 after retry RPC after error@1705160909) -> (continuation of Deferred@1521730373 after retry RPC after error@424559760) -> (continuation of Deferred@443838953 after retry RPC after error@1780518578) -> (continuation of Deferred@785236312 after retry RPC after error@1162635989) -> (continuation of Deferred@2081337516 after retry RPC after error@305525889) -> (continuation of Deferred@1387409566 after retry RPC after error@1947132639) -> (continuation of Deferred@2106369826 after retry RPC after error@1084282350) -> (continuation of Deferred@55913380 after retry RPC after error@13515019)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29636), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [37ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [55ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [56ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [64ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [368ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [369ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [414ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [415ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [415ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [416ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [417ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [417ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [442ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [461ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [502ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [542ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [562ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [562ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [703ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [703ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [920ms] refreshing cache from master, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [921ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [922ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [922ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [923ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1280ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1284ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1284ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2000ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2002ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2002ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2003ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [4680ms] refreshing cache from master, [4680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [4682ms] too many traces: truncated at 100 traces, deferred=Deferred@171617885(state=PENDING, result=null, callback=(continuation of Deferred@1693399612 after retry RPC after error@519751128) -> (continuation of Deferred@746235013 after retry RPC after error@1936572177) -> (continuation of Deferred@1850623386 after retry RPC after error@642943374) -> (continuation of Deferred@1601527629 after retry RPC after error@1098839685) -> (continuation of Deferred@1568676261 after retry RPC after error@1865217378) -> (continuation of Deferred@441864445 after retry RPC after error@749357036) -> (continuation of Deferred@1908031213 after retry RPC after error@2041926237) -> (continuation of Deferred@1372333102 after retry RPC after error@791125212) -> (continuation of Deferred@264929923 after retry RPC after error@1555959453) -> (continuation of Deferred@1818471536 after retry RPC after error@2142309468) -> (continuation of Deferred@615798707 after retry RPC after error@139624286) -> (continuation of Deferred@2040746504 after retry RPC after error@235369100) -> (continuation of Deferred@143172912 after retry RPC after error@331056112) -> (continuation of Deferred@1886105757 after retry RPC after error@1162690318) -> (continuation of Deferred@144810930 after retry RPC after error@1196037461) -> (continuation of Deferred@1787345529 after retry RPC after error@1183931753) -> (continuation of Deferred@1135139386 after retry RPC after error@1423941543) -> (continuation of Deferred@2066463799 after retry RPC after error@933088302) -> (continuation of Deferred@845265389 after retry RPC after error@451619489) -> (continuation of Deferred@1015539663 after retry RPC after error@1705160909) -> (continuation of Deferred@1521730373 after retry RPC after error@424559760) -> (continuation of Deferred@443838953 after retry RPC after error@1780518578) -> (continuation of Deferred@785236312 after retry RPC after error@1162635989) -> (continuation of Deferred@2081337516 after retry RPC after error@305525889) -> (continuation of Deferred@1387409566 after retry RPC after error@1947132639) -> (continuation of Deferred@2106369826 after retry RPC after error@1084282350) -> (continuation of Deferred@55913380 after retry RPC after error@13515019), errback=(continuation of Deferred@1693399612 after retry RPC after error@519751128) -> (continuation of Deferred@746235013 after retry RPC after error@1936572177) -> (continuation of Deferred@1850623386 after retry RPC after error@642943374) -> (continuation of Deferred@1601527629 after retry RPC after error@1098839685) -> (continuation of Deferred@1568676261 after retry RPC after error@1865217378) -> (continuation of Deferred@441864445 after retry RPC after error@749357036) -> (continuation of Deferred@1908031213 after retry RPC after error@2041926237) -> (continuation of Deferred@1372333102 after retry RPC after error@791125212) -> (continuation of Deferred@264929923 after retry RPC after error@1555959453) -> (continuation of Deferred@1818471536 after retry RPC after error@2142309468) -> (continuation of Deferred@615798707 after retry RPC after error@139624286) -> (continuation of Deferred@2040746504 after retry RPC after error@235369100) -> (continuation of Deferred@143172912 after retry RPC after error@331056112) -> (continuation of Deferred@1886105757 after retry RPC after error@1162690318) -> (continuation of Deferred@144810930 after retry RPC after error@1196037461) -> (continuation of Deferred@1787345529 after retry RPC after error@1183931753) -> (continuation of Deferred@1135139386 after retry RPC after error@1423941543) -> (continuation of Deferred@2066463799 after retry RPC after error@933088302) -> (continuation of Deferred@845265389 after retry RPC after error@451619489) -> (continuation of Deferred@1015539663 after retry RPC after error@1705160909) -> (continuation of Deferred@1521730373 after retry RPC after error@424559760) -> (continuation of Deferred@443838953 after retry RPC after error@1780518578) -> (continuation of Deferred@785236312 after retry RPC after error@1162635989) -> (continuation of Deferred@2081337516 after retry RPC after error@305525889) -> (continuation of Deferred@1387409566 after retry RPC after error@1947132639) -> (continuation of Deferred@2106369826 after retry RPC after error@1084282350) -> (continuation of Deferred@55913380 after retry RPC after error@13515019)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.68.188:38393
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:51.295 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.295 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.295 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.295 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.295 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.295 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.295 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:51.299 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:51.299 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:51.300 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:51.300 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:51.300 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29683), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [90ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [261ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [263ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [448ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [448ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [449ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [451ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [452ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [494ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [495ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [496ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [496ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [504ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [504ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [523ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [541ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [562ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [562ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [562ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [621ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [622ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [641ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [642ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [642ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [642ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [842ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [843ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [843ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [843ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1040ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1043ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1460ms] refreshing cache from master, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1464ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2520ms] refreshing cache from master, [2520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2521ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2522ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3020ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3022ms] too many traces: truncated at 100 traces, deferred=Deferred@1007980784(state=PENDING, result=null, callback=(continuation of Deferred@596913690 after retry RPC after error@200187208) -> (continuation of Deferred@137885785 after retry RPC after error@280783551) -> (continuation of Deferred@307913292 after retry RPC after error@1830922642) -> (continuation of Deferred@1524855135 after retry RPC after error@695800110) -> (continuation of Deferred@1752190543 after retry RPC after error@150800362) -> (continuation of Deferred@1230366243 after retry RPC after error@683961926) -> (continuation of Deferred@1118588711 after retry RPC after error@579781327) -> (continuation of Deferred@1150049347 after retry RPC after error@1337048266) -> (continuation of Deferred@1875117932 after retry RPC after error@990390497) -> (continuation of Deferred@490734983 after retry RPC after error@1599454473) -> (continuation of Deferred@283455208 after retry RPC after error@1792033589) -> (continuation of Deferred@2007048149 after retry RPC after error@99506653) -> (continuation of Deferred@1011201510 after retry RPC after error@1415872688) -> (continuation of Deferred@725901918 after retry RPC after error@1553200730) -> (continuation of Deferred@1307083435 after retry RPC after error@1039788710) -> (continuation of Deferred@900147669 after retry RPC after error@1992632349) -> (continuation of Deferred@2133918132 after retry RPC after error@225409070) -> (continuation of Deferred@25821655 after retry RPC after error@1582322747) -> (continuation of Deferred@698077924 after retry RPC after error@1606644209) -> (continuation of Deferred@244733799 after retry RPC after error@1379609346) -> (continuation of Deferred@633397075 after retry RPC after error@1632141027) -> (continuation of Deferred@1574514882 after retry RPC after error@1446081344) -> (continuation of Deferred@1973945490 after retry RPC after error@1463141282) -> (continuation of Deferred@1132373670 after retry RPC after error@503867130) -> (continuation of Deferred@724663613 after retry RPC after error@1382060842) -> (continuation of Deferred@1679643734 after retry RPC after error@964673945) -> (continuation of Deferred@428317470 after retry RPC after error@1336455879), errback=(continuation of Deferred@596913690 after retry RPC after error@200187208) -> (continuation of Deferred@137885785 after retry RPC after error@280783551) -> (continuation of Deferred@307913292 after retry RPC after error@1830922642) -> (continuation of Deferred@1524855135 after retry RPC after error@695800110) -> (continuation of Deferred@1752190543 after retry RPC after error@150800362) -> (continuation of Deferred@1230366243 after retry RPC after error@683961926) -> (continuation of Deferred@1118588711 after retry RPC after error@579781327) -> (continuation of Deferred@1150049347 after retry RPC after error@1337048266) -> (continuation of Deferred@1875117932 after retry RPC after error@990390497) -> (continuation of Deferred@490734983 after retry RPC after error@1599454473) -> (continuation of Deferred@283455208 after retry RPC after error@1792033589) -> (continuation of Deferred@2007048149 after retry RPC after error@99506653) -> (continuation of Deferred@1011201510 after retry RPC after error@1415872688) -> (continuation of Deferred@725901918 after retry RPC after error@1553200730) -> (continuation of Deferred@1307083435 after retry RPC after error@1039788710) -> (continuation of Deferred@900147669 after retry RPC after error@1992632349) -> (continuation of Deferred@2133918132 after retry RPC after error@225409070) -> (continuation of Deferred@25821655 after retry RPC after error@1582322747) -> (continuation of Deferred@698077924 after retry RPC after error@1606644209) -> (continuation of Deferred@244733799 after retry RPC after error@1379609346) -> (continuation of Deferred@633397075 after retry RPC after error@1632141027) -> (continuation of Deferred@1574514882 after retry RPC after error@1446081344) -> (continuation of Deferred@1973945490 after retry RPC after error@1463141282) -> (continuation of Deferred@1132373670 after retry RPC after error@503867130) -> (continuation of Deferred@724663613 after retry RPC after error@1382060842) -> (continuation of Deferred@1679643734 after retry RPC after error@964673945) -> (continuation of Deferred@428317470 after retry RPC after error@1336455879)))
18:31:51.301 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
18:31:51.301 [WARN - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29683), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [90ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [261ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [263ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [448ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [448ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [449ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [451ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [452ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [494ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [495ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [496ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [496ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [504ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [504ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [523ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [541ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [562ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [562ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [562ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [621ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [622ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [641ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [642ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [642ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [642ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [842ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [843ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [843ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [843ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1040ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1043ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1460ms] refreshing cache from master, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1464ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2520ms] refreshing cache from master, [2520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2521ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2522ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3020ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3022ms] too many traces: truncated at 100 traces, deferred=Deferred@1007980784(state=PENDING, result=null, callback=(continuation of Deferred@596913690 after retry RPC after error@200187208) -> (continuation of Deferred@137885785 after retry RPC after error@280783551) -> (continuation of Deferred@307913292 after retry RPC after error@1830922642) -> (continuation of Deferred@1524855135 after retry RPC after error@695800110) -> (continuation of Deferred@1752190543 after retry RPC after error@150800362) -> (continuation of Deferred@1230366243 after retry RPC after error@683961926) -> (continuation of Deferred@1118588711 after retry RPC after error@579781327) -> (continuation of Deferred@1150049347 after retry RPC after error@1337048266) -> (continuation of Deferred@1875117932 after retry RPC after error@990390497) -> (continuation of Deferred@490734983 after retry RPC after error@1599454473) -> (continuation of Deferred@283455208 after retry RPC after error@1792033589) -> (continuation of Deferred@2007048149 after retry RPC after error@99506653) -> (continuation of Deferred@1011201510 after retry RPC after error@1415872688) -> (continuation of Deferred@725901918 after retry RPC after error@1553200730) -> (continuation of Deferred@1307083435 after retry RPC after error@1039788710) -> (continuation of Deferred@900147669 after retry RPC after error@1992632349) -> (continuation of Deferred@2133918132 after retry RPC after error@225409070) -> (continuation of Deferred@25821655 after retry RPC after error@1582322747) -> (continuation of Deferred@698077924 after retry RPC after error@1606644209) -> (continuation of Deferred@244733799 after retry RPC after error@1379609346) -> (continuation of Deferred@633397075 after retry RPC after error@1632141027) -> (continuation of Deferred@1574514882 after retry RPC after error@1446081344) -> (continuation of Deferred@1973945490 after retry RPC after error@1463141282) -> (continuation of Deferred@1132373670 after retry RPC after error@503867130) -> (continuation of Deferred@724663613 after retry RPC after error@1382060842) -> (continuation of Deferred@1679643734 after retry RPC after error@964673945) -> (continuation of Deferred@428317470 after retry RPC after error@1336455879), errback=(continuation of Deferred@596913690 after retry RPC after error@200187208) -> (continuation of Deferred@137885785 after retry RPC after error@280783551) -> (continuation of Deferred@307913292 after retry RPC after error@1830922642) -> (continuation of Deferred@1524855135 after retry RPC after error@695800110) -> (continuation of Deferred@1752190543 after retry RPC after error@150800362) -> (continuation of Deferred@1230366243 after retry RPC after error@683961926) -> (continuation of Deferred@1118588711 after retry RPC after error@579781327) -> (continuation of Deferred@1150049347 after retry RPC after error@1337048266) -> (continuation of Deferred@1875117932 after retry RPC after error@990390497) -> (continuation of Deferred@490734983 after retry RPC after error@1599454473) -> (continuation of Deferred@283455208 after retry RPC after error@1792033589) -> (continuation of Deferred@2007048149 after retry RPC after error@99506653) -> (continuation of Deferred@1011201510 after retry RPC after error@1415872688) -> (continuation of Deferred@725901918 after retry RPC after error@1553200730) -> (continuation of Deferred@1307083435 after retry RPC after error@1039788710) -> (continuation of Deferred@900147669 after retry RPC after error@1992632349) -> (continuation of Deferred@2133918132 after retry RPC after error@225409070) -> (continuation of Deferred@25821655 after retry RPC after error@1582322747) -> (continuation of Deferred@698077924 after retry RPC after error@1606644209) -> (continuation of Deferred@244733799 after retry RPC after error@1379609346) -> (continuation of Deferred@633397075 after retry RPC after error@1632141027) -> (continuation of Deferred@1574514882 after retry RPC after error@1446081344) -> (continuation of Deferred@1973945490 after retry RPC after error@1463141282) -> (continuation of Deferred@1132373670 after retry RPC after error@503867130) -> (continuation of Deferred@724663613 after retry RPC after error@1382060842) -> (continuation of Deferred@1679643734 after retry RPC after error@964673945) -> (continuation of Deferred@428317470 after retry RPC after error@1336455879)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:51.302 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
18:31:51.302 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29636), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [37ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [55ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [56ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [64ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [368ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [369ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [414ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [415ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [415ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [416ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [417ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [417ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [442ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [461ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [502ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [542ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [562ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [562ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [703ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [703ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [920ms] refreshing cache from master, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [921ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [922ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [922ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [923ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1280ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1284ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1284ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2000ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2002ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2002ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2003ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [4680ms] refreshing cache from master, [4680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [4682ms] too many traces: truncated at 100 traces, deferred=Deferred@171617885(state=PENDING, result=null, callback=(continuation of Deferred@1693399612 after retry RPC after error@519751128) -> (continuation of Deferred@746235013 after retry RPC after error@1936572177) -> (continuation of Deferred@1850623386 after retry RPC after error@642943374) -> (continuation of Deferred@1601527629 after retry RPC after error@1098839685) -> (continuation of Deferred@1568676261 after retry RPC after error@1865217378) -> (continuation of Deferred@441864445 after retry RPC after error@749357036) -> (continuation of Deferred@1908031213 after retry RPC after error@2041926237) -> (continuation of Deferred@1372333102 after retry RPC after error@791125212) -> (continuation of Deferred@264929923 after retry RPC after error@1555959453) -> (continuation of Deferred@1818471536 after retry RPC after error@2142309468) -> (continuation of Deferred@615798707 after retry RPC after error@139624286) -> (continuation of Deferred@2040746504 after retry RPC after error@235369100) -> (continuation of Deferred@143172912 after retry RPC after error@331056112) -> (continuation of Deferred@1886105757 after retry RPC after error@1162690318) -> (continuation of Deferred@144810930 after retry RPC after error@1196037461) -> (continuation of Deferred@1787345529 after retry RPC after error@1183931753) -> (continuation of Deferred@1135139386 after retry RPC after error@1423941543) -> (continuation of Deferred@2066463799 after retry RPC after error@933088302) -> (continuation of Deferred@845265389 after retry RPC after error@451619489) -> (continuation of Deferred@1015539663 after retry RPC after error@1705160909) -> (continuation of Deferred@1521730373 after retry RPC after error@424559760) -> (continuation of Deferred@443838953 after retry RPC after error@1780518578) -> (continuation of Deferred@785236312 after retry RPC after error@1162635989) -> (continuation of Deferred@2081337516 after retry RPC after error@305525889) -> (continuation of Deferred@1387409566 after retry RPC after error@1947132639) -> (continuation of Deferred@2106369826 after retry RPC after error@1084282350) -> (continuation of Deferred@55913380 after retry RPC after error@13515019), errback=(continuation of Deferred@1693399612 after retry RPC after error@519751128) -> (continuation of Deferred@746235013 after retry RPC after error@1936572177) -> (continuation of Deferred@1850623386 after retry RPC after error@642943374) -> (continuation of Deferred@1601527629 after retry RPC after error@1098839685) -> (continuation of Deferred@1568676261 after retry RPC after error@1865217378) -> (continuation of Deferred@441864445 after retry RPC after error@749357036) -> (continuation of Deferred@1908031213 after retry RPC after error@2041926237) -> (continuation of Deferred@1372333102 after retry RPC after error@791125212) -> (continuation of Deferred@264929923 after retry RPC after error@1555959453) -> (continuation of Deferred@1818471536 after retry RPC after error@2142309468) -> (continuation of Deferred@615798707 after retry RPC after error@139624286) -> (continuation of Deferred@2040746504 after retry RPC after error@235369100) -> (continuation of Deferred@143172912 after retry RPC after error@331056112) -> (continuation of Deferred@1886105757 after retry RPC after error@1162690318) -> (continuation of Deferred@144810930 after retry RPC after error@1196037461) -> (continuation of Deferred@1787345529 after retry RPC after error@1183931753) -> (continuation of Deferred@1135139386 after retry RPC after error@1423941543) -> (continuation of Deferred@2066463799 after retry RPC after error@933088302) -> (continuation of Deferred@845265389 after retry RPC after error@451619489) -> (continuation of Deferred@1015539663 after retry RPC after error@1705160909) -> (continuation of Deferred@1521730373 after retry RPC after error@424559760) -> (continuation of Deferred@443838953 after retry RPC after error@1780518578) -> (continuation of Deferred@785236312 after retry RPC after error@1162635989) -> (continuation of Deferred@2081337516 after retry RPC after error@305525889) -> (continuation of Deferred@1387409566 after retry RPC after error@1947132639) -> (continuation of Deferred@2106369826 after retry RPC after error@1084282350) -> (continuation of Deferred@55913380 after retry RPC after error@13515019)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29636), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [37ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [55ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [56ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [64ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [368ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [369ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [414ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [415ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [415ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [416ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [417ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [417ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [442ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [461ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [502ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [542ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [562ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [562ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [703ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [703ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [920ms] refreshing cache from master, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [921ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [922ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [922ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [923ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1280ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1282ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1284ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1284ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2000ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2002ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2002ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2003ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [4680ms] refreshing cache from master, [4680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [4681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [4682ms] too many traces: truncated at 100 traces, deferred=Deferred@171617885(state=PENDING, result=null, callback=(continuation of Deferred@1693399612 after retry RPC after error@519751128) -> (continuation of Deferred@746235013 after retry RPC after error@1936572177) -> (continuation of Deferred@1850623386 after retry RPC after error@642943374) -> (continuation of Deferred@1601527629 after retry RPC after error@1098839685) -> (continuation of Deferred@1568676261 after retry RPC after error@1865217378) -> (continuation of Deferred@441864445 after retry RPC after error@749357036) -> (continuation of Deferred@1908031213 after retry RPC after error@2041926237) -> (continuation of Deferred@1372333102 after retry RPC after error@791125212) -> (continuation of Deferred@264929923 after retry RPC after error@1555959453) -> (continuation of Deferred@1818471536 after retry RPC after error@2142309468) -> (continuation of Deferred@615798707 after retry RPC after error@139624286) -> (continuation of Deferred@2040746504 after retry RPC after error@235369100) -> (continuation of Deferred@143172912 after retry RPC after error@331056112) -> (continuation of Deferred@1886105757 after retry RPC after error@1162690318) -> (continuation of Deferred@144810930 after retry RPC after error@1196037461) -> (continuation of Deferred@1787345529 after retry RPC after error@1183931753) -> (continuation of Deferred@1135139386 after retry RPC after error@1423941543) -> (continuation of Deferred@2066463799 after retry RPC after error@933088302) -> (continuation of Deferred@845265389 after retry RPC after error@451619489) -> (continuation of Deferred@1015539663 after retry RPC after error@1705160909) -> (continuation of Deferred@1521730373 after retry RPC after error@424559760) -> (continuation of Deferred@443838953 after retry RPC after error@1780518578) -> (continuation of Deferred@785236312 after retry RPC after error@1162635989) -> (continuation of Deferred@2081337516 after retry RPC after error@305525889) -> (continuation of Deferred@1387409566 after retry RPC after error@1947132639) -> (continuation of Deferred@2106369826 after retry RPC after error@1084282350) -> (continuation of Deferred@55913380 after retry RPC after error@13515019), errback=(continuation of Deferred@1693399612 after retry RPC after error@519751128) -> (continuation of Deferred@746235013 after retry RPC after error@1936572177) -> (continuation of Deferred@1850623386 after retry RPC after error@642943374) -> (continuation of Deferred@1601527629 after retry RPC after error@1098839685) -> (continuation of Deferred@1568676261 after retry RPC after error@1865217378) -> (continuation of Deferred@441864445 after retry RPC after error@749357036) -> (continuation of Deferred@1908031213 after retry RPC after error@2041926237) -> (continuation of Deferred@1372333102 after retry RPC after error@791125212) -> (continuation of Deferred@264929923 after retry RPC after error@1555959453) -> (continuation of Deferred@1818471536 after retry RPC after error@2142309468) -> (continuation of Deferred@615798707 after retry RPC after error@139624286) -> (continuation of Deferred@2040746504 after retry RPC after error@235369100) -> (continuation of Deferred@143172912 after retry RPC after error@331056112) -> (continuation of Deferred@1886105757 after retry RPC after error@1162690318) -> (continuation of Deferred@144810930 after retry RPC after error@1196037461) -> (continuation of Deferred@1787345529 after retry RPC after error@1183931753) -> (continuation of Deferred@1135139386 after retry RPC after error@1423941543) -> (continuation of Deferred@2066463799 after retry RPC after error@933088302) -> (continuation of Deferred@845265389 after retry RPC after error@451619489) -> (continuation of Deferred@1015539663 after retry RPC after error@1705160909) -> (continuation of Deferred@1521730373 after retry RPC after error@424559760) -> (continuation of Deferred@443838953 after retry RPC after error@1780518578) -> (continuation of Deferred@785236312 after retry RPC after error@1162635989) -> (continuation of Deferred@2081337516 after retry RPC after error@305525889) -> (continuation of Deferred@1387409566 after retry RPC after error@1947132639) -> (continuation of Deferred@2106369826 after retry RPC after error@1084282350) -> (continuation of Deferred@55913380 after retry RPC after error@13515019)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.68.188:38393
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:31:51.303 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:31:51.304 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#3 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
18:31:51.304 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#3) of source Source: KuduSource.
18:31:51.304 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
18:31:51.306 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
18:31:51.307 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1318) Discarding the results produced by task execution 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
18:31:51.307 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job fa73e37017778341a79e5b3ef3d55eb9
18:31:51.308 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:51.308 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:51.308 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:51.309 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.309 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.309 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.309 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.310 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.310 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.310 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.310 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.310 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.310 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:51.311 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:51.311 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:51.312 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:51.312 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:51.312 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:51.312 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:51.312 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:51.312 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:51.312 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:51.313 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:51.313 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:51.313 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:51.313 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:51.328 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:51.328 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:51.328 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:51.329 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.329 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.329 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.329 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.329 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.330 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.330 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.330 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.330 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.330 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:51.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.343605  2022 tablet_service.cc:1511] Processing CreateTablet for tablet d0f1128a3fe04e489ce31d6c00c4ef07 (DEFAULT_TABLE table=replication_test_table [id=e368137a0f9646a79dfbc36dd286c50c]), partition=
18:31:51.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.345108  2022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f1128a3fe04e489ce31d6c00c4ef07. 1 dirs total, 0 dirs full, 0 dirs failed
18:31:51.348 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:51.348 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:51.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.348023  1879 tablet_service.cc:1511] Processing CreateTablet for tablet d0f1128a3fe04e489ce31d6c00c4ef07 (DEFAULT_TABLE table=replication_test_table [id=e368137a0f9646a79dfbc36dd286c50c]), partition=
18:31:51.348 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:51.349 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.349 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.349 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.349473  1879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f1128a3fe04e489ce31d6c00c4ef07. 1 dirs total, 0 dirs full, 0 dirs failed
18:31:51.349 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.349 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.350 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.350 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.350 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.350 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.350 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:51.368 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:51.368 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:51.368 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:51.369 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.369 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.369 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.369 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.369 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.369 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.370 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.370 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.370 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.370 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:51.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.382261  1731 tablet_service.cc:1511] Processing CreateTablet for tablet d0f1128a3fe04e489ce31d6c00c4ef07 (DEFAULT_TABLE table=replication_test_table [id=e368137a0f9646a79dfbc36dd286c50c]), partition=
18:31:51.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.384477  1731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f1128a3fe04e489ce31d6c00c4ef07. 1 dirs total, 0 dirs full, 0 dirs failed
18:31:51.388 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:51.388 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:51.388 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:51.389 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.389 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.389 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.389 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.389 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.389 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.389 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.390 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.390 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.390 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:51.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.399798  2184 tablet_bootstrap.cc:492] T d0f1128a3fe04e489ce31d6c00c4ef07 P 34e313c9f2af4b09ac792b1d56430135: Bootstrap starting.
18:31:51.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.408097  2184 tablet_bootstrap.cc:654] T d0f1128a3fe04e489ce31d6c00c4ef07 P 34e313c9f2af4b09ac792b1d56430135: Neither blocks nor log segments found. Creating new log.
18:31:51.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.410476  2184 log.cc:826] T d0f1128a3fe04e489ce31d6c00c4ef07 P 34e313c9f2af4b09ac792b1d56430135: Log is configured to *not* fsync() on all Append() calls
18:31:51.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.419718  2186 tablet_bootstrap.cc:492] T d0f1128a3fe04e489ce31d6c00c4ef07 P 7acd6e8275eb45be929bf583441c7eee: Bootstrap starting.
18:31:51.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.427100  2186 tablet_bootstrap.cc:654] T d0f1128a3fe04e489ce31d6c00c4ef07 P 7acd6e8275eb45be929bf583441c7eee: Neither blocks nor log segments found. Creating new log.
18:31:51.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.432163  2186 log.cc:826] T d0f1128a3fe04e489ce31d6c00c4ef07 P 7acd6e8275eb45be929bf583441c7eee: Log is configured to *not* fsync() on all Append() calls
18:31:51.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.445024  2184 tablet_bootstrap.cc:492] T d0f1128a3fe04e489ce31d6c00c4ef07 P 34e313c9f2af4b09ac792b1d56430135: No bootstrap required, opened a new log
18:31:51.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.448387  2186 tablet_bootstrap.cc:492] T d0f1128a3fe04e489ce31d6c00c4ef07 P 7acd6e8275eb45be929bf583441c7eee: No bootstrap required, opened a new log
18:31:51.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.450506  2184 ts_tablet_manager.cc:1403] T d0f1128a3fe04e489ce31d6c00c4ef07 P 34e313c9f2af4b09ac792b1d56430135: Time spent bootstrapping tablet: real 0.051s	user 0.032s	sys 0.011s
18:31:51.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.449020  2186 ts_tablet_manager.cc:1403] T d0f1128a3fe04e489ce31d6c00c4ef07 P 7acd6e8275eb45be929bf583441c7eee: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.011s
18:31:51.468 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:51.468 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:51.468 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:51.469 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.469 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.469 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.469 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.469 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.469 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.470 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.470 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.470 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.470 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:51.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.474350  2188 tablet_bootstrap.cc:492] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f: Bootstrap starting.
18:31:51.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.485631  2184 raft_consensus.cc:359] T d0f1128a3fe04e489ce31d6c00c4ef07 P 34e313c9f2af4b09ac792b1d56430135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd6e8275eb45be929bf583441c7eee" member_type: VOTER last_known_addr { host: "127.1.59.130" port: 36365 } } peers { permanent_uuid: "5a4601fd26394edfbfbe4479bc35fd3f" member_type: VOTER last_known_addr { host: "127.1.59.129" port: 44129 } } peers { permanent_uuid: "34e313c9f2af4b09ac792b1d56430135" member_type: VOTER last_known_addr { host: "127.1.59.131" port: 46483 } }
18:31:51.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.486538  2184 raft_consensus.cc:385] T d0f1128a3fe04e489ce31d6c00c4ef07 P 34e313c9f2af4b09ac792b1d56430135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:51.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.486842  2184 raft_consensus.cc:740] T d0f1128a3fe04e489ce31d6c00c4ef07 P 34e313c9f2af4b09ac792b1d56430135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e313c9f2af4b09ac792b1d56430135, State: Initialized, Role: FOLLOWER
18:31:51.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.487848  2184 consensus_queue.cc:260] T d0f1128a3fe04e489ce31d6c00c4ef07 P 34e313c9f2af4b09ac792b1d56430135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd6e8275eb45be929bf583441c7eee" member_type: VOTER last_known_addr { host: "127.1.59.130" port: 36365 } } peers { permanent_uuid: "5a4601fd26394edfbfbe4479bc35fd3f" member_type: VOTER last_known_addr { host: "127.1.59.129" port: 44129 } } peers { permanent_uuid: "34e313c9f2af4b09ac792b1d56430135" member_type: VOTER last_known_addr { host: "127.1.59.131" port: 46483 } }
18:31:51.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.490096  2186 raft_consensus.cc:359] T d0f1128a3fe04e489ce31d6c00c4ef07 P 7acd6e8275eb45be929bf583441c7eee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd6e8275eb45be929bf583441c7eee" member_type: VOTER last_known_addr { host: "127.1.59.130" port: 36365 } } peers { permanent_uuid: "5a4601fd26394edfbfbe4479bc35fd3f" member_type: VOTER last_known_addr { host: "127.1.59.129" port: 44129 } } peers { permanent_uuid: "34e313c9f2af4b09ac792b1d56430135" member_type: VOTER last_known_addr { host: "127.1.59.131" port: 46483 } }
18:31:51.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.490921  2188 tablet_bootstrap.cc:654] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f: Neither blocks nor log segments found. Creating new log.
18:31:51.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.491535  2186 raft_consensus.cc:385] T d0f1128a3fe04e489ce31d6c00c4ef07 P 7acd6e8275eb45be929bf583441c7eee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:51.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.491976  2186 raft_consensus.cc:740] T d0f1128a3fe04e489ce31d6c00c4ef07 P 7acd6e8275eb45be929bf583441c7eee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7acd6e8275eb45be929bf583441c7eee, State: Initialized, Role: FOLLOWER
18:31:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.493019  2186 consensus_queue.cc:260] T d0f1128a3fe04e489ce31d6c00c4ef07 P 7acd6e8275eb45be929bf583441c7eee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd6e8275eb45be929bf583441c7eee" member_type: VOTER last_known_addr { host: "127.1.59.130" port: 36365 } } peers { permanent_uuid: "5a4601fd26394edfbfbe4479bc35fd3f" member_type: VOTER last_known_addr { host: "127.1.59.129" port: 44129 } } peers { permanent_uuid: "34e313c9f2af4b09ac792b1d56430135" member_type: VOTER last_known_addr { host: "127.1.59.131" port: 46483 } }
18:31:51.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.493875  2188 log.cc:826] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f: Log is configured to *not* fsync() on all Append() calls
18:31:51.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.508868  2184 ts_tablet_manager.cc:1434] T d0f1128a3fe04e489ce31d6c00c4ef07 P 34e313c9f2af4b09ac792b1d56430135: Time spent starting tablet: real 0.058s	user 0.024s	sys 0.010s
18:31:51.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.542704  2186 ts_tablet_manager.cc:1434] T d0f1128a3fe04e489ce31d6c00c4ef07 P 7acd6e8275eb45be929bf583441c7eee: Time spent starting tablet: real 0.090s	user 0.040s	sys 0.024s
18:31:51.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.557021  2188 tablet_bootstrap.cc:492] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f: No bootstrap required, opened a new log
18:31:51.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.557611  2188 ts_tablet_manager.cc:1403] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f: Time spent bootstrapping tablet: real 0.084s	user 0.019s	sys 0.017s
18:31:51.567 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:51.567 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:51.568 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:51.568 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.568 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.568 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.568 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.568 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.568 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.568 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.568 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.568 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.568 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:51.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.582752  2188 raft_consensus.cc:359] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd6e8275eb45be929bf583441c7eee" member_type: VOTER last_known_addr { host: "127.1.59.130" port: 36365 } } peers { permanent_uuid: "5a4601fd26394edfbfbe4479bc35fd3f" member_type: VOTER last_known_addr { host: "127.1.59.129" port: 44129 } } peers { permanent_uuid: "34e313c9f2af4b09ac792b1d56430135" member_type: VOTER last_known_addr { host: "127.1.59.131" port: 46483 } }
18:31:51.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.583630  2188 raft_consensus.cc:385] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:31:51.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.583879  2188 raft_consensus.cc:740] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a4601fd26394edfbfbe4479bc35fd3f, State: Initialized, Role: FOLLOWER
18:31:51.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.584780  2188 consensus_queue.cc:260] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd6e8275eb45be929bf583441c7eee" member_type: VOTER last_known_addr { host: "127.1.59.130" port: 36365 } } peers { permanent_uuid: "5a4601fd26394edfbfbe4479bc35fd3f" member_type: VOTER last_known_addr { host: "127.1.59.129" port: 44129 } } peers { permanent_uuid: "34e313c9f2af4b09ac792b1d56430135" member_type: VOTER last_known_addr { host: "127.1.59.131" port: 46483 } }
18:31:51.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.590396  2188 ts_tablet_manager.cc:1434] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f: Time spent starting tablet: real 0.032s	user 0.030s	sys 0.001s
18:31:51.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:51.603477  1810 tablet.cc:2406] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:31:51.607 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:51.608 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:51.608 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:51.608 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.608 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.608 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.608 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.608 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.608 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.608 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.608 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.608 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.609 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:51.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.680907  2192 raft_consensus.cc:493] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:31:51.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.681455  2192 raft_consensus.cc:515] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd6e8275eb45be929bf583441c7eee" member_type: VOTER last_known_addr { host: "127.1.59.130" port: 36365 } } peers { permanent_uuid: "5a4601fd26394edfbfbe4479bc35fd3f" member_type: VOTER last_known_addr { host: "127.1.59.129" port: 44129 } } peers { permanent_uuid: "34e313c9f2af4b09ac792b1d56430135" member_type: VOTER last_known_addr { host: "127.1.59.131" port: 46483 } }
18:31:51.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:51.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.684502  2192 leader_election.cc:290] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7acd6e8275eb45be929bf583441c7eee (127.1.59.130:36365), 34e313c9f2af4b09ac792b1d56430135 (127.1.59.131:46483)
18:31:51.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:51.693459  2095 tablet.cc:2406] T d0f1128a3fe04e489ce31d6c00c4ef07 P 34e313c9f2af4b09ac792b1d56430135: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:31:51.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.698470  1899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f1128a3fe04e489ce31d6c00c4ef07" candidate_uuid: "5a4601fd26394edfbfbe4479bc35fd3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7acd6e8275eb45be929bf583441c7eee" is_pre_election: true
18:31:51.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.699362  1899 raft_consensus.cc:2468] T d0f1128a3fe04e489ce31d6c00c4ef07 P 7acd6e8275eb45be929bf583441c7eee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a4601fd26394edfbfbe4479bc35fd3f in term 0.
18:31:51.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.700834  1650 leader_election.cc:304] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a4601fd26394edfbfbe4479bc35fd3f, 7acd6e8275eb45be929bf583441c7eee; no voters: 
18:31:51.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.701220  2042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f1128a3fe04e489ce31d6c00c4ef07" candidate_uuid: "5a4601fd26394edfbfbe4479bc35fd3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e313c9f2af4b09ac792b1d56430135" is_pre_election: true
18:31:51.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.701761  2192 raft_consensus.cc:2804] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [term 0 FOLLOWER]: Leader pre-election won for term 1
18:31:51.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.702023  2042 raft_consensus.cc:2468] T d0f1128a3fe04e489ce31d6c00c4ef07 P 34e313c9f2af4b09ac792b1d56430135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a4601fd26394edfbfbe4479bc35fd3f in term 0.
18:31:51.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.702113  2192 raft_consensus.cc:493] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:31:51.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.702452  2192 raft_consensus.cc:3060] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [term 0 FOLLOWER]: Advancing to term 1
18:31:51.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.708847  2192 raft_consensus.cc:515] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd6e8275eb45be929bf583441c7eee" member_type: VOTER last_known_addr { host: "127.1.59.130" port: 36365 } } peers { permanent_uuid: "5a4601fd26394edfbfbe4479bc35fd3f" member_type: VOTER last_known_addr { host: "127.1.59.129" port: 44129 } } peers { permanent_uuid: "34e313c9f2af4b09ac792b1d56430135" member_type: VOTER last_known_addr { host: "127.1.59.131" port: 46483 } }
18:31:51.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.711166  2192 leader_election.cc:290] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [CANDIDATE]: Term 1 election: Requested vote from peers 7acd6e8275eb45be929bf583441c7eee (127.1.59.130:36365), 34e313c9f2af4b09ac792b1d56430135 (127.1.59.131:46483)
18:31:51.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.711817  1899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f1128a3fe04e489ce31d6c00c4ef07" candidate_uuid: "5a4601fd26394edfbfbe4479bc35fd3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7acd6e8275eb45be929bf583441c7eee"
18:31:51.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.712508  1899 raft_consensus.cc:3060] T d0f1128a3fe04e489ce31d6c00c4ef07 P 7acd6e8275eb45be929bf583441c7eee [term 0 FOLLOWER]: Advancing to term 1
18:31:51.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.716588  2042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f1128a3fe04e489ce31d6c00c4ef07" candidate_uuid: "5a4601fd26394edfbfbe4479bc35fd3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e313c9f2af4b09ac792b1d56430135"
18:31:51.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.717121  2042 raft_consensus.cc:3060] T d0f1128a3fe04e489ce31d6c00c4ef07 P 34e313c9f2af4b09ac792b1d56430135 [term 0 FOLLOWER]: Advancing to term 1
18:31:51.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.720783  1899 raft_consensus.cc:2468] T d0f1128a3fe04e489ce31d6c00c4ef07 P 7acd6e8275eb45be929bf583441c7eee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a4601fd26394edfbfbe4479bc35fd3f in term 1.
18:31:51.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.723460  2042 raft_consensus.cc:2468] T d0f1128a3fe04e489ce31d6c00c4ef07 P 34e313c9f2af4b09ac792b1d56430135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a4601fd26394edfbfbe4479bc35fd3f in term 1.
18:31:51.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.724433  1650 leader_election.cc:304] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34e313c9f2af4b09ac792b1d56430135, 5a4601fd26394edfbfbe4479bc35fd3f; no voters: 
18:31:51.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.725096  2192 raft_consensus.cc:2804] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [term 1 FOLLOWER]: Leader election won for term 1
18:31:51.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.727680  2192 raft_consensus.cc:697] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [term 1 LEADER]: Becoming Leader. State: Replica: 5a4601fd26394edfbfbe4479bc35fd3f, State: Running, Role: LEADER
18:31:51.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.729758  2192 consensus_queue.cc:237] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd6e8275eb45be929bf583441c7eee" member_type: VOTER last_known_addr { host: "127.1.59.130" port: 36365 } } peers { permanent_uuid: "5a4601fd26394edfbfbe4479bc35fd3f" member_type: VOTER last_known_addr { host: "127.1.59.129" port: 44129 } } peers { permanent_uuid: "34e313c9f2af4b09ac792b1d56430135" member_type: VOTER last_known_addr { host: "127.1.59.131" port: 46483 } }
18:31:51.749 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:51.749 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:51.749 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:51.750 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:51.750 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:51.750 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:51.750 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:51.750 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:51.750 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:51.750 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:51.750 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:51.750 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:51.751 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:51.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:51.749342  1474 catalog_manager.cc:5696] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a4601fd26394edfbfbe4479bc35fd3f (127.1.59.129). New cstate: current_term: 1 leader_uuid: "5a4601fd26394edfbfbe4479bc35fd3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7acd6e8275eb45be929bf583441c7eee" member_type: VOTER last_known_addr { host: "127.1.59.130" port: 36365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a4601fd26394edfbfbe4479bc35fd3f" member_type: VOTER last_known_addr { host: "127.1.59.129" port: 44129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e313c9f2af4b09ac792b1d56430135" member_type: VOTER last_known_addr { host: "127.1.59.131" port: 46483 } health_report { overall_health: UNKNOWN } } }
18:31:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:31:51.777472  1952 tablet.cc:2406] T d0f1128a3fe04e489ce31d6c00c4ef07 P 7acd6e8275eb45be929bf583441c7eee: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:31:51.827 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:51.828 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:51.828 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:51.828 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.828 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.828 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:51.829 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.829 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.829 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:51.828 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.829 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.829 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:51.829 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:51.852 [DEBUG - main] (Connection.java:575) [peer master-127.0.106.253:45189(127.0.106.253:45189)] disconnecting while in state READY
18:31:51.852 [DEBUG - main] (Connection.java:575) [peer master-127.0.106.254:32967(127.0.106.254:32967)] disconnecting while in state READY
18:31:51.852 [DEBUG - main] (Connection.java:575) [peer master-127.0.106.252:46705(127.0.106.252:46705)] disconnecting while in state READY
18:31:51.853 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.0.106.252:46705(127.0.106.252:46705)] handling channelInactive
18:31:51.853 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state READY due to: connection closed
18:31:51.853 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:51.853 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.0.106.253:45189(127.0.106.253:45189)] handling channelInactive
18:31:51.855 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state READY due to: connection closed
18:31:51.856 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
18:31:51.856 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
18:31:51.857 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.0.106.254:32967(127.0.106.254:32967)] handling channelInactive
18:31:51.857 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state READY due to: connection closed
18:31:51.857 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-0
18:31:51.857 [DEBUG - main] (Connection.java:575) [peer master-127.1.59.189:42073(127.1.59.189:42073)] disconnecting while in state READY
18:31:51.857 [DEBUG - main] (Connection.java:575) [peer master-127.1.59.188:33901(127.1.59.188:33901)] disconnecting while in state READY
18:31:51.857 [DEBUG - main] (Connection.java:575) [peer master-127.1.59.190:46863(127.1.59.190:46863)] disconnecting while in state READY
18:31:51.858 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.1.59.189:42073(127.1.59.189:42073)] handling channelInactive
18:31:51.858 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.1.59.190:46863(127.1.59.190:46863)] handling channelInactive
18:31:51.858 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state READY due to: connection closed
18:31:51.858 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state READY due to: connection closed
18:31:51.859 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:51.860 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:51.861 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
18:31:51.861 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.1.59.188:33901(127.1.59.188:33901)] handling channelInactive
18:31:51.862 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state READY due to: connection closed
18:31:51.862 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
18:31:51.864 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:31:51.864 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
18:31:51.864 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
18:31:51.864 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:31:51.864 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:31:51.864 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:31:51.884 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
18:31:51.884 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
18:31:51.884 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
18:31:51.885 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
18:31:51.885 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
18:31:51.885 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
18:31:51.885 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
18:31:51.920 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:51.920 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:51.920 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:51.921 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:51.921 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:51.921 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:51.921 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:51.921 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:51.921 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:51.922 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:51.922 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:51.922 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:51.922 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:51.951 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:51.951 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:51.951 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:51.951 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:51.951 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:51.951 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:51.952 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:51.952 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:51.952 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:51.952 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:51.952 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:51.952 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:51.952 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:52.047 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:52.048 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:52.048 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:52.048 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:52.048 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:52.048 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:52.048 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:52.048 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:52.048 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:52.048 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:52.048 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:52.048 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:52.048 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:52.118 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
18:31:52.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:52.182 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
18:31:52.182 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
18:31:52.182 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
18:31:52.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:52.223038  2192 consensus_queue.cc:1048] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7acd6e8275eb45be929bf583441c7eee" member_type: VOTER last_known_addr { host: "127.1.59.130" port: 36365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:31:52.223 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
18:31:52.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:52.327543  2192 consensus_queue.cc:1048] T d0f1128a3fe04e489ce31d6c00c4ef07 P 5a4601fd26394edfbfbe4479bc35fd3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e313c9f2af4b09ac792b1d56430135" member_type: VOTER last_known_addr { host: "127.1.59.131" port: 46483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:31:52.367 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:52.368 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:52.368 [DEBUG - pool-110-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:52.368 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:52.369 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:52.369 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:52.369 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:52.369 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:52.369 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:52.369 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:52.369 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:52.369 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:52.370 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:52.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:52.899 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:52.900 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:52.900 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:52.900 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:52.900 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:52.900 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:52.900 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:52.900 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:52.900 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:52.901 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:52.901 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:52.901 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:52.901 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:52.959 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RESTARTING to RUNNING.
18:31:52.960 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job fa73e37017778341a79e5b3ef3d55eb9 from Checkpoint 69 @ 1783535448409 for fa73e37017778341a79e5b3ef3d55eb9 located at file:/tmp/junit12731664100414606042/checkpoints/fa73e37017778341a79e5b3ef3d55eb9/chk-69.
18:31:52.962 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
18:31:52.962 [INFO - flink-pekko.actor.default-dispatcher-9] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:31:52.963 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to SCHEDULED.
18:31:52.963 [INFO - Thread-21] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:31:52.963 [DEBUG - Thread-21] (Connection.java:575) [peer master-127.28.68.190:40429(127.28.68.190:40429)] disconnecting while in state TERMINATED
18:31:52.963 [DEBUG - Thread-21] (Connection.java:575) [peer master-127.28.68.188:38393(127.28.68.188:38393)] disconnecting while in state TERMINATED
18:31:52.964 [DEBUG - Thread-21] (Connection.java:575) [peer master-127.28.68.189:33753(127.28.68.189:33753)] disconnecting while in state TERMINATED
18:31:52.964 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:52.964 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:31:52.964 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
18:31:52.965 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from SCHEDULED to DEPLOYING.
18:31:52.965 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #4) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 1623ba59e704d1676486c6f13d60068c
18:31:52.965 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to SCHEDULED.
18:31:52.965 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 1623ba59e704d1676486c6f13d60068c.
18:31:52.967 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_4), deploy into slot with allocation id 1623ba59e704d1676486c6f13d60068c.
18:31:52.968 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:31:52.968 [INFO - Thread-21] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:31:52.968 [INFO - Thread-21] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:31:52.968 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from SCHEDULED to DEPLOYING.
18:31:52.968 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #4) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 409256c48f07c3602c01f545df4e7b3c
18:31:52.969 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to SCHEDULED.
18:31:52.969 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:31:52.970 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from SCHEDULED to DEPLOYING.
18:31:52.970 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #3) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 120c9de24dd4d7d83c84cb1a65b36252
18:31:52.970 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to SCHEDULED.
18:31:52.970 [DEBUG - Thread-21] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:52.971 [INFO - Thread-21] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:31:52.971 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from SCHEDULED to DEPLOYING.
18:31:52.971 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #4) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d
18:31:52.971 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:31:52.972 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 409256c48f07c3602c01f545df4e7b3c.
18:31:52.973 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to DEPLOYING.
18:31:52.973 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) [DEPLOYING].
18:31:52.974 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1f147d0a
18:31:52.974 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:52.974 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_4), deploy into slot with allocation id 409256c48f07c3602c01f545df4e7b3c.
18:31:52.974 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:31:52.973 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:31:52.975 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
18:31:52.975 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:31:52.975 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:31:52.975 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:31:52.975 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
18:31:52.978 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 120c9de24dd4d7d83c84cb1a65b36252.
18:31:52.979 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to DEPLOYING.
18:31:52.979 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_4) [DEPLOYING].
18:31:52.979 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@200d7981
18:31:52.980 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7c4cb326
18:31:52.980 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:52.980 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:31:52.980 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
18:31:52.980 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
18:31:52.982 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:52.983 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@9340d53
18:31:52.983 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_3), deploy into slot with allocation id 120c9de24dd4d7d83c84cb1a65b36252.
18:31:52.985 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:52.986 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:52.987 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot fe2a3c24d55fce5c8d5a55c4e880b53d.
18:31:52.988 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_4), deploy into slot with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d.
18:31:52.988 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to DEPLOYING.
18:31:52.989 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_4) [DEPLOYING].
18:31:52.989 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@77fd0861
18:31:52.989 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:52.989 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:31:52.990 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
18:31:52.990 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
18:31:52.991 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to DEPLOYING.
18:31:52.991 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) [DEPLOYING].
18:31:52.992 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7d333032
18:31:52.992 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:52.992 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:31:52.992 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
18:31:52.992 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
18:31:52.993 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@416fc518
18:31:52.995 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:52.996 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4e542358
18:31:52.998 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:52.999 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:52.999 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.000 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.000 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.000 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.001 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:53.002 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.002 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.003 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.003 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.003 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.003 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.004 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.004 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.004 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.004 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.005 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:53.005 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.005 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.005 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.015 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.017 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.017 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.017 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.021 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.022 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.022 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.022 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.027 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.027 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.027 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.027 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.027 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.028 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.028 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.029 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.030 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.030 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.030 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.030 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.030 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.031 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.031 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.031 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.032 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.032 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.032 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:53.032 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.033 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.033 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.033 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.034 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.034 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.034 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.035 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.035 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.035 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.035 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:53.036 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.036 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.036 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.037 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.037 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.037 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.037 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:53.041 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.042 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:53.042 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.042 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.044 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.045 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.045 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.045 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.045 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.046 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.046 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.046 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.046 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.048 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.049 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.049 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.049 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.051 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.051 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.051 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.051 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.056 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.057 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.057 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.057 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.058 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.058 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.058 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.058 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.061 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.062 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.065 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.066 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.066 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.066 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.066 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.067 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.067 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.067 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.067 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.068 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.068 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.068 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.073 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.073 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.073 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.073 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.077 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.077 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.077 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.077 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.081 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:53.082 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.082 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.082 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.082 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.083 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:53.083 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.083 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.083 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.084 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.090 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.090 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.090 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.091 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.092 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.092 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.092 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.092 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.092 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.093 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.093 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.093 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.093 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.093 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.093 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.094 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.094 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.094 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.094 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.095 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.095 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.095 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.095 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.096 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.096 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.096 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.096 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.096 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.097 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.097 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.097 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.098 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.098 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.098 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.098 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.099 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.099 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.099 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.099 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.099 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.099 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.100 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.100 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:53.101 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.101 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.101 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.101 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.102 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.102 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.102 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.102 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.102 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.102 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.103 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.103 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.103 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.103 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.103 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.103 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.103 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.103 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.104 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.104 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.104 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.104 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.104 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.104 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.104 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.105 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.105 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.105 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.105 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.105 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.105 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.105 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.106 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.106 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.106 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.106 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.106 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.106 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.106 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.107 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.107 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.108 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.108 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.108 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.108 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.108 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.108 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.109 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.109 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.109 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.109 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.109 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.121 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.121 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.121 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.121 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.121 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.121 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:53.121 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.122 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.122 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.122 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.122 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.122 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.122 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.122 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.122 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.123 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.123 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.122 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.123 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.123 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.123 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.123 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.123 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.123 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.123 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.123 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.123 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.123 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.124 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.124 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.124 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.124 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.124 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.124 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.124 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.124 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.124 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.124 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.124 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.124 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.126 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.127 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.127 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.127 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:53.127 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.127 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.127 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.128 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.128 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.128 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.128 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.128 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.128 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.128 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.129 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.129 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.129 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.130 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:53.130 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.130 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.130 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.130 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.130 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.133 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.133 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:53.141 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:53.141 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:53.142 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:53.142 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.142 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.142 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.142 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.142 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.143 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.143 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.143 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.143 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.143 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:53.143 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.143 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.144 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.144 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.144 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.144 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.144 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.144 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.144 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.145 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.145 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.145 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.145 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.145 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.145 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.145 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.145 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.146 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.146 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.146 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.146 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.146 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.146 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.146 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.146 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.146 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.146 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.146 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.147 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.147 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.147 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.147 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.147 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.147 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.147 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.147 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.147 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.147 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.147 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.159 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
18:31:53.161 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:53.161 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:53.161 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:53.162 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.162 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.162 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.162 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.162 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.162 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.162 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.162 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.162 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.163 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.163 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.163 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.163 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.163 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.163 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.163 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.162 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.163 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:53.163 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.164 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.164 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.164 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.164 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.175 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
18:31:53.181 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.181 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.181 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.181 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.181 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.182 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.182 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.182 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.182 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.182 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.182 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.182 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.182 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.185 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:53.186 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.187 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.187 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.187 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.187 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.187 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.187 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.187 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.187 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.188 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.188 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.188 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.189 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.201 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:53.201 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:53.201 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:53.201 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.201 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.201 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.201 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.202 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.202 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.202 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.202 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.202 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.202 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.202 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:53.202 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.202 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.202 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.203 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.203 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.203 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.203 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.203 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.203 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.203 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.203 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.203 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.221 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
18:31:53.223 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.223 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.223 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.223 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.224 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.224 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.224 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.224 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.224 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.224 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.224 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.224 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.224 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.241 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:53.241 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:53.241 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:53.242 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.242 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.242 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.242 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.242 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.242 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.242 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.242 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.242 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.242 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:53.243 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.243 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.243 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.244 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.244 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.244 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.244 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.244 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.244 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.244 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.245 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.245 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.245 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.246 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.246 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.247 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.247 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.247 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.247 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.248 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.248 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.248 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.249 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.249 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.249 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.249 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.251 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
18:31:53.261 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:53.261 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:53.261 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:53.261 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.261 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.261 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.262 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.262 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.262 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.261 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.262 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.262 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.262 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:53.269 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
18:31:53.283 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.283 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.283 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.284 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.284 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.284 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.284 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.284 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.285 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.285 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.285 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.285 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.285 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.288 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
18:31:53.289 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
18:31:53.289 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
18:31:53.290 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
18:31:53.290 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
18:31:53.290 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
18:31:53.290 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
18:31:53.291 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
18:31:53.291 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
18:31:53.291 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
18:31:53.292 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
18:31:53.292 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
18:31:53.292 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
18:31:53.292 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
18:31:53.292 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
18:31:53.292 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
18:31:53.292 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
18:31:53.292 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
18:31:53.293 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
18:31:53.293 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
18:31:53.293 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
18:31:53.294 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
18:31:53.294 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
18:31:53.294 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
18:31:53.294 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_f0745c91101114d89c737e2836cb2828/blobStorage
18:31:53.295 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:43139 - max concurrent requests: 50 - max backlog: 1000
18:31:53.301 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.302 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.302 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.302 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.302 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.302 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.302 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.302 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.302 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.302 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.302 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.302 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.302 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.302 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.303 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.303 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.303 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.303 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.303 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.303 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.303 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.303 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.303 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.303 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.303 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.303 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.312 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_f0745c91101114d89c737e2836cb2828/blobStorage
18:31:53.313 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_f0745c91101114d89c737e2836cb2828/blobStorage
18:31:53.314 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
18:31:53.315 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 1d03ac8f-9014-4e11-a73d-f29e736712bb
18:31:53.317 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 32 GB (66.67% usable)
18:31:53.317 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-acf1a867-99cb-4169-afe7-7041959c9264
18:31:53.319 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-29a0abf4-3261-4f57-9aab-7b022df2f0e4
18:31:53.327 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.327 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.327 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.327 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.327 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.328 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.328 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.328 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.328 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.328 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.329 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.329 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.329 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.386 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.387 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.387 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.387 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.388 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.388 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.388 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.388 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.388 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.388 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.388 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.388 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.388 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.396 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
18:31:53.397 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
18:31:53.397 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
18:31:53.397 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
18:31:53.398 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
18:31:53.400 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_8 .
18:31:53.405 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
18:31:53.405 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-a2982c9b-b3f8-4207-88c2-a9c1f964a73f
18:31:53.406 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
18:31:53.406 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
18:31:53.411 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:53.412 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:53.412 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:53.412 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:53.412 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:53.412 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:53.413 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:53.413 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:53.413 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:53.413 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:53.413 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:53.413 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:53.413 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:53.416 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
18:31:53.416 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
18:31:53.426 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:37337
18:31:53.426 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
18:31:53.428 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
18:31:53.429 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:37337 was granted leadership with leaderSessionID=220d8001-a694-4ceb-841c-16317ccd8bd8
18:31:53.429 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:37337 , session=220d8001-a694-4ceb-841c-16317ccd8bd8
18:31:53.435 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
18:31:53.435 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
18:31:53.435 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 1eb97a54-2fcf-4f31-b083-3630f58d9a5d. Creating new DispatcherLeaderProcess.
18:31:53.435 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
18:31:53.436 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
18:31:53.436 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
18:31:53.436 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
18:31:53.437 [INFO - pool-149-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id a518a9d2-e476-4ecd-8c7d-3dc92eeb2153.
18:31:53.439 [INFO - mini-cluster-io-thread-4] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_9 .
18:31:53.441 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:53.441 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:53.441 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:53.441 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.441 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.442 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.442 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.442 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.442 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.441 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.442 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.442 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.442 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:53.444 [INFO - pool-149-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_10 .
18:31:53.445 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_9 , session=1eb97a54-2fcf-4f31-b083-3630f58d9a5d
18:31:53.449 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:253) Starting the resource manager.
18:31:53.455 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:212) Starting the slot manager.
18:31:53.455 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:308) Starting tokens update task
18:31:53.456 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
18:31:53.456 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
18:31:53.457 [INFO - mini-cluster-io-thread-3] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_10 , session=a518a9d2-e476-4ecd-8c7d-3dc92eeb2153
18:31:53.474 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_10(8c7d3dc92eeb2153a518a9d2e4764ecd).
18:31:53.492 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (4cd649562a0f5305571102b5c888c5a9).
18:31:53.493 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (4cd649562a0f5305571102b5c888c5a9).
18:31:53.494 [INFO - flink-pekko.actor.default-dispatcher-7] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-4cd649562a0f5305571102b5c888c5a9'.
18:31:53.494 [INFO - mini-cluster-io-thread-2] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 4cd649562a0f5305571102b5c888c5a9 was granted leadership with leader id 6419eace-28b3-4303-92d1-a1824d709f37. Creating new JobMasterServiceProcess.
18:31:53.496 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_11 .
18:31:53.498 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
18:31:53.501 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.501 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.501 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.501 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.501 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.502 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.502 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.502 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.502 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.502 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.502 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.502 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.503 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.503 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:1080) Registering TaskManager with ResourceID 1d03ac8f-9014-4e11-a73d-f29e736712bb (pekko://flink/user/rpc/taskmanager_8) at ResourceManager
18:31:53.504 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_10 under registration id 284d69f6e9f655c4cb9dd70c36475555.
18:31:53.504 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:344) Registering task executor 1d03ac8f-9014-4e11-a73d-f29e736712bb under 284d69f6e9f655c4cb9dd70c36475555 at the slot manager.
18:31:53.506 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (4cd649562a0f5305571102b5c888c5a9).
18:31:53.507 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9).
18:31:53.507 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 98e5c1d86bc65faceedd09bcb151d258 for job 4cd649562a0f5305571102b5c888c5a9.
18:31:53.508 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9).
18:31:53.508 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
18:31:53.509 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
18:31:53.510 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@21624628
18:31:53.510 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:53.510 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:31:53.515 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
18:31:53.516 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@5a7ce73b for Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9).
18:31:53.516 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_11 , session=6419eace-28b3-4303-92d1-a1824d709f37
18:31:53.517 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (4cd649562a0f5305571102b5c888c5a9) under job master id 92d1a1824d709f376419eace28b34303.
18:31:53.517 [INFO - flink-pekko.actor.default-dispatcher-5] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:31:53.519 [DEBUG - flink-pekko.actor.default-dispatcher-5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:53.522 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
18:31:53.522 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.522 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9) switched from state CREATED to RUNNING.
18:31:53.522 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.522 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.523 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.523 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.523 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.524 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.524 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.524 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.524 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.524 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.524 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.524 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.524 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
18:31:53.525 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:31:53.525 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
18:31:53.525 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
18:31:53.526 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
18:31:53.526 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:31:53.526 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_10(8c7d3dc92eeb2153a518a9d2e4764ecd)
18:31:53.528 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
18:31:53.529 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:390) Registering job manager 92d1a1824d709f376419eace28b34303@pekko://flink/user/rpc/jobmanager_11 for job 4cd649562a0f5305571102b5c888c5a9.
18:31:53.532 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.0.106.254:32967(127.0.106.254:32967)] Successfully connected to peer
18:31:53.532 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:53.534 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:1015) Registered job manager 92d1a1824d709f376419eace28b34303@pekko://flink/user/rpc/jobmanager_11 for job 4cd649562a0f5305571102b5c888c5a9.
18:31:53.534 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:31:53.537 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.0.106.254
18:31:53.535 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.0.106.253:45189(127.0.106.253:45189)] Successfully connected to peer
18:31:53.542 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.0.106.253
18:31:53.543 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.543 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.543 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.544 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.544 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.544 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.544 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.544 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.544 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.545 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.545 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.545 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.545 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.549 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.553 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: 8c7d3dc92eeb2153a518a9d2e4764ecd.
18:31:53.553 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.554 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:31:53.554 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8ecc5138, L:/127.0.0.1:54954 - R:/127.0.106.254:32967] using SASL/PLAIN
18:31:53.557 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x37263e88, L:/127.0.0.1:43232 - R:/127.0.106.253:45189] using SASL/PLAIN
18:31:53.559 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:31:53.559 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=34), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [34ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: OK, deferred=null) after lookup
18:31:53.561 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.561 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.561 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.562 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.562 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.562 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.562 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.562 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.562 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.555 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.0.106.252:46705(127.0.106.252:46705)] Successfully connected to peer
18:31:53.563 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.563 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.563 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.563 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.564 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 76bbf70ff510462a93a28833882099ea
18:31:53.567 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 4cd649562a0f5305571102b5c888c5a9
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 1d03ac8f-9014-4e11-a73d-f29e736712bb
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
18:31:53.567 [DEBUG - main] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:31:53.568 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 163e6d56962e3a45c0e4353eb3be3a9b from 1d03ac8f-9014-4e11-a73d-f29e736712bb for job 4cd649562a0f5305571102b5c888c5a9 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:31:53.568 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot c230971fad26d6cfa2b63ff44e7a1af5 from 1d03ac8f-9014-4e11-a73d-f29e736712bb for job 4cd649562a0f5305571102b5c888c5a9 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:31:53.569 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot d0320e7b86362daa97e494337af6f333 from 1d03ac8f-9014-4e11-a73d-f29e736712bb for job 4cd649562a0f5305571102b5c888c5a9 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:31:53.569 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 577db455445946b4b3637f89e9e8da72 for table 'replication_test_table' with partition [<start>, <end>)
18:31:53.569 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=577db455445946b4b3637f89e9e8da72@[0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)[L],6f21d544834a406f92f688ea6d5a8dba(127.0.106.194:45251),fa977f48a0f448969dae707cebb47d86(127.0.106.193:33681)]}]
18:31:53.569 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 0abd8d1f15ad274a5029e6ed83960f8c from 1d03ac8f-9014-4e11-a73d-f29e736712bb for job 4cd649562a0f5305571102b5c888c5a9 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:31:53.569 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1149) Receive slot request 163e6d56962e3a45c0e4353eb3be3a9b for job 4cd649562a0f5305571102b5c888c5a9 from resource manager with leader id 8c7d3dc92eeb2153a518a9d2e4764ecd.
18:31:53.569 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:321) Allocated slot for 163e6d56962e3a45c0e4353eb3be3a9b with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:31:53.577 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.579 [DEBUG - main] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:31:53.580 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.1.59.190:46863(127.1.59.190:46863)] Successfully connected to peer
18:31:53.580 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:192) Add job 4cd649562a0f5305571102b5c888c5a9 for job leader monitoring.
18:31:53.580 [INFO - mini-cluster-io-thread-2] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_11 with leader id 6419eace-28b3-4303-92d1-a1824d709f37.
18:31:53.580 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x4d6fb9a8, L:/127.0.0.1:35552 - R:/127.0.106.252:46705] using TOKEN/null
18:31:53.581 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:53.581 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:53.581 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:53.582 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.582 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.582 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.582 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:53.582 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.582 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:53.582 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.582 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.583 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:53.583 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:53.583 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1149) Receive slot request c230971fad26d6cfa2b63ff44e7a1af5 for job 4cd649562a0f5305571102b5c888c5a9 from resource manager with leader id 8c7d3dc92eeb2153a518a9d2e4764ecd.
18:31:53.583 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:321) Allocated slot for c230971fad26d6cfa2b63ff44e7a1af5 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:31:53.584 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
18:31:53.584 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1149) Receive slot request d0320e7b86362daa97e494337af6f333 for job 4cd649562a0f5305571102b5c888c5a9 from resource manager with leader id 8c7d3dc92eeb2153a518a9d2e4764ecd.
18:31:53.585 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:321) Allocated slot for d0320e7b86362daa97e494337af6f333 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:31:53.585 [DEBUG - main] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:31:53.586 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.1.59.189:42073(127.1.59.189:42073)] Successfully connected to peer
18:31:53.586 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1149) Receive slot request 0abd8d1f15ad274a5029e6ed83960f8c for job 4cd649562a0f5305571102b5c888c5a9 from resource manager with leader id 8c7d3dc92eeb2153a518a9d2e4764ecd.
18:31:53.586 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:321) Allocated slot for 0abd8d1f15ad274a5029e6ed83960f8c with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:31:53.589 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_11 for job 4cd649562a0f5305571102b5c888c5a9.
18:31:53.589 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1783) Establish JobManager connection for job 4cd649562a0f5305571102b5c888c5a9.
18:31:53.589 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 4cd649562a0f5305571102b5c888c5a9.
18:31:53.590 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
18:31:53.590 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id c230971fad26d6cfa2b63ff44e7a1af5
18:31:53.591 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot c230971fad26d6cfa2b63ff44e7a1af5.
18:31:53.592 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 4cd649562a0f5305571102b5c888c5a9.
18:31:53.592 [INFO - flink-pekko.actor.default-dispatcher-5] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
18:31:53.592 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 4cd649562a0f5305571102b5c888c5a9
18:31:53.592 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.189
18:31:53.593 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id c230971fad26d6cfa2b63ff44e7a1af5.
18:31:53.597 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.190
18:31:53.601 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
18:31:53.601 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id 0abd8d1f15ad274a5029e6ed83960f8c
18:31:53.607 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.607 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.1.59.188:33901(127.1.59.188:33901)] Successfully connected to peer
18:31:53.608 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 0abd8d1f15ad274a5029e6ed83960f8c.
18:31:53.609 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.609 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 0abd8d1f15ad274a5029e6ed83960f8c.
18:31:53.612 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
18:31:53.612 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
18:31:53.612 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb85ac4d8, L:/127.0.0.1:51810 - R:/127.1.59.190:46863] using SASL/PLAIN
18:31:53.613 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
18:31:53.613 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
18:31:53.614 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@46f23a71
18:31:53.614 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:53.615 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:31:53.615 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
18:31:53.617 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@17ee16af
18:31:53.617 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:53.619 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:31:53.620 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
18:31:53.620 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc25d522c, L:/127.0.0.1:40320 - R:/127.1.59.189:42073] using SASL/PLAIN
18:31:53.622 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.188
18:31:53.627 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
18:31:53.627 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id 163e6d56962e3a45c0e4353eb3be3a9b
18:31:53.627 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 163e6d56962e3a45c0e4353eb3be3a9b.
18:31:53.629 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
18:31:53.629 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id d0320e7b86362daa97e494337af6f333
18:31:53.629 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
18:31:53.630 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
18:31:53.631 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.632 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 163e6d56962e3a45c0e4353eb3be3a9b.
18:31:53.635 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xe3982573, L:/127.0.0.1:58930 - R:/127.1.59.188:33901] using SASL/PLAIN
18:31:53.643 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:31:53.643 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=95), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [49ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: OK, [56ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: OK, deferred=null) after lookup
18:31:53.643 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@29fa76ec
18:31:53.647 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table e368137a0f9646a79dfbc36dd286c50c
18:31:53.648 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@741cc6ba
18:31:53.649 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot d0320e7b86362daa97e494337af6f333.
18:31:53.650 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
18:31:53.650 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
18:31:53.651 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d0f1128a3fe04e489ce31d6c00c4ef07 for table 'replication_test_table' with partition [<start>, <end>)
18:31:53.651 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d0f1128a3fe04e489ce31d6c00c4ef07@[34e313c9f2af4b09ac792b1d56430135(127.1.59.131:46483),5a4601fd26394edfbfbe4479bc35fd3f(127.1.59.129:44129)[L],7acd6e8275eb45be929bf583441c7eee(127.1.59.130:36365)]}]
18:31:53.651 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id d0320e7b86362daa97e494337af6f333.
18:31:53.652 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.59.188:33901, [4ms] Sub RPC GetTableLocations: received response from server master-127.1.59.188:33901: OK, deferred=null)) after lookup
18:31:53.652 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 5a4601fd26394edfbfbe4479bc35fd3f(127.1.59.129:44129)] connecting to peer
18:31:53.653 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@78b4ede1
18:31:53.654 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:53.654 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:31:53.654 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
18:31:53.654 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
18:31:53.659 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:53.660 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
18:31:53.660 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
18:31:53.660 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot c230971fad26d6cfa2b63ff44e7a1af5.
18:31:53.660 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 0abd8d1f15ad274a5029e6ed83960f8c.
18:31:53.660 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 163e6d56962e3a45c0e4353eb3be3a9b.
18:31:53.660 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot d0320e7b86362daa97e494337af6f333.
18:31:53.661 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2b768e45
18:31:53.661 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:31:53.661 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:31:53.661 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:53.661 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
18:31:53.661 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
18:31:53.662 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 5a4601fd26394edfbfbe4479bc35fd3f(127.1.59.129:44129)] Successfully connected to peer
18:31:53.669 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@237e4b97
18:31:53.671 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:31:53.671 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:31:53.672 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:31:53.678 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:53.678 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.1.59.190:46863(127.1.59.190:46863)] Successfully connected to peer
18:31:53.678 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@30a3757d
18:31:53.681 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:53.685 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.686 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:53.687 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.190
18:31:53.691 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:31:53.692 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xc907487c, L:/127.0.0.1:49496 - R:/127.1.59.129:44129] using TOKEN/null
18:31:53.698 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.699 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.1.59.190:46863(127.1.59.190:46863)] Successfully connected to peer
18:31:53.705 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:31:53.706 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.1.59.188:33901(127.1.59.188:33901)] Successfully connected to peer
18:31:53.711 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:31:53.711 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.190
18:31:53.711 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d0f1128a3fe04e489ce31d6c00c4ef07, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:53.712 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0acaff2b, L:/127.0.0.1:51822 - R:/127.1.59.190:46863] using SASL/PLAIN
18:31:53.709 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.1.59.189:42073(127.1.59.189:42073)] Successfully connected to peer
18:31:53.708 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:31:53.719 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.1.59.189:42073(127.1.59.189:42073)] Successfully connected to peer
18:31:53.721 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.188
18:31:53.724 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:31:53.727 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:31:53.728 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.189
18:31:53.728 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.1.59.190:46863(127.1.59.190:46863)] Successfully connected to peer
18:31:53.731 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.189
18:31:53.735 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.190
18:31:53.739 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.1.59.188:33901(127.1.59.188:33901)] Successfully connected to peer
18:31:53.740 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.741 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.742 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.742 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.743 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.743 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.743 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.743 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.743 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.743 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.744 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.744 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.744 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.744 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.746 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.747 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x6e37a1db, L:/127.0.0.1:58946 - R:/127.1.59.188:33901] using SASL/PLAIN
18:31:53.747 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.749 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.188
18:31:53.750 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.755 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x22efa33b, L:/127.0.0.1:51838 - R:/127.1.59.190:46863] using SASL/PLAIN
18:31:53.759 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x74880ad5, L:/127.0.0.1:51850 - R:/127.1.59.190:46863] using SASL/PLAIN
18:31:53.764 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x661ec643, L:/127.0.0.1:40322 - R:/127.1.59.189:42073] using SASL/PLAIN
18:31:53.766 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.766 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.766 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.767 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.767 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.767 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.767 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.767 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.767 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.768 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.768 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.768 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.768 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.768 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d0f1128a3fe04e489ce31d6c00c4ef07, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:53.773 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:31:53.774 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.1.59.190:46863(127.1.59.190:46863)] Successfully connected to peer
18:31:53.775 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:31:53.775 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=113), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [88ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: OK, [99ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: OK, [104ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: OK, deferred=null) after lookup
18:31:53.780 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.190
18:31:53.781 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table e368137a0f9646a79dfbc36dd286c50c
18:31:53.784 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table e368137a0f9646a79dfbc36dd286c50c
18:31:53.784 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@d4d9ef0
18:31:53.786 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
18:31:53.787 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
18:31:53.790 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.790 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.796 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xf25db485, L:/127.0.0.1:40330 - R:/127.1.59.189:42073] using SASL/PLAIN
18:31:53.796 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9909e367, L:/127.0.0.1:58948 - R:/127.1.59.188:33901] using SASL/PLAIN
18:31:53.800 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:31:53.802 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.1.59.189:42073(127.1.59.189:42073)] Successfully connected to peer
18:31:53.803 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:31:53.803 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=144), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [46ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: OK, [130ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: OK, [132ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: OK, deferred=null) after lookup
18:31:53.806 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table e368137a0f9646a79dfbc36dd286c50c
18:31:53.810 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
18:31:53.810 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='684c56e8db214e69fe904989a8fcccbc2bd6d71e53f4851a6925f533403a4c93'}]
18:31:53.811 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.1.59.188:33901(127.1.59.188:33901)] Successfully connected to peer
18:31:53.812 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:53.813 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.815 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.189
18:31:53.815 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:31:53.816 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299998, tablet=577db455445946b4b3637f89e9e8da72@[0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809),6f21d544834a406f92f688ea6d5a8dba(127.0.106.194:45251),fa977f48a0f448969dae707cebb47d86(127.0.106.193:33681)[L]]}]
18:31:53.817 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
18:31:53.818 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:31:53.818 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.188
18:31:53.820 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table e368137a0f9646a79dfbc36dd286c50c
18:31:53.820 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.1.59.189:42073(127.1.59.189:42073)] Successfully connected to peer
18:31:53.820 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@f90bc1e
18:31:53.822 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
18:31:53.822 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
18:31:53.822 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.189
18:31:53.826 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.1.59.188:33901(127.1.59.188:33901)] Successfully connected to peer
18:31:53.833 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.59.188
18:31:53.838 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.840 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d0f1128a3fe04e489ce31d6c00c4ef07, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:53.841 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)] connecting to peer
18:31:53.846 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x296fe55e, L:/127.0.0.1:40348 - R:/127.1.59.189:42073] using SASL/PLAIN
18:31:53.847 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9405238f, L:/127.0.0.1:51858 - R:/127.1.59.190:46863] using SASL/PLAIN
18:31:53.853 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.855 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
18:31:53.856 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5116db44, L:/127.0.0.1:58970 - R:/127.1.59.188:33901] using SASL/PLAIN
18:31:53.860 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:31:53.861 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=179), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [51ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: OK, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [141ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: OK, [149ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: OK, deferred=null) after lookup
18:31:53.864 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:53.864 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:53.864 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table e368137a0f9646a79dfbc36dd286c50c
18:31:53.864 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:53.865 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.865 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.865 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.865 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.865 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:53.865 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.865 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:53.865 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.865 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:53.865 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:53.866 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.867 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table e368137a0f9646a79dfbc36dd286c50c
18:31:53.867 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3af1489f
18:31:53.869 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)] Successfully connected to peer
18:31:53.875 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.876 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x3c116264, L:/127.0.0.1:40336 - R:/127.1.59.189:42073] using SASL/PLAIN
18:31:53.880 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x118942e8, L:/127.0.0.1:58956 - R:/127.1.59.188:33901] using SASL/PLAIN
18:31:53.884 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:31:53.884 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=205), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [133ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: OK, [155ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: OK, [159ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: OK, deferred=null) after lookup
18:31:53.887 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table e368137a0f9646a79dfbc36dd286c50c
18:31:53.892 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table e368137a0f9646a79dfbc36dd286c50c
18:31:53.892 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@414c0eeb
18:31:53.895 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.0.106.195
18:31:53.898 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d0f1128a3fe04e489ce31d6c00c4ef07, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:53.903 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
18:31:53.904 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
18:31:53.904 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
18:31:53.904 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
18:31:53.904 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
18:31:53.908 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:53.919 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2403aaab, L:/127.0.0.1:48226 - R:/127.0.106.195:46809] using SASL/PLAIN
18:31:53.926 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
18:31:53.944 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false, responseScanTimestamp = 7305361463394304001) for scanner KuduScanner(table=replication_test_table, tablet=577db455445946b4b3637f89e9e8da72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:53.945 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [684c56e8db214e69fe904989a8fcccbc2bd6d71e53f4851a6925f533403a4c93]
18:31:53.947 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
18:31:53.948 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
18:31:53.954 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
18:31:53.954 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
18:31:53.968 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d0f1128a3fe04e489ce31d6c00c4ef07 for table 'replication_test_table' with partition [<start>, <end>)
18:31:53.968 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d0f1128a3fe04e489ce31d6c00c4ef07@[34e313c9f2af4b09ac792b1d56430135(127.1.59.131:46483),5a4601fd26394edfbfbe4479bc35fd3f(127.1.59.129:44129)[L],7acd6e8275eb45be929bf583441c7eee(127.1.59.130:36365)]}]
18:31:53.969 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d0f1128a3fe04e489ce31d6c00c4ef07 for table 'replication_test_table' with partition [<start>, <end>)
18:31:53.969 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d0f1128a3fe04e489ce31d6c00c4ef07@[34e313c9f2af4b09ac792b1d56430135(127.1.59.131:46483),5a4601fd26394edfbfbe4479bc35fd3f(127.1.59.129:44129)[L],7acd6e8275eb45be929bf583441c7eee(127.1.59.130:36365)]}]
18:31:53.970 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [684c56e8db214e69fe904989a8fcccbc2bd6d71e53f4851a6925f533403a4c93]
18:31:53.970 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:31:53.970 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:31:53.971 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)] disconnecting while in state READY
18:31:53.972 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:53.971 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 684c56e8db214e69fe904989a8fcccbc2bd6d71e53f4851a6925f533403a4c93 finished by subtask 0; deferring removal (restored in pending)
18:31:53.972 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d0f1128a3fe04e489ce31d6c00c4ef07, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:53.971 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d0f1128a3fe04e489ce31d6c00c4ef07 for table 'replication_test_table' with partition [<start>, <end>)
18:31:53.973 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d0f1128a3fe04e489ce31d6c00c4ef07@[34e313c9f2af4b09ac792b1d56430135(127.1.59.131:46483),5a4601fd26394edfbfbe4479bc35fd3f(127.1.59.129:44129)[L],7acd6e8275eb45be929bf583441c7eee(127.1.59.130:36365)]}]
18:31:53.989 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)] handling channelInactive
18:31:53.989 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)] cleaning up while in state READY due to: connection closed
18:31:53.989 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:31:53.989 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:31:54.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535514001 for job 4cd649562a0f5305571102b5c888c5a9.
18:31:54.005 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=8, operationSize=504, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4bb0cb3a, flushNotification=Deferred@27984124(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:31:54.005 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 5a4601fd26394edfbfbe4479bc35fd3f(127.1.59.129:44129)] connecting to peer
18:31:54.040 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:54.040 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 5a4601fd26394edfbfbe4479bc35fd3f(127.1.59.129:44129)] Successfully connected to peer
18:31:54.049 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d0f1128a3fe04e489ce31d6c00c4ef07, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:54.055 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:54.058 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x9484ccb5, L:/127.0.0.1:49506 - R:/127.1.59.129:44129] using TOKEN/null
18:31:54.106 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d0f1128a3fe04e489ce31d6c00c4ef07, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:54.163 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:54.163 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:54.164 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:54.164 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d0f1128a3fe04e489ce31d6c00c4ef07, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:54.164 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:54.164 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:54.165 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:54.165 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:54.165 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:54.165 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:54.166 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:54.166 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:54.166 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:54.166 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:54.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:54.223 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d0f1128a3fe04e489ce31d6c00c4ef07, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:54.241 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:54.242 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:54.242 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:54.242 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:54.242 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:54.243 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:54.243 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:54.243 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:54.243 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:54.243 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:54.243 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:54.244 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:54.244 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:54.261 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:54.261 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:54.262 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:54.262 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:54.262 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:54.262 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:54.263 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:54.263 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:54.263 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:54.263 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:54.263 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:54.263 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:54.263 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:54.263 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:54.263 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:54.263 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:54.264 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:54.264 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:54.264 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:54.264 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:54.264 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:54.264 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:54.264 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:54.264 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:54.264 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:54.265 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:54.284 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d0f1128a3fe04e489ce31d6c00c4ef07, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:54.309 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 4cd649562a0f5305571102b5c888c5a9 (1584 bytes, checkpointDuration=307 ms, finalizationTime=1 ms).
18:31:54.312 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
18:31:54.312 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 684c56e8db214e69fe904989a8fcccbc2bd6d71e53f4851a6925f533403a4c93 from pending
18:31:54.312 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 1 finished splits from enumerator state
18:31:54.328 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:54.328 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:54.329 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:54.329 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:54.329 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:54.329 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:54.329 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:54.329 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:54.329 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:54.330 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:54.330 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:54.330 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:54.330 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:54.342 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d0f1128a3fe04e489ce31d6c00c4ef07, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:54.347 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 76bbf70ff510462a93a28833882099ea
18:31:54.350 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table e368137a0f9646a79dfbc36dd286c50c
18:31:54.353 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 76bbf70ff510462a93a28833882099ea
18:31:54.359 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table e368137a0f9646a79dfbc36dd286c50c
18:31:54.363 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 76bbf70ff510462a93a28833882099ea
18:31:54.366 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table e368137a0f9646a79dfbc36dd286c50c
18:31:54.375 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=577db455445946b4b3637f89e9e8da72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:54.385 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d0f1128a3fe04e489ce31d6c00c4ef07, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:54.397 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=577db455445946b4b3637f89e9e8da72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:54.412 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d0f1128a3fe04e489ce31d6c00c4ef07, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:54.412 [DEBUG - main] (Connection.java:575) [peer 5a4601fd26394edfbfbe4479bc35fd3f(127.1.59.129:44129)] disconnecting while in state READY
18:31:54.412 [DEBUG - main] (Connection.java:575) [peer master-127.1.59.189:42073(127.1.59.189:42073)] disconnecting while in state READY
18:31:54.412 [DEBUG - main] (Connection.java:575) [peer master-127.1.59.188:33901(127.1.59.188:33901)] disconnecting while in state READY
18:31:54.412 [DEBUG - main] (Connection.java:575) [peer master-127.1.59.190:46863(127.1.59.190:46863)] disconnecting while in state READY
18:31:54.413 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.1.59.188:33901(127.1.59.188:33901)] handling channelInactive
18:31:54.413 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state READY due to: connection closed
18:31:54.414 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.1.59.190:46863(127.1.59.190:46863)] handling channelInactive
18:31:54.414 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state READY due to: connection closed
18:31:54.413 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.1.59.189:42073(127.1.59.189:42073)] handling channelInactive
18:31:54.414 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state READY due to: connection closed
18:31:54.415 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:54.416 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
18:31:54.416 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
18:31:54.416 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-2
18:31:54.418 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 5a4601fd26394edfbfbe4479bc35fd3f(127.1.59.129:44129)] handling channelInactive
18:31:54.418 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 5a4601fd26394edfbfbe4479bc35fd3f(127.1.59.129:44129)] cleaning up while in state READY due to: connection closed
18:31:54.419 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
18:31:54.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:54.419420  1262 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 1559
18:31:54.426 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:54.426 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:54.427 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:54.427 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:54.427 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:54.427 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:54.427 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:54.428 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:54.428 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:54.428 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:54.428 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:54.428 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:54.428 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:54.468 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 5a4601fd26394edfbfbe4479bc35fd3f(127.1.59.129:44129)] handling channelInactive
18:31:54.469 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 5a4601fd26394edfbfbe4479bc35fd3f(127.1.59.129:44129)] cleaning up while in state READY due to: connection closed
18:31:54.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:54.469137  1262 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 1807
18:31:54.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535514502 for job 4cd649562a0f5305571102b5c888c5a9.
18:31:54.533 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=31 ms, finalizationTime=0 ms).
18:31:54.534 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
18:31:54.535 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:54.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:54.539667  1262 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 1955
18:31:54.548 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:54.548 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:54.549 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:54.549 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:54.549 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:54.549 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:54.550 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:54.550 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:54.550 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:54.550 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:54.550 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:54.550 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:54.553 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:54.553 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:54.553 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:54.553 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:54.554 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:54.554 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:54.554 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:54.554 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:54.554 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:54.554 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:54.554 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:54.554 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:54.557 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:54.559 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:54.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:54.569270  1262 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 1275
18:31:54.601 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.1.59.190:46863(127.1.59.190:46863)] handling channelInactive
18:31:54.601 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state READY due to: connection closed
18:31:54.601 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.1.59.190:46863(127.1.59.190:46863)] handling channelInactive
18:31:54.601 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state READY due to: connection closed
18:31:54.602 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.1.59.190:46863(127.1.59.190:46863)] handling channelInactive
18:31:54.602 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state READY due to: connection closed
18:31:54.602 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.1.59.190:46863(127.1.59.190:46863)] handling channelInactive
18:31:54.602 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state READY due to: connection closed
18:31:54.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:54.603794  1262 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 1346
18:31:54.638 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.1.59.189:42073(127.1.59.189:42073)] handling channelInactive
18:31:54.638 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state READY due to: connection closed
18:31:54.638 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.1.59.189:42073(127.1.59.189:42073)] handling channelInactive
18:31:54.638 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state READY due to: connection closed
18:31:54.638 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.1.59.189:42073(127.1.59.189:42073)] handling channelInactive
18:31:54.638 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state READY due to: connection closed
18:31:54.639 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.1.59.189:42073(127.1.59.189:42073)] handling channelInactive
18:31:54.639 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state READY due to: connection closed
18:31:54.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:54.640188  1262 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 1428
18:31:54.673 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.1.59.188:33901(127.1.59.188:33901)] handling channelInactive
18:31:54.673 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state READY due to: connection closed
18:31:54.674 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.1.59.188:33901(127.1.59.188:33901)] handling channelInactive
18:31:54.674 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.1.59.188:33901(127.1.59.188:33901)] handling channelInactive
18:31:54.674 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state READY due to: connection closed
18:31:54.674 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state READY due to: connection closed
18:31:54.674 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.1.59.188:33901(127.1.59.188:33901)] handling channelInactive
18:31:54.674 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state READY due to: connection closed
18:31:54.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:54.752 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:54.753 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:54.753 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:54.753 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:54.755 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:54.755 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:54.755 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:54.755 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:54.755 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:54.756 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:54.756 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:54.756 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:54.756 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:54.803 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:54.804 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:54.804 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:54.804 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:54.805 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:54.805 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:54.805 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:54.805 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:54.805 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:54.805 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:54.805 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:54.805 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:54.806 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:55.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535515001 for job 4cd649562a0f5305571102b5c888c5a9.
18:31:55.023 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
18:31:55.025 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
18:31:55.032 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:55.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:55.488 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:55.489 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:55.489 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:55.489 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:55.489 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:55.489 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:55.489 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:55.489 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:55.489 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:55.490 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:55.490 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:55.490 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:55.490 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:55.501 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535515501 for job 4cd649562a0f5305571102b5c888c5a9.
18:31:55.514 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
18:31:55.516 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
18:31:55.528 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 76bbf70ff510462a93a28833882099ea
18:31:55.530 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='dbc39f203a6b86447aca308b479f94d03b5f7593c4e44a307f98aa79bc45b511'}]
18:31:55.533 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:31:55.534 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:55.535 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:31:55.536 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=298039, tablet=577db455445946b4b3637f89e9e8da72@[0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809),6f21d544834a406f92f688ea6d5a8dba(127.0.106.194:45251),fa977f48a0f448969dae707cebb47d86(127.0.106.193:33681)[L]]}]
18:31:55.537 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)] connecting to peer
18:31:55.539 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)] Successfully connected to peer
18:31:55.546 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.0.106.195
18:31:55.565 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:31:55.569 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x64d5bb87, L:/127.0.0.1:48234 - R:/127.0.106.195:46809] using SASL/PLAIN
18:31:55.578 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361471586304001) for scanner KuduScanner(table=replication_test_table, tablet=577db455445946b4b3637f89e9e8da72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:31:55.582 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [dbc39f203a6b86447aca308b479f94d03b5f7593c4e44a307f98aa79bc45b511]
18:31:55.583 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [dbc39f203a6b86447aca308b479f94d03b5f7593c4e44a307f98aa79bc45b511]
18:31:55.583 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:31:55.583 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:31:55.584 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split dbc39f203a6b86447aca308b479f94d03b5f7593c4e44a307f98aa79bc45b511 finished by subtask 1; deferring removal (restored in pending)
18:31:55.584 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)] disconnecting while in state READY
18:31:55.585 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:55.588 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)] handling channelInactive
18:31:55.589 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)] cleaning up while in state READY due to: connection closed
18:31:55.589 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:31:55.589 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:31:55.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:55.862 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:55.862 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:55.862 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:55.863 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:55.863 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:55.863 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:55.863 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:55.863 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:55.863 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:55.864 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:55.864 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:55.864 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:55.864 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:55.864 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:55.864 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:55.865 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:55.865 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:55.865 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:55.865 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:55.865 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:55.865 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:55.865 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:55.866 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:55.866 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:55.866 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:55.866 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:55.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:31:55Z chronyd exiting
18:31:56.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535516001 for job 4cd649562a0f5305571102b5c888c5a9.
18:31:56.012 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 4cd649562a0f5305571102b5c888c5a9 (1594 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:31:56.013 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
18:31:56.013 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split dbc39f203a6b86447aca308b479f94d03b5f7593c4e44a307f98aa79bc45b511 from pending
18:31:56.013 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 1 finished splits from enumerator state
18:31:56.026 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:56.026 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:56.027 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:56.027 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:56.027 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:56.027 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:56.027 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:56.027 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:56.027 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:56.027 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:56.027 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:56.027 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:56.027 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:56.033 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:56.120 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:56.120 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:56.121 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:56.121 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:56.121 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:56.121 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:56.121 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:56.121 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:56.121 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:56.121 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:56.121 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:56.121 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:56.121 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:56.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:56.461 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:56.462 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:56.462 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:56.462 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:56.462 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:56.462 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:56.463 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:56.463 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:56.463 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:56.463 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:56.463 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:56.463 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:56.463 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:56.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535516501 for job 4cd649562a0f5305571102b5c888c5a9.
18:31:56.511 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:31:56.512 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
18:31:56.533 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:56.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:56.746 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:56.747 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:56.747 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:56.747 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:56.747 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:56.747 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:56.747 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:56.747 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:56.747 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:56.747 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:56.747 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:56.747 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:56.747 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:56.999 [DEBUG - main] (Connection.java:575) [peer master-127.0.106.253:45189(127.0.106.253:45189)] disconnecting while in state READY
18:31:56.999 [DEBUG - main] (Connection.java:575) [peer master-127.0.106.254:32967(127.0.106.254:32967)] disconnecting while in state READY
18:31:57.000 [DEBUG - main] (Connection.java:575) [peer master-127.0.106.252:46705(127.0.106.252:46705)] disconnecting while in state READY
18:31:57.000 [DEBUG - main] (Connection.java:575) [peer 0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)] disconnecting while in state READY
18:31:57.000 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.0.106.253:45189(127.0.106.253:45189)] handling channelInactive
18:31:57.000 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.0.106.254:32967(127.0.106.254:32967)] handling channelInactive
18:31:57.000 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state READY due to: connection closed
18:31:57.000 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state READY due to: connection closed
18:31:57.001 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)] handling channelInactive
18:31:57.001 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:31:57.001 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 0865e0f96b7348dfbf4a502a6d8151dd(127.0.106.195:46809)] cleaning up while in state READY due to: connection closed
18:31:57.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535517001 for job 4cd649562a0f5305571102b5c888c5a9.
18:31:57.002 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-3
18:31:57.002 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-0
18:31:57.002 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
18:31:57.008 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.0.106.252:46705(127.0.106.252:46705)] handling channelInactive
18:31:57.008 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state READY due to: connection closed
18:31:57.008 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
18:31:57.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:57.009902   427 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 753
18:31:57.013 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:31:57.014 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
18:31:57.032 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:57.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:57.042712   427 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 974
18:31:57.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:57.078429   427 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 1117
18:31:57.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:57.132306   427 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 439
18:31:57.164 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.0.106.254:32967(127.0.106.254:32967)] handling channelInactive
18:31:57.164 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state READY due to: connection closed
18:31:57.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:57.165320   427 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 509
18:31:57.168 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:57.168 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:57.169 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:57.169 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:57.169 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:57.169 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:57.169 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:57.169 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:57.169 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:57.169 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:57.169 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:57.169 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:57.169 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:57.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:57.205 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.0.106.253:45189(127.0.106.253:45189)] handling channelInactive
18:31:57.205 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state READY due to: connection closed
18:31:57.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:57.205832   427 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 589
18:31:57.243 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.0.106.252:46705(127.0.106.252:46705)] handling channelInactive
18:31:57.243 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state READY due to: connection closed
18:31:57.432 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:31:57.432 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:31:57.432 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:31:57.432 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:57.432 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:57.432 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:31:57.433 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:57.433 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:57.433 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:31:57.433 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:57.433 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:57.433 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:31:57.433 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:31:57.501 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:57.501 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:57.501 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:57.502 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:57.502 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:57.502 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:57.502 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:57.502 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:57.502 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:57.502 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:57.502 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:57.502 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:57.502 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:57.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535517501 for job 4cd649562a0f5305571102b5c888c5a9.
18:31:57.514 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:31:57.515 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
18:31:57.524 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:31:57.525 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.525 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.526 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.0.106.254:32967(127.0.106.254:32967) for tablet Kudu Master: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.532 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:57.546 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:31:57.547 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:31:57.547 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:31:57.547 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.547 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.548 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.548 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.548 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.548 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.550 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.550 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.550 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.550 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:31:57.565 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:31:57.566 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:31:57.566 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:31:57.566 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.566 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.566 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.566 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.567 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.567 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.567 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.567 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.567 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.567 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:31:57.586 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:31:57.586 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:31:57.586 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:31:57.587 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.587 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.587 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.587 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.587 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.587 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.587 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.587 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.587 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.587 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:31:57.606 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:31:57.606 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:31:57.606 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:31:57.607 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.607 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.607 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.607 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.607 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.607 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.607 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.607 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.607 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.607 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:31:57.626 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:31:57.626 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:31:57.627 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:31:57.627 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.627 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.627 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.627 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.627 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.627 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.628 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.628 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.628 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.628 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:31:57.663 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:57.664 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:57.664 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:57.664 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:57.664 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:57.664 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:57.664 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:57.664 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:57.664 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:57.664 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:57.665 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:57.665 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:57.665 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:57.666 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:31:57.666 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:31:57.667 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:31:57.667 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.667 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.667 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.667 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.667 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.667 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.668 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.668 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.668 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.668 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:31:57.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:57.723 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:57.723 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:57.724 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:57.724 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:57.724 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:57.724 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:57.724 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:57.724 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:57.724 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:57.724 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:57.724 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:57.724 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:57.724 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:57.766 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:31:57.766 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:31:57.766 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:31:57.767 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.767 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.767 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.767 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.767 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.767 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.767 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.767 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.767 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.767 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:31:57.806 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:31:57.807 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:31:57.807 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:31:57.807 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.807 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.807 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:57.807 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.807 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.807 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.807 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.808 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:57.808 [INFO - pool-150-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:57.808 [WARN - pool-150-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:31:57.862 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:57.862 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:57.863 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:57.863 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:57.863 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:57.863 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:57.863 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:57.864 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:57.864 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:57.864 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:57.864 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:57.864 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:57.864 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:57.911 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:57.912 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:57.912 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:57.912 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:57.912 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:57.912 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:57.912 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:57.912 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:57.912 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:57.912 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:57.912 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:57.913 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:57.913 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:58.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535518001 for job 4cd649562a0f5305571102b5c888c5a9.
18:31:58.012 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:31:58.013 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
18:31:58.033 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:58.046 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:31:58.046 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:31:58.046 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:31:58.046 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:58.046 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:58.047 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:58.047 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:58.047 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:58.047 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:58.047 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:58.047 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:58.047 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:58.047 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:31:58.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:58.188 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:58.189 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:58.189 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:58.189 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:58.189 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:58.189 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:58.189 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:58.189 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:58.189 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:58.190 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:58.190 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:58.190 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:58.190 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:58.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:31:58Z chronyd exiting
18:31:58.501 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535518501 for job 4cd649562a0f5305571102b5c888c5a9.
18:31:58.506 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:31:58.506 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:31:58.506 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:58.507 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:58.507 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:31:58.508 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:58.508 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:58.508 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:58.508 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:58.508 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:58.508 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:58.508 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:58.508 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:31:58.509 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
18:31:58.509 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
18:31:58.533 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:58.543 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:58.543 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:58.543 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:58.544 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:58.544 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:58.544 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:58.544 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:58.544 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:58.544 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:58.544 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:58.544 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:58.544 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:58.544 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:58.628 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:58.629 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:58.629 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:58.629 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:58.629 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:58.629 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:58.629 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:58.629 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:58.629 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:58.629 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:58.629 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:58.630 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:58.630 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:58.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:58.968 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:58.969 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:58.969 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:58.969 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:58.969 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:58.969 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:58.969 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:58.969 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:58.969 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:58.969 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:58.969 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:58.969 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:58.969 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:59.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535519001 for job 4cd649562a0f5305571102b5c888c5a9.
18:31:59.010 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
18:31:59.010 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
18:31:59.033 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:59.108 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:59.109 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:59.109 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:59.109 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:59.109 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:59.109 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:59.109 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:59.109 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:59.109 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:59.109 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:59.109 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:59.109 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:59.109 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:59.141 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:59.142 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:59.142 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:59.142 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:59.142 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:59.142 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:59.142 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:59.142 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:59.142 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:59.142 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:59.142 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:59.143 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:59.143 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:59.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:59.220 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:59.220 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:59.220 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:59.220 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:59.220 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:59.221 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:59.221 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:59.221 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:59.221 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:59.221 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:59.221 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:59.221 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:59.221 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:31:59.327 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:59.327 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:59.327 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:59.327 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:59.327 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:59.327 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:59.327 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:59.327 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:59.327 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:59.327 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:59.327 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:59.328 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:59.328 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:59.345 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:31:59.345 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:31:59.345 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:31:59.346 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:59.346 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:59.346 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:59.346 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:59.346 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:31:59.346 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:31:59.346 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:59.346 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:59.346 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:31:59.346 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
.18:31:59.462 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783535519462
18:31:59.462 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783535519462
18:31:59.466 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
18:31:59.471 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
18:31:59.471 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
18:31:59.472 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskSwO0Je/test-tmp
18:31:59.472 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
18:31:59.472 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskSwO0Je/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
18:31:59.476 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

18:31:59.483 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:31:59.483 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:31:59.483 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:31:59.483 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:59.484 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:59.484 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:59.484 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:31:59.484 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:59.484 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:59.484 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:31:59.484 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:59.484 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:31:59.484 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:31:59.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535519501 for job 4cd649562a0f5305571102b5c888c5a9.
18:31:59.511 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:31:59.512 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
18:31:59.533 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:59.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:31:59.702 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:31:59.702 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:31:59.702 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:31:59.702 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:59.702 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:59.702 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:59.702 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:59.703 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:31:59.703 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:31:59.703 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:59.703 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:59.703 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:31:59.703 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:31:59.835 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:31:59.836 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

18:31:59.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:59.839184  2434 mini_oidc.cc:150] Starting JWKS server
18:31:59.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:59.842912  2434 webserver.cc:534] Webserver started at http://127.0.0.1:32789/ using document root <none> and password file <none>
18:31:59.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:59.843354  2434 mini_oidc.cc:186] Starting OIDC Discovery server
18:31:59.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:59.845207  2434 webserver.cc:534] Webserver started at http://127.0.0.1:44731/ using document root <none> and password file <none>
18:31:59.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:31:59Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
18:31:59.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:31:59Z Disabled control of system clock
18:31:59.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:31:59.916420  2434 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:59.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:31:59.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/wal
18:31:59.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/data
18:31:59.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:31:59.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:31:59.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/logs
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/data/info.pb
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.96.190:44161
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.96.190
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.96.148:40431
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:31:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:32789/jwks.json with env {}
18:31:59.968 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:31:59.968 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:31:59.968 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:31:59.969 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:59.969 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:59.969 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:59.969 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:59.969 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:59.969 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:31:59.969 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:31:59.969 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:59.969 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:31:59.969 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:00.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535520001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:00.013 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:32:00.014 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
18:32:00.034 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:00.126 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:00.126 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:00.126 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:00.127 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:00.127 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:00.127 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:00.127 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:00.127 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:00.127 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:00.127 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:00.127 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:00.127 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:00.127 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:00.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:00.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:00.246189  2447 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:32:00.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:00.246819  2447 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:32:00.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:00.247422  2447 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:32:00.272 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:00.272 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:00.273 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:00.273 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:00.273 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:00.273 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:00.273 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:00.273 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:00.273 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:00.273 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:00.273 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:00.273 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:00.273 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:00.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:00.282785  2447 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:32:00.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:00.283260  2447 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:32:00.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:00.283601  2447 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:32:00.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:00.283903  2447 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:32:00.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:00.284133  2447 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:32:00.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:00.284372  2447 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:32789/jwks.json
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:00.323278  2447 master_runner.cc:387] Master server non-default flags:
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.96.148:40431
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/data
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/wal
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.96.190:44161
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:32789/jwks.json
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:00.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/data/info.pb
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.96.190
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/logs
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:32:00.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:00.324688  2447 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:32:00.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:00.326227  2447 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:32:00.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:00.337613  2454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:00.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535520501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:00.521 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
18:32:00.525 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
18:32:00.532 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:00.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:00.692 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:00.692 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:00.693 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:00.694 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:00.694 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:00.694 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:00.695 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:00.695 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:00.695 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:00.695 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:00.695 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:00.695 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:00.695 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:00.851 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:00.852 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:00.852 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:00.853 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:00.853 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:00.853 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:00.854 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:00.854 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:00.854 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:00.854 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:00.854 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:00.854 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:00.855 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:01.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535521001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:01.032 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:01.033 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=27 ms, finalizationTime=5 ms).
18:32:01.046 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:01.047 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:01.047 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:01.048 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:01.048 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:01.048 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:01.049 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:01.049 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:01.049 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:01.049 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:01.049 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:01.049 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:01.049 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:01.051 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
18:32:01.066 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:01.067 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:01.067 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:01.067 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:01.068 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:01.068 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:01.068 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:01.069 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:01.069 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:01.069 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:01.069 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:01.069 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:01.069 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:01.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:01.249 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:01.249 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:01.250 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:01.251 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:01.251 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:01.251 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:01.252 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:01.252 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:01.252 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:01.252 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:01.252 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:01.252 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:01.252 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:01.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535521501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:01.515 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
18:32:01.516 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
18:32:01.532 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:01.661 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:01.662 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:01.662 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:01.662 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:01.663 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:01.663 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:01.663 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:01.663 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:01.663 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:01.663 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:01.664 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:01.664 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:01.664 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:01.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:01.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:00.337616  2453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:01.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:01.708074  2456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:01.710093  2455 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1367 milliseconds
18:32:01.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:01.710793  2447 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.373s	user 0.435s	sys 0.935s
18:32:01.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:01.711138  2447 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.374s	user 0.437s	sys 0.935s
18:32:01.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.711344  2447 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:32:01.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.712453  2447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:32:01.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.717363  2447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:32:01.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.718761  2447 hybrid_clock.cc:648] HybridClock initialized: now 1783535521718725 us; error 46 us; skew 500 ppm
18:32:01.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.719666  2447 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:32:01.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.727195  2447 webserver.cc:534] Webserver started at http://127.2.96.190:38483/ using document root <none> and password file <none>
18:32:01.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.728183  2447 fs_manager.cc:362] Metadata directory not provided
18:32:01.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.728433  2447 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:32:01.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.728927  2447 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:32:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.733361  2447 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/data/instance:
18:32:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ed192fc093f747fb8e31c36e40863eac"
18:32:01.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:01 on dist-test-slave-dxnw"
18:32:01.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.734483  2447 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/wal/instance:
18:32:01.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ed192fc093f747fb8e31c36e40863eac"
18:32:01.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:01 on dist-test-slave-dxnw"
18:32:01.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.742480  2447 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
18:32:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.748742  2463 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:32:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.749963  2447 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
18:32:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.750324  2447 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/wal
18:32:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ed192fc093f747fb8e31c36e40863eac"
18:32:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:01 on dist-test-slave-dxnw"
18:32:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.750674  2447 fs_report.cc:389] FS layout report
18:32:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:32:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/wal
18:32:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/wal
18:32:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/data/data
18:32:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:32:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:32:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:32:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:32:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:32:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:32:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:32:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:32:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:32:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:32:01.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:32:01.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.820326  2447 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:32:01.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.821907  2447 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:32:01.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.822428  2447 kserver.cc:163] Server-wide thread pool size limit: 3276
18:32:01.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.899380  2447 rpc_server.cc:307] RPC server started. Bound to: 127.2.96.190:44161
18:32:01.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.899538  2514 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.96.190:44161 every 8 connection(s)
18:32:01.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.902393  2447 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/data/info.pb
18:32:01.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.905028  2434 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 2447
18:32:01.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.905603  2434 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-0/wal/instance
18:32:01.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.910369  2515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.911528  2434 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/wal
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/data
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/logs
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/data/info.pb
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.96.189:33339
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.96.189
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.96.148:40431
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:01.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:32789/jwks.json with env {}
18:32:01.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.925367  2515 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } has no permanent_uuid. Determining permanent_uuid...
18:32:01.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:01.953153  2515 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } has no permanent_uuid. Determining permanent_uuid...
18:32:01.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:01.956002  2465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.96.189:33339: connect: Connection refused (error 111)
18:32:01.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:01.960974  2515 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.189:33339: Network error: Client connection negotiation failed: client connection to 127.2.96.189:33339: connect: Connection refused (error 111)
18:32:02.001 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535522001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:02.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:02.010528  2515 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } attempt: 1
18:32:02.012 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:32:02.013 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
18:32:02.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:02.019133  2515 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.189:33339: Network error: Client connection negotiation failed: client connection to 127.2.96.189:33339: connect: Connection refused (error 111)
18:32:02.032 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:02.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:02.087604  2515 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } attempt: 2
18:32:02.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:02.092821  2515 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.189:33339: Network error: Client connection negotiation failed: client connection to 127.2.96.189:33339: connect: Connection refused (error 111)
18:32:02.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:02.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:02.184273  2515 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } attempt: 3
18:32:02.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:02.189406  2515 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.189:33339: Network error: Client connection negotiation failed: client connection to 127.2.96.189:33339: connect: Connection refused (error 111)
18:32:02.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:02.266214  2517 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:32:02.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:02.266983  2517 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:32:02.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:02.267727  2517 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:32:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:02.303718  2517 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:32:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:02.304083  2517 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:32:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:02.304410  2517 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:32:02.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:02.304718  2517 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:32:02.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:02.305018  2517 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:32:02.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:02.305259  2517 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:32789/jwks.json
18:32:02.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:02.332821  2515 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } attempt: 4
18:32:02.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:02.337402  2515 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.189:33339: Network error: Client connection negotiation failed: client connection to 127.2.96.189:33339: connect: Connection refused (error 111)
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:02.344663  2517 master_runner.cc:387] Master server non-default flags:
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.96.148:40431
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/data
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/wal
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.96.189:33339
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:32789/jwks.json
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/data/info.pb
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.96.189
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/logs
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:32:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:32:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:02.346238  2517 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:32:02.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:02.347980  2517 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:32:02.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:02.359663  2526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:02.468 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:02.468 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:02.468 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:02.469 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:02.469 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:02.469 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:02.469 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:02.469 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:02.469 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:02.469 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:02.469 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:02.470 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:02.470 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:02.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535522501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:02.503 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:02.503 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:02.503 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:02.504 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:02.504 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:02.504 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:02.505 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:02.505 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:02.505 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:02.505 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:02.506 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:02.506 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:02.506 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:02.521 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
18:32:02.522 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
18:32:02.526 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:02.526 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:02.527 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:02.527 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:02.527 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:02.528 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:02.528 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:02.528 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:02.528 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:02.529 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:02.529 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:02.529 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:02.529 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:02.533 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:02.549 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:02.549 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:02.549 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:02.550 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:02.550 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:02.550 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:02.550 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:02.550 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:02.550 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:02.550 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:02.551 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:02.551 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:02.551 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:02.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:02.636837  2515 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } attempt: 5
18:32:02.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:02.644464  2515 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.189:33339: Network error: Client connection negotiation failed: client connection to 127.2.96.189:33339: connect: Connection refused (error 111)
18:32:02.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:02.942 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:02.942 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:02.943 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:02.943 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:02.943 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:02.943 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:02.943 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:02.943 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:02.943 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:02.944 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:02.944 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:02.944 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:02.944 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:03.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535523001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:03.023 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=22 ms, finalizationTime=0 ms).
18:32:03.026 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
18:32:03.033 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:03.080 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:03.081 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:03.081 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:03.082 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:03.082 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:03.082 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:03.083 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:03.083 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:03.083 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:03.084 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:03.084 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:03.084 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:03.084 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:03.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:03.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.192099  2515 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } attempt: 6
18:32:03.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:03.223404  2515 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.189:33339: Network error: Client connection negotiation failed: client connection to 127.2.96.189:33339: connect: Connection refused (error 111)
18:32:03.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535523501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:03.514 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:32:03.515 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
18:32:03.522 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:03.522 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:03.523 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:03.523 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:03.523 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:03.523 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:03.523 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:03.523 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:03.523 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:03.523 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:03.523 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:03.523 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:03.523 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:03.533 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:03.611 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:03.612 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:03.612 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:03.612 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:03.612 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:03.612 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:03.612 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:03.612 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:03.612 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:03.612 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:03.613 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:03.613 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:03.613 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:03.652 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:03.652 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:03.652 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:03.653 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:03.653 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:03.653 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:03.653 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:03.653 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:03.653 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:03.653 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:03.653 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:03.653 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:03.653 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:03.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:03.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:02.361078  2527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:03.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:03.705892  2529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:03.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:03.710788  2528 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1349 milliseconds
18:32:03.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.710979  2517 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:32:03.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.712714  2517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:32:03.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.715502  2517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:32:03.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.716969  2517 hybrid_clock.cc:648] HybridClock initialized: now 1783535523716905 us; error 64 us; skew 500 ppm
18:32:03.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.717941  2517 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:32:03.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.725889  2517 webserver.cc:534] Webserver started at http://127.2.96.189:45171/ using document root <none> and password file <none>
18:32:03.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.726840  2517 fs_manager.cc:362] Metadata directory not provided
18:32:03.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.727100  2517 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:32:03.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.727573  2517 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:32:03.729 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:03.729 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:03.729 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:03.729 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:03.729 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:03.729 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:03.729 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:03.730 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:03.730 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:03.730 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:03.730 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:03.730 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:03.730 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:03.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.732738  2517 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/data/instance:
18:32:03.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c5eabb798c3c44d982c6aca6efff93a5"
18:32:03.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:03 on dist-test-slave-dxnw"
18:32:03.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.733803  2517 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/wal/instance:
18:32:03.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c5eabb798c3c44d982c6aca6efff93a5"
18:32:03.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:03 on dist-test-slave-dxnw"
18:32:03.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.741245  2517 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.003s
18:32:03.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.747452  2538 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:32:03.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.748596  2517 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.748895  2517 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/wal
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c5eabb798c3c44d982c6aca6efff93a5"
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:03 on dist-test-slave-dxnw"
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.749188  2517 fs_report.cc:389] FS layout report
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/wal
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/wal
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/data/data
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:32:03.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:32:03.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.811282  2517 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:32:03.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.812885  2517 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:32:03.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.813351  2517 kserver.cc:163] Server-wide thread pool size limit: 3276
18:32:03.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.888839  2517 rpc_server.cc:307] RPC server started. Bound to: 127.2.96.189:33339
18:32:03.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.888944  2589 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.96.189:33339 every 8 connection(s)
18:32:03.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.891613  2517 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/data/info.pb
18:32:03.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.895897  2434 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 2517
18:32:03.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.896354  2434 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-1/wal/instance
18:32:03.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.898286  2590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:03.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.899348  2434 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:03.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:03.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/wal
18:32:03.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/data
18:32:03.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:32:03.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:32:03.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:32:03.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:03.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/logs
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/data/info.pb
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.96.188:32989
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.96.188
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.96.148:40431
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:03.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:32789/jwks.json with env {}
18:32:03.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.915934  2590 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } has no permanent_uuid. Determining permanent_uuid...
18:32:03.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.950244  2590 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } has no permanent_uuid. Determining permanent_uuid...
18:32:03.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:03.965935  2590 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } has no permanent_uuid. Determining permanent_uuid...
18:32:03.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:03.968530  2540 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.96.188:32989: connect: Connection refused (error 111)
18:32:03.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:03.972857  2590 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.188:32989: Network error: Client connection negotiation failed: client connection to 127.2.96.188:32989: connect: Connection refused (error 111)
18:32:04.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535524001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:04.011 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:32:04.012 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
18:32:04.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:04.022378  2590 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } attempt: 1
18:32:04.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.026924  2590 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.188:32989: Network error: Client connection negotiation failed: client connection to 127.2.96.188:32989: connect: Connection refused (error 111)
18:32:04.033 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:04.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:04.095379  2590 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } attempt: 2
18:32:04.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.101074  2590 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.188:32989: Network error: Client connection negotiation failed: client connection to 127.2.96.188:32989: connect: Connection refused (error 111)
18:32:04.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:04.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:04.192533  2590 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } attempt: 3
18:32:04.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.197525  2590 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.188:32989: Network error: Client connection negotiation failed: client connection to 127.2.96.188:32989: connect: Connection refused (error 111)
18:32:04.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.246217  2592 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:32:04.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.246918  2592 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:32:04.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.247465  2592 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:32:04.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.281569  2592 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:32:04.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.281913  2592 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:32:04.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.282147  2592 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:32:04.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.282357  2592 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:32:04.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.282687  2592 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:32:04.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.282910  2592 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:32789/jwks.json
18:32:04.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:04.284045  2515 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } attempt: 7
18:32:04.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:04.297739  2515 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } has no permanent_uuid. Determining permanent_uuid...
18:32:04.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.303678  2515 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.188:32989: Network error: Client connection negotiation failed: client connection to 127.2.96.188:32989: connect: Connection refused (error 111)
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:04.326102  2592 master_runner.cc:387] Master server non-default flags:
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.96.148:40431
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/data
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/wal
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.96.188:32989
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:32789/jwks.json
18:32:04.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/data/info.pb
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.96.188
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/logs
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:32:04.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:32:04.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:04.327790  2592 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:32:04.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:04.329414  2592 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:32:04.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.340399  2604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:04.341004  2590 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } attempt: 4
18:32:04.342 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:04.343 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:04.343 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:04.343 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:04.343 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:04.343 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:04.344 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:04.344 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:04.344 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:04.344 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:04.344 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:04.344 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:04.345 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:04.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.347445  2590 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.188:32989: Network error: Client connection negotiation failed: client connection to 127.2.96.188:32989: connect: Connection refused (error 111)
18:32:04.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:04.362056  2515 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } attempt: 1
18:32:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.366505  2515 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.188:32989: Network error: Client connection negotiation failed: client connection to 127.2.96.188:32989: connect: Connection refused (error 111)
18:32:04.401 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:04.402 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:04.402 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:04.403 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:04.403 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:04.403 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:04.403 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:04.403 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:04.403 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:04.403 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:04.403 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:04.403 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:04.404 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:04.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:04.447947  2515 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } attempt: 2
18:32:04.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.455443  2515 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.188:32989: Network error: Client connection negotiation failed: client connection to 127.2.96.188:32989: connect: Connection refused (error 111)
18:32:04.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535524501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:04.513 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:32:04.515 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
18:32:04.525 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:04.526 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:04.526 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:04.526 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:04.526 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:04.526 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:04.526 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:04.526 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:04.527 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:04.527 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:04.527 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:04.526 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:04.527 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:04.532 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:04.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:04.541046  2515 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } attempt: 3
18:32:04.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.547156  2515 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.188:32989: Network error: Client connection negotiation failed: client connection to 127.2.96.188:32989: connect: Connection refused (error 111)
18:32:04.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:04.646942  2590 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } attempt: 5
18:32:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.651942  2590 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.188:32989: Network error: Client connection negotiation failed: client connection to 127.2.96.188:32989: connect: Connection refused (error 111)
18:32:04.666 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:04.666 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:04.667 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:04.667 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:04.667 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:04.667 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:04.667 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:04.667 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:04.667 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:04.667 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:04.667 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:04.667 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:04.667 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:04.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:04.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:04.687613  2515 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } attempt: 4
18:32:04.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.692569  2515 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.188:32989: Network error: Client connection negotiation failed: client connection to 127.2.96.188:32989: connect: Connection refused (error 111)
18:32:04.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:04.976022  2515 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } attempt: 5
18:32:04.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.983327  2515 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.188:32989: Network error: Client connection negotiation failed: client connection to 127.2.96.188:32989: connect: Connection refused (error 111)
18:32:05.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535525001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:05.016 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
18:32:05.017 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
18:32:05.033 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:05.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:05.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.199452  2590 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } attempt: 6
18:32:05.201 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:05.201 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:05.201 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:05.202 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:05.202 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:05.202 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:05.203 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:05.203 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:05.203 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:05.203 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:05.203 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:05.203 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:05.204 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:05.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:05.224460  2590 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.188:32989: Network error: Client connection negotiation failed: client connection to 127.2.96.188:32989: connect: Connection refused (error 111)
18:32:05.228 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:05.228 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:05.228 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:05.228 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:05.229 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:05.229 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:05.229 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:05.229 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:05.229 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:05.229 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:05.229 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:05.229 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:05.229 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:05.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535525501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:05.517 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
18:32:05.518 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
18:32:05.532 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:05.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.535897  2515 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } attempt: 6
18:32:05.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:05.556547  2515 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.96.188:32989: Network error: Client connection negotiation failed: client connection to 127.2.96.188:32989: connect: Connection refused (error 111)
18:32:05.623 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:05.623 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:05.624 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:05.624 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:05.624 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:05.624 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:05.624 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:05.624 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:05.624 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:05.624 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:05.625 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:05.625 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:05.625 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:05.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:05.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.341627  2605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:05.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:04.346495  2607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:05.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:05.832190  2606 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1485 milliseconds
18:32:05.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.832381  2592 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:32:05.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.833786  2592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:32:05.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.836936  2592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:32:05.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.838364  2592 hybrid_clock.cc:648] HybridClock initialized: now 1783535525838315 us; error 61 us; skew 500 ppm
18:32:05.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.839202  2592 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:32:05.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.845394  2592 webserver.cc:534] Webserver started at http://127.2.96.188:32813/ using document root <none> and password file <none>
18:32:05.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.846267  2592 fs_manager.cc:362] Metadata directory not provided
18:32:05.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.846460  2592 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:32:05.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.846926  2592 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:32:05.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.851289  2592 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/data/instance:
18:32:05.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51"
18:32:05.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:05 on dist-test-slave-dxnw"
18:32:05.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.852509  2592 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/wal/instance:
18:32:05.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51"
18:32:05.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:05 on dist-test-slave-dxnw"
18:32:05.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.860251  2592 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
18:32:05.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.866302  2619 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:32:05.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.867837  2592 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
18:32:05.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.868163  2592 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/wal
18:32:05.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51"
18:32:05.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:05 on dist-test-slave-dxnw"
18:32:05.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.868497  2592 fs_report.cc:389] FS layout report
18:32:05.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:32:05.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/wal
18:32:05.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/wal
18:32:05.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/data/data
18:32:05.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:32:05.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:32:05.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:32:05.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:32:05.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:32:05.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:32:05.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:32:05.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:32:05.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:32:05.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:32:05.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:32:05.923 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:05.923 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:05.923 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:05.923 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:05.924 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:05.924 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:05.924 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:05.924 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:05.924 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:05.924 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:05.924 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:05.924 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:05.924 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:05.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.927095  2592 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:32:05.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.928623  2592 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:32:05.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:05.929080  2592 kserver.cc:163] Server-wide thread pool size limit: 3276
18:32:05.940 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:05.940 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:05.940 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:05.940 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:05.940 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:05.940 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:05.941 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:05.941 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:05.941 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:05.941 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:05.941 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:05.941 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:05.941 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:06.001 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535526001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:06.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.006023  2592 rpc_server.cc:307] RPC server started. Bound to: 127.2.96.188:32989
18:32:06.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.006155  2670 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.96.188:32989 every 8 connection(s)
18:32:06.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.011384  2592 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/data/info.pb
18:32:06.012 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:32:06.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.012436  2434 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 2592
18:32:06.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.012981  2434 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/master-2/wal/instance
18:32:06.014 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
18:32:06.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.018905  2671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:06.033 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:06.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.036814  2671 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } has no permanent_uuid. Determining permanent_uuid...
18:32:06.063 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:06.063 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:06.063 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:06.064 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:06.064 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:06.064 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:06.064 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:06.064 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:06.064 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:06.064 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:06.064 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:06.064 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:06.065 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:06.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.065084  2671 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } has no permanent_uuid. Determining permanent_uuid...
18:32:06.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.075623  2671 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } has no permanent_uuid. Determining permanent_uuid...
18:32:06.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.094468  2671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51: Bootstrap starting.
18:32:06.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.100544  2671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51: Neither blocks nor log segments found. Creating new log.
18:32:06.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.102255  2671 log.cc:826] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51: Log is configured to *not* fsync() on all Append() calls
18:32:06.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.107333  2671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51: No bootstrap required, opened a new log
18:32:06.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.129843  2671 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } }
18:32:06.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.130743  2671 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:06.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.131067  2671 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1deaaa17019e4d4e8fb196a4d8bb8c51, State: Initialized, Role: FOLLOWER
18:32:06.132 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:06.132 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:06.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.132048  2671 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } }
18:32:06.132 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:06.133 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:06.133 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:06.133 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:06.133 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:06.133 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:06.133 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:06.133 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:06.133 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:06.133 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:06.133 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:06.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.135325  2679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } } }
18:32:06.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.136190  2679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [sys.catalog]: This master's current role is: FOLLOWER
18:32:06.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.137027  2671 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [sys.catalog]: configured and running, proceeding with master startup.
18:32:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:06.165395  2690 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:32:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:06.165743  2690 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:32:06.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.158483  2592 master_runner.cc:187] Error getting master registration for 127.2.96.190:44161: OK, instance_id { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" instance_seqno: 1783535521877101 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:32:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:06.184348  2625 tablet.cc:2406] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:32:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.184733  2592 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:32:06.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.284956  2590 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } attempt: 7
18:32:06.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.305838  2590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5: Bootstrap starting.
18:32:06.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.311731  2590 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5: Neither blocks nor log segments found. Creating new log.
18:32:06.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.313668  2590 log.cc:826] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5: Log is configured to *not* fsync() on all Append() calls
18:32:06.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.318691  2590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5: No bootstrap required, opened a new log
18:32:06.322 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:06.323 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:06.323 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:06.324 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:06.324 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:06.324 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:06.324 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:06.324 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:06.325 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:06.325 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:06.325 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:06.326 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:06.326 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:06.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.340981  2590 raft_consensus.cc:359] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } }
18:32:06.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.341684  2590 raft_consensus.cc:385] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:06.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.341902  2590 raft_consensus.cc:740] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5eabb798c3c44d982c6aca6efff93a5, State: Initialized, Role: FOLLOWER
18:32:06.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.342645  2590 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } }
18:32:06.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.345358  2694 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } } }
18:32:06.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.346251  2694 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5 [sys.catalog]: This master's current role is: FOLLOWER
18:32:06.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.347350  2590 sys_catalog.cc:565] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5 [sys.catalog]: configured and running, proceeding with master startup.
18:32:06.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:06.390765  2705 catalog_manager.cc:1593] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:32:06.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:06.391161  2705 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:32:06.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.375116  2517 master_runner.cc:187] Error getting master registration for 127.2.96.190:44161: OK, instance_id { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" instance_seqno: 1783535521877101 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:32:06.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.409078  2517 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:32:06.501 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535526501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:06.513 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:32:06.514 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
18:32:06.533 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:06.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.535854  2679 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:06.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.536422  2679 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } }
18:32:06.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.540125  2679 leader_election.cc:290] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed192fc093f747fb8e31c36e40863eac (127.2.96.190:44161), c5eabb798c3c44d982c6aca6efff93a5 (127.2.96.189:33339)
18:32:06.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.541030  2565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5eabb798c3c44d982c6aca6efff93a5" is_pre_election: true
18:32:06.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.541963  2565 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1deaaa17019e4d4e8fb196a4d8bb8c51 in term 0.
18:32:06.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.544198  2621 leader_election.cc:304] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1deaaa17019e4d4e8fb196a4d8bb8c51, c5eabb798c3c44d982c6aca6efff93a5; no voters: 
18:32:06.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.546458  2679 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:32:06.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.546936  2679 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:32:06.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.547380  2679 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [term 0 FOLLOWER]: Advancing to term 1
18:32:06.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.554644  2679 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } }
18:32:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.560067  2565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5eabb798c3c44d982c6aca6efff93a5"
18:32:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.560696  2565 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5 [term 0 FOLLOWER]: Advancing to term 1
18:32:06.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.569360  2565 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1deaaa17019e4d4e8fb196a4d8bb8c51 in term 1.
18:32:06.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.570399  2621 leader_election.cc:304] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1deaaa17019e4d4e8fb196a4d8bb8c51, c5eabb798c3c44d982c6aca6efff93a5; no voters: 
18:32:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.571127  2679 leader_election.cc:290] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [CANDIDATE]: Term 1 election: Requested vote from peers ed192fc093f747fb8e31c36e40863eac (127.2.96.190:44161), c5eabb798c3c44d982c6aca6efff93a5 (127.2.96.189:33339)
18:32:06.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:06.571635  2544 tablet.cc:2406] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:32:06.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.571903  2707 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [term 1 FOLLOWER]: Leader election won for term 1
18:32:06.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.576561  2707 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [term 1 LEADER]: Becoming Leader. State: Replica: 1deaaa17019e4d4e8fb196a4d8bb8c51, State: Running, Role: LEADER
18:32:06.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.577713  2707 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } }
18:32:06.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.590080  2515 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } attempt: 7
18:32:06.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.594341  2679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1deaaa17019e4d4e8fb196a4d8bb8c51. Latest consensus state: current_term: 1 leader_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } } }
18:32:06.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.595055  2679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [sys.catalog]: This master's current role is: LEADER
18:32:06.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.607578  2711 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:32:06.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.614660  2711 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:32:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.625442  2515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac: Bootstrap starting.
18:32:06.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.634044  2515 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac: Neither blocks nor log segments found. Creating new log.
18:32:06.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.639037  2515 log.cc:826] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac: Log is configured to *not* fsync() on all Append() calls
18:32:06.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.643994  2565 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5 [term 1 FOLLOWER]: Refusing update from remote peer 1deaaa17019e4d4e8fb196a4d8bb8c51: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:32:06.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.646085  2679 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:06.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.650137  2515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac: No bootstrap required, opened a new log
18:32:06.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.695926  2515 raft_consensus.cc:359] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } }
18:32:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.697222  2515 raft_consensus.cc:385] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:06.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.697746  2515 raft_consensus.cc:740] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed192fc093f747fb8e31c36e40863eac, State: Initialized, Role: FOLLOWER
18:32:06.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.699059  2515 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } }
18:32:06.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.711032  2694 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1deaaa17019e4d4e8fb196a4d8bb8c51. Latest consensus state: current_term: 1 leader_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } } }
18:32:06.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.713878  2694 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5 [sys.catalog]: This master's current role is: FOLLOWER
18:32:06.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.715909  2716 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } } }
18:32:06.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.716866  2716 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [sys.catalog]: This master's current role is: FOLLOWER
18:32:06.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.720410  2515 sys_catalog.cc:565] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [sys.catalog]: configured and running, proceeding with master startup.
18:32:06.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.721201  2488 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [term 0 FOLLOWER]: Advancing to term 1
18:32:06.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.723462  2489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed192fc093f747fb8e31c36e40863eac"
18:32:06.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.726331  2490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed192fc093f747fb8e31c36e40863eac" is_pre_election: true
18:32:06.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.734980  2707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } } }
18:32:06.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.735746  2707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [sys.catalog]: This master's current role is: LEADER
18:32:06.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.738548  2488 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [term 1 FOLLOWER]: Refusing update from remote peer 1deaaa17019e4d4e8fb196a4d8bb8c51: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:32:06.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.739919  2716 raft_consensus.cc:493] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:06.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.740578  2716 raft_consensus.cc:515] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } }
18:32:06.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.741151  2708 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:06.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.747139  2711 catalog_manager.cc:1382] Generated new cluster ID: 83db11d2ca4444c8b7e872faf13f1079
18:32:06.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.747486  2711 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:32:06.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.753767  2564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed192fc093f747fb8e31c36e40863eac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5eabb798c3c44d982c6aca6efff93a5" is_pre_election: true
18:32:06.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.760483  2694 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } } }
18:32:06.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.762045  2694 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5 [sys.catalog]: This master's current role is: FOLLOWER
18:32:06.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.763054  2716 leader_election.cc:290] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5eabb798c3c44d982c6aca6efff93a5 (127.2.96.189:33339), 1deaaa17019e4d4e8fb196a4d8bb8c51 (127.2.96.188:32989)
18:32:06.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.764310  2646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed192fc093f747fb8e31c36e40863eac" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" is_pre_election: true
18:32:06.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.766271  2465 leader_election.cc:304] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed192fc093f747fb8e31c36e40863eac; no voters: 1deaaa17019e4d4e8fb196a4d8bb8c51, c5eabb798c3c44d982c6aca6efff93a5
18:32:06.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.783784  2711 catalog_manager.cc:1405] Generated new certificate authority record
18:32:06.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.785847  2711 catalog_manager.cc:1539] Loading token signing keys...
18:32:06.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.808877  2716 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
18:32:06.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.812016  2722 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1deaaa17019e4d4e8fb196a4d8bb8c51. Latest consensus state: current_term: 1 leader_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } } }
18:32:06.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.812774  2722 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [sys.catalog]: This master's current role is: FOLLOWER
18:32:06.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.814592  2708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } } }
18:32:06.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.815310  2708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51 [sys.catalog]: This master's current role is: LEADER
18:32:06.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.810883  2730 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed192fc093f747fb8e31c36e40863eac" member_type: VOTER last_known_addr { host: "127.2.96.190" port: 44161 } } peers { permanent_uuid: "c5eabb798c3c44d982c6aca6efff93a5" member_type: VOTER last_known_addr { host: "127.2.96.189" port: 33339 } } peers { permanent_uuid: "1deaaa17019e4d4e8fb196a4d8bb8c51" member_type: VOTER last_known_addr { host: "127.2.96.188" port: 32989 } } }
18:32:06.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.819425  2730 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac [sys.catalog]: This master's current role is: FOLLOWER
18:32:06.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.824282  2711 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 1deaaa17019e4d4e8fb196a4d8bb8c51: Generated new TSK 0
18:32:06.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.825598  2711 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:32:06.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.847319  2434 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:06.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:06.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/wal
18:32:06.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/data
18:32:06.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:32:06.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/logs
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/data/info.pb
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.96.129:0
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.96.129
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.96.129
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.96.148:40431
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:32:06.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.867019  2735 catalog_manager.cc:1294] Loaded cluster ID: 83db11d2ca4444c8b7e872faf13f1079
18:32:06.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.867550  2735 catalog_manager.cc:1587] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac: loading cluster ID for follower catalog manager: success
18:32:06.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.875901  2735 catalog_manager.cc:1609] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac: acquiring CA information for follower catalog manager: success
18:32:06.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:06.881912  2735 catalog_manager.cc:1637] T 00000000000000000000000000000000 P ed192fc093f747fb8e31c36e40863eac: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:32:06.911 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:06.912 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:06.912 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:06.912 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:06.912 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:06.912 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:06.919 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:06.919 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:06.919 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:06.919 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:06.919 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:06.919 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:06.919 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:06.941 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:06.942 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:06.942 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:06.942 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:06.942 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:06.942 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:06.942 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:06.942 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:06.943 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:06.943 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:06.943 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:06.942 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:06.943 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:07.001 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535527001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:07.006 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:07.006 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:07.006 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:07.007 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:07.007 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:07.007 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:07.009 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:07.009 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:07.009 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:07.010 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:07.010 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:07.010 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:07.010 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:07.016 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
18:32:07.017 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
18:32:07.033 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:07.089 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:07.089 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:07.089 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:07.090 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:07.090 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:07.090 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:07.090 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:07.090 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:07.090 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:07.090 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:07.090 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:07.091 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:07.091 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:07.146 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:07.147 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:07.147 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:07.147 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:07.148 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:07.148 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:07.148 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:07.148 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:07.148 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:07.149 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:07.149 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:07.149 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:07.149 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:07.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:07.241 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:07.242 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:07.242 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:07.242 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:07.242 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:07.242 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:07.242 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:07.242 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:07.242 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:07.242 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:07.242 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:07.242 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:07.243 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:07.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:07.397109  2705 catalog_manager.cc:1294] Loaded cluster ID: 83db11d2ca4444c8b7e872faf13f1079
18:32:07.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:07.397681  2705 catalog_manager.cc:1587] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5: loading cluster ID for follower catalog manager: success
18:32:07.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:07.415341  2705 catalog_manager.cc:1609] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5: acquiring CA information for follower catalog manager: success
18:32:07.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:07.421007  2705 catalog_manager.cc:1637] T 00000000000000000000000000000000 P c5eabb798c3c44d982c6aca6efff93a5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:32:07.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535527501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:07.517 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
18:32:07.521 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
18:32:07.533 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:07.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:07.594842  2738 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:32:07.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:07.595754  2738 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:32:07.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:07.596604  2738 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:32:07.607 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:07.608 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:07.608 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:07.608 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:07.608 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:07.608 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:07.608 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:07.608 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:07.608 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:07.611 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:07.611 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:07.612 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:07.612 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:07.612 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:07.612 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:07.612 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:07.612 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:07.612 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:07.612 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:07.613 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:07.613 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:07.613 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:07.613 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:07.613 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:07.613 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:07.613 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:07.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:07.662659  2738 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:32:07.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:07.664445  2738 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.96.129
18:32:07.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:07.730880  2738 tablet_server_runner.cc:78] Tablet server non-default flags:
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.96.148:40431
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/data
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/wal
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.96.129:0
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/data/info.pb
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.96.129
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.96.129
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/logs
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:32:07.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:32:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:32:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:32:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:32:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:07.733408  2738 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:32:07.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:07.735584  2738 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:32:07.746 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:07.746 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:07.747 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:07.747 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:07.747 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:07.747 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:07.748 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:07.748 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:07.748 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:07.748 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:07.748 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:07.748 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:07.748 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:07.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:07.764951  2745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:07.963 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:07.963 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:07.963 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:07.964 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:07.964 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:07.964 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:07.964 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:07.965 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:07.965 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:07.965 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:07.965 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:07.965 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:07.965 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:08.006 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535528001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:08.020 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
18:32:08.022 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
18:32:08.033 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:08.141 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:08.141 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:08.142 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:08.142 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:08.142 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:08.142 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:08.143 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:08.143 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:08.143 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:08.143 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:08.143 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:08.143 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:08.143 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:08.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:08.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535528501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:08.525 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=23 ms, finalizationTime=0 ms).
18:32:08.526 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
18:32:08.533 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:08.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:09.007 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535529001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:09.016 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
18:32:09.017 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
18:32:09.032 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:09.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:09.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535529501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:09.511 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:32:09.513 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
18:32:09.520 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:09.520 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:09.520 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:09.521 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:09.521 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:09.521 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:09.521 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:09.521 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:09.521 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:09.521 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:09.521 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:09.521 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:09.521 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:09.533 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:09.552 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:09.552 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:09.552 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:09.552 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:09.553 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:09.553 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:09.553 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:09.553 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:09.553 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:09.553 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:09.553 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:09.553 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:09.553 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:09.609 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:09.609 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:09.609 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:09.610 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:09.610 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:09.610 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:09.610 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:09.610 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:09.610 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:09.610 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:09.610 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:09.611 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:09.611 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:09.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:09.732 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:09.732 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:09.733 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:09.733 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:09.733 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:09.734 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:09.734 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:09.734 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:09.734 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:09.734 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:09.734 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:09.734 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:09.735 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:09.886 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:09.887 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:09.887 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:09.888 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:09.888 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:09.888 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:09.888 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:09.888 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:09.888 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:09.888 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:09.889 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:09.889 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:09.889 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:09.980 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:09.980 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:09.980 [DEBUG - pool-128-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:09.981 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:09.981 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:09.981 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:09.981 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:09.982 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:09.982 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:09.982 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:09.982 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:09.982 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:09.982 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:09.983 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27093), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [24ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [41ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [118ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [118ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [154ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [191ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [196ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [211ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [211ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [244ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [249ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [249ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [252ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [252ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [261ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [261ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [261ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [261ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [282ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [323ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [343ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [422ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [543ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [543ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [661ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [662ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1462ms] refreshing cache from master, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1465ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1465ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1640ms] refreshing cache from master, [1640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1641ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1643ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [4100ms] refreshing cache from master, [4100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4102ms] too many traces: truncated at 100 traces, deferred=Deferred@684513663(state=PENDING, result=null, callback=(continuation of Deferred@1371272405 after retry RPC after error@283615402) -> (continuation of Deferred@875532135 after retry RPC after error@2053550012) -> (continuation of Deferred@1953882489 after retry RPC after error@1505426861) -> (continuation of Deferred@296097098 after retry RPC after error@1592935309) -> (continuation of Deferred@89595651 after retry RPC after error@193908113) -> (continuation of Deferred@715359727 after retry RPC after error@1719747869) -> (continuation of Deferred@1528033737 after retry RPC after error@646729087) -> (continuation of Deferred@271984828 after retry RPC after error@2087927306) -> (continuation of Deferred@950670836 after retry RPC after error@2089369643) -> (continuation of Deferred@1574692046 after retry RPC after error@951915025) -> (continuation of Deferred@1355851079 after retry RPC after error@1726889838) -> (continuation of Deferred@1678854889 after retry RPC after error@887939552) -> (continuation of Deferred@1640202407 after retry RPC after error@1984022206) -> (continuation of Deferred@409570461 after retry RPC after error@1272548753) -> (continuation of Deferred@920845045 after retry RPC after error@1324265121) -> (continuation of Deferred@448257669 after retry RPC after error@495287623) -> (continuation of Deferred@1007753552 after retry RPC after error@120665045) -> (continuation of Deferred@592873024 after retry RPC after error@353347624) -> (continuation of Deferred@568387648 after retry RPC after error@801232946) -> (continuation of Deferred@942812940 after retry RPC after error@1343524554) -> (continuation of Deferred@1989201504 after retry RPC after error@1462864072) -> (continuation of Deferred@2127730541 after retry RPC after error@172237987), errback=(continuation of Deferred@1371272405 after retry RPC after error@283615402) -> (continuation of Deferred@875532135 after retry RPC after error@2053550012) -> (continuation of Deferred@1953882489 after retry RPC after error@1505426861) -> (continuation of Deferred@296097098 after retry RPC after error@1592935309) -> (continuation of Deferred@89595651 after retry RPC after error@193908113) -> (continuation of Deferred@715359727 after retry RPC after error@1719747869) -> (continuation of Deferred@1528033737 after retry RPC after error@646729087) -> (continuation of Deferred@271984828 after retry RPC after error@2087927306) -> (continuation of Deferred@950670836 after retry RPC after error@2089369643) -> (continuation of Deferred@1574692046 after retry RPC after error@951915025) -> (continuation of Deferred@1355851079 after retry RPC after error@1726889838) -> (continuation of Deferred@1678854889 after retry RPC after error@887939552) -> (continuation of Deferred@1640202407 after retry RPC after error@1984022206) -> (continuation of Deferred@409570461 after retry RPC after error@1272548753) -> (continuation of Deferred@920845045 after retry RPC after error@1324265121) -> (continuation of Deferred@448257669 after retry RPC after error@495287623) -> (continuation of Deferred@1007753552 after retry RPC after error@120665045) -> (continuation of Deferred@592873024 after retry RPC after error@353347624) -> (continuation of Deferred@568387648 after retry RPC after error@801232946) -> (continuation of Deferred@942812940 after retry RPC after error@1343524554) -> (continuation of Deferred@1989201504 after retry RPC after error@1462864072) -> (continuation of Deferred@2127730541 after retry RPC after error@172237987)))
18:32:09.984 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:32:09.984 [WARN - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27093), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [24ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [41ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [118ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [118ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [154ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [191ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [196ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [211ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [211ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [244ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [249ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [249ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [252ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [252ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [261ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [261ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [261ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [261ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [282ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [323ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [343ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [422ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [543ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [543ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [661ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [662ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1462ms] refreshing cache from master, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1465ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1465ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1640ms] refreshing cache from master, [1640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1641ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1643ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [4100ms] refreshing cache from master, [4100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4102ms] too many traces: truncated at 100 traces, deferred=Deferred@684513663(state=PENDING, result=null, callback=(continuation of Deferred@1371272405 after retry RPC after error@283615402) -> (continuation of Deferred@875532135 after retry RPC after error@2053550012) -> (continuation of Deferred@1953882489 after retry RPC after error@1505426861) -> (continuation of Deferred@296097098 after retry RPC after error@1592935309) -> (continuation of Deferred@89595651 after retry RPC after error@193908113) -> (continuation of Deferred@715359727 after retry RPC after error@1719747869) -> (continuation of Deferred@1528033737 after retry RPC after error@646729087) -> (continuation of Deferred@271984828 after retry RPC after error@2087927306) -> (continuation of Deferred@950670836 after retry RPC after error@2089369643) -> (continuation of Deferred@1574692046 after retry RPC after error@951915025) -> (continuation of Deferred@1355851079 after retry RPC after error@1726889838) -> (continuation of Deferred@1678854889 after retry RPC after error@887939552) -> (continuation of Deferred@1640202407 after retry RPC after error@1984022206) -> (continuation of Deferred@409570461 after retry RPC after error@1272548753) -> (continuation of Deferred@920845045 after retry RPC after error@1324265121) -> (continuation of Deferred@448257669 after retry RPC after error@495287623) -> (continuation of Deferred@1007753552 after retry RPC after error@120665045) -> (continuation of Deferred@592873024 after retry RPC after error@353347624) -> (continuation of Deferred@568387648 after retry RPC after error@801232946) -> (continuation of Deferred@942812940 after retry RPC after error@1343524554) -> (continuation of Deferred@1989201504 after retry RPC after error@1462864072) -> (continuation of Deferred@2127730541 after retry RPC after error@172237987), errback=(continuation of Deferred@1371272405 after retry RPC after error@283615402) -> (continuation of Deferred@875532135 after retry RPC after error@2053550012) -> (continuation of Deferred@1953882489 after retry RPC after error@1505426861) -> (continuation of Deferred@296097098 after retry RPC after error@1592935309) -> (continuation of Deferred@89595651 after retry RPC after error@193908113) -> (continuation of Deferred@715359727 after retry RPC after error@1719747869) -> (continuation of Deferred@1528033737 after retry RPC after error@646729087) -> (continuation of Deferred@271984828 after retry RPC after error@2087927306) -> (continuation of Deferred@950670836 after retry RPC after error@2089369643) -> (continuation of Deferred@1574692046 after retry RPC after error@951915025) -> (continuation of Deferred@1355851079 after retry RPC after error@1726889838) -> (continuation of Deferred@1678854889 after retry RPC after error@887939552) -> (continuation of Deferred@1640202407 after retry RPC after error@1984022206) -> (continuation of Deferred@409570461 after retry RPC after error@1272548753) -> (continuation of Deferred@920845045 after retry RPC after error@1324265121) -> (continuation of Deferred@448257669 after retry RPC after error@495287623) -> (continuation of Deferred@1007753552 after retry RPC after error@120665045) -> (continuation of Deferred@592873024 after retry RPC after error@353347624) -> (continuation of Deferred@568387648 after retry RPC after error@801232946) -> (continuation of Deferred@942812940 after retry RPC after error@1343524554) -> (continuation of Deferred@1989201504 after retry RPC after error@1462864072) -> (continuation of Deferred@2127730541 after retry RPC after error@172237987)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:09.984 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
18:32:09.986 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
18:32:09.989 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27093), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [24ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [41ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [118ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [118ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [154ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [191ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [196ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [211ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [211ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [244ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [249ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [249ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [252ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [252ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [261ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [261ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [261ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [261ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [282ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [323ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [343ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [422ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [543ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [543ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [661ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [662ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1462ms] refreshing cache from master, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1465ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1465ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1640ms] refreshing cache from master, [1640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1641ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1643ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [4100ms] refreshing cache from master, [4100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4102ms] too many traces: truncated at 100 traces, deferred=Deferred@684513663(state=PENDING, result=null, callback=(continuation of Deferred@1371272405 after retry RPC after error@283615402) -> (continuation of Deferred@875532135 after retry RPC after error@2053550012) -> (continuation of Deferred@1953882489 after retry RPC after error@1505426861) -> (continuation of Deferred@296097098 after retry RPC after error@1592935309) -> (continuation of Deferred@89595651 after retry RPC after error@193908113) -> (continuation of Deferred@715359727 after retry RPC after error@1719747869) -> (continuation of Deferred@1528033737 after retry RPC after error@646729087) -> (continuation of Deferred@271984828 after retry RPC after error@2087927306) -> (continuation of Deferred@950670836 after retry RPC after error@2089369643) -> (continuation of Deferred@1574692046 after retry RPC after error@951915025) -> (continuation of Deferred@1355851079 after retry RPC after error@1726889838) -> (continuation of Deferred@1678854889 after retry RPC after error@887939552) -> (continuation of Deferred@1640202407 after retry RPC after error@1984022206) -> (continuation of Deferred@409570461 after retry RPC after error@1272548753) -> (continuation of Deferred@920845045 after retry RPC after error@1324265121) -> (continuation of Deferred@448257669 after retry RPC after error@495287623) -> (continuation of Deferred@1007753552 after retry RPC after error@120665045) -> (continuation of Deferred@592873024 after retry RPC after error@353347624) -> (continuation of Deferred@568387648 after retry RPC after error@801232946) -> (continuation of Deferred@942812940 after retry RPC after error@1343524554) -> (continuation of Deferred@1989201504 after retry RPC after error@1462864072) -> (continuation of Deferred@2127730541 after retry RPC after error@172237987), errback=(continuation of Deferred@1371272405 after retry RPC after error@283615402) -> (continuation of Deferred@875532135 after retry RPC after error@2053550012) -> (continuation of Deferred@1953882489 after retry RPC after error@1505426861) -> (continuation of Deferred@296097098 after retry RPC after error@1592935309) -> (continuation of Deferred@89595651 after retry RPC after error@193908113) -> (continuation of Deferred@715359727 after retry RPC after error@1719747869) -> (continuation of Deferred@1528033737 after retry RPC after error@646729087) -> (continuation of Deferred@271984828 after retry RPC after error@2087927306) -> (continuation of Deferred@950670836 after retry RPC after error@2089369643) -> (continuation of Deferred@1574692046 after retry RPC after error@951915025) -> (continuation of Deferred@1355851079 after retry RPC after error@1726889838) -> (continuation of Deferred@1678854889 after retry RPC after error@887939552) -> (continuation of Deferred@1640202407 after retry RPC after error@1984022206) -> (continuation of Deferred@409570461 after retry RPC after error@1272548753) -> (continuation of Deferred@920845045 after retry RPC after error@1324265121) -> (continuation of Deferred@448257669 after retry RPC after error@495287623) -> (continuation of Deferred@1007753552 after retry RPC after error@120665045) -> (continuation of Deferred@592873024 after retry RPC after error@353347624) -> (continuation of Deferred@568387648 after retry RPC after error@801232946) -> (continuation of Deferred@942812940 after retry RPC after error@1343524554) -> (continuation of Deferred@1989201504 after retry RPC after error@1462864072) -> (continuation of Deferred@2127730541 after retry RPC after error@172237987)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:09.990 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
18:32:09.990 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state RUNNING to RESTARTING.
18:32:09.990 [WARN - flink-pekko.actor.default-dispatcher-8] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
18:32:09.991 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:32:09.991 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
18:32:10.007 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535530001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:10.014 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:32:10.015 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
18:32:10.022 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:10.022 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:10.023 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:10.023 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:10.023 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:10.023 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:10.023 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:10.023 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:10.023 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:10.023 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:10.023 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:10.023 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:10.023 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:10.032 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:10.381 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:10.381 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:10.382 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:10.382 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:10.382 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:10.382 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:10.383 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:10.383 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:10.383 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:10.383 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:10.383 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:10.383 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:10.384 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:10.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:09.161204  2744 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 2738
18:32:10.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:10.395252  2738 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.627s	user 0.561s	sys 1.102s
18:32:10.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:07.770257  2746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:10.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:10.395742  2738 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.627s	user 0.561s	sys 1.103s
18:32:10.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:10.409868  2753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:10.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.411202  2738 server_base.cc:1061] running on GCE node
18:32:10.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.412814  2738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:32:10.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.415807  2738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:32:10.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.417279  2738 hybrid_clock.cc:648] HybridClock initialized: now 1783535530417176 us; error 95 us; skew 500 ppm
18:32:10.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.418501  2738 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:32:10.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.427420  2738 webserver.cc:534] Webserver started at http://127.2.96.129:37293/ using document root <none> and password file <none>
18:32:10.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.428694  2738 fs_manager.cc:362] Metadata directory not provided
18:32:10.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.429019  2738 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:32:10.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.429585  2738 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:32:10.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.437498  2738 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/data/instance:
18:32:10.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6eacdcba4a9042a9a0000123e8be6eb8"
18:32:10.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:10 on dist-test-slave-dxnw"
18:32:10.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.439190  2738 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/wal/instance:
18:32:10.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6eacdcba4a9042a9a0000123e8be6eb8"
18:32:10.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:10 on dist-test-slave-dxnw"
18:32:10.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.449699  2738 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.005s	sys 0.004s
18:32:10.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.457657  2759 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:32:10.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.459079  2738 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.005s
18:32:10.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.459460  2738 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/wal
18:32:10.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6eacdcba4a9042a9a0000123e8be6eb8"
18:32:10.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:10 on dist-test-slave-dxnw"
18:32:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.459880  2738 fs_report.cc:389] FS layout report
18:32:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:32:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/wal
18:32:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/wal
18:32:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/data/data
18:32:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:32:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:32:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:32:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:32:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:32:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:32:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:32:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:32:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:32:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:32:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:32:10.501 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535530501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:10.510 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:32:10.511 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
18:32:10.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.525761  2738 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:32:10.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.527509  2738 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:32:10.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.528002  2738 kserver.cc:163] Server-wide thread pool size limit: 3276
18:32:10.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.530813  2738 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:32:10.532 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:10.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.536190  2738 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:32:10.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.536435  2738 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:32:10.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.536743  2738 ts_tablet_manager.cc:616] Registered 0 tablets
18:32:10.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.536983  2738 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:32:10.628 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:10.629 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:10.629 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:10.629 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:10.629 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:10.629 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:10.629 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:10.630 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:10.630 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:10.630 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:10.630 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:10.630 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:10.630 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:10.666 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:10.666 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:10.666 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:10.667 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:10.667 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:10.667 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:10.667 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:10.667 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:10.667 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:10.667 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:10.667 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:10.667 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:10.667 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:10.681 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:10.682 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:10.682 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:10.682 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:10.682 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:10.683 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:10.683 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:10.683 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:10.683 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:10.683 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:10.683 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:10.683 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:10.683 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:10.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.708601  2738 rpc_server.cc:307] RPC server started. Bound to: 127.2.96.129:42953
18:32:10.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.708702  2872 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.96.129:42953 every 8 connection(s)
18:32:10.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.711241  2738 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/data/info.pb
18:32:10.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.719338  2434 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 2738
18:32:10.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.720150  2434 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-0/wal/instance
18:32:10.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.734175  2434 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:10.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:10.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/wal
18:32:10.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/data
18:32:10.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:32:10.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:32:10.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:32:10.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:10.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:10.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:10.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/logs
18:32:10.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/data/info.pb
18:32:10.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:10.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:32:10.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:32:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:32:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:32:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:32:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:32:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.96.130:0
18:32:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.96.130
18:32:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.96.130
18:32:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989
18:32:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.96.148:40431
18:32:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:32:10.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.755486  2873 heartbeater.cc:344] Connected to a master server at 127.2.96.188:32989
18:32:10.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.756044  2873 heartbeater.cc:461] Registering TS with master...
18:32:10.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.757625  2873 heartbeater.cc:507] Master 127.2.96.188:32989 requested a full tablet report, sending...
18:32:10.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.758744  2875 heartbeater.cc:344] Connected to a master server at 127.2.96.190:44161
18:32:10.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.759063  2874 heartbeater.cc:344] Connected to a master server at 127.2.96.189:33339
18:32:10.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.759198  2875 heartbeater.cc:461] Registering TS with master...
18:32:10.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.759398  2874 heartbeater.cc:461] Registering TS with master...
18:32:10.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.760214  2875 heartbeater.cc:507] Master 127.2.96.190:44161 requested a full tablet report, sending...
18:32:10.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.760280  2874 heartbeater.cc:507] Master 127.2.96.189:33339 requested a full tablet report, sending...
18:32:10.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.763340  2636 ts_manager.cc:194] Registered new tserver with Master: 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953)
18:32:10.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.763885  2555 ts_manager.cc:194] Registered new tserver with Master: 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953)
18:32:10.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.765976  2479 ts_manager.cc:194] Registered new tserver with Master: 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953)
18:32:10.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:10.766040  2636 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.96.129:59127
18:32:11.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535531001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:11.011 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:32:11.011 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
18:32:11.033 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:11.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:11.100086  2883 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:32:11.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:11.100613  2883 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:32:11.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:11.101112  2883 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:32:11.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:11.135073  2883 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:32:11.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:11.135876  2883 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.96.130
18:32:11.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:11.173344  2883 tablet_server_runner.cc:78] Tablet server non-default flags:
18:32:11.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:11.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.96.148:40431
18:32:11.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:11.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:11.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/data
18:32:11.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/wal
18:32:11.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:11.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:11.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.96.130:0
18:32:11.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/data/info.pb
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.96.130
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.96.130
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/logs
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:32:11.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:32:11.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:11.174907  2883 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:32:11.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:11.176702  2883 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:32:11.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:11.190296  2889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:11.426 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:11.427 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:11.427 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:11.428 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:11.428 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:11.428 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:11.428 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:11.428 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:11.429 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:11.429 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:11.429 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:11.429 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:11.429 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:11.491 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.491 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.492 [DEBUG - pool-126-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.492 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.492 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.493 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.493 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.493 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.493 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.494 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.494 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.494 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.494 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.495 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28606), Traces: [0ms] refreshing cache from master, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [30ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [116ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [236ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [236ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [276ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [289ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [289ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [289ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [353ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [354ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [354ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [355ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [362ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [381ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [382ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [423ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [423ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [443ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [443ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [443ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [523ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [523ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [603ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1100ms] refreshing cache from master, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1104ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1741ms] refreshing cache from master, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1743ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1744ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1744ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2121ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2123ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [5221ms] refreshing cache from master, [5221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [5222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [5222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [5223ms] too many traces: truncated at 100 traces, deferred=Deferred@1098549309(state=PENDING, result=null, callback=(continuation of Deferred@542574622 after retry RPC after error@552899651) -> (continuation of Deferred@1567671017 after retry RPC after error@1214157338) -> (continuation of Deferred@1355904247 after retry RPC after error@1409528866) -> (continuation of Deferred@264197057 after retry RPC after error@869125742) -> (continuation of Deferred@1759539756 after retry RPC after error@554400182) -> (continuation of Deferred@1415513869 after retry RPC after error@163319126) -> (continuation of Deferred@1655074655 after retry RPC after error@404384884) -> (continuation of Deferred@886138645 after retry RPC after error@1575885412) -> (continuation of Deferred@207837713 after retry RPC after error@1204940325) -> (continuation of Deferred@2013777925 after retry RPC after error@1427621979) -> (continuation of Deferred@1135784762 after retry RPC after error@190500271) -> (continuation of Deferred@1293656889 after retry RPC after error@640020433) -> (continuation of Deferred@1884857164 after retry RPC after error@758263645) -> (continuation of Deferred@1033913257 after retry RPC after error@888301739) -> (continuation of Deferred@17170362 after retry RPC after error@1039233024) -> (continuation of Deferred@49533212 after retry RPC after error@627267289) -> (continuation of Deferred@196445664 after retry RPC after error@1039304166) -> (continuation of Deferred@555075701 after retry RPC after error@520066832) -> (continuation of Deferred@969055146 after retry RPC after error@280425665) -> (continuation of Deferred@535810242 after retry RPC after error@2110427960) -> (continuation of Deferred@1358452960 after retry RPC after error@2010099394), errback=(continuation of Deferred@542574622 after retry RPC after error@552899651) -> (continuation of Deferred@1567671017 after retry RPC after error@1214157338) -> (continuation of Deferred@1355904247 after retry RPC after error@1409528866) -> (continuation of Deferred@264197057 after retry RPC after error@869125742) -> (continuation of Deferred@1759539756 after retry RPC after error@554400182) -> (continuation of Deferred@1415513869 after retry RPC after error@163319126) -> (continuation of Deferred@1655074655 after retry RPC after error@404384884) -> (continuation of Deferred@886138645 after retry RPC after error@1575885412) -> (continuation of Deferred@207837713 after retry RPC after error@1204940325) -> (continuation of Deferred@2013777925 after retry RPC after error@1427621979) -> (continuation of Deferred@1135784762 after retry RPC after error@190500271) -> (continuation of Deferred@1293656889 after retry RPC after error@640020433) -> (continuation of Deferred@1884857164 after retry RPC after error@758263645) -> (continuation of Deferred@1033913257 after retry RPC after error@888301739) -> (continuation of Deferred@17170362 after retry RPC after error@1039233024) -> (continuation of Deferred@49533212 after retry RPC after error@627267289) -> (continuation of Deferred@196445664 after retry RPC after error@1039304166) -> (continuation of Deferred@555075701 after retry RPC after error@520066832) -> (continuation of Deferred@969055146 after retry RPC after error@280425665) -> (continuation of Deferred@535810242 after retry RPC after error@2110427960) -> (continuation of Deferred@1358452960 after retry RPC after error@2010099394)))
18:32:11.497 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:32:11.497 [WARN - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28606), Traces: [0ms] refreshing cache from master, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [30ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [116ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [236ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [236ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [276ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [289ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [289ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [289ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [353ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [354ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [354ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [355ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [362ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [381ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [382ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [423ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [423ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [443ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [443ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [443ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [523ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [523ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [603ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1100ms] refreshing cache from master, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1104ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1741ms] refreshing cache from master, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1743ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1744ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1744ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2121ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2123ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [5221ms] refreshing cache from master, [5221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [5222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [5222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [5223ms] too many traces: truncated at 100 traces, deferred=Deferred@1098549309(state=PENDING, result=null, callback=(continuation of Deferred@542574622 after retry RPC after error@552899651) -> (continuation of Deferred@1567671017 after retry RPC after error@1214157338) -> (continuation of Deferred@1355904247 after retry RPC after error@1409528866) -> (continuation of Deferred@264197057 after retry RPC after error@869125742) -> (continuation of Deferred@1759539756 after retry RPC after error@554400182) -> (continuation of Deferred@1415513869 after retry RPC after error@163319126) -> (continuation of Deferred@1655074655 after retry RPC after error@404384884) -> (continuation of Deferred@886138645 after retry RPC after error@1575885412) -> (continuation of Deferred@207837713 after retry RPC after error@1204940325) -> (continuation of Deferred@2013777925 after retry RPC after error@1427621979) -> (continuation of Deferred@1135784762 after retry RPC after error@190500271) -> (continuation of Deferred@1293656889 after retry RPC after error@640020433) -> (continuation of Deferred@1884857164 after retry RPC after error@758263645) -> (continuation of Deferred@1033913257 after retry RPC after error@888301739) -> (continuation of Deferred@17170362 after retry RPC after error@1039233024) -> (continuation of Deferred@49533212 after retry RPC after error@627267289) -> (continuation of Deferred@196445664 after retry RPC after error@1039304166) -> (continuation of Deferred@555075701 after retry RPC after error@520066832) -> (continuation of Deferred@969055146 after retry RPC after error@280425665) -> (continuation of Deferred@535810242 after retry RPC after error@2110427960) -> (continuation of Deferred@1358452960 after retry RPC after error@2010099394), errback=(continuation of Deferred@542574622 after retry RPC after error@552899651) -> (continuation of Deferred@1567671017 after retry RPC after error@1214157338) -> (continuation of Deferred@1355904247 after retry RPC after error@1409528866) -> (continuation of Deferred@264197057 after retry RPC after error@869125742) -> (continuation of Deferred@1759539756 after retry RPC after error@554400182) -> (continuation of Deferred@1415513869 after retry RPC after error@163319126) -> (continuation of Deferred@1655074655 after retry RPC after error@404384884) -> (continuation of Deferred@886138645 after retry RPC after error@1575885412) -> (continuation of Deferred@207837713 after retry RPC after error@1204940325) -> (continuation of Deferred@2013777925 after retry RPC after error@1427621979) -> (continuation of Deferred@1135784762 after retry RPC after error@190500271) -> (continuation of Deferred@1293656889 after retry RPC after error@640020433) -> (continuation of Deferred@1884857164 after retry RPC after error@758263645) -> (continuation of Deferred@1033913257 after retry RPC after error@888301739) -> (continuation of Deferred@17170362 after retry RPC after error@1039233024) -> (continuation of Deferred@49533212 after retry RPC after error@627267289) -> (continuation of Deferred@196445664 after retry RPC after error@1039304166) -> (continuation of Deferred@555075701 after retry RPC after error@520066832) -> (continuation of Deferred@969055146 after retry RPC after error@280425665) -> (continuation of Deferred@535810242 after retry RPC after error@2110427960) -> (continuation of Deferred@1358452960 after retry RPC after error@2010099394)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:11.498 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
18:32:11.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535531501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:11.514 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
18:32:11.515 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
18:32:11.519 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28606), Traces: [0ms] refreshing cache from master, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [30ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [116ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [236ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [236ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [276ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [289ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [289ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [289ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [353ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [354ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [354ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [355ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [362ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [381ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [382ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [423ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [423ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [443ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [443ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [443ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [523ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [523ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [603ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1100ms] refreshing cache from master, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1104ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1741ms] refreshing cache from master, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1742ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1743ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1744ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1744ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2121ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2123ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [5221ms] refreshing cache from master, [5221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [5222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [5222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [5223ms] too many traces: truncated at 100 traces, deferred=Deferred@1098549309(state=PENDING, result=null, callback=(continuation of Deferred@542574622 after retry RPC after error@552899651) -> (continuation of Deferred@1567671017 after retry RPC after error@1214157338) -> (continuation of Deferred@1355904247 after retry RPC after error@1409528866) -> (continuation of Deferred@264197057 after retry RPC after error@869125742) -> (continuation of Deferred@1759539756 after retry RPC after error@554400182) -> (continuation of Deferred@1415513869 after retry RPC after error@163319126) -> (continuation of Deferred@1655074655 after retry RPC after error@404384884) -> (continuation of Deferred@886138645 after retry RPC after error@1575885412) -> (continuation of Deferred@207837713 after retry RPC after error@1204940325) -> (continuation of Deferred@2013777925 after retry RPC after error@1427621979) -> (continuation of Deferred@1135784762 after retry RPC after error@190500271) -> (continuation of Deferred@1293656889 after retry RPC after error@640020433) -> (continuation of Deferred@1884857164 after retry RPC after error@758263645) -> (continuation of Deferred@1033913257 after retry RPC after error@888301739) -> (continuation of Deferred@17170362 after retry RPC after error@1039233024) -> (continuation of Deferred@49533212 after retry RPC after error@627267289) -> (continuation of Deferred@196445664 after retry RPC after error@1039304166) -> (continuation of Deferred@555075701 after retry RPC after error@520066832) -> (continuation of Deferred@969055146 after retry RPC after error@280425665) -> (continuation of Deferred@535810242 after retry RPC after error@2110427960) -> (continuation of Deferred@1358452960 after retry RPC after error@2010099394), errback=(continuation of Deferred@542574622 after retry RPC after error@552899651) -> (continuation of Deferred@1567671017 after retry RPC after error@1214157338) -> (continuation of Deferred@1355904247 after retry RPC after error@1409528866) -> (continuation of Deferred@264197057 after retry RPC after error@869125742) -> (continuation of Deferred@1759539756 after retry RPC after error@554400182) -> (continuation of Deferred@1415513869 after retry RPC after error@163319126) -> (continuation of Deferred@1655074655 after retry RPC after error@404384884) -> (continuation of Deferred@886138645 after retry RPC after error@1575885412) -> (continuation of Deferred@207837713 after retry RPC after error@1204940325) -> (continuation of Deferred@2013777925 after retry RPC after error@1427621979) -> (continuation of Deferred@1135784762 after retry RPC after error@190500271) -> (continuation of Deferred@1293656889 after retry RPC after error@640020433) -> (continuation of Deferred@1884857164 after retry RPC after error@758263645) -> (continuation of Deferred@1033913257 after retry RPC after error@888301739) -> (continuation of Deferred@17170362 after retry RPC after error@1039233024) -> (continuation of Deferred@49533212 after retry RPC after error@627267289) -> (continuation of Deferred@196445664 after retry RPC after error@1039304166) -> (continuation of Deferred@555075701 after retry RPC after error@520066832) -> (continuation of Deferred@969055146 after retry RPC after error@280425665) -> (continuation of Deferred@535810242 after retry RPC after error@2110427960) -> (continuation of Deferred@1358452960 after retry RPC after error@2010099394)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:11.521 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:32:11.521 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
18:32:11.522 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
18:32:11.523 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
18:32:11.533 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:11.581 [INFO - flink-pekko.actor.default-dispatcher-10] (CheckpointCoordinator.java:1805) Restoring job f6e63683f34d031c5da392b08baea20c from Checkpoint 74 @ 1783535501335 for f6e63683f34d031c5da392b08baea20c located at file:/tmp/junit4154231101817438778/checkpoints/f6e63683f34d031c5da392b08baea20c/chk-74.
18:32:11.582 [INFO - flink-pekko.actor.default-dispatcher-10] (MasterHooks.java:201) No master state to restore
18:32:11.582 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 2 to checkpoint 74 for source Source: KuduSource to checkpoint.
18:32:11.583 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
18:32:11.584 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:32:11.585 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
18:32:11.585 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id e5ed6e64fe4e0a504f52a2cb8573a359
18:32:11.585 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot e5ed6e64fe4e0a504f52a2cb8573a359.
18:32:11.586 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state RESTARTING to RUNNING.
18:32:11.587 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id e5ed6e64fe4e0a504f52a2cb8573a359.
18:32:11.588 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
18:32:11.588 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
18:32:11.588 [INFO - flink-pekko.actor.default-dispatcher-10] (CheckpointCoordinator.java:1805) Restoring job f6e63683f34d031c5da392b08baea20c from Checkpoint 74 @ 1783535501335 for f6e63683f34d031c5da392b08baea20c located at file:/tmp/junit4154231101817438778/checkpoints/f6e63683f34d031c5da392b08baea20c/chk-74.
18:32:11.589 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4d0ad2e2
18:32:11.589 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:11.589 [INFO - flink-pekko.actor.default-dispatcher-10] (MasterHooks.java:201) No master state to restore
18:32:11.589 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:32:11.590 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 74 for source Source: KuduSource to checkpoint.
18:32:11.590 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
18:32:11.593 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
18:32:11.593 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:32:11.594 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@52c2ae31
18:32:11.594 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
18:32:11.594 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8c518d750e8767059e15b0e0577096dd
18:32:11.595 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 8c518d750e8767059e15b0e0577096dd.
18:32:11.596 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id 8c518d750e8767059e15b0e0577096dd.
18:32:11.600 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:11.601 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
18:32:11.601 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
18:32:11.603 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:11.603 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:11.603 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:11.604 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:11.604 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:11.604 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:11.604 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:11.604 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:11.604 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:11.604 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:11.604 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:11.605 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:11.605 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:11.611 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2f721b7a
18:32:11.611 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:11.612 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:32:11.612 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
18:32:11.613 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
18:32:11.613 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
18:32:11.615 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.619 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@53089cce
18:32:11.621 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.627 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.627 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.631 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.632 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.632 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.632 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.632 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.632 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.632 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.633 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.633 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.635 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:11.643 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.644 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.644 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.645 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.645 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.645 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.647 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.647 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.647 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.648 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.648 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.649 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.649 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.655 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.656 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.656 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.657 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.657 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.657 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.658 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.658 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.658 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.659 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.659 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.659 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.659 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.663 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.663 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.664 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.664 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.664 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.665 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.666 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.666 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.666 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.667 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.667 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.667 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.667 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.675 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.676 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.676 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.677 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.677 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.677 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.678 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.678 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.678 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.679 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.679 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.680 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.680 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.683 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.684 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.686 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.686 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.686 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.686 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.687 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.687 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.687 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.688 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.688 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.688 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.688 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.695 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.696 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.696 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.696 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.696 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.696 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.696 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.696 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.696 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.697 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.697 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.697 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.697 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.703 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.703 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.704 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.704 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.704 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.705 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.705 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.705 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.705 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.706 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.706 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.706 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.706 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.715 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.715 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.716 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.716 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.716 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.716 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.717 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.717 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.717 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.717 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.718 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.718 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.718 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.722 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:11.723 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.723 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.723 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.724 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.724 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.724 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.725 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.725 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.725 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.725 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.725 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.725 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.726 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.743 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.743 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.744 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.744 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.744 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.744 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.744 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.745 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.745 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.744 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.745 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.745 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.745 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.749 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.749 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.750 [DEBUG - pool-130-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.750 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.750 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.750 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.751 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.751 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.751 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.750 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.751 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.751 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.751 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.752 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28792), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [105ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [114ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [114ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [169ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [204ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [217ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [217ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [234ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [235ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [236ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [241ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [261ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [262ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [280ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [281ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [281ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [281ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [323ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [381ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [382ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [501ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [501ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [501ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [501ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [541ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [541ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [542ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [760ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [762ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [762ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [763ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [763ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1564ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1680ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1694ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1694ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1695ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3180ms] refreshing cache from master, [3180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3182ms] too many traces: truncated at 100 traces, deferred=Deferred@1455516012(state=PENDING, result=null, callback=(continuation of Deferred@314559212 after retry RPC after error@1738625782) -> (continuation of Deferred@507765417 after retry RPC after error@1133797892) -> (continuation of Deferred@797976624 after retry RPC after error@1120659926) -> (continuation of Deferred@1134300556 after retry RPC after error@603509689) -> (continuation of Deferred@218607198 after retry RPC after error@270496625) -> (continuation of Deferred@869072019 after retry RPC after error@1447859272) -> (continuation of Deferred@1711912321 after retry RPC after error@233227978) -> (continuation of Deferred@1494911873 after retry RPC after error@1808181822) -> (continuation of Deferred@1078505338 after retry RPC after error@2074341679) -> (continuation of Deferred@1994926937 after retry RPC after error@681703648) -> (continuation of Deferred@756527601 after retry RPC after error@1238960117) -> (continuation of Deferred@2128371572 after retry RPC after error@1503518391) -> (continuation of Deferred@1226138700 after retry RPC after error@1215444020) -> (continuation of Deferred@1414129073 after retry RPC after error@1662444009) -> (continuation of Deferred@21225155 after retry RPC after error@1481218379) -> (continuation of Deferred@1127648158 after retry RPC after error@402334648) -> (continuation of Deferred@139547202 after retry RPC after error@474354114) -> (continuation of Deferred@1801130927 after retry RPC after error@628296607) -> (continuation of Deferred@657624625 after retry RPC after error@190206740) -> (continuation of Deferred@950271930 after retry RPC after error@87106754) -> (continuation of Deferred@910258515 after retry RPC after error@255220348) -> (continuation of Deferred@676276751 after retry RPC after error@609488112) -> (continuation of Deferred@421669568 after retry RPC after error@612001314) -> (continuation of Deferred@1966354416 after retry RPC after error@1904451114) -> (continuation of Deferred@2038423280 after retry RPC after error@247721099) -> (continuation of Deferred@1515985164 after retry RPC after error@935571107), errback=(continuation of Deferred@314559212 after retry RPC after error@1738625782) -> (continuation of Deferred@507765417 after retry RPC after error@1133797892) -> (continuation of Deferred@797976624 after retry RPC after error@1120659926) -> (continuation of Deferred@1134300556 after retry RPC after error@603509689) -> (continuation of Deferred@218607198 after retry RPC after error@270496625) -> (continuation of Deferred@869072019 after retry RPC after error@1447859272) -> (continuation of Deferred@1711912321 after retry RPC after error@233227978) -> (continuation of Deferred@1494911873 after retry RPC after error@1808181822) -> (continuation of Deferred@1078505338 after retry RPC after error@2074341679) -> (continuation of Deferred@1994926937 after retry RPC after error@681703648) -> (continuation of Deferred@756527601 after retry RPC after error@1238960117) -> (continuation of Deferred@2128371572 after retry RPC after error@1503518391) -> (continuation of Deferred@1226138700 after retry RPC after error@1215444020) -> (continuation of Deferred@1414129073 after retry RPC after error@1662444009) -> (continuation of Deferred@21225155 after retry RPC after error@1481218379) -> (continuation of Deferred@1127648158 after retry RPC after error@402334648) -> (continuation of Deferred@139547202 after retry RPC after error@474354114) -> (continuation of Deferred@1801130927 after retry RPC after error@628296607) -> (continuation of Deferred@657624625 after retry RPC after error@190206740) -> (continuation of Deferred@950271930 after retry RPC after error@87106754) -> (continuation of Deferred@910258515 after retry RPC after error@255220348) -> (continuation of Deferred@676276751 after retry RPC after error@609488112) -> (continuation of Deferred@421669568 after retry RPC after error@612001314) -> (continuation of Deferred@1966354416 after retry RPC after error@1904451114) -> (continuation of Deferred@2038423280 after retry RPC after error@247721099) -> (continuation of Deferred@1515985164 after retry RPC after error@935571107)))
18:32:11.753 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:32:11.754 [WARN - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28792), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [105ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [114ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [114ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [169ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [204ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [217ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [217ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [234ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [235ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [236ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [241ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [261ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [262ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [280ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [281ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [281ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [281ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [323ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [381ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [382ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [501ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [501ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [501ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [501ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [541ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [541ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [542ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [760ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [762ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [762ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [763ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [763ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1564ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1680ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1694ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1694ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1695ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3180ms] refreshing cache from master, [3180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3182ms] too many traces: truncated at 100 traces, deferred=Deferred@1455516012(state=PENDING, result=null, callback=(continuation of Deferred@314559212 after retry RPC after error@1738625782) -> (continuation of Deferred@507765417 after retry RPC after error@1133797892) -> (continuation of Deferred@797976624 after retry RPC after error@1120659926) -> (continuation of Deferred@1134300556 after retry RPC after error@603509689) -> (continuation of Deferred@218607198 after retry RPC after error@270496625) -> (continuation of Deferred@869072019 after retry RPC after error@1447859272) -> (continuation of Deferred@1711912321 after retry RPC after error@233227978) -> (continuation of Deferred@1494911873 after retry RPC after error@1808181822) -> (continuation of Deferred@1078505338 after retry RPC after error@2074341679) -> (continuation of Deferred@1994926937 after retry RPC after error@681703648) -> (continuation of Deferred@756527601 after retry RPC after error@1238960117) -> (continuation of Deferred@2128371572 after retry RPC after error@1503518391) -> (continuation of Deferred@1226138700 after retry RPC after error@1215444020) -> (continuation of Deferred@1414129073 after retry RPC after error@1662444009) -> (continuation of Deferred@21225155 after retry RPC after error@1481218379) -> (continuation of Deferred@1127648158 after retry RPC after error@402334648) -> (continuation of Deferred@139547202 after retry RPC after error@474354114) -> (continuation of Deferred@1801130927 after retry RPC after error@628296607) -> (continuation of Deferred@657624625 after retry RPC after error@190206740) -> (continuation of Deferred@950271930 after retry RPC after error@87106754) -> (continuation of Deferred@910258515 after retry RPC after error@255220348) -> (continuation of Deferred@676276751 after retry RPC after error@609488112) -> (continuation of Deferred@421669568 after retry RPC after error@612001314) -> (continuation of Deferred@1966354416 after retry RPC after error@1904451114) -> (continuation of Deferred@2038423280 after retry RPC after error@247721099) -> (continuation of Deferred@1515985164 after retry RPC after error@935571107), errback=(continuation of Deferred@314559212 after retry RPC after error@1738625782) -> (continuation of Deferred@507765417 after retry RPC after error@1133797892) -> (continuation of Deferred@797976624 after retry RPC after error@1120659926) -> (continuation of Deferred@1134300556 after retry RPC after error@603509689) -> (continuation of Deferred@218607198 after retry RPC after error@270496625) -> (continuation of Deferred@869072019 after retry RPC after error@1447859272) -> (continuation of Deferred@1711912321 after retry RPC after error@233227978) -> (continuation of Deferred@1494911873 after retry RPC after error@1808181822) -> (continuation of Deferred@1078505338 after retry RPC after error@2074341679) -> (continuation of Deferred@1994926937 after retry RPC after error@681703648) -> (continuation of Deferred@756527601 after retry RPC after error@1238960117) -> (continuation of Deferred@2128371572 after retry RPC after error@1503518391) -> (continuation of Deferred@1226138700 after retry RPC after error@1215444020) -> (continuation of Deferred@1414129073 after retry RPC after error@1662444009) -> (continuation of Deferred@21225155 after retry RPC after error@1481218379) -> (continuation of Deferred@1127648158 after retry RPC after error@402334648) -> (continuation of Deferred@139547202 after retry RPC after error@474354114) -> (continuation of Deferred@1801130927 after retry RPC after error@628296607) -> (continuation of Deferred@657624625 after retry RPC after error@190206740) -> (continuation of Deferred@950271930 after retry RPC after error@87106754) -> (continuation of Deferred@910258515 after retry RPC after error@255220348) -> (continuation of Deferred@676276751 after retry RPC after error@609488112) -> (continuation of Deferred@421669568 after retry RPC after error@612001314) -> (continuation of Deferred@1966354416 after retry RPC after error@1904451114) -> (continuation of Deferred@2038423280 after retry RPC after error@247721099) -> (continuation of Deferred@1515985164 after retry RPC after error@935571107)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.124:38627
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:11.754 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
18:32:11.755 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.755 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.756 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.756 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
18:32:11.756 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.756 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.756 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.756 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.756 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.756 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.757 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.757 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.757 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.757 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.758 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28792), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [105ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [114ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [114ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [169ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [204ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [217ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [217ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [234ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [235ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [236ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [241ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [261ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [262ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [280ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [281ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [281ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [281ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [323ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [381ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [382ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [501ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [501ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [501ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [501ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [541ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [541ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [542ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [760ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [762ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [762ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [763ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [763ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1564ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1680ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1694ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1694ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1695ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3180ms] refreshing cache from master, [3180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3182ms] too many traces: truncated at 100 traces, deferred=Deferred@1455516012(state=PENDING, result=null, callback=(continuation of Deferred@314559212 after retry RPC after error@1738625782) -> (continuation of Deferred@507765417 after retry RPC after error@1133797892) -> (continuation of Deferred@797976624 after retry RPC after error@1120659926) -> (continuation of Deferred@1134300556 after retry RPC after error@603509689) -> (continuation of Deferred@218607198 after retry RPC after error@270496625) -> (continuation of Deferred@869072019 after retry RPC after error@1447859272) -> (continuation of Deferred@1711912321 after retry RPC after error@233227978) -> (continuation of Deferred@1494911873 after retry RPC after error@1808181822) -> (continuation of Deferred@1078505338 after retry RPC after error@2074341679) -> (continuation of Deferred@1994926937 after retry RPC after error@681703648) -> (continuation of Deferred@756527601 after retry RPC after error@1238960117) -> (continuation of Deferred@2128371572 after retry RPC after error@1503518391) -> (continuation of Deferred@1226138700 after retry RPC after error@1215444020) -> (continuation of Deferred@1414129073 after retry RPC after error@1662444009) -> (continuation of Deferred@21225155 after retry RPC after error@1481218379) -> (continuation of Deferred@1127648158 after retry RPC after error@402334648) -> (continuation of Deferred@139547202 after retry RPC after error@474354114) -> (continuation of Deferred@1801130927 after retry RPC after error@628296607) -> (continuation of Deferred@657624625 after retry RPC after error@190206740) -> (continuation of Deferred@950271930 after retry RPC after error@87106754) -> (continuation of Deferred@910258515 after retry RPC after error@255220348) -> (continuation of Deferred@676276751 after retry RPC after error@609488112) -> (continuation of Deferred@421669568 after retry RPC after error@612001314) -> (continuation of Deferred@1966354416 after retry RPC after error@1904451114) -> (continuation of Deferred@2038423280 after retry RPC after error@247721099) -> (continuation of Deferred@1515985164 after retry RPC after error@935571107), errback=(continuation of Deferred@314559212 after retry RPC after error@1738625782) -> (continuation of Deferred@507765417 after retry RPC after error@1133797892) -> (continuation of Deferred@797976624 after retry RPC after error@1120659926) -> (continuation of Deferred@1134300556 after retry RPC after error@603509689) -> (continuation of Deferred@218607198 after retry RPC after error@270496625) -> (continuation of Deferred@869072019 after retry RPC after error@1447859272) -> (continuation of Deferred@1711912321 after retry RPC after error@233227978) -> (continuation of Deferred@1494911873 after retry RPC after error@1808181822) -> (continuation of Deferred@1078505338 after retry RPC after error@2074341679) -> (continuation of Deferred@1994926937 after retry RPC after error@681703648) -> (continuation of Deferred@756527601 after retry RPC after error@1238960117) -> (continuation of Deferred@2128371572 after retry RPC after error@1503518391) -> (continuation of Deferred@1226138700 after retry RPC after error@1215444020) -> (continuation of Deferred@1414129073 after retry RPC after error@1662444009) -> (continuation of Deferred@21225155 after retry RPC after error@1481218379) -> (continuation of Deferred@1127648158 after retry RPC after error@402334648) -> (continuation of Deferred@139547202 after retry RPC after error@474354114) -> (continuation of Deferred@1801130927 after retry RPC after error@628296607) -> (continuation of Deferred@657624625 after retry RPC after error@190206740) -> (continuation of Deferred@950271930 after retry RPC after error@87106754) -> (continuation of Deferred@910258515 after retry RPC after error@255220348) -> (continuation of Deferred@676276751 after retry RPC after error@609488112) -> (continuation of Deferred@421669568 after retry RPC after error@612001314) -> (continuation of Deferred@1966354416 after retry RPC after error@1904451114) -> (continuation of Deferred@2038423280 after retry RPC after error@247721099) -> (continuation of Deferred@1515985164 after retry RPC after error@935571107)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.124:38627
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:11.759 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
18:32:11.759 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state RUNNING to RESTARTING.
18:32:11.760 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:32:11.760 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
18:32:11.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:11.769949  2873 heartbeater.cc:499] Master 127.2.96.188:32989 was elected leader, sending a full tablet report...
18:32:11.775 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.775 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.776 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.776 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.776 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.776 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.776 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.777 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.777 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.777 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.777 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.777 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.777 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.823 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:11.823 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:11.823 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:11.823 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:11.823 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:11.823 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:11.823 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:11.824 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:11.824 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:11.824 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:11.824 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:11.824 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:11.824 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:11.824 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.824 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.825 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.825 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.825 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.825 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.825 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.825 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.825 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.825 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.825 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.825 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.825 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.835 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.835 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.836 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.836 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.836 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.836 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.836 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.836 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.836 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.836 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.836 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.837 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.837 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.944 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.944 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.944 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.945 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.945 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.945 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.945 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.945 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.945 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.946 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.946 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.946 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.946 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:11.995 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:11.996 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:11.996 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:11.997 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.997 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.997 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:11.997 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.997 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.997 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:11.998 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.998 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.998 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:11.998 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:12.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535532001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:12.023 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=22 ms, finalizationTime=0 ms).
18:32:12.025 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
18:32:12.033 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:12.183 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:12.184 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:12.184 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:12.184 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:12.184 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:12.184 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:12.184 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:12.184 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:12.185 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:12.185 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:12.185 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:12.185 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:12.185 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:12.301 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:12.301 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:12.302 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:12.302 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:12.303 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:12.303 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:12.303 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:12.303 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:12.303 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:12.302 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:12.303 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:12.303 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:12.304 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:12.327 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:12.327 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:12.327 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:12.328 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:12.328 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:12.328 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:12.328 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:12.328 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:12.328 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:12.329 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:12.329 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:12.329 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:12.329 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:12.335 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:12.335 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:12.335 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:12.336 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:12.336 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:12.336 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:12.336 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:12.336 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:12.336 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:12.336 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:12.336 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:12.337 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:12.337 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:12.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535532501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:12.515 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
18:32:12.516 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
18:32:12.523 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:12.523 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:12.523 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:12.524 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:12.524 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:12.524 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:12.524 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:12.524 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:12.524 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:12.524 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:12.524 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:12.524 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:12.525 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:12.533 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:12.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:11.203645  2892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:12.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:12.565150  2891 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1374 milliseconds
18:32:12.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:11.192595  2890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:12.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.565493  2883 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:32:12.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.570225  2883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:32:12.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.573287  2883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:32:12.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.574704  2883 hybrid_clock.cc:648] HybridClock initialized: now 1783535532574645 us; error 71 us; skew 500 ppm
18:32:12.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.575592  2883 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:32:12.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.583060  2883 webserver.cc:534] Webserver started at http://127.2.96.130:37345/ using document root <none> and password file <none>
18:32:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.584329  2883 fs_manager.cc:362] Metadata directory not provided
18:32:12.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.584568  2883 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:32:12.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.585045  2883 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:32:12.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.589468  2883 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/data/instance:
18:32:12.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f996ea4859274e2fa9d44a503fa0aa5a"
18:32:12.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:12 on dist-test-slave-dxnw"
18:32:12.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.590586  2883 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/wal/instance:
18:32:12.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f996ea4859274e2fa9d44a503fa0aa5a"
18:32:12.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:12 on dist-test-slave-dxnw"
18:32:12.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.597877  2883 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.001s	sys 0.004s
18:32:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.603885  2921 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:32:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.604959  2883 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.005s
18:32:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.605341  2883 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/wal
18:32:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f996ea4859274e2fa9d44a503fa0aa5a"
18:32:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:12 on dist-test-slave-dxnw"
18:32:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.605736  2883 fs_report.cc:389] FS layout report
18:32:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:32:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/wal
18:32:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/wal
18:32:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/data/data
18:32:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:32:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:32:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:32:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:32:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:32:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:32:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:32:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:32:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:32:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:32:12.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:32:12.643 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:12.644 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:12.644 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:12.644 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:12.644 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:12.644 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:12.644 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:12.644 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:12.644 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:12.645 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:12.645 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:12.645 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:12.645 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:12.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.668370  2883 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:32:12.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.669902  2883 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:32:12.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.670396  2883 kserver.cc:163] Server-wide thread pool size limit: 3276
18:32:12.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.673578  2883 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:32:12.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.678164  2883 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:32:12.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.678409  2883 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:32:12.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.678711  2883 ts_tablet_manager.cc:616] Registered 0 tablets
18:32:12.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.678921  2883 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
18:32:12.712 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:12.712 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:12.713 [DEBUG - pool-124-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:12.713 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:12.713 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:12.713 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:12.713 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:12.713 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:12.713 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:12.713 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:12.713 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:12.713 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:12.713 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:12.714 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29834), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [132ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [136ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [137ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [169ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [170ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [280ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [283ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [317ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [317ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [325ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [325ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [341ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [344ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [344ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [364ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [364ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [403ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [403ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [461ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [462ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [462ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [462ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [483ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [483ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [641ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [642ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [683ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [683ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [683ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1584ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1920ms] refreshing cache from master, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1923ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2800ms] refreshing cache from master, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2802ms] too many traces: truncated at 100 traces, deferred=Deferred@1989753769(state=PENDING, result=null, callback=(continuation of Deferred@564787451 after retry RPC after error@165719284) -> (continuation of Deferred@1665982932 after retry RPC after error@1555552871) -> (continuation of Deferred@842501930 after retry RPC after error@1052508820) -> (continuation of Deferred@989464278 after retry RPC after error@1492944652) -> (continuation of Deferred@1446780390 after retry RPC after error@139070743) -> (continuation of Deferred@1651275390 after retry RPC after error@1578387928) -> (continuation of Deferred@1760672977 after retry RPC after error@814425709) -> (continuation of Deferred@836073860 after retry RPC after error@1299430639) -> (continuation of Deferred@679581348 after retry RPC after error@1095792023) -> (continuation of Deferred@1532177760 after retry RPC after error@186082849) -> (continuation of Deferred@797435217 after retry RPC after error@1832501755) -> (continuation of Deferred@792971537 after retry RPC after error@534090934) -> (continuation of Deferred@266884976 after retry RPC after error@754805103) -> (continuation of Deferred@491206304 after retry RPC after error@780427674) -> (continuation of Deferred@1662709997 after retry RPC after error@619404272) -> (continuation of Deferred@4037627 after retry RPC after error@221815511) -> (continuation of Deferred@957462021 after retry RPC after error@1197170188) -> (continuation of Deferred@727054175 after retry RPC after error@1664341752) -> (continuation of Deferred@1462170885 after retry RPC after error@1242589907) -> (continuation of Deferred@1325110209 after retry RPC after error@855775472) -> (continuation of Deferred@1407999304 after retry RPC after error@451146516) -> (continuation of Deferred@143924754 after retry RPC after error@737301096) -> (continuation of Deferred@440749123 after retry RPC after error@532379468) -> (continuation of Deferred@938974759 after retry RPC after error@238021539), errback=(continuation of Deferred@564787451 after retry RPC after error@165719284) -> (continuation of Deferred@1665982932 after retry RPC after error@1555552871) -> (continuation of Deferred@842501930 after retry RPC after error@1052508820) -> (continuation of Deferred@989464278 after retry RPC after error@1492944652) -> (continuation of Deferred@1446780390 after retry RPC after error@139070743) -> (continuation of Deferred@1651275390 after retry RPC after error@1578387928) -> (continuation of Deferred@1760672977 after retry RPC after error@814425709) -> (continuation of Deferred@836073860 after retry RPC after error@1299430639) -> (continuation of Deferred@679581348 after retry RPC after error@1095792023) -> (continuation of Deferred@1532177760 after retry RPC after error@186082849) -> (continuation of Deferred@797435217 after retry RPC after error@1832501755) -> (continuation of Deferred@792971537 after retry RPC after error@534090934) -> (continuation of Deferred@266884976 after retry RPC after error@754805103) -> (continuation of Deferred@491206304 after retry RPC after error@780427674) -> (continuation of Deferred@1662709997 after retry RPC after error@619404272) -> (continuation of Deferred@4037627 after retry RPC after error@221815511) -> (continuation of Deferred@957462021 after retry RPC after error@1197170188) -> (continuation of Deferred@727054175 after retry RPC after error@1664341752) -> (continuation of Deferred@1462170885 after retry RPC after error@1242589907) -> (continuation of Deferred@1325110209 after retry RPC after error@855775472) -> (continuation of Deferred@1407999304 after retry RPC after error@451146516) -> (continuation of Deferred@143924754 after retry RPC after error@737301096) -> (continuation of Deferred@440749123 after retry RPC after error@532379468) -> (continuation of Deferred@938974759 after retry RPC after error@238021539)))
18:32:12.715 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:32:12.715 [WARN - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29834), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [132ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [136ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [137ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [169ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [170ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [280ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [283ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [317ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [317ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [325ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [325ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [341ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [344ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [344ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [364ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [364ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [403ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [403ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [461ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [462ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [462ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [462ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [483ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [483ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [641ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [642ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [683ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [683ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [683ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1584ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1920ms] refreshing cache from master, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1923ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2800ms] refreshing cache from master, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2802ms] too many traces: truncated at 100 traces, deferred=Deferred@1989753769(state=PENDING, result=null, callback=(continuation of Deferred@564787451 after retry RPC after error@165719284) -> (continuation of Deferred@1665982932 after retry RPC after error@1555552871) -> (continuation of Deferred@842501930 after retry RPC after error@1052508820) -> (continuation of Deferred@989464278 after retry RPC after error@1492944652) -> (continuation of Deferred@1446780390 after retry RPC after error@139070743) -> (continuation of Deferred@1651275390 after retry RPC after error@1578387928) -> (continuation of Deferred@1760672977 after retry RPC after error@814425709) -> (continuation of Deferred@836073860 after retry RPC after error@1299430639) -> (continuation of Deferred@679581348 after retry RPC after error@1095792023) -> (continuation of Deferred@1532177760 after retry RPC after error@186082849) -> (continuation of Deferred@797435217 after retry RPC after error@1832501755) -> (continuation of Deferred@792971537 after retry RPC after error@534090934) -> (continuation of Deferred@266884976 after retry RPC after error@754805103) -> (continuation of Deferred@491206304 after retry RPC after error@780427674) -> (continuation of Deferred@1662709997 after retry RPC after error@619404272) -> (continuation of Deferred@4037627 after retry RPC after error@221815511) -> (continuation of Deferred@957462021 after retry RPC after error@1197170188) -> (continuation of Deferred@727054175 after retry RPC after error@1664341752) -> (continuation of Deferred@1462170885 after retry RPC after error@1242589907) -> (continuation of Deferred@1325110209 after retry RPC after error@855775472) -> (continuation of Deferred@1407999304 after retry RPC after error@451146516) -> (continuation of Deferred@143924754 after retry RPC after error@737301096) -> (continuation of Deferred@440749123 after retry RPC after error@532379468) -> (continuation of Deferred@938974759 after retry RPC after error@238021539), errback=(continuation of Deferred@564787451 after retry RPC after error@165719284) -> (continuation of Deferred@1665982932 after retry RPC after error@1555552871) -> (continuation of Deferred@842501930 after retry RPC after error@1052508820) -> (continuation of Deferred@989464278 after retry RPC after error@1492944652) -> (continuation of Deferred@1446780390 after retry RPC after error@139070743) -> (continuation of Deferred@1651275390 after retry RPC after error@1578387928) -> (continuation of Deferred@1760672977 after retry RPC after error@814425709) -> (continuation of Deferred@836073860 after retry RPC after error@1299430639) -> (continuation of Deferred@679581348 after retry RPC after error@1095792023) -> (continuation of Deferred@1532177760 after retry RPC after error@186082849) -> (continuation of Deferred@797435217 after retry RPC after error@1832501755) -> (continuation of Deferred@792971537 after retry RPC after error@534090934) -> (continuation of Deferred@266884976 after retry RPC after error@754805103) -> (continuation of Deferred@491206304 after retry RPC after error@780427674) -> (continuation of Deferred@1662709997 after retry RPC after error@619404272) -> (continuation of Deferred@4037627 after retry RPC after error@221815511) -> (continuation of Deferred@957462021 after retry RPC after error@1197170188) -> (continuation of Deferred@727054175 after retry RPC after error@1664341752) -> (continuation of Deferred@1462170885 after retry RPC after error@1242589907) -> (continuation of Deferred@1325110209 after retry RPC after error@855775472) -> (continuation of Deferred@1407999304 after retry RPC after error@451146516) -> (continuation of Deferred@143924754 after retry RPC after error@737301096) -> (continuation of Deferred@440749123 after retry RPC after error@532379468) -> (continuation of Deferred@938974759 after retry RPC after error@238021539)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.125:40423
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:12.716 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
18:32:12.717 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
18:32:12.719 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29834), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [132ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [136ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [137ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [169ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [170ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [280ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [283ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [317ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [317ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [325ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [325ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [341ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [344ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [344ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [364ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [364ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [403ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [403ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [461ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [462ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [462ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [462ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [483ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [483ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [641ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [642ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [683ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [683ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [683ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1583ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1584ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1584ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1920ms] refreshing cache from master, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1923ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1923ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2800ms] refreshing cache from master, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2802ms] too many traces: truncated at 100 traces, deferred=Deferred@1989753769(state=PENDING, result=null, callback=(continuation of Deferred@564787451 after retry RPC after error@165719284) -> (continuation of Deferred@1665982932 after retry RPC after error@1555552871) -> (continuation of Deferred@842501930 after retry RPC after error@1052508820) -> (continuation of Deferred@989464278 after retry RPC after error@1492944652) -> (continuation of Deferred@1446780390 after retry RPC after error@139070743) -> (continuation of Deferred@1651275390 after retry RPC after error@1578387928) -> (continuation of Deferred@1760672977 after retry RPC after error@814425709) -> (continuation of Deferred@836073860 after retry RPC after error@1299430639) -> (continuation of Deferred@679581348 after retry RPC after error@1095792023) -> (continuation of Deferred@1532177760 after retry RPC after error@186082849) -> (continuation of Deferred@797435217 after retry RPC after error@1832501755) -> (continuation of Deferred@792971537 after retry RPC after error@534090934) -> (continuation of Deferred@266884976 after retry RPC after error@754805103) -> (continuation of Deferred@491206304 after retry RPC after error@780427674) -> (continuation of Deferred@1662709997 after retry RPC after error@619404272) -> (continuation of Deferred@4037627 after retry RPC after error@221815511) -> (continuation of Deferred@957462021 after retry RPC after error@1197170188) -> (continuation of Deferred@727054175 after retry RPC after error@1664341752) -> (continuation of Deferred@1462170885 after retry RPC after error@1242589907) -> (continuation of Deferred@1325110209 after retry RPC after error@855775472) -> (continuation of Deferred@1407999304 after retry RPC after error@451146516) -> (continuation of Deferred@143924754 after retry RPC after error@737301096) -> (continuation of Deferred@440749123 after retry RPC after error@532379468) -> (continuation of Deferred@938974759 after retry RPC after error@238021539), errback=(continuation of Deferred@564787451 after retry RPC after error@165719284) -> (continuation of Deferred@1665982932 after retry RPC after error@1555552871) -> (continuation of Deferred@842501930 after retry RPC after error@1052508820) -> (continuation of Deferred@989464278 after retry RPC after error@1492944652) -> (continuation of Deferred@1446780390 after retry RPC after error@139070743) -> (continuation of Deferred@1651275390 after retry RPC after error@1578387928) -> (continuation of Deferred@1760672977 after retry RPC after error@814425709) -> (continuation of Deferred@836073860 after retry RPC after error@1299430639) -> (continuation of Deferred@679581348 after retry RPC after error@1095792023) -> (continuation of Deferred@1532177760 after retry RPC after error@186082849) -> (continuation of Deferred@797435217 after retry RPC after error@1832501755) -> (continuation of Deferred@792971537 after retry RPC after error@534090934) -> (continuation of Deferred@266884976 after retry RPC after error@754805103) -> (continuation of Deferred@491206304 after retry RPC after error@780427674) -> (continuation of Deferred@1662709997 after retry RPC after error@619404272) -> (continuation of Deferred@4037627 after retry RPC after error@221815511) -> (continuation of Deferred@957462021 after retry RPC after error@1197170188) -> (continuation of Deferred@727054175 after retry RPC after error@1664341752) -> (continuation of Deferred@1462170885 after retry RPC after error@1242589907) -> (continuation of Deferred@1325110209 after retry RPC after error@855775472) -> (continuation of Deferred@1407999304 after retry RPC after error@451146516) -> (continuation of Deferred@143924754 after retry RPC after error@737301096) -> (continuation of Deferred@440749123 after retry RPC after error@532379468) -> (continuation of Deferred@938974759 after retry RPC after error@238021539)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.125:40423
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:12.721 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
18:32:12.721 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:32:12.722 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
18:32:12.812 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:12.812 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:12.812 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:12.813 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.813 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.813 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.814 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.814 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.814 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.816 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.816 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.816 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.816 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:12.817 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29915), Traces: [0ms] refreshing cache from master, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [41ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [52ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [59ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [59ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [132ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [133ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [266ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [271ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [272ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [273ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [277ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [303ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [363ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [363ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [423ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [424ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [424ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [424ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [523ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [523ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [702ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [704ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [741ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [741ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [742ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [742ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1383ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1788ms] refreshing cache from master, [1788ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1789ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1789ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1789ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1790ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1790ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1790ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [5421ms] refreshing cache from master, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [5422ms] too many traces: truncated at 100 traces, deferred=Deferred@1363172585(state=PENDING, result=null, callback=(continuation of Deferred@178189176 after retry RPC after error@1441985391) -> (continuation of Deferred@979126709 after retry RPC after error@1772678403) -> (continuation of Deferred@349226621 after retry RPC after error@1459303939) -> (continuation of Deferred@246602888 after retry RPC after error@551352488) -> (continuation of Deferred@841822688 after retry RPC after error@1030312584) -> (continuation of Deferred@623353649 after retry RPC after error@1660500613) -> (continuation of Deferred@956347659 after retry RPC after error@1317686705) -> (continuation of Deferred@1464704326 after retry RPC after error@2085337144) -> (continuation of Deferred@1080025687 after retry RPC after error@1545914408) -> (continuation of Deferred@1731778887 after retry RPC after error@1175660512) -> (continuation of Deferred@2044799023 after retry RPC after error@58641075) -> (continuation of Deferred@573426042 after retry RPC after error@2103363320) -> (continuation of Deferred@227424556 after retry RPC after error@2026914172) -> (continuation of Deferred@888811781 after retry RPC after error@1058560100) -> (continuation of Deferred@1126388210 after retry RPC after error@956445515) -> (continuation of Deferred@1553293175 after retry RPC after error@557049849) -> (continuation of Deferred@2017894124 after retry RPC after error@1358324420) -> (continuation of Deferred@653189450 after retry RPC after error@417121857) -> (continuation of Deferred@1411484232 after retry RPC after error@924983882) -> (continuation of Deferred@1721196885 after retry RPC after error@411524360) -> (continuation of Deferred@1085073306 after retry RPC after error@1715121591), errback=(continuation of Deferred@178189176 after retry RPC after error@1441985391) -> (continuation of Deferred@979126709 after retry RPC after error@1772678403) -> (continuation of Deferred@349226621 after retry RPC after error@1459303939) -> (continuation of Deferred@246602888 after retry RPC after error@551352488) -> (continuation of Deferred@841822688 after retry RPC after error@1030312584) -> (continuation of Deferred@623353649 after retry RPC after error@1660500613) -> (continuation of Deferred@956347659 after retry RPC after error@1317686705) -> (continuation of Deferred@1464704326 after retry RPC after error@2085337144) -> (continuation of Deferred@1080025687 after retry RPC after error@1545914408) -> (continuation of Deferred@1731778887 after retry RPC after error@1175660512) -> (continuation of Deferred@2044799023 after retry RPC after error@58641075) -> (continuation of Deferred@573426042 after retry RPC after error@2103363320) -> (continuation of Deferred@227424556 after retry RPC after error@2026914172) -> (continuation of Deferred@888811781 after retry RPC after error@1058560100) -> (continuation of Deferred@1126388210 after retry RPC after error@956445515) -> (continuation of Deferred@1553293175 after retry RPC after error@557049849) -> (continuation of Deferred@2017894124 after retry RPC after error@1358324420) -> (continuation of Deferred@653189450 after retry RPC after error@417121857) -> (continuation of Deferred@1411484232 after retry RPC after error@924983882) -> (continuation of Deferred@1721196885 after retry RPC after error@411524360) -> (continuation of Deferred@1085073306 after retry RPC after error@1715121591)))
18:32:12.818 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:12.818 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:12.818 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:12.819 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.819 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.819 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.819 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29915), Traces: [0ms] refreshing cache from master, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [41ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [52ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [59ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [59ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [132ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [133ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [266ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [271ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [272ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [273ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [277ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [303ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [363ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [363ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [423ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [424ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [424ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [424ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [523ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [523ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [702ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [704ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [741ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [741ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [742ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [742ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1383ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1788ms] refreshing cache from master, [1788ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1789ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1789ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1789ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1790ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1790ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1790ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [5421ms] refreshing cache from master, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [5422ms] too many traces: truncated at 100 traces, deferred=Deferred@1363172585(state=PENDING, result=null, callback=(continuation of Deferred@178189176 after retry RPC after error@1441985391) -> (continuation of Deferred@979126709 after retry RPC after error@1772678403) -> (continuation of Deferred@349226621 after retry RPC after error@1459303939) -> (continuation of Deferred@246602888 after retry RPC after error@551352488) -> (continuation of Deferred@841822688 after retry RPC after error@1030312584) -> (continuation of Deferred@623353649 after retry RPC after error@1660500613) -> (continuation of Deferred@956347659 after retry RPC after error@1317686705) -> (continuation of Deferred@1464704326 after retry RPC after error@2085337144) -> (continuation of Deferred@1080025687 after retry RPC after error@1545914408) -> (continuation of Deferred@1731778887 after retry RPC after error@1175660512) -> (continuation of Deferred@2044799023 after retry RPC after error@58641075) -> (continuation of Deferred@573426042 after retry RPC after error@2103363320) -> (continuation of Deferred@227424556 after retry RPC after error@2026914172) -> (continuation of Deferred@888811781 after retry RPC after error@1058560100) -> (continuation of Deferred@1126388210 after retry RPC after error@956445515) -> (continuation of Deferred@1553293175 after retry RPC after error@557049849) -> (continuation of Deferred@2017894124 after retry RPC after error@1358324420) -> (continuation of Deferred@653189450 after retry RPC after error@417121857) -> (continuation of Deferred@1411484232 after retry RPC after error@924983882) -> (continuation of Deferred@1721196885 after retry RPC after error@411524360) -> (continuation of Deferred@1085073306 after retry RPC after error@1715121591), errback=(continuation of Deferred@178189176 after retry RPC after error@1441985391) -> (continuation of Deferred@979126709 after retry RPC after error@1772678403) -> (continuation of Deferred@349226621 after retry RPC after error@1459303939) -> (continuation of Deferred@246602888 after retry RPC after error@551352488) -> (continuation of Deferred@841822688 after retry RPC after error@1030312584) -> (continuation of Deferred@623353649 after retry RPC after error@1660500613) -> (continuation of Deferred@956347659 after retry RPC after error@1317686705) -> (continuation of Deferred@1464704326 after retry RPC after error@2085337144) -> (continuation of Deferred@1080025687 after retry RPC after error@1545914408) -> (continuation of Deferred@1731778887 after retry RPC after error@1175660512) -> (continuation of Deferred@2044799023 after retry RPC after error@58641075) -> (continuation of Deferred@573426042 after retry RPC after error@2103363320) -> (continuation of Deferred@227424556 after retry RPC after error@2026914172) -> (continuation of Deferred@888811781 after retry RPC after error@1058560100) -> (continuation of Deferred@1126388210 after retry RPC after error@956445515) -> (continuation of Deferred@1553293175 after retry RPC after error@557049849) -> (continuation of Deferred@2017894124 after retry RPC after error@1358324420) -> (continuation of Deferred@653189450 after retry RPC after error@417121857) -> (continuation of Deferred@1411484232 after retry RPC after error@924983882) -> (continuation of Deferred@1721196885 after retry RPC after error@411524360) -> (continuation of Deferred@1085073306 after retry RPC after error@1715121591)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29915), Traces: [0ms] refreshing cache from master, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [41ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [52ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [59ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [59ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [132ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [133ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [266ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [271ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [272ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [273ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [277ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [303ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [363ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [363ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [423ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [424ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [424ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [424ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [523ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [523ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [702ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [704ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [741ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [741ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [742ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [742ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1383ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1788ms] refreshing cache from master, [1788ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1789ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1789ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1789ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1790ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1790ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1790ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [5421ms] refreshing cache from master, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [5422ms] too many traces: truncated at 100 traces, deferred=Deferred@1363172585(state=PENDING, result=null, callback=(continuation of Deferred@178189176 after retry RPC after error@1441985391) -> (continuation of Deferred@979126709 after retry RPC after error@1772678403) -> (continuation of Deferred@349226621 after retry RPC after error@1459303939) -> (continuation of Deferred@246602888 after retry RPC after error@551352488) -> (continuation of Deferred@841822688 after retry RPC after error@1030312584) -> (continuation of Deferred@623353649 after retry RPC after error@1660500613) -> (continuation of Deferred@956347659 after retry RPC after error@1317686705) -> (continuation of Deferred@1464704326 after retry RPC after error@2085337144) -> (continuation of Deferred@1080025687 after retry RPC after error@1545914408) -> (continuation of Deferred@1731778887 after retry RPC after error@1175660512) -> (continuation of Deferred@2044799023 after retry RPC after error@58641075) -> (continuation of Deferred@573426042 after retry RPC after error@2103363320) -> (continuation of Deferred@227424556 after retry RPC after error@2026914172) -> (continuation of Deferred@888811781 after retry RPC after error@1058560100) -> (continuation of Deferred@1126388210 after retry RPC after error@956445515) -> (continuation of Deferred@1553293175 after retry RPC after error@557049849) -> (continuation of Deferred@2017894124 after retry RPC after error@1358324420) -> (continuation of Deferred@653189450 after retry RPC after error@417121857) -> (continuation of Deferred@1411484232 after retry RPC after error@924983882) -> (continuation of Deferred@1721196885 after retry RPC after error@411524360) -> (continuation of Deferred@1085073306 after retry RPC after error@1715121591), errback=(continuation of Deferred@178189176 after retry RPC after error@1441985391) -> (continuation of Deferred@979126709 after retry RPC after error@1772678403) -> (continuation of Deferred@349226621 after retry RPC after error@1459303939) -> (continuation of Deferred@246602888 after retry RPC after error@551352488) -> (continuation of Deferred@841822688 after retry RPC after error@1030312584) -> (continuation of Deferred@623353649 after retry RPC after error@1660500613) -> (continuation of Deferred@956347659 after retry RPC after error@1317686705) -> (continuation of Deferred@1464704326 after retry RPC after error@2085337144) -> (continuation of Deferred@1080025687 after retry RPC after error@1545914408) -> (continuation of Deferred@1731778887 after retry RPC after error@1175660512) -> (continuation of Deferred@2044799023 after retry RPC after error@58641075) -> (continuation of Deferred@573426042 after retry RPC after error@2103363320) -> (continuation of Deferred@227424556 after retry RPC after error@2026914172) -> (continuation of Deferred@888811781 after retry RPC after error@1058560100) -> (continuation of Deferred@1126388210 after retry RPC after error@956445515) -> (continuation of Deferred@1553293175 after retry RPC after error@557049849) -> (continuation of Deferred@2017894124 after retry RPC after error@1358324420) -> (continuation of Deferred@653189450 after retry RPC after error@417121857) -> (continuation of Deferred@1411484232 after retry RPC after error@924983882) -> (continuation of Deferred@1721196885 after retry RPC after error@411524360) -> (continuation of Deferred@1085073306 after retry RPC after error@1715121591)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.11.253:35677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:12.820 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.820 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.820 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.820 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.820 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.820 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.820 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:12.823 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:12.823 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:12.823 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:12.823 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:12.823 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:12.823 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:12.823 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:12.823 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:12.823 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:12.823 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:12.823 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:12.824 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:12.824 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:12.824 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29915), Traces: [0ms] refreshing cache from master, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [41ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [52ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [59ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [59ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [132ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [133ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [266ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [271ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [272ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [273ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [277ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [303ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [363ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [363ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [423ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [424ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [424ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [424ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [523ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [523ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [702ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [704ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [741ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [741ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [742ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [742ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1383ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1788ms] refreshing cache from master, [1788ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1789ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1789ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1789ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1790ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1790ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1790ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [5421ms] refreshing cache from master, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [5422ms] too many traces: truncated at 100 traces, deferred=Deferred@1363172585(state=PENDING, result=null, callback=(continuation of Deferred@178189176 after retry RPC after error@1441985391) -> (continuation of Deferred@979126709 after retry RPC after error@1772678403) -> (continuation of Deferred@349226621 after retry RPC after error@1459303939) -> (continuation of Deferred@246602888 after retry RPC after error@551352488) -> (continuation of Deferred@841822688 after retry RPC after error@1030312584) -> (continuation of Deferred@623353649 after retry RPC after error@1660500613) -> (continuation of Deferred@956347659 after retry RPC after error@1317686705) -> (continuation of Deferred@1464704326 after retry RPC after error@2085337144) -> (continuation of Deferred@1080025687 after retry RPC after error@1545914408) -> (continuation of Deferred@1731778887 after retry RPC after error@1175660512) -> (continuation of Deferred@2044799023 after retry RPC after error@58641075) -> (continuation of Deferred@573426042 after retry RPC after error@2103363320) -> (continuation of Deferred@227424556 after retry RPC after error@2026914172) -> (continuation of Deferred@888811781 after retry RPC after error@1058560100) -> (continuation of Deferred@1126388210 after retry RPC after error@956445515) -> (continuation of Deferred@1553293175 after retry RPC after error@557049849) -> (continuation of Deferred@2017894124 after retry RPC after error@1358324420) -> (continuation of Deferred@653189450 after retry RPC after error@417121857) -> (continuation of Deferred@1411484232 after retry RPC after error@924983882) -> (continuation of Deferred@1721196885 after retry RPC after error@411524360) -> (continuation of Deferred@1085073306 after retry RPC after error@1715121591), errback=(continuation of Deferred@178189176 after retry RPC after error@1441985391) -> (continuation of Deferred@979126709 after retry RPC after error@1772678403) -> (continuation of Deferred@349226621 after retry RPC after error@1459303939) -> (continuation of Deferred@246602888 after retry RPC after error@551352488) -> (continuation of Deferred@841822688 after retry RPC after error@1030312584) -> (continuation of Deferred@623353649 after retry RPC after error@1660500613) -> (continuation of Deferred@956347659 after retry RPC after error@1317686705) -> (continuation of Deferred@1464704326 after retry RPC after error@2085337144) -> (continuation of Deferred@1080025687 after retry RPC after error@1545914408) -> (continuation of Deferred@1731778887 after retry RPC after error@1175660512) -> (continuation of Deferred@2044799023 after retry RPC after error@58641075) -> (continuation of Deferred@573426042 after retry RPC after error@2103363320) -> (continuation of Deferred@227424556 after retry RPC after error@2026914172) -> (continuation of Deferred@888811781 after retry RPC after error@1058560100) -> (continuation of Deferred@1126388210 after retry RPC after error@956445515) -> (continuation of Deferred@1553293175 after retry RPC after error@557049849) -> (continuation of Deferred@2017894124 after retry RPC after error@1358324420) -> (continuation of Deferred@653189450 after retry RPC after error@417121857) -> (continuation of Deferred@1411484232 after retry RPC after error@924983882) -> (continuation of Deferred@1721196885 after retry RPC after error@411524360) -> (continuation of Deferred@1085073306 after retry RPC after error@1715121591)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29915), Traces: [0ms] refreshing cache from master, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [41ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [52ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [59ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [59ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [132ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [133ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [266ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [271ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [272ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [273ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [277ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [303ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [363ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [363ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [423ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [424ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [424ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [424ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [523ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [523ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [702ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [704ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [741ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [741ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [742ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [742ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1383ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1788ms] refreshing cache from master, [1788ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1789ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1789ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1789ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1790ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1790ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1790ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [5421ms] refreshing cache from master, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [5421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [5422ms] too many traces: truncated at 100 traces, deferred=Deferred@1363172585(state=PENDING, result=null, callback=(continuation of Deferred@178189176 after retry RPC after error@1441985391) -> (continuation of Deferred@979126709 after retry RPC after error@1772678403) -> (continuation of Deferred@349226621 after retry RPC after error@1459303939) -> (continuation of Deferred@246602888 after retry RPC after error@551352488) -> (continuation of Deferred@841822688 after retry RPC after error@1030312584) -> (continuation of Deferred@623353649 after retry RPC after error@1660500613) -> (continuation of Deferred@956347659 after retry RPC after error@1317686705) -> (continuation of Deferred@1464704326 after retry RPC after error@2085337144) -> (continuation of Deferred@1080025687 after retry RPC after error@1545914408) -> (continuation of Deferred@1731778887 after retry RPC after error@1175660512) -> (continuation of Deferred@2044799023 after retry RPC after error@58641075) -> (continuation of Deferred@573426042 after retry RPC after error@2103363320) -> (continuation of Deferred@227424556 after retry RPC after error@2026914172) -> (continuation of Deferred@888811781 after retry RPC after error@1058560100) -> (continuation of Deferred@1126388210 after retry RPC after error@956445515) -> (continuation of Deferred@1553293175 after retry RPC after error@557049849) -> (continuation of Deferred@2017894124 after retry RPC after error@1358324420) -> (continuation of Deferred@653189450 after retry RPC after error@417121857) -> (continuation of Deferred@1411484232 after retry RPC after error@924983882) -> (continuation of Deferred@1721196885 after retry RPC after error@411524360) -> (continuation of Deferred@1085073306 after retry RPC after error@1715121591), errback=(continuation of Deferred@178189176 after retry RPC after error@1441985391) -> (continuation of Deferred@979126709 after retry RPC after error@1772678403) -> (continuation of Deferred@349226621 after retry RPC after error@1459303939) -> (continuation of Deferred@246602888 after retry RPC after error@551352488) -> (continuation of Deferred@841822688 after retry RPC after error@1030312584) -> (continuation of Deferred@623353649 after retry RPC after error@1660500613) -> (continuation of Deferred@956347659 after retry RPC after error@1317686705) -> (continuation of Deferred@1464704326 after retry RPC after error@2085337144) -> (continuation of Deferred@1080025687 after retry RPC after error@1545914408) -> (continuation of Deferred@1731778887 after retry RPC after error@1175660512) -> (continuation of Deferred@2044799023 after retry RPC after error@58641075) -> (continuation of Deferred@573426042 after retry RPC after error@2103363320) -> (continuation of Deferred@227424556 after retry RPC after error@2026914172) -> (continuation of Deferred@888811781 after retry RPC after error@1058560100) -> (continuation of Deferred@1126388210 after retry RPC after error@956445515) -> (continuation of Deferred@1553293175 after retry RPC after error@557049849) -> (continuation of Deferred@2017894124 after retry RPC after error@1358324420) -> (continuation of Deferred@653189450 after retry RPC after error@417121857) -> (continuation of Deferred@1411484232 after retry RPC after error@924983882) -> (continuation of Deferred@1721196885 after retry RPC after error@411524360) -> (continuation of Deferred@1085073306 after retry RPC after error@1715121591)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.11.253:35677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:12.824 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:32:12.825 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
18:32:12.825 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
18:32:12.825 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
18:32:12.825 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
18:32:12.826 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
18:32:12.826 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
18:32:12.826 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
18:32:12.827 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:32:12.828 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
18:32:12.828 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
18:32:12.830 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
18:32:12.830 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
18:32:12.830 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
18:32:12.831 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:32:12.832 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
18:32:12.832 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
18:32:12.832 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
18:32:12.832 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:12.832 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
18:32:12.832 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:12.832 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:12.832 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
18:32:12.833 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.833 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.833 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.833 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:32:12.833 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.833 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
18:32:12.833 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.833 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.834 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job f6e63683f34d031c5da392b08baea20c
18:32:12.834 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.834 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.834 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.834 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:12.852 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:12.852 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:12.852 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:12.852 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.853 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.853 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.853 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.853 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.853 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.853 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.853 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.853 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.853 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:12.872 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:12.872 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:12.872 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:12.873 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.873 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.873 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.873 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.873 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.873 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.873 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.873 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.873 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.873 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:12.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.881397  2883 rpc_server.cc:307] RPC server started. Bound to: 127.2.96.130:36745
18:32:12.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.881702  3040 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.96.130:36745 every 8 connection(s)
18:32:12.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.885046  2883 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/data/info.pb
18:32:12.892 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:12.892 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:12.892 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:12.893 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.893 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.893 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.893 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.893 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.893 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.890448  2434 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 2883
18:32:12.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.890951  2434 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-1/wal/instance
18:32:12.894 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.894 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.894 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.894 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.916404  2434 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/wal
18:32:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/data
18:32:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:32:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:32:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:32:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/logs
18:32:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/data/info.pb
18:32:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:32:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:32:12.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:32:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:32:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:32:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:32:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.96.131:0
18:32:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.96.131
18:32:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.96.131
18:32:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989
18:32:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.96.148:40431
18:32:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:12.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:32:12.932 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:12.932 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:12.932 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:12.933 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.933 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.933 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.934 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.934 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.934 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.934 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.934 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.934 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.934 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:12.972 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:12.972 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:12.972 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:12.973 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.973 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.973 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.973 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.973 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.973 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:12.973 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:12.973 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.973 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:12.973 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.983783  3044 heartbeater.cc:344] Connected to a master server at 127.2.96.190:44161
18:32:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.984328  3044 heartbeater.cc:461] Registering TS with master...
18:32:12.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.985634  3044 heartbeater.cc:507] Master 127.2.96.190:44161 requested a full tablet report, sending...
18:32:12.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.988804  2479 ts_manager.cc:194] Registered new tserver with Master: f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745)
18:32:12.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.991068  3042 heartbeater.cc:344] Connected to a master server at 127.2.96.189:33339
18:32:12.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.991418  3042 heartbeater.cc:461] Registering TS with master...
18:32:12.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.992281  3042 heartbeater.cc:507] Master 127.2.96.189:33339 requested a full tablet report, sending...
18:32:12.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:12.994987  2555 ts_manager.cc:194] Registered new tserver with Master: f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745)
18:32:13.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:13.000136  3041 heartbeater.cc:344] Connected to a master server at 127.2.96.188:32989
18:32:13.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:13.000461  3041 heartbeater.cc:461] Registering TS with master...
18:32:13.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:13.001336  3041 heartbeater.cc:507] Master 127.2.96.188:32989 requested a full tablet report, sending...
18:32:13.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535533001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:13.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:13.005185  2636 ts_manager.cc:194] Registered new tserver with Master: f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745)
18:32:13.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:13.006810  2636 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.96.130:54569
18:32:13.015 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
18:32:13.017 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
18:32:13.033 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:13.052 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:13.053 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:13.053 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:13.053 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:13.053 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:13.053 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:13.053 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:13.053 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:13.053 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:13.053 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:13.053 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:13.054 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:13.054 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:13.115 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:13.115 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:13.115 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:13.115 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.115 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.115 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.115 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.116 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.116 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.116 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.116 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.116 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.116 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:13.121 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:13.121 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:13.121 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:13.122 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:13.122 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:13.122 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:13.122 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:13.122 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:13.122 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:13.122 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:13.122 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:13.122 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:13.122 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:13.146 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:13.146 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:13.146 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:13.146 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:13.147 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:13.147 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:13.147 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:13.147 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:13.147 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:13.147 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:13.147 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:13.147 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:13.147 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:13.203 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:13.204 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:13.204 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:13.204 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.204 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.204 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.204 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.204 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.204 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.204 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.204 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.204 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.205 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:13.292 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:13.292 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:13.293 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:13.293 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:13.293 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:13.293 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:13.293 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:13.293 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:13.293 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:13.293 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:13.293 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:13.293 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:13.293 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:13.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:13.309767  3046 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:32:13.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:13.310294  3046 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:32:13.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:13.310719  3046 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:32:13.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:13.344192  3046 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:32:13.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:13.344967  3046 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.96.131
18:32:13.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:13.386174  3046 tablet_server_runner.cc:78] Tablet server non-default flags:
18:32:13.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:13.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.96.148:40431
18:32:13.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:13.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:13.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/data
18:32:13.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/wal
18:32:13.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:13.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:13.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.96.131:0
18:32:13.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:32:13.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:13.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:13.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/data/info.pb
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.96.131
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.96.131
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/logs
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:32:13.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:32:13.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:13.387702  3046 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:32:13.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:13.389509  3046 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:32:13.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:13.403146  3057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:13.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535533501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:13.512 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:32:13.514 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
18:32:13.532 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:13.641 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:13.641 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:13.642 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:13.642 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:13.642 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:13.642 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:13.643 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:13.643 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:13.643 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:13.644 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:13.644 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:13.644 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:13.644 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:13.752 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:13.752 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:13.752 [DEBUG - pool-122-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:13.753 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:13.753 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:13.753 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:13.753 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:13.753 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:13.753 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:13.753 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:13.753 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:13.753 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:13.753 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:13.860 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state RESTARTING to RUNNING.
18:32:13.861 [INFO - flink-pekko.actor.default-dispatcher-10] (CheckpointCoordinator.java:1805) Restoring job f6e63683f34d031c5da392b08baea20c from Checkpoint 74 @ 1783535501335 for f6e63683f34d031c5da392b08baea20c located at file:/tmp/junit4154231101817438778/checkpoints/f6e63683f34d031c5da392b08baea20c/chk-74.
18:32:13.862 [INFO - flink-pekko.actor.default-dispatcher-10] (MasterHooks.java:201) No master state to restore
18:32:13.863 [INFO - flink-pekko.actor.default-dispatcher-10] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:32:13.863 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
18:32:13.864 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
18:32:13.864 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 13a0441c1420d35b57a28ebd584f9846
18:32:13.864 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:32:13.865 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
18:32:13.866 [INFO - Thread-29] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:32:13.866 [DEBUG - Thread-29] (Connection.java:575) [peer master-127.30.11.253:35677(127.30.11.253:35677)] disconnecting while in state TERMINATED
18:32:13.866 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 13a0441c1420d35b57a28ebd584f9846.
18:32:13.866 [DEBUG - Thread-29] (Connection.java:575) [peer master-127.30.11.252:39405(127.30.11.252:39405)] disconnecting while in state TERMINATED
18:32:13.866 [DEBUG - Thread-29] (Connection.java:575) [peer master-127.30.11.254:41811(127.30.11.254:41811)] disconnecting while in state TERMINATED
18:32:13.866 [DEBUG - Thread-29] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:13.867 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id 13a0441c1420d35b57a28ebd584f9846.
18:32:13.868 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:32:13.869 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
18:32:13.869 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id e5ed6e64fe4e0a504f52a2cb8573a359
18:32:13.869 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to SCHEDULED.
18:32:13.870 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:32:13.871 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from SCHEDULED to DEPLOYING.
18:32:13.872 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #3) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8c518d750e8767059e15b0e0577096dd
18:32:13.872 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
18:32:13.872 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:32:13.873 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
18:32:13.873 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8ff5a8fd5a1d7f8775f563b9a37bf60a
18:32:13.874 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot e5ed6e64fe4e0a504f52a2cb8573a359.
18:32:13.876 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id e5ed6e64fe4e0a504f52a2cb8573a359.
18:32:13.876 [INFO - Thread-29] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:32:13.877 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
18:32:13.877 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
18:32:13.877 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3ca0dd0a
18:32:13.877 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:13.878 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:32:13.878 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
18:32:13.879 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 8c518d750e8767059e15b0e0577096dd.
18:32:13.880 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_3), deploy into slot with allocation id 8c518d750e8767059e15b0e0577096dd.
18:32:13.881 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
18:32:13.881 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
18:32:13.882 [INFO - Thread-29] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:32:13.881 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
18:32:13.883 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@29c50c7
18:32:13.884 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1b364967
18:32:13.884 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:13.884 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:32:13.885 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:32:13.886 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to DEPLOYING.
18:32:13.886 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_3) [DEPLOYING].
18:32:13.887 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:32:13.887 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
18:32:13.888 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:13.890 [DEBUG - Thread-29] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:13.890 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
18:32:13.890 [INFO - Thread-29] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:32:13.890 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
18:32:13.890 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
18:32:13.891 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@43dc915d
18:32:13.891 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:13.887 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7b62a091
18:32:13.891 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:13.891 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:32:13.892 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:32:13.892 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
18:32:13.892 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
18:32:13.892 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
18:32:13.892 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
18:32:13.895 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@60638d10
18:32:13.897 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:13.898 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:13.904 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1124e3d7
18:32:13.907 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@362cbc2b
18:32:13.915 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:13.915 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:13.917 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:13.918 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:13.918 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:13.918 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:13.923 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:13.924 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:13.924 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.924 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.924 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.932 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:13.937 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:13.951 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:13.952 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.952 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.952 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.952 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:13.953 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.953 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.953 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.959 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:13.961 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.961 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.961 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.962 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:13.963 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.963 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.963 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.964 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.964 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.964 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.964 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:13.966 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:13.967 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.967 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.967 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.969 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.969 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.969 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.969 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:13.973 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:13.975 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:13.976 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.976 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.976 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:13.976 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.977 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.977 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.977 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.978 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.978 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.978 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.978 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:13.978 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:13.979 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:13.979 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.980 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.980 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.980 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:13.981 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.981 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.981 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.981 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:13.982 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:13.983 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.983 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.983 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.983 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:13.984 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:13.984 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.984 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.984 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.985 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.985 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.985 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.985 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:13.986 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:13.986 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.987 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.987 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.988 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.988 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.988 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.988 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:13.990 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:13.991 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:13.991 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.991 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.991 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:13.991 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:13.991 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:13.991 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:13.992 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:13.992 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:13.993 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.993 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.993 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:13.994 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.994 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.994 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:13.994 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:13.994 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:13.995 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:13.995 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:13.995 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:13.996 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:13.999 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:13.999 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535534001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:14.011 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.013 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.013 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.013 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:14.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:14.013696  3041 heartbeater.cc:499] Master 127.2.96.188:32989 was elected leader, sending a full tablet report...
18:32:14.014 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.014 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.015 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.015 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.015 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.016 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.016 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.016 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.016 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.017 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.017 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.017 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.017 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.018 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.018 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.018 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.019 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.019 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.019 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.019 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.019 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.019 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.019 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.019 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.020 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.020 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.020 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.021 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.021 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:14.021 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.022 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.022 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.023 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.023 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.023 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.023 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.023 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.024 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=22 ms, finalizationTime=1 ms).
18:32:14.024 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.025 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.025 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.025 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.025 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
18:32:14.026 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.026 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.027 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.027 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.028 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.028 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.028 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.028 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.030 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:14.031 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.031 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.032 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.032 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:14.033 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.033 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:14.033 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.033 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.033 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.033 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.033 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.034 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.034 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.034 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.035 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.035 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.035 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.035 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.036 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.036 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.036 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.037 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.037 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.037 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.037 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.037 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:14.038 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.038 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.038 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.038 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.038 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.039 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.039 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.039 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.039 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.039 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.039 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.039 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.039 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.040 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.040 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:14.041 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.041 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.041 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.043 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.043 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.067 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.068 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.068 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.068 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.068 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.068 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.068 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:14.068 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.068 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.069 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.069 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.069 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.069 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.069 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.069 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.069 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.069 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.069 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.069 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.070 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.070 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.070 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.070 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.070 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.070 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.070 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.070 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.070 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.070 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:14.070 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.071 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.071 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.071 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.071 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.071 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.071 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:14.071 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.071 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.071 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.071 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.071 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.071 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.072 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.072 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.072 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.072 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.072 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.072 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.072 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.072 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.072 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.073 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.073 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.073 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.073 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.073 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.073 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.079 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.079 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.080 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.080 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.080 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.081 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:14.081 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:14.081 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.081 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.081 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:14.081 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.082 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.082 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.082 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.082 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.082 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.082 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.081 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.082 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.082 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.082 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.083 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.082 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.083 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.083 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.083 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:14.083 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.083 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.084 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.084 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.084 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.084 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.084 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.084 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.084 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.084 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.084 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.084 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.084 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.092 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.093 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.093 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.093 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.093 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.093 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.094 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.094 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.094 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.094 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.094 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.094 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.094 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.097 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.097 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.097 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.097 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.098 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.098 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.098 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.098 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.099 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.099 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.099 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.099 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.099 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.099 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.100 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.100 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.100 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.100 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.100 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.100 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.100 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.101 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.101 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.101 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.101 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.101 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.100 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:14.101 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:14.101 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:14.101 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.102 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.102 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.102 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.102 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.102 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.102 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.102 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.102 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.102 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:14.103 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:14.103 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.103 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.103 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.104 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.104 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.104 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.104 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.104 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.104 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.104 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.104 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.104 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.104 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.118 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.118 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.119 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.119 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.119 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.119 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.120 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.120 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.120 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.120 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.120 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.120 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.120 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.121 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:14.121 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:14.121 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:14.121 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.121 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.122 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.122 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.122 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.122 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.122 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.122 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.122 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.122 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:14.132 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.133 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.133 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.133 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.133 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.133 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.134 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.134 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.134 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.134 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.134 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.135 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.135 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.137 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.137 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.137 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.138 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.138 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.138 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.138 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.138 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.138 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.139 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.139 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.139 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.139 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.140 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:14.141 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:14.141 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:14.141 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.141 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.141 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.141 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.141 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.142 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.142 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.142 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.141 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.142 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:14.163 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.163 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.163 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.164 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.164 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.164 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.164 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.164 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.164 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.164 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.164 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.164 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.164 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.217 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.218 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.218 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.218 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.218 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.218 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.218 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.219 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.219 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.219 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.219 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.219 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.219 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.219 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.219 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.219 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.219 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.220 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.220 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.220 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.220 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.218 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.220 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.220 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.221 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.221 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.221 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.221 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.221 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.221 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.221 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.221 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.221 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.221 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.220 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.228 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.228 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.219 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.228 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.253 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.253 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.253 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.254 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.254 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.254 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.254 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.255 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.255 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.255 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.255 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.255 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.255 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.278 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.279 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.279 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.280 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.280 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.280 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.280 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.280 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.280 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.281 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.281 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.281 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.281 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.281 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:14.281 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:14.282 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:14.282 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.282 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.282 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.283 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.283 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.283 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.283 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.283 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.283 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.283 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:14.317 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.318 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.318 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.318 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.318 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.318 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.318 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.318 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.319 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.319 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.319 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.319 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.319 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.332 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.333 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.333 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.333 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.333 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.333 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.333 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.333 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.333 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.334 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.334 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.334 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.334 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.404 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.404 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.404 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.405 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.405 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.405 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.405 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.405 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.405 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.405 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.405 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.406 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.406 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.461 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:14.461 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:14.462 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:14.462 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.462 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.462 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.462 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.462 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.462 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.463 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.463 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.463 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.463 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:14.484 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.484 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.485 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.485 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.485 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.485 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.485 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.485 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.485 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.486 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.486 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.486 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.486 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.498 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.498 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.498 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.499 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.499 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.499 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.499 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.499 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.499 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.500 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.500 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.500 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.500 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535534501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:14.512 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:32:14.514 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
18:32:14.532 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:14.537 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.538 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.538 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.538 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.538 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.539 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.539 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.539 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.539 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.539 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.539 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.539 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.539 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.603 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:14.624 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.624 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.625 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.625 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.625 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.626 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.626 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.626 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.626 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.626 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.626 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.626 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.627 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.713 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.713 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.713 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.714 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.714 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.714 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.715 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.715 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.715 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.715 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.715 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.715 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.715 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.875 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.875 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.875 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.876 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.876 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.876 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.876 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.876 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.876 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.876 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.876 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.876 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.876 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.926 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:14.926 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:14.926 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:14.927 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:14.927 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:14.927 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:14.927 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:14.928 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:14.928 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:14.928 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:14.928 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:14.928 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:14.928 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:14.937 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:14.938 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:14.938 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:14.938 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.938 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.938 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:14.939 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.939 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.939 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:14.939 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.939 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.939 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:14.939 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:14.940 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:14.941 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:14.941 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.941 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:14.941 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.941 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:14.945 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.945 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.945 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:14.945 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.945 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.945 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:14.945 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:14.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:13.404122  3058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:14.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:14.957731  3060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:14.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:14.962179  3059 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1551 milliseconds
18:32:14.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:14.962309  3046 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:32:14.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:14.963886  3046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:32:14.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:14.966539  3046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:32:14.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:14.968137  3046 hybrid_clock.cc:648] HybridClock initialized: now 1783535534968059 us; error 65 us; skew 500 ppm
18:32:14.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:14.969201  3046 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:32:14.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:14.976691  3046 webserver.cc:534] Webserver started at http://127.2.96.131:35485/ using document root <none> and password file <none>
18:32:14.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:14.977764  3046 fs_manager.cc:362] Metadata directory not provided
18:32:14.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:14.978068  3046 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:32:14.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:14.978593  3046 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:32:14.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:14.983989  3046 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/data/instance:
18:32:14.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "50ba3f6f15704aa1a07abe18d2d4b153"
18:32:14.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:14 on dist-test-slave-dxnw"
18:32:14.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:14.985489  3046 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/wal/instance:
18:32:14.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "50ba3f6f15704aa1a07abe18d2d4b153"
18:32:14.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:14 on dist-test-slave-dxnw"
18:32:14.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:14.992913  3046 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.003s
18:32:14.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:14.999512  3122 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:32:15.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.001067  3046 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.000s
18:32:15.001 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535535001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:15.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.001475  3046 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/wal
18:32:15.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "50ba3f6f15704aa1a07abe18d2d4b153"
18:32:15.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:14 on dist-test-slave-dxnw"
18:32:15.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.001895  3046 fs_report.cc:389] FS layout report
18:32:15.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:32:15.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/wal
18:32:15.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/wal
18:32:15.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/data/data
18:32:15.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:32:15.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:32:15.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:32:15.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:32:15.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:32:15.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:32:15.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:32:15.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:32:15.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:32:15.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:32:15.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:32:15.009 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:32:15.011 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
18:32:15.033 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:15.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.074182  3046 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:32:15.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.075897  3046 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:32:15.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.076406  3046 kserver.cc:163] Server-wide thread pool size limit: 3276
18:32:15.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.080343  3046 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:32:15.084 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:15.084 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:15.085 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:15.085 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.085 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.085 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.086 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.086 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.086 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.086 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.086074  3046 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:32:15.086 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.086 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.086 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:15.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.086401  3046 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:32:15.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.086740  3046 ts_tablet_manager.cc:616] Registered 0 tablets
18:32:15.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.087060  3046 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
18:32:15.102 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:15.102 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:15.102 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:15.103 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:15.103 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:15.103 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:15.103 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:15.104 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:15.104 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:15.104 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:15.104 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:15.104 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:15.104 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:15.104 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:15.206 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:15.206 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:15.207 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:15.207 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:15.207 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:15.207 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:15.207 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:15.207 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:15.207 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:15.207 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:15.207 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:15.207 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:15.207 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:15.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.243757  3046 rpc_server.cc:307] RPC server started. Bound to: 127.2.96.131:37979
18:32:15.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.243839  3235 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.96.131:37979 every 8 connection(s)
18:32:15.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.246490  3046 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/data/info.pb
18:32:15.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.247804  2434 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 3046
18:32:15.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.248261  2434 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14494671596502016307/ts-2/wal/instance
18:32:15.277 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:15.277 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:15.277 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:15.277 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.278 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.278 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.278 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.278 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.278 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.278 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.278 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.278 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.278 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:15.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.294795  3236 heartbeater.cc:344] Connected to a master server at 127.2.96.188:32989
18:32:15.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.295259  3237 heartbeater.cc:344] Connected to a master server at 127.2.96.189:33339
18:32:15.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.295399  3236 heartbeater.cc:461] Registering TS with master...
18:32:15.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.295723  3237 heartbeater.cc:461] Registering TS with master...
18:32:15.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.296870  3236 heartbeater.cc:507] Master 127.2.96.188:32989 requested a full tablet report, sending...
18:32:15.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.297300  3237 heartbeater.cc:507] Master 127.2.96.189:33339 requested a full tablet report, sending...
18:32:15.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.298120  3238 heartbeater.cc:344] Connected to a master server at 127.2.96.190:44161
18:32:15.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.298511  3238 heartbeater.cc:461] Registering TS with master...
18:32:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.299561  3238 heartbeater.cc:507] Master 127.2.96.190:44161 requested a full tablet report, sending...
18:32:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.300640  2636 ts_manager.cc:194] Registered new tserver with Master: 50ba3f6f15704aa1a07abe18d2d4b153 (127.2.96.131:37979)
18:32:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.300843  2555 ts_manager.cc:194] Registered new tserver with Master: 50ba3f6f15704aa1a07abe18d2d4b153 (127.2.96.131:37979)
18:32:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.302546  2636 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.96.131:52075
18:32:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.303308  2479 ts_manager.cc:194] Registered new tserver with Master: 50ba3f6f15704aa1a07abe18d2d4b153 (127.2.96.131:37979)
18:32:15.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.320330  2434 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
18:32:15.333 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:32:15.333 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

18:32:15.334 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.2.96.190"
      port: 44161
    }
    bound_http_address {
      host: "127.2.96.190"
      port: 38483
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.2.96.189"
      port: 33339
    }
    bound_http_address {
      host: "127.2.96.189"
      port: 45171
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.2.96.188"
      port: 32989
    }
    bound_http_address {
      host: "127.2.96.188"
      port: 32813
    }
  }
}

18:32:15.334 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

18:32:15.335 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.2.96.129"
      port: 42953
    }
    bound_http_address {
      host: "127.2.96.129"
      port: 37293
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.2.96.130"
      port: 36745
    }
    bound_http_address {
      host: "127.2.96.130"
      port: 37345
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.2.96.131"
      port: 37979
    }
    bound_http_address {
      host: "127.2.96.131"
      port: 35485
    }
  }
}

18:32:15.335 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
18:32:15.336 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:15.336 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
18:32:15.337 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskSwO0Je/test-tmp
18:32:15.337 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
18:32:15.337 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskSwO0Je/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
18:32:15.341 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

18:32:15.381 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:15.382 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:15.382 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:15.382 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:15.382 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:15.382 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:15.382 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:15.382 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:15.382 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:15.383 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:15.383 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:15.383 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:15.383 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:15.443 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:15.443 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:15.443 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:15.444 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:15.444 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:15.444 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:15.444 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:15.444 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:15.444 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:15.444 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:15.444 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:15.444 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:15.444 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:15.498 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:15.498 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:15.499 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:15.499 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.499 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.499 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.499 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.499 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.499 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.499 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.499 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.499 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.499 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:15.501 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535535501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:15.512 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:32:15.513 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
18:32:15.533 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:15.603 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:15.613 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:15.613 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:15.613 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:15.613 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.613 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.614 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.614 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.614 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.614 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.614 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.614 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.614 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.614 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:15.658 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:15.658 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:15.658 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:15.658 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.658 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.659 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.659 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.659 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.659 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.659 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.659 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.659 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.659 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:15.696 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:32:15.696 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

18:32:15.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.699615  3246 mini_oidc.cc:150] Starting JWKS server
18:32:15.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.703095  3246 webserver.cc:534] Webserver started at http://127.0.0.1:39267/ using document root <none> and password file <none>
18:32:15.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.703581  3246 mini_oidc.cc:186] Starting OIDC Discovery server
18:32:15.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.705380  3246 webserver.cc:534] Webserver started at http://127.0.0.1:45369/ using document root <none> and password file <none>
18:32:15.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:32:15Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
18:32:15.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:32:15Z Disabled control of system clock
18:32:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:15.774223  3246 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/wal
18:32:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/data
18:32:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:32:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:32:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:32:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/logs
18:32:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/data/info.pb
18:32:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.43.190:40613
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.43.190
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.43.148:38361
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.43.190:40613,127.3.43.189:32951,127.3.43.188:36795
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39267/jwks.json with env {}
18:32:15.832 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:15.833 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:15.833 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:15.833 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.833 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.833 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.833 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.833 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.833 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:15.833 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:15.833 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.834 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:15.834 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:16.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535536001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:16.015 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
18:32:16.016 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
18:32:16.033 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:16.102 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:16.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:16.116437  3258 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:32:16.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:16.117125  3258 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:32:16.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:16.117828  3258 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:32:16.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:16.152568  3258 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:32:16.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:16.152930  3258 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:32:16.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:16.153309  3258 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:32:16.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:16.153631  3258 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:32:16.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:16.153936  3258 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:32:16.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:16.154201  3258 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39267/jwks.json
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:16.193951  3258 master_runner.cc:387] Master server non-default flags:
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.43.148:38361
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/data
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/wal
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.43.190:40613,127.3.43.189:32951,127.3.43.188:36795
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.43.190:40613
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39267/jwks.json
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/data/info.pb
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.43.190
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:16.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:32:16.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:32:16.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:16.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/logs
18:32:16.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:16.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:32:16.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:32:16.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:32:16.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:32:16.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:32:16.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:32:16.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:32:16.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:32:16.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:32:16.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:16.195674  3258 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:32:16.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:16.197261  3258 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:32:16.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:16.209757  3264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:16.222 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:16.223 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:16.223 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:16.223 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:16.223 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:16.223 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:16.223 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:16.223 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:16.223 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:16.224 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:16.224 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:16.224 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:16.224 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:16.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:16.306450  3236 heartbeater.cc:499] Master 127.2.96.188:32989 was elected leader, sending a full tablet report...
18:32:16.426 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:16.426 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:16.426 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:16.427 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:16.427 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:16.427 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:16.428 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:16.428 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:16.428 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:16.428 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:16.428 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:16.428 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:16.428 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:16.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535536501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:16.514 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
18:32:16.516 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
18:32:16.525 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:16.525 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:16.526 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:16.526 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:16.526 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:16.526 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:16.526 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:16.527 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:16.527 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:16.527 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:16.527 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:16.526 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:16.527 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:16.533 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:16.563 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:16.564 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:16.564 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:16.565 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:16.565 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:16.565 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:16.565 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:16.565 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:16.565 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:16.566 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:16.566 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:16.566 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:16.566 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:16.583 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:16.583 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:16.583 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:16.584 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:16.584 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:16.584 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:16.584 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:16.585 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:16.585 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:16.585 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:16.585 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:16.585 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:16.585 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:16.603 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:16.738 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:16.738 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:16.739 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:16.739 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:16.739 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:16.740 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:16.740 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:16.740 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:16.740 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:16.741 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:16.741 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:16.741 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:16.741 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:16.861 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:16.861 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:16.861 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:16.862 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:16.862 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:16.862 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:16.863 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:16.863 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:16.863 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:16.863 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:16.863 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:16.863 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:16.863 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:16.958 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:16.958 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:16.959 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:16.959 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:16.959 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:16.960 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:16.960 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:16.960 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:16.960 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:16.961 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:16.961 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:16.961 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:16.961 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:16.981 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:16.981 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:16.981 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:16.982 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:16.982 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:16.982 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:16.983 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:16.983 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:16.983 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:16.984 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:16.984 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:16.984 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:16.984 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:17.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535537001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:17.022 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
18:32:17.023 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
18:32:17.032 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:17.103 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:17.223 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:17.223 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:17.223 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:17.224 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:17.224 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:17.224 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:17.225 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:17.225 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:17.225 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:17.225 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:17.225 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:17.225 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:17.225 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:17.261 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:17.261 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:17.262 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:17.263 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:17.263 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:17.263 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:17.264 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:17.264 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:17.264 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:17.267 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:17.267 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:17.267 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:17.267 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:17.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535537502 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:17.522 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
18:32:17.523 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
18:32:17.532 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:17.562 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:17.562 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:17.562 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:17.563 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:17.563 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:17.563 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:17.564 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:17.564 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:17.564 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:17.565 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:17.565 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:17.565 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:17.565 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:17.603 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:17.653 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:17.654 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:17.654 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:17.655 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:17.655 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:17.655 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:17.655 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:17.656 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:17.656 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:17.656 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:17.656 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:17.656 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:17.656 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:17.827 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:17.827 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:17.827 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:17.828 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:17.828 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:17.828 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:17.829 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:17.829 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:17.829 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:17.830 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:17.830 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:17.830 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:17.830 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:17.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:17.908121  2511 debug-util.cc:398] Leaking SignalData structure 0x7b080009dbc0 after lost signal to thread 2448
18:32:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:17.908838  2511 debug-util.cc:398] Leaking SignalData structure 0x7b08000867c0 after lost signal to thread 2514
18:32:17.958 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:17.958 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:17.959 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:17.959 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:17.959 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:17.959 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:17.959 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:17.959 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:17.959 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:17.959 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:17.959 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:17.959 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:17.959 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:18.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535538001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:18.012 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:32:18.016 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
18:32:18.032 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:18.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:17.614209  3263 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 3258
18:32:18.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.089083  3263 kernel_stack_watchdog.cc:198] Thread 3258 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 399ms:
18:32:18.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:32:18.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:32:18.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:32:18.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:32:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:16.210718  3265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:18.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.093796  3258 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.882s	user 0.002s	sys 0.001s
18:32:18.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.094170  3258 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.883s	user 0.002s	sys 0.001s
18:32:18.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.095672  3266 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1879 milliseconds
18:32:18.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.097254  3258 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:32:18.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.097817  3267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:18.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.099323  3258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:32:18.103 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:18.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.111510  3258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:32:18.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.113128  3258 hybrid_clock.cc:648] HybridClock initialized: now 1783535538113056 us; error 91 us; skew 500 ppm
18:32:18.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.114012  3258 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:32:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.127280  3258 webserver.cc:534] Webserver started at http://127.3.43.190:39499/ using document root <none> and password file <none>
18:32:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.128414  3258 fs_manager.cc:362] Metadata directory not provided
18:32:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.128660  3258 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:32:18.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.129189  3258 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:32:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.133908  3258 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/data/instance:
18:32:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "dccd3d09c4904f18acbc8fa3ba91bd63"
18:32:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:18 on dist-test-slave-dxnw"
18:32:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.135149  3258 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/wal/instance:
18:32:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "dccd3d09c4904f18acbc8fa3ba91bd63"
18:32:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:18 on dist-test-slave-dxnw"
18:32:18.141 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:18.141 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:18.141 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:18.142 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:18.142 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:18.142 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:18.142 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:18.142 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:18.142 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:18.143 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:18.143 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:18.143 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:18.143 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:18.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.143944  3258 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
18:32:18.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.151093  3275 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:32:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.152433  3258 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.152771  3258 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/wal
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "dccd3d09c4904f18acbc8fa3ba91bd63"
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:18 on dist-test-slave-dxnw"
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.153075  3258 fs_report.cc:389] FS layout report
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/wal
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/wal
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/data/data
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:32:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:32:18.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.217855  3258 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:32:18.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.219383  3258 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:32:18.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.219779  3258 kserver.cc:163] Server-wide thread pool size limit: 3276
18:32:18.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.314159  3258 rpc_server.cc:307] RPC server started. Bound to: 127.3.43.190:40613
18:32:18.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.314332  3326 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.43.190:40613 every 8 connection(s)
18:32:18.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.317145  3258 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/data/info.pb
18:32:18.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.324419  3327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:18.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.328632  3246 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 3258
18:32:18.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.329128  3246 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-0/wal/instance
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.335054  3246 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/wal
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/data
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/logs
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/data/info.pb
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:32:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:18.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:18.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.43.189:32951
18:32:18.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.43.189
18:32:18.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:18.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.43.148:38361
18:32:18.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:18.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:18.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:18.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:18.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.43.190:40613,127.3.43.189:32951,127.3.43.188:36795
18:32:18.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:18.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39267/jwks.json with env {}
18:32:18.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.338943  3327 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } has no permanent_uuid. Determining permanent_uuid...
18:32:18.363 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:18.363 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:18.363 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:18.363 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:18.364 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:18.364 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:18.364 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:18.364 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:18.364 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:18.364 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:18.364 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:18.364 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:18.364 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:18.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.372572  3327 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } has no permanent_uuid. Determining permanent_uuid...
18:32:18.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.375741  3276 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.43.189:32951: connect: Connection refused (error 111)
18:32:18.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.380162  3327 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.43.189:32951: Network error: Client connection negotiation failed: client connection to 127.3.43.189:32951: connect: Connection refused (error 111)
18:32:18.403 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:18.403 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:18.403 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:18.403 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:18.404 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:18.404 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:18.404 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:18.404 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:18.404 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:18.404 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:18.404 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:18.404 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:18.404 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:18.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.429728  3327 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } attempt: 1
18:32:18.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.434219  3327 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.43.189:32951: Network error: Client connection negotiation failed: client connection to 127.3.43.189:32951: connect: Connection refused (error 111)
18:32:18.455 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:18.456 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:18.456 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:18.456 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:18.456 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:18.456 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:18.456 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:18.456 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:18.456 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:18.456 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:18.456 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:18.456 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:18.456 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:18.501 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535538501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:18.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.502614  3327 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } attempt: 2
18:32:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.514457  3327 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.43.189:32951: Network error: Client connection negotiation failed: client connection to 127.3.43.189:32951: connect: Connection refused (error 111)
18:32:18.518 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
18:32:18.519 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
18:32:18.532 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:18.584 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:18.584 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:18.584 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:18.584 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:18.585 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:18.585 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:18.585 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:18.585 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:18.585 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:18.585 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:18.585 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:18.585 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:18.585 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:18.603 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:18.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.605893  3327 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } attempt: 3
18:32:18.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.610363  3327 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.43.189:32951: Network error: Client connection negotiation failed: client connection to 127.3.43.189:32951: connect: Connection refused (error 111)
18:32:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.753773  3327 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } attempt: 4
18:32:18.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.759155  3327 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.43.189:32951: Network error: Client connection negotiation failed: client connection to 127.3.43.189:32951: connect: Connection refused (error 111)
18:32:18.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.781448  3329 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:32:18.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.782171  3329 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:32:18.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.782739  3329 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:32:18.797 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:18.798 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:18.798 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:18.798 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:18.798 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:18.798 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:18.798 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:18.799 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:18.799 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:18.799 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:18.798 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:18.799 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:18.799 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:18.805 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:18.806 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:18.806 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:18.806 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:18.806 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:18.806 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:18.806 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:18.806 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:18.806 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:18.806 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:18.806 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:18.806 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:18.806 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:18.806 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:18.807 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:18.807 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:18.807 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:18.807 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:18.807 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:18.807 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:18.807 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:18.807 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:18.807 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:18.807 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:18.808 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:18.808 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:18.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.819002  3329 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:32:18.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.819372  3329 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:32:18.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.819677  3329 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:32:18.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.820032  3329 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:32:18.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.820349  3329 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:32:18.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.820591  3329 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39267/jwks.json
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.865849  3329 master_runner.cc:387] Master server non-default flags:
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.43.148:38361
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/data
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/wal
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.43.190:40613,127.3.43.189:32951,127.3.43.188:36795
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.43.189:32951
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39267/jwks.json
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/data/info.pb
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.43.189
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/logs
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:32:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:32:18.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:32:18.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:32:18.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:32:18.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:32:18.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.867507  3329 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:32:18.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:18.869710  3329 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:32:18.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.883618  3338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:18.924 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:18.924 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:18.924 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:18.925 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:18.925 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:18.925 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:18.925 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:18.925 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:18.925 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:18.926 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:18.926 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:18.926 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:18.926 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:19.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535539001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:19.015 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
18:32:19.019 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
18:32:19.033 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:19.058991  3327 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } attempt: 5
18:32:19.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:19.065450  3327 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.43.189:32951: Network error: Client connection negotiation failed: client connection to 127.3.43.189:32951: connect: Connection refused (error 111)
18:32:19.103 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:19.185 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:19.185 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:19.185 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:19.186 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:19.186 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:19.186 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:19.187 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:19.187 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:19.187 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:19.188 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:19.188 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:19.188 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:19.188 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:19.353 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:19.353 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:19.353 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:19.354 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:19.354 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:19.354 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:19.354 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:19.354 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:19.354 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:19.355 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:19.355 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:19.355 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:19.355 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:19.385 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:19.386 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:19.386 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:19.386 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:19.387 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:19.387 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:19.387 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:19.387 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:19.387 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:19.388 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:19.388 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:19.388 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:19.388 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:19.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535539501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:19.512 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:32:19.515 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
18:32:19.532 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:19.603 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:19.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:19.612882  3327 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } attempt: 6
18:32:19.623 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:19.624 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:19.624 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:19.624 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:19.625 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:19.625 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:19.625 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:19.625 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:19.625 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:19.626 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:19.626 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:19.626 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:19.626 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:19.641 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:19.641 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:19.642 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:19.642 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:19.642 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:19.642 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:19.643 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:19.643 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:19.643 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:19.643 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:19.643 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:19.643 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:19.643 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:19.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:19.649681  3327 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.43.189:32951: Network error: Client connection negotiation failed: client connection to 127.3.43.189:32951: connect: Connection refused (error 111)
18:32:20.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535540001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:20.011 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:32:20.012 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
18:32:20.032 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:20.104 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:20.362 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:20.362 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:20.363 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:20.363 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:20.363 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:20.363 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:20.364 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:20.364 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:20.364 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:20.364 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:20.364 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:20.365 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:20.365 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:20.441 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:20.441 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:20.441 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:20.442 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:20.442 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:20.442 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:20.442 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:20.442 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:20.442 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:20.442 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:20.442 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:20.442 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:20.442 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:20.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535540501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:20.513 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:32:20.514 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
18:32:20.532 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:20.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:20.286446  3337 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 3329
18:32:20.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:20.563832  3329 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.676s	user 0.601s	sys 0.987s
18:32:20.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:18.890093  3339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:20.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:20.564510  3329 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.677s	user 0.601s	sys 0.988s
18:32:20.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.573171  3329 server_base.cc:1061] running on GCE node
18:32:20.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:20.574091  3348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:20.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.575641  3329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:32:20.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.578763  3329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:32:20.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.580230  3329 hybrid_clock.cc:648] HybridClock initialized: now 1783535540580181 us; error 51 us; skew 500 ppm
18:32:20.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.581149  3329 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:32:20.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.589012  3329 webserver.cc:534] Webserver started at http://127.3.43.189:32833/ using document root <none> and password file <none>
18:32:20.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.589931  3329 fs_manager.cc:362] Metadata directory not provided
18:32:20.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.590118  3329 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:32:20.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.590507  3329 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:32:20.592 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:20.593 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:20.593 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:20.593 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:20.593 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:20.593 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:20.593 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:20.593 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:20.593 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:20.593 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:20.593 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:20.593 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:20.593 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:20.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.596342  3329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/data/instance:
18:32:20.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9a65d4fc06e14f2ab7a31b666ebfda31"
18:32:20.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:20 on dist-test-slave-dxnw"
18:32:20.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.597455  3329 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/wal/instance:
18:32:20.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9a65d4fc06e14f2ab7a31b666ebfda31"
18:32:20.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:20 on dist-test-slave-dxnw"
18:32:20.602 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:20.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.606200  3329 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.010s	sys 0.000s
18:32:20.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.613406  3353 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:32:20.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.614686  3329 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.006s	sys 0.000s
18:32:20.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.615108  3329 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/wal
18:32:20.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9a65d4fc06e14f2ab7a31b666ebfda31"
18:32:20.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:20 on dist-test-slave-dxnw"
18:32:20.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.615415  3329 fs_report.cc:389] FS layout report
18:32:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:32:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/wal
18:32:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/wal
18:32:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/data/data
18:32:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:32:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:32:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:32:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:32:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:32:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:32:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:32:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:32:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:32:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:32:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:32:20.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.680903  3329 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:32:20.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.682403  3329 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:32:20.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.682927  3329 kserver.cc:163] Server-wide thread pool size limit: 3276
18:32:20.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.710182  3327 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } attempt: 7
18:32:20.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:20.719314  3327 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.43.189:32951: Network error: Client connection negotiation failed: client connection to 127.3.43.189:32951: connect: Connection refused (error 111)
18:32:20.722 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:20.722 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:20.723 [DEBUG - pool-144-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:20.723 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:20.723 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:20.723 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:20.723 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:20.723 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:20.723 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:20.723 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:20.723 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:20.723 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:20.723 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:20.724 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27727), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [15ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [20ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [25ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [66ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [71ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [75ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [75ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [92ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [93ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [94ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [94ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [103ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [103ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [122ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [162ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [222ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [521ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [522ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [863ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1164ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1164ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2862ms] refreshing cache from master, [2862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2863ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2864ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2864ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [4660ms] refreshing cache from master, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [4662ms] too many traces: truncated at 100 traces, deferred=Deferred@2139982927(state=PENDING, result=null, callback=(continuation of Deferred@1389822246 after retry RPC after error@124221286) -> (continuation of Deferred@1091891337 after retry RPC after error@1390994192) -> (continuation of Deferred@953943642 after retry RPC after error@79465056) -> (continuation of Deferred@1657447110 after retry RPC after error@1999580652) -> (continuation of Deferred@798559109 after retry RPC after error@1335262108) -> (continuation of Deferred@2029861946 after retry RPC after error@1983065732) -> (continuation of Deferred@294766308 after retry RPC after error@1831278033) -> (continuation of Deferred@2083190947 after retry RPC after error@327331500) -> (continuation of Deferred@213642462 after retry RPC after error@1508370693) -> (continuation of Deferred@1923345786 after retry RPC after error@1951582796) -> (continuation of Deferred@668734724 after retry RPC after error@1091923771) -> (continuation of Deferred@741376606 after retry RPC after error@1314008382) -> (continuation of Deferred@157377989 after retry RPC after error@1667743589) -> (continuation of Deferred@1273881381 after retry RPC after error@336141499) -> (continuation of Deferred@373562546 after retry RPC after error@1216746888) -> (continuation of Deferred@1825973110 after retry RPC after error@811996819) -> (continuation of Deferred@116469153 after retry RPC after error@2124628642) -> (continuation of Deferred@590545811 after retry RPC after error@593578984) -> (continuation of Deferred@754120192 after retry RPC after error@1218451310) -> (continuation of Deferred@1941224050 after retry RPC after error@1520669159) -> (continuation of Deferred@1633304133 after retry RPC after error@696864359) -> (continuation of Deferred@2142770702 after retry RPC after error@961711287) -> (continuation of Deferred@155858382 after retry RPC after error@1783867638) -> (continuation of Deferred@1432669140 after retry RPC after error@2029961979) -> (continuation of Deferred@549616751 after retry RPC after error@1461810329), errback=(continuation of Deferred@1389822246 after retry RPC after error@124221286) -> (continuation of Deferred@1091891337 after retry RPC after error@1390994192) -> (continuation of Deferred@953943642 after retry RPC after error@79465056) -> (continuation of Deferred@1657447110 after retry RPC after error@1999580652) -> (continuation of Deferred@798559109 after retry RPC after error@1335262108) -> (continuation of Deferred@2029861946 after retry RPC after error@1983065732) -> (continuation of Deferred@294766308 after retry RPC after error@1831278033) -> (continuation of Deferred@2083190947 after retry RPC after error@327331500) -> (continuation of Deferred@213642462 after retry RPC after error@1508370693) -> (continuation of Deferred@1923345786 after retry RPC after error@1951582796) -> (continuation of Deferred@668734724 after retry RPC after error@1091923771) -> (continuation of Deferred@741376606 after retry RPC after error@1314008382) -> (continuation of Deferred@157377989 after retry RPC after error@1667743589) -> (continuation of Deferred@1273881381 after retry RPC after error@336141499) -> (continuation of Deferred@373562546 after retry RPC after error@1216746888) -> (continuation of Deferred@1825973110 after retry RPC after error@811996819) -> (continuation of Deferred@116469153 after retry RPC after error@2124628642) -> (continuation of Deferred@590545811 after retry RPC after error@593578984) -> (continuation of Deferred@754120192 after retry RPC after error@1218451310) -> (continuation of Deferred@1941224050 after retry RPC after error@1520669159) -> (continuation of Deferred@1633304133 after retry RPC after error@696864359) -> (continuation of Deferred@2142770702 after retry RPC after error@961711287) -> (continuation of Deferred@155858382 after retry RPC after error@1783867638) -> (continuation of Deferred@1432669140 after retry RPC after error@2029961979) -> (continuation of Deferred@549616751 after retry RPC after error@1461810329)))
18:32:20.725 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
18:32:20.725 [WARN - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27727), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [15ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [20ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [25ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [66ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [71ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [75ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [75ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [92ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [93ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [94ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [94ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [103ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [103ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [122ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [162ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [222ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [521ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [522ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [863ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1164ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1164ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2862ms] refreshing cache from master, [2862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2863ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2864ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2864ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [4660ms] refreshing cache from master, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [4662ms] too many traces: truncated at 100 traces, deferred=Deferred@2139982927(state=PENDING, result=null, callback=(continuation of Deferred@1389822246 after retry RPC after error@124221286) -> (continuation of Deferred@1091891337 after retry RPC after error@1390994192) -> (continuation of Deferred@953943642 after retry RPC after error@79465056) -> (continuation of Deferred@1657447110 after retry RPC after error@1999580652) -> (continuation of Deferred@798559109 after retry RPC after error@1335262108) -> (continuation of Deferred@2029861946 after retry RPC after error@1983065732) -> (continuation of Deferred@294766308 after retry RPC after error@1831278033) -> (continuation of Deferred@2083190947 after retry RPC after error@327331500) -> (continuation of Deferred@213642462 after retry RPC after error@1508370693) -> (continuation of Deferred@1923345786 after retry RPC after error@1951582796) -> (continuation of Deferred@668734724 after retry RPC after error@1091923771) -> (continuation of Deferred@741376606 after retry RPC after error@1314008382) -> (continuation of Deferred@157377989 after retry RPC after error@1667743589) -> (continuation of Deferred@1273881381 after retry RPC after error@336141499) -> (continuation of Deferred@373562546 after retry RPC after error@1216746888) -> (continuation of Deferred@1825973110 after retry RPC after error@811996819) -> (continuation of Deferred@116469153 after retry RPC after error@2124628642) -> (continuation of Deferred@590545811 after retry RPC after error@593578984) -> (continuation of Deferred@754120192 after retry RPC after error@1218451310) -> (continuation of Deferred@1941224050 after retry RPC after error@1520669159) -> (continuation of Deferred@1633304133 after retry RPC after error@696864359) -> (continuation of Deferred@2142770702 after retry RPC after error@961711287) -> (continuation of Deferred@155858382 after retry RPC after error@1783867638) -> (continuation of Deferred@1432669140 after retry RPC after error@2029961979) -> (continuation of Deferred@549616751 after retry RPC after error@1461810329), errback=(continuation of Deferred@1389822246 after retry RPC after error@124221286) -> (continuation of Deferred@1091891337 after retry RPC after error@1390994192) -> (continuation of Deferred@953943642 after retry RPC after error@79465056) -> (continuation of Deferred@1657447110 after retry RPC after error@1999580652) -> (continuation of Deferred@798559109 after retry RPC after error@1335262108) -> (continuation of Deferred@2029861946 after retry RPC after error@1983065732) -> (continuation of Deferred@294766308 after retry RPC after error@1831278033) -> (continuation of Deferred@2083190947 after retry RPC after error@327331500) -> (continuation of Deferred@213642462 after retry RPC after error@1508370693) -> (continuation of Deferred@1923345786 after retry RPC after error@1951582796) -> (continuation of Deferred@668734724 after retry RPC after error@1091923771) -> (continuation of Deferred@741376606 after retry RPC after error@1314008382) -> (continuation of Deferred@157377989 after retry RPC after error@1667743589) -> (continuation of Deferred@1273881381 after retry RPC after error@336141499) -> (continuation of Deferred@373562546 after retry RPC after error@1216746888) -> (continuation of Deferred@1825973110 after retry RPC after error@811996819) -> (continuation of Deferred@116469153 after retry RPC after error@2124628642) -> (continuation of Deferred@590545811 after retry RPC after error@593578984) -> (continuation of Deferred@754120192 after retry RPC after error@1218451310) -> (continuation of Deferred@1941224050 after retry RPC after error@1520669159) -> (continuation of Deferred@1633304133 after retry RPC after error@696864359) -> (continuation of Deferred@2142770702 after retry RPC after error@961711287) -> (continuation of Deferred@155858382 after retry RPC after error@1783867638) -> (continuation of Deferred@1432669140 after retry RPC after error@2029961979) -> (continuation of Deferred@549616751 after retry RPC after error@1461810329)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.124:38123
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:20.726 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
18:32:20.728 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#4 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
18:32:20.730 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27727), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [15ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [20ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [25ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [25ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [66ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [71ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [75ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [75ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [92ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [93ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [94ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [94ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [103ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [103ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [122ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [162ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [222ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [521ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [522ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [863ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1164ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1164ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2862ms] refreshing cache from master, [2862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2863ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2864ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2864ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [4660ms] refreshing cache from master, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [4662ms] too many traces: truncated at 100 traces, deferred=Deferred@2139982927(state=PENDING, result=null, callback=(continuation of Deferred@1389822246 after retry RPC after error@124221286) -> (continuation of Deferred@1091891337 after retry RPC after error@1390994192) -> (continuation of Deferred@953943642 after retry RPC after error@79465056) -> (continuation of Deferred@1657447110 after retry RPC after error@1999580652) -> (continuation of Deferred@798559109 after retry RPC after error@1335262108) -> (continuation of Deferred@2029861946 after retry RPC after error@1983065732) -> (continuation of Deferred@294766308 after retry RPC after error@1831278033) -> (continuation of Deferred@2083190947 after retry RPC after error@327331500) -> (continuation of Deferred@213642462 after retry RPC after error@1508370693) -> (continuation of Deferred@1923345786 after retry RPC after error@1951582796) -> (continuation of Deferred@668734724 after retry RPC after error@1091923771) -> (continuation of Deferred@741376606 after retry RPC after error@1314008382) -> (continuation of Deferred@157377989 after retry RPC after error@1667743589) -> (continuation of Deferred@1273881381 after retry RPC after error@336141499) -> (continuation of Deferred@373562546 after retry RPC after error@1216746888) -> (continuation of Deferred@1825973110 after retry RPC after error@811996819) -> (continuation of Deferred@116469153 after retry RPC after error@2124628642) -> (continuation of Deferred@590545811 after retry RPC after error@593578984) -> (continuation of Deferred@754120192 after retry RPC after error@1218451310) -> (continuation of Deferred@1941224050 after retry RPC after error@1520669159) -> (continuation of Deferred@1633304133 after retry RPC after error@696864359) -> (continuation of Deferred@2142770702 after retry RPC after error@961711287) -> (continuation of Deferred@155858382 after retry RPC after error@1783867638) -> (continuation of Deferred@1432669140 after retry RPC after error@2029961979) -> (continuation of Deferred@549616751 after retry RPC after error@1461810329), errback=(continuation of Deferred@1389822246 after retry RPC after error@124221286) -> (continuation of Deferred@1091891337 after retry RPC after error@1390994192) -> (continuation of Deferred@953943642 after retry RPC after error@79465056) -> (continuation of Deferred@1657447110 after retry RPC after error@1999580652) -> (continuation of Deferred@798559109 after retry RPC after error@1335262108) -> (continuation of Deferred@2029861946 after retry RPC after error@1983065732) -> (continuation of Deferred@294766308 after retry RPC after error@1831278033) -> (continuation of Deferred@2083190947 after retry RPC after error@327331500) -> (continuation of Deferred@213642462 after retry RPC after error@1508370693) -> (continuation of Deferred@1923345786 after retry RPC after error@1951582796) -> (continuation of Deferred@668734724 after retry RPC after error@1091923771) -> (continuation of Deferred@741376606 after retry RPC after error@1314008382) -> (continuation of Deferred@157377989 after retry RPC after error@1667743589) -> (continuation of Deferred@1273881381 after retry RPC after error@336141499) -> (continuation of Deferred@373562546 after retry RPC after error@1216746888) -> (continuation of Deferred@1825973110 after retry RPC after error@811996819) -> (continuation of Deferred@116469153 after retry RPC after error@2124628642) -> (continuation of Deferred@590545811 after retry RPC after error@593578984) -> (continuation of Deferred@754120192 after retry RPC after error@1218451310) -> (continuation of Deferred@1941224050 after retry RPC after error@1520669159) -> (continuation of Deferred@1633304133 after retry RPC after error@696864359) -> (continuation of Deferred@2142770702 after retry RPC after error@961711287) -> (continuation of Deferred@155858382 after retry RPC after error@1783867638) -> (continuation of Deferred@1432669140 after retry RPC after error@2029961979) -> (continuation of Deferred@549616751 after retry RPC after error@1461810329)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.124:38123
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:20.731 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:32:20.732 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
18:32:20.732 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RUNNING to RESTARTING.
18:32:20.732 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#4) of source Source: KuduSource.
18:32:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.774168  3329 rpc_server.cc:307] RPC server started. Bound to: 127.3.43.189:32951
18:32:20.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.774283  3408 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.43.189:32951 every 8 connection(s)
18:32:20.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.777838  3329 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/data/info.pb
18:32:20.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.785475  3409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:20.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.786120  3246 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 3329
18:32:20.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.786538  3246 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-1/wal/instance
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.788781  3246 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/wal
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/data
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/logs
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/data/info.pb
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.43.188:36795
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.43.188
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.43.148:38361
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.43.190:40613,127.3.43.189:32951,127.3.43.188:36795
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:20.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39267/jwks.json with env {}
18:32:20.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.797500  3409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } has no permanent_uuid. Determining permanent_uuid...
18:32:20.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.823249  3409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } has no permanent_uuid. Determining permanent_uuid...
18:32:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.840108  3409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } has no permanent_uuid. Determining permanent_uuid...
18:32:20.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:20.842938  3355 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.43.188:36795: connect: Connection refused (error 111)
18:32:20.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:20.848043  3409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.43.188:36795: Network error: Client connection negotiation failed: client connection to 127.3.43.188:36795: connect: Connection refused (error 111)
18:32:20.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.897624  3409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } attempt: 1
18:32:20.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:20.902400  3409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.43.188:36795: Network error: Client connection negotiation failed: client connection to 127.3.43.188:36795: connect: Connection refused (error 111)
18:32:20.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:20.970813  3409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } attempt: 2
18:32:20.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:20.975674  3409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.43.188:36795: Network error: Client connection negotiation failed: client connection to 127.3.43.188:36795: connect: Connection refused (error 111)
18:32:21.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535541001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:21.010 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
18:32:21.010 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
18:32:21.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:21.067212  3409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } attempt: 3
18:32:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:21.074352  3409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.43.188:36795: Network error: Client connection negotiation failed: client connection to 127.3.43.188:36795: connect: Connection refused (error 111)
18:32:21.102 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:21.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:21.171533  3411 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:32:21.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:21.172155  3411 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:32:21.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:21.172725  3411 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:32:21.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:21.208204  3411 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:32:21.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:21.208492  3411 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:32:21.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:21.208693  3411 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:32:21.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:21.208921  3411 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:32:21.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:21.209126  3411 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:32:21.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:21.209278  3411 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39267/jwks.json
18:32:21.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:21.217832  3409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } attempt: 4
18:32:21.223 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:21.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:21.222872  3409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.43.188:36795: Network error: Client connection negotiation failed: client connection to 127.3.43.188:36795: connect: Connection refused (error 111)
18:32:21.223 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:21.223 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:21.223 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.223 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.223 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.223 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.223 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.223 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.224 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.224 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.224 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.224 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:21.252422  3411 master_runner.cc:387] Master server non-default flags:
18:32:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.43.148:38361
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/data
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/wal
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.43.190:40613,127.3.43.189:32951,127.3.43.188:36795
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.43.188:36795
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39267/jwks.json
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/data/info.pb
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.43.188
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/logs
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:32:21.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:32:21.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:21.253911  3411 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:32:21.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:21.255659  3411 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:32:21.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:21.268297  3422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:21.441 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:21.441 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:21.441 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:21.442 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:21.442 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:21.442 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:21.443 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:21.443 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:21.443 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:21.443 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:21.443 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:21.443 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:21.443 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:21.498 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:21.499 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:21.499 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:21.499 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.499 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.499 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.499 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.499 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.500 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.500 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.500 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.500 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.500 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:21.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535541501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:21.514 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:32:21.514 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
18:32:21.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:21.522414  3409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } attempt: 5
18:32:21.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:21.530004  3409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.43.188:36795: Network error: Client connection negotiation failed: client connection to 127.3.43.188:36795: connect: Connection refused (error 111)
18:32:21.603 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:21.615 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:21.615 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:21.616 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:21.616 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.616 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.616 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.616 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.616 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.616 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.616 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.616 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.616 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.616 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:21.653 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:21.653 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:21.653 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:21.653 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.654 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.654 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.654 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.654 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.654 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.654 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.654 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.654 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.654 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:21.683 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:21.683 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:21.683 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:21.684 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:21.684 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:21.684 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:21.685 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:21.685 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:21.685 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:21.686 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:21.686 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:21.686 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:21.686 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:21.778 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:21.778 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:21.778 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:21.779 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.779 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.779 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.779 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.779 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.779 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.779 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.779 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.779 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.779 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:21.795 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:21.795 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:21.795 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:21.795 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.795 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.795 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:21.796 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.796 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.796 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:21.796 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.796 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.796 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:21.796 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:21.826 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:21.826 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:21.827 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:21.827 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:21.827 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:21.827 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:21.827 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:21.827 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:21.827 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:21.828 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:21.828 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:21.828 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:21.828 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:22.001 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535542001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:22.013 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:32:22.014 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
18:32:22.041 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:22.041 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:22.042 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:22.042 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:22.042 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:22.043 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:22.043 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:22.043 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:22.043 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:22.043 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:22.044 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:22.044 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:22.044 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:22.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.077834  3409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } attempt: 6
18:32:22.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:22.090082  3409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.43.188:36795: Network error: Client connection negotiation failed: client connection to 127.3.43.188:36795: connect: Connection refused (error 111)
18:32:22.103 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:22.141 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:22.141 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:22.142 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:22.142 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:22.142 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:22.142 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:22.142 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:22.142 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:22.142 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:22.143 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:22.143 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:22.143 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:22.143 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:22.144 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29158), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [29ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [30ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [30ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [45ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [46ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [49ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [49ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [90ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [98ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [98ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [103ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [103ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [123ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [143ms] refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [145ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [145ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [145ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [146ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [182ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [302ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [503ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [562ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [562ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [563ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [563ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [744ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [744ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1244ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3461ms] refreshing cache from master, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3462ms] too many traces: truncated at 100 traces, deferred=Deferred@1524369435(state=PENDING, result=null, callback=(continuation of Deferred@1193599782 after retry RPC after error@1330276753) -> (continuation of Deferred@1301607195 after retry RPC after error@2008196706) -> (continuation of Deferred@401557089 after retry RPC after error@192259052) -> (continuation of Deferred@1628673458 after retry RPC after error@57720388) -> (continuation of Deferred@1858153477 after retry RPC after error@1217235186) -> (continuation of Deferred@894319188 after retry RPC after error@860495911) -> (continuation of Deferred@1418498895 after retry RPC after error@1885494068) -> (continuation of Deferred@884622326 after retry RPC after error@1444087390) -> (continuation of Deferred@1723199800 after retry RPC after error@82619681) -> (continuation of Deferred@1647311801 after retry RPC after error@750788692) -> (continuation of Deferred@1706375365 after retry RPC after error@72418551) -> (continuation of Deferred@431937015 after retry RPC after error@886146068) -> (continuation of Deferred@2028921179 after retry RPC after error@1955865613) -> (continuation of Deferred@468342277 after retry RPC after error@597917768) -> (continuation of Deferred@742934878 after retry RPC after error@2032772246) -> (continuation of Deferred@809144264 after retry RPC after error@254076999) -> (continuation of Deferred@1640514116 after retry RPC after error@1441880063) -> (continuation of Deferred@827446854 after retry RPC after error@429881083) -> (continuation of Deferred@979815918 after retry RPC after error@1710697458) -> (continuation of Deferred@1512780524 after retry RPC after error@954314748) -> (continuation of Deferred@887364787 after retry RPC after error@1745881446) -> (continuation of Deferred@1798302426 after retry RPC after error@1585718796) -> (continuation of Deferred@1251064043 after retry RPC after error@572703718) -> (continuation of Deferred@919569474 after retry RPC after error@1233412305) -> (continuation of Deferred@244703210 after retry RPC after error@983306285) -> (continuation of Deferred@1891331752 after retry RPC after error@441653894), errback=(continuation of Deferred@1193599782 after retry RPC after error@1330276753) -> (continuation of Deferred@1301607195 after retry RPC after error@2008196706) -> (continuation of Deferred@401557089 after retry RPC after error@192259052) -> (continuation of Deferred@1628673458 after retry RPC after error@57720388) -> (continuation of Deferred@1858153477 after retry RPC after error@1217235186) -> (continuation of Deferred@894319188 after retry RPC after error@860495911) -> (continuation of Deferred@1418498895 after retry RPC after error@1885494068) -> (continuation of Deferred@884622326 after retry RPC after error@1444087390) -> (continuation of Deferred@1723199800 after retry RPC after error@82619681) -> (continuation of Deferred@1647311801 after retry RPC after error@750788692) -> (continuation of Deferred@1706375365 after retry RPC after error@72418551) -> (continuation of Deferred@431937015 after retry RPC after error@886146068) -> (continuation of Deferred@2028921179 after retry RPC after error@1955865613) -> (continuation of Deferred@468342277 after retry RPC after error@597917768) -> (continuation of Deferred@742934878 after retry RPC after error@2032772246) -> (continuation of Deferred@809144264 after retry RPC after error@254076999) -> (continuation of Deferred@1640514116 after retry RPC after error@1441880063) -> (continuation of Deferred@827446854 after retry RPC after error@429881083) -> (continuation of Deferred@979815918 after retry RPC after error@1710697458) -> (continuation of Deferred@1512780524 after retry RPC after error@954314748) -> (continuation of Deferred@887364787 after retry RPC after error@1745881446) -> (continuation of Deferred@1798302426 after retry RPC after error@1585718796) -> (continuation of Deferred@1251064043 after retry RPC after error@572703718) -> (continuation of Deferred@919569474 after retry RPC after error@1233412305) -> (continuation of Deferred@244703210 after retry RPC after error@983306285) -> (continuation of Deferred@1891331752 after retry RPC after error@441653894)))
18:32:22.145 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
18:32:22.146 [WARN - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29158), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [29ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [30ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [30ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [45ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [46ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [49ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [49ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [90ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [98ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [98ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [103ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [103ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [123ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [143ms] refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [145ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [145ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [145ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [146ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [182ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [302ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [503ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [562ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [562ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [563ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [563ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [744ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [744ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1244ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3461ms] refreshing cache from master, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3462ms] too many traces: truncated at 100 traces, deferred=Deferred@1524369435(state=PENDING, result=null, callback=(continuation of Deferred@1193599782 after retry RPC after error@1330276753) -> (continuation of Deferred@1301607195 after retry RPC after error@2008196706) -> (continuation of Deferred@401557089 after retry RPC after error@192259052) -> (continuation of Deferred@1628673458 after retry RPC after error@57720388) -> (continuation of Deferred@1858153477 after retry RPC after error@1217235186) -> (continuation of Deferred@894319188 after retry RPC after error@860495911) -> (continuation of Deferred@1418498895 after retry RPC after error@1885494068) -> (continuation of Deferred@884622326 after retry RPC after error@1444087390) -> (continuation of Deferred@1723199800 after retry RPC after error@82619681) -> (continuation of Deferred@1647311801 after retry RPC after error@750788692) -> (continuation of Deferred@1706375365 after retry RPC after error@72418551) -> (continuation of Deferred@431937015 after retry RPC after error@886146068) -> (continuation of Deferred@2028921179 after retry RPC after error@1955865613) -> (continuation of Deferred@468342277 after retry RPC after error@597917768) -> (continuation of Deferred@742934878 after retry RPC after error@2032772246) -> (continuation of Deferred@809144264 after retry RPC after error@254076999) -> (continuation of Deferred@1640514116 after retry RPC after error@1441880063) -> (continuation of Deferred@827446854 after retry RPC after error@429881083) -> (continuation of Deferred@979815918 after retry RPC after error@1710697458) -> (continuation of Deferred@1512780524 after retry RPC after error@954314748) -> (continuation of Deferred@887364787 after retry RPC after error@1745881446) -> (continuation of Deferred@1798302426 after retry RPC after error@1585718796) -> (continuation of Deferred@1251064043 after retry RPC after error@572703718) -> (continuation of Deferred@919569474 after retry RPC after error@1233412305) -> (continuation of Deferred@244703210 after retry RPC after error@983306285) -> (continuation of Deferred@1891331752 after retry RPC after error@441653894), errback=(continuation of Deferred@1193599782 after retry RPC after error@1330276753) -> (continuation of Deferred@1301607195 after retry RPC after error@2008196706) -> (continuation of Deferred@401557089 after retry RPC after error@192259052) -> (continuation of Deferred@1628673458 after retry RPC after error@57720388) -> (continuation of Deferred@1858153477 after retry RPC after error@1217235186) -> (continuation of Deferred@894319188 after retry RPC after error@860495911) -> (continuation of Deferred@1418498895 after retry RPC after error@1885494068) -> (continuation of Deferred@884622326 after retry RPC after error@1444087390) -> (continuation of Deferred@1723199800 after retry RPC after error@82619681) -> (continuation of Deferred@1647311801 after retry RPC after error@750788692) -> (continuation of Deferred@1706375365 after retry RPC after error@72418551) -> (continuation of Deferred@431937015 after retry RPC after error@886146068) -> (continuation of Deferred@2028921179 after retry RPC after error@1955865613) -> (continuation of Deferred@468342277 after retry RPC after error@597917768) -> (continuation of Deferred@742934878 after retry RPC after error@2032772246) -> (continuation of Deferred@809144264 after retry RPC after error@254076999) -> (continuation of Deferred@1640514116 after retry RPC after error@1441880063) -> (continuation of Deferred@827446854 after retry RPC after error@429881083) -> (continuation of Deferred@979815918 after retry RPC after error@1710697458) -> (continuation of Deferred@1512780524 after retry RPC after error@954314748) -> (continuation of Deferred@887364787 after retry RPC after error@1745881446) -> (continuation of Deferred@1798302426 after retry RPC after error@1585718796) -> (continuation of Deferred@1251064043 after retry RPC after error@572703718) -> (continuation of Deferred@919569474 after retry RPC after error@1233412305) -> (continuation of Deferred@244703210 after retry RPC after error@983306285) -> (continuation of Deferred@1891331752 after retry RPC after error@441653894)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:22.147 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
18:32:22.150 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#4 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
18:32:22.153 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29158), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [29ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [30ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [30ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [45ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [46ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [49ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [49ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [90ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [98ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [98ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [103ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [103ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [123ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [143ms] refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [145ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [145ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [145ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [146ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [182ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [302ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [503ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [562ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [562ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [563ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [563ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [744ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [744ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1244ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3461ms] refreshing cache from master, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3462ms] too many traces: truncated at 100 traces, deferred=Deferred@1524369435(state=PENDING, result=null, callback=(continuation of Deferred@1193599782 after retry RPC after error@1330276753) -> (continuation of Deferred@1301607195 after retry RPC after error@2008196706) -> (continuation of Deferred@401557089 after retry RPC after error@192259052) -> (continuation of Deferred@1628673458 after retry RPC after error@57720388) -> (continuation of Deferred@1858153477 after retry RPC after error@1217235186) -> (continuation of Deferred@894319188 after retry RPC after error@860495911) -> (continuation of Deferred@1418498895 after retry RPC after error@1885494068) -> (continuation of Deferred@884622326 after retry RPC after error@1444087390) -> (continuation of Deferred@1723199800 after retry RPC after error@82619681) -> (continuation of Deferred@1647311801 after retry RPC after error@750788692) -> (continuation of Deferred@1706375365 after retry RPC after error@72418551) -> (continuation of Deferred@431937015 after retry RPC after error@886146068) -> (continuation of Deferred@2028921179 after retry RPC after error@1955865613) -> (continuation of Deferred@468342277 after retry RPC after error@597917768) -> (continuation of Deferred@742934878 after retry RPC after error@2032772246) -> (continuation of Deferred@809144264 after retry RPC after error@254076999) -> (continuation of Deferred@1640514116 after retry RPC after error@1441880063) -> (continuation of Deferred@827446854 after retry RPC after error@429881083) -> (continuation of Deferred@979815918 after retry RPC after error@1710697458) -> (continuation of Deferred@1512780524 after retry RPC after error@954314748) -> (continuation of Deferred@887364787 after retry RPC after error@1745881446) -> (continuation of Deferred@1798302426 after retry RPC after error@1585718796) -> (continuation of Deferred@1251064043 after retry RPC after error@572703718) -> (continuation of Deferred@919569474 after retry RPC after error@1233412305) -> (continuation of Deferred@244703210 after retry RPC after error@983306285) -> (continuation of Deferred@1891331752 after retry RPC after error@441653894), errback=(continuation of Deferred@1193599782 after retry RPC after error@1330276753) -> (continuation of Deferred@1301607195 after retry RPC after error@2008196706) -> (continuation of Deferred@401557089 after retry RPC after error@192259052) -> (continuation of Deferred@1628673458 after retry RPC after error@57720388) -> (continuation of Deferred@1858153477 after retry RPC after error@1217235186) -> (continuation of Deferred@894319188 after retry RPC after error@860495911) -> (continuation of Deferred@1418498895 after retry RPC after error@1885494068) -> (continuation of Deferred@884622326 after retry RPC after error@1444087390) -> (continuation of Deferred@1723199800 after retry RPC after error@82619681) -> (continuation of Deferred@1647311801 after retry RPC after error@750788692) -> (continuation of Deferred@1706375365 after retry RPC after error@72418551) -> (continuation of Deferred@431937015 after retry RPC after error@886146068) -> (continuation of Deferred@2028921179 after retry RPC after error@1955865613) -> (continuation of Deferred@468342277 after retry RPC after error@597917768) -> (continuation of Deferred@742934878 after retry RPC after error@2032772246) -> (continuation of Deferred@809144264 after retry RPC after error@254076999) -> (continuation of Deferred@1640514116 after retry RPC after error@1441880063) -> (continuation of Deferred@827446854 after retry RPC after error@429881083) -> (continuation of Deferred@979815918 after retry RPC after error@1710697458) -> (continuation of Deferred@1512780524 after retry RPC after error@954314748) -> (continuation of Deferred@887364787 after retry RPC after error@1745881446) -> (continuation of Deferred@1798302426 after retry RPC after error@1585718796) -> (continuation of Deferred@1251064043 after retry RPC after error@572703718) -> (continuation of Deferred@919569474 after retry RPC after error@1233412305) -> (continuation of Deferred@244703210 after retry RPC after error@983306285) -> (continuation of Deferred@1891331752 after retry RPC after error@441653894)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:22.154 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:32:22.156 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
18:32:22.157 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#4) of source Source: KuduSource.
18:32:22.258 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:22.258 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:22.258 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:22.259 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:22.259 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:22.259 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:22.259 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:22.259 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:22.259 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:22.259 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:22.259 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:22.259 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:22.259 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:22.321 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:22.321 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:22.322 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:22.323 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.323 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.323 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.323 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.324 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.324 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.324 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.324 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.324 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.324 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:22.325 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29330), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [5ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [36ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [37ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [37ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [99ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [100ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [129ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [130ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [133ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [133ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [143ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [202ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [242ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [261ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [262ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [442ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [583ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [583ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1261ms] refreshing cache from master, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1263ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2861ms] refreshing cache from master, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2864ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2864ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [6701ms] refreshing cache from master, [6701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [6702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [6702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [6703ms] too many traces: truncated at 100 traces, deferred=Deferred@468277447(state=PENDING, result=null, callback=(continuation of Deferred@154334037 after retry RPC after error@994306816) -> (continuation of Deferred@1759067159 after retry RPC after error@967274155) -> (continuation of Deferred@655461009 after retry RPC after error@61763224) -> (continuation of Deferred@582407038 after retry RPC after error@551957429) -> (continuation of Deferred@193486906 after retry RPC after error@2065827197) -> (continuation of Deferred@1872434244 after retry RPC after error@2121398681) -> (continuation of Deferred@909172701 after retry RPC after error@1574059403) -> (continuation of Deferred@1784425281 after retry RPC after error@462465698) -> (continuation of Deferred@737038394 after retry RPC after error@1738284713) -> (continuation of Deferred@1813063480 after retry RPC after error@1917474210) -> (continuation of Deferred@737977425 after retry RPC after error@747806417) -> (continuation of Deferred@1230984348 after retry RPC after error@1763241808) -> (continuation of Deferred@654839822 after retry RPC after error@534017576) -> (continuation of Deferred@740047610 after retry RPC after error@47198790) -> (continuation of Deferred@1707068018 after retry RPC after error@1499895259) -> (continuation of Deferred@341880807 after retry RPC after error@388099375) -> (continuation of Deferred@206985699 after retry RPC after error@1634979327) -> (continuation of Deferred@1887259041 after retry RPC after error@1747819028) -> (continuation of Deferred@1451904947 after retry RPC after error@694774952) -> (continuation of Deferred@868419685 after retry RPC after error@926599475) -> (continuation of Deferred@868872112 after retry RPC after error@1361561933), errback=(continuation of Deferred@154334037 after retry RPC after error@994306816) -> (continuation of Deferred@1759067159 after retry RPC after error@967274155) -> (continuation of Deferred@655461009 after retry RPC after error@61763224) -> (continuation of Deferred@582407038 after retry RPC after error@551957429) -> (continuation of Deferred@193486906 after retry RPC after error@2065827197) -> (continuation of Deferred@1872434244 after retry RPC after error@2121398681) -> (continuation of Deferred@909172701 after retry RPC after error@1574059403) -> (continuation of Deferred@1784425281 after retry RPC after error@462465698) -> (continuation of Deferred@737038394 after retry RPC after error@1738284713) -> (continuation of Deferred@1813063480 after retry RPC after error@1917474210) -> (continuation of Deferred@737977425 after retry RPC after error@747806417) -> (continuation of Deferred@1230984348 after retry RPC after error@1763241808) -> (continuation of Deferred@654839822 after retry RPC after error@534017576) -> (continuation of Deferred@740047610 after retry RPC after error@47198790) -> (continuation of Deferred@1707068018 after retry RPC after error@1499895259) -> (continuation of Deferred@341880807 after retry RPC after error@388099375) -> (continuation of Deferred@206985699 after retry RPC after error@1634979327) -> (continuation of Deferred@1887259041 after retry RPC after error@1747819028) -> (continuation of Deferred@1451904947 after retry RPC after error@694774952) -> (continuation of Deferred@868419685 after retry RPC after error@926599475) -> (continuation of Deferred@868872112 after retry RPC after error@1361561933)))
18:32:22.326 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:22.326 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:22.327 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:22.327 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.327 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.327 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.327 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.327 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.327 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.327 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.327 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.327 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.327 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:22.326 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29330), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [5ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [36ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [37ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [37ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [99ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [100ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [129ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [130ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [133ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [133ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [143ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [202ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [242ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [261ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [262ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [442ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [583ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [583ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1261ms] refreshing cache from master, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1263ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2861ms] refreshing cache from master, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2864ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2864ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [6701ms] refreshing cache from master, [6701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [6702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [6702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [6703ms] too many traces: truncated at 100 traces, deferred=Deferred@468277447(state=PENDING, result=null, callback=(continuation of Deferred@154334037 after retry RPC after error@994306816) -> (continuation of Deferred@1759067159 after retry RPC after error@967274155) -> (continuation of Deferred@655461009 after retry RPC after error@61763224) -> (continuation of Deferred@582407038 after retry RPC after error@551957429) -> (continuation of Deferred@193486906 after retry RPC after error@2065827197) -> (continuation of Deferred@1872434244 after retry RPC after error@2121398681) -> (continuation of Deferred@909172701 after retry RPC after error@1574059403) -> (continuation of Deferred@1784425281 after retry RPC after error@462465698) -> (continuation of Deferred@737038394 after retry RPC after error@1738284713) -> (continuation of Deferred@1813063480 after retry RPC after error@1917474210) -> (continuation of Deferred@737977425 after retry RPC after error@747806417) -> (continuation of Deferred@1230984348 after retry RPC after error@1763241808) -> (continuation of Deferred@654839822 after retry RPC after error@534017576) -> (continuation of Deferred@740047610 after retry RPC after error@47198790) -> (continuation of Deferred@1707068018 after retry RPC after error@1499895259) -> (continuation of Deferred@341880807 after retry RPC after error@388099375) -> (continuation of Deferred@206985699 after retry RPC after error@1634979327) -> (continuation of Deferred@1887259041 after retry RPC after error@1747819028) -> (continuation of Deferred@1451904947 after retry RPC after error@694774952) -> (continuation of Deferred@868419685 after retry RPC after error@926599475) -> (continuation of Deferred@868872112 after retry RPC after error@1361561933), errback=(continuation of Deferred@154334037 after retry RPC after error@994306816) -> (continuation of Deferred@1759067159 after retry RPC after error@967274155) -> (continuation of Deferred@655461009 after retry RPC after error@61763224) -> (continuation of Deferred@582407038 after retry RPC after error@551957429) -> (continuation of Deferred@193486906 after retry RPC after error@2065827197) -> (continuation of Deferred@1872434244 after retry RPC after error@2121398681) -> (continuation of Deferred@909172701 after retry RPC after error@1574059403) -> (continuation of Deferred@1784425281 after retry RPC after error@462465698) -> (continuation of Deferred@737038394 after retry RPC after error@1738284713) -> (continuation of Deferred@1813063480 after retry RPC after error@1917474210) -> (continuation of Deferred@737977425 after retry RPC after error@747806417) -> (continuation of Deferred@1230984348 after retry RPC after error@1763241808) -> (continuation of Deferred@654839822 after retry RPC after error@534017576) -> (continuation of Deferred@740047610 after retry RPC after error@47198790) -> (continuation of Deferred@1707068018 after retry RPC after error@1499895259) -> (continuation of Deferred@341880807 after retry RPC after error@388099375) -> (continuation of Deferred@206985699 after retry RPC after error@1634979327) -> (continuation of Deferred@1887259041 after retry RPC after error@1747819028) -> (continuation of Deferred@1451904947 after retry RPC after error@694774952) -> (continuation of Deferred@868419685 after retry RPC after error@926599475) -> (continuation of Deferred@868872112 after retry RPC after error@1361561933)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29330), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [5ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [36ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [37ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [37ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [99ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [100ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [129ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [130ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [133ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [133ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [143ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [202ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [242ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [261ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [262ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [442ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [583ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [583ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1261ms] refreshing cache from master, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1263ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2861ms] refreshing cache from master, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2864ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2864ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [6701ms] refreshing cache from master, [6701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [6702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [6702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [6703ms] too many traces: truncated at 100 traces, deferred=Deferred@468277447(state=PENDING, result=null, callback=(continuation of Deferred@154334037 after retry RPC after error@994306816) -> (continuation of Deferred@1759067159 after retry RPC after error@967274155) -> (continuation of Deferred@655461009 after retry RPC after error@61763224) -> (continuation of Deferred@582407038 after retry RPC after error@551957429) -> (continuation of Deferred@193486906 after retry RPC after error@2065827197) -> (continuation of Deferred@1872434244 after retry RPC after error@2121398681) -> (continuation of Deferred@909172701 after retry RPC after error@1574059403) -> (continuation of Deferred@1784425281 after retry RPC after error@462465698) -> (continuation of Deferred@737038394 after retry RPC after error@1738284713) -> (continuation of Deferred@1813063480 after retry RPC after error@1917474210) -> (continuation of Deferred@737977425 after retry RPC after error@747806417) -> (continuation of Deferred@1230984348 after retry RPC after error@1763241808) -> (continuation of Deferred@654839822 after retry RPC after error@534017576) -> (continuation of Deferred@740047610 after retry RPC after error@47198790) -> (continuation of Deferred@1707068018 after retry RPC after error@1499895259) -> (continuation of Deferred@341880807 after retry RPC after error@388099375) -> (continuation of Deferred@206985699 after retry RPC after error@1634979327) -> (continuation of Deferred@1887259041 after retry RPC after error@1747819028) -> (continuation of Deferred@1451904947 after retry RPC after error@694774952) -> (continuation of Deferred@868419685 after retry RPC after error@926599475) -> (continuation of Deferred@868872112 after retry RPC after error@1361561933), errback=(continuation of Deferred@154334037 after retry RPC after error@994306816) -> (continuation of Deferred@1759067159 after retry RPC after error@967274155) -> (continuation of Deferred@655461009 after retry RPC after error@61763224) -> (continuation of Deferred@582407038 after retry RPC after error@551957429) -> (continuation of Deferred@193486906 after retry RPC after error@2065827197) -> (continuation of Deferred@1872434244 after retry RPC after error@2121398681) -> (continuation of Deferred@909172701 after retry RPC after error@1574059403) -> (continuation of Deferred@1784425281 after retry RPC after error@462465698) -> (continuation of Deferred@737038394 after retry RPC after error@1738284713) -> (continuation of Deferred@1813063480 after retry RPC after error@1917474210) -> (continuation of Deferred@737977425 after retry RPC after error@747806417) -> (continuation of Deferred@1230984348 after retry RPC after error@1763241808) -> (continuation of Deferred@654839822 after retry RPC after error@534017576) -> (continuation of Deferred@740047610 after retry RPC after error@47198790) -> (continuation of Deferred@1707068018 after retry RPC after error@1499895259) -> (continuation of Deferred@341880807 after retry RPC after error@388099375) -> (continuation of Deferred@206985699 after retry RPC after error@1634979327) -> (continuation of Deferred@1887259041 after retry RPC after error@1747819028) -> (continuation of Deferred@1451904947 after retry RPC after error@694774952) -> (continuation of Deferred@868419685 after retry RPC after error@926599475) -> (continuation of Deferred@868872112 after retry RPC after error@1361561933)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.68.190:40429
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:22.341 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:22.341 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29330), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [5ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [36ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [37ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [37ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [99ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [100ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [129ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [130ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [133ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [133ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [143ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [202ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [242ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [261ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [262ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [442ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [583ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [583ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1261ms] refreshing cache from master, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1263ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2861ms] refreshing cache from master, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2864ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2864ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [6701ms] refreshing cache from master, [6701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [6702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [6702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [6703ms] too many traces: truncated at 100 traces, deferred=Deferred@468277447(state=PENDING, result=null, callback=(continuation of Deferred@154334037 after retry RPC after error@994306816) -> (continuation of Deferred@1759067159 after retry RPC after error@967274155) -> (continuation of Deferred@655461009 after retry RPC after error@61763224) -> (continuation of Deferred@582407038 after retry RPC after error@551957429) -> (continuation of Deferred@193486906 after retry RPC after error@2065827197) -> (continuation of Deferred@1872434244 after retry RPC after error@2121398681) -> (continuation of Deferred@909172701 after retry RPC after error@1574059403) -> (continuation of Deferred@1784425281 after retry RPC after error@462465698) -> (continuation of Deferred@737038394 after retry RPC after error@1738284713) -> (continuation of Deferred@1813063480 after retry RPC after error@1917474210) -> (continuation of Deferred@737977425 after retry RPC after error@747806417) -> (continuation of Deferred@1230984348 after retry RPC after error@1763241808) -> (continuation of Deferred@654839822 after retry RPC after error@534017576) -> (continuation of Deferred@740047610 after retry RPC after error@47198790) -> (continuation of Deferred@1707068018 after retry RPC after error@1499895259) -> (continuation of Deferred@341880807 after retry RPC after error@388099375) -> (continuation of Deferred@206985699 after retry RPC after error@1634979327) -> (continuation of Deferred@1887259041 after retry RPC after error@1747819028) -> (continuation of Deferred@1451904947 after retry RPC after error@694774952) -> (continuation of Deferred@868419685 after retry RPC after error@926599475) -> (continuation of Deferred@868872112 after retry RPC after error@1361561933), errback=(continuation of Deferred@154334037 after retry RPC after error@994306816) -> (continuation of Deferred@1759067159 after retry RPC after error@967274155) -> (continuation of Deferred@655461009 after retry RPC after error@61763224) -> (continuation of Deferred@582407038 after retry RPC after error@551957429) -> (continuation of Deferred@193486906 after retry RPC after error@2065827197) -> (continuation of Deferred@1872434244 after retry RPC after error@2121398681) -> (continuation of Deferred@909172701 after retry RPC after error@1574059403) -> (continuation of Deferred@1784425281 after retry RPC after error@462465698) -> (continuation of Deferred@737038394 after retry RPC after error@1738284713) -> (continuation of Deferred@1813063480 after retry RPC after error@1917474210) -> (continuation of Deferred@737977425 after retry RPC after error@747806417) -> (continuation of Deferred@1230984348 after retry RPC after error@1763241808) -> (continuation of Deferred@654839822 after retry RPC after error@534017576) -> (continuation of Deferred@740047610 after retry RPC after error@47198790) -> (continuation of Deferred@1707068018 after retry RPC after error@1499895259) -> (continuation of Deferred@341880807 after retry RPC after error@388099375) -> (continuation of Deferred@206985699 after retry RPC after error@1634979327) -> (continuation of Deferred@1887259041 after retry RPC after error@1747819028) -> (continuation of Deferred@1451904947 after retry RPC after error@694774952) -> (continuation of Deferred@868419685 after retry RPC after error@926599475) -> (continuation of Deferred@868872112 after retry RPC after error@1361561933)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29330), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [5ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [36ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [37ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [37ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [99ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [100ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [129ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [130ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [133ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [133ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [143ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [202ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [242ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [261ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [262ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [442ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [583ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [583ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1261ms] refreshing cache from master, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1263ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2861ms] refreshing cache from master, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2864ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2864ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [6701ms] refreshing cache from master, [6701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [6702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [6702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [6703ms] too many traces: truncated at 100 traces, deferred=Deferred@468277447(state=PENDING, result=null, callback=(continuation of Deferred@154334037 after retry RPC after error@994306816) -> (continuation of Deferred@1759067159 after retry RPC after error@967274155) -> (continuation of Deferred@655461009 after retry RPC after error@61763224) -> (continuation of Deferred@582407038 after retry RPC after error@551957429) -> (continuation of Deferred@193486906 after retry RPC after error@2065827197) -> (continuation of Deferred@1872434244 after retry RPC after error@2121398681) -> (continuation of Deferred@909172701 after retry RPC after error@1574059403) -> (continuation of Deferred@1784425281 after retry RPC after error@462465698) -> (continuation of Deferred@737038394 after retry RPC after error@1738284713) -> (continuation of Deferred@1813063480 after retry RPC after error@1917474210) -> (continuation of Deferred@737977425 after retry RPC after error@747806417) -> (continuation of Deferred@1230984348 after retry RPC after error@1763241808) -> (continuation of Deferred@654839822 after retry RPC after error@534017576) -> (continuation of Deferred@740047610 after retry RPC after error@47198790) -> (continuation of Deferred@1707068018 after retry RPC after error@1499895259) -> (continuation of Deferred@341880807 after retry RPC after error@388099375) -> (continuation of Deferred@206985699 after retry RPC after error@1634979327) -> (continuation of Deferred@1887259041 after retry RPC after error@1747819028) -> (continuation of Deferred@1451904947 after retry RPC after error@694774952) -> (continuation of Deferred@868419685 after retry RPC after error@926599475) -> (continuation of Deferred@868872112 after retry RPC after error@1361561933), errback=(continuation of Deferred@154334037 after retry RPC after error@994306816) -> (continuation of Deferred@1759067159 after retry RPC after error@967274155) -> (continuation of Deferred@655461009 after retry RPC after error@61763224) -> (continuation of Deferred@582407038 after retry RPC after error@551957429) -> (continuation of Deferred@193486906 after retry RPC after error@2065827197) -> (continuation of Deferred@1872434244 after retry RPC after error@2121398681) -> (continuation of Deferred@909172701 after retry RPC after error@1574059403) -> (continuation of Deferred@1784425281 after retry RPC after error@462465698) -> (continuation of Deferred@737038394 after retry RPC after error@1738284713) -> (continuation of Deferred@1813063480 after retry RPC after error@1917474210) -> (continuation of Deferred@737977425 after retry RPC after error@747806417) -> (continuation of Deferred@1230984348 after retry RPC after error@1763241808) -> (continuation of Deferred@654839822 after retry RPC after error@534017576) -> (continuation of Deferred@740047610 after retry RPC after error@47198790) -> (continuation of Deferred@1707068018 after retry RPC after error@1499895259) -> (continuation of Deferred@341880807 after retry RPC after error@388099375) -> (continuation of Deferred@206985699 after retry RPC after error@1634979327) -> (continuation of Deferred@1887259041 after retry RPC after error@1747819028) -> (continuation of Deferred@1451904947 after retry RPC after error@694774952) -> (continuation of Deferred@868419685 after retry RPC after error@926599475) -> (continuation of Deferred@868872112 after retry RPC after error@1361561933)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.68.190:40429
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:22.342 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:32:22.342 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.342 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.342 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.342 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:22.342 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#3) of source Source: KuduSource.
18:32:22.343 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:22.343 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.343 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.343 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to CANCELING.
18:32:22.343 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.344 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.344 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.343 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.344 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:22.344 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
18:32:22.344 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to CANCELING.
18:32:22.344 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
18:32:22.345 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to CANCELING.
18:32:22.345 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#4) of source Source: KuduSource.
18:32:22.346 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
18:32:22.347 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CANCELING to CANCELED.
18:32:22.347 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#3 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
18:32:22.359 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
18:32:22.359 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to CANCELING.
18:32:22.359 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
18:32:22.361 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:22.361 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:22.362 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:22.362 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.362 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.362 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.363 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.363 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.363 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.364 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.364 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.364 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.364 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:22.369 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
18:32:22.369 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CANCELING to CANCELED.
18:32:22.369 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
18:32:22.374 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#3 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
18:32:22.375 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#4 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
18:32:22.376 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CANCELING to CANCELED.
18:32:22.377 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:32:22.377 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CANCELING to CANCELED.
18:32:22.377 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:318) Clearing resource requirements of job fa73e37017778341a79e5b3ef3d55eb9
18:32:22.381 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:22.381 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:22.382 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:22.382 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.382 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.382 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.382 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.383 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.382 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.383 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.383 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.383 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.383 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:22.401 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:22.402 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:22.402 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:22.402 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.402 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.402 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.402 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.403 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.403 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.403 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.403 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.403 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.403 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:22.421 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:22.422 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:22.422 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:22.422 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.422 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.422 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.422 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.423 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.423 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.423 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.423 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.423 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.423 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:22.444 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:22.444 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:22.444 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:22.444 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:22.444 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:22.444 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:22.444 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:22.445 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:22.445 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:22.445 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:22.445 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:22.445 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:22.445 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:22.462 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:22.462 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:22.462 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:22.462 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.463 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.463 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.463 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.463 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.463 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.463 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.463 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.463 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.463 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:22.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535542501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:22.511 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:32:22.512 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
18:32:22.541 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:22.542 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:22.542 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:22.542 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.542 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.542 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.543 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.543 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.543 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.543 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.543 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.544 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.544 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:22.603 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:22.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:21.269142  3423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:22.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:22.693764  3411 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.426s	user 0.510s	sys 0.883s
18:32:22.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:22.694185  3411 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.426s	user 0.510s	sys 0.883s
18:32:22.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:22.672658  3421 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 3411
18:32:22.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:22.696134  3425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:22.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:22.699409  3424 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
18:32:22.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.699436  3411 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:32:22.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.700980  3411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:32:22.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.704087  3411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:32:22.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.705513  3411 hybrid_clock.cc:648] HybridClock initialized: now 1783535542705449 us; error 71 us; skew 500 ppm
18:32:22.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.706593  3411 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:32:22.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.714566  3411 webserver.cc:534] Webserver started at http://127.3.43.188:37753/ using document root <none> and password file <none>
18:32:22.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.715924  3411 fs_manager.cc:362] Metadata directory not provided
18:32:22.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.716226  3411 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:32:22.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.716847  3411 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:32:22.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.723789  3411 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/data/instance:
18:32:22.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c0c218271cc04cb9861bba527b26da57"
18:32:22.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:22 on dist-test-slave-dxnw"
18:32:22.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.725349  3411 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/wal/instance:
18:32:22.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c0c218271cc04cb9861bba527b26da57"
18:32:22.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:22 on dist-test-slave-dxnw"
18:32:22.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.733752  3411 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.001s
18:32:22.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.740144  3442 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:32:22.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.741209  3411 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
18:32:22.741 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:22.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.741588  3411 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/wal
18:32:22.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c0c218271cc04cb9861bba527b26da57"
18:32:22.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:22 on dist-test-slave-dxnw"
18:32:22.742 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:22.742 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:22.742 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.742 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.742 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.742 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.742 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.742 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.741930  3411 fs_report.cc:389] FS layout report
18:32:22.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:32:22.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/wal
18:32:22.742 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.742 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.742 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.743 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:22.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/wal
18:32:22.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/data/data
18:32:22.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:32:22.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:32:22.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:32:22.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:32:22.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:32:22.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:32:22.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:32:22.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:32:22.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:32:22.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:32:22.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:32:22.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.800328  3411 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:32:22.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.801980  3411 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:32:22.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.802413  3411 kserver.cc:163] Server-wide thread pool size limit: 3276
18:32:22.806 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:22.807 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:22.807 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:22.807 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:22.807 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:22.807 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:22.807 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:22.808 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:22.808 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:22.808 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:22.808 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:22.808 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:22.808 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:22.808 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29825), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [15ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [18ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [50ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [114ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [114ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [121ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [124ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [124ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [143ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [143ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [162ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [203ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [204ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [263ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [264ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [264ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [341ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [343ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [343ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [344ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [344ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [403ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [403ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [782ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [782ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [783ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [783ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1443ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3041ms] refreshing cache from master, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3042ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3042ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3042ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3042ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3761ms] refreshing cache from master, [3761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3762ms] too many traces: truncated at 100 traces, deferred=Deferred@582325990(state=PENDING, result=null, callback=(continuation of Deferred@1424342643 after retry RPC after error@1861398967) -> (continuation of Deferred@657679044 after retry RPC after error@692048482) -> (continuation of Deferred@1347483408 after retry RPC after error@735353764) -> (continuation of Deferred@399374680 after retry RPC after error@1077318913) -> (continuation of Deferred@394855008 after retry RPC after error@403681934) -> (continuation of Deferred@1617993710 after retry RPC after error@337281148) -> (continuation of Deferred@1272912541 after retry RPC after error@782322346) -> (continuation of Deferred@1246379903 after retry RPC after error@177430314) -> (continuation of Deferred@959162135 after retry RPC after error@494624386) -> (continuation of Deferred@105982869 after retry RPC after error@380329594) -> (continuation of Deferred@1918652583 after retry RPC after error@890539808) -> (continuation of Deferred@974522260 after retry RPC after error@1979897378) -> (continuation of Deferred@1724606765 after retry RPC after error@2000127835) -> (continuation of Deferred@2107053198 after retry RPC after error@491024088) -> (continuation of Deferred@553381468 after retry RPC after error@1807595591) -> (continuation of Deferred@776725210 after retry RPC after error@273116005) -> (continuation of Deferred@1865547327 after retry RPC after error@1774717982) -> (continuation of Deferred@409239247 after retry RPC after error@869475045) -> (continuation of Deferred@1408496294 after retry RPC after error@2062724154) -> (continuation of Deferred@1096492973 after retry RPC after error@1807085929) -> (continuation of Deferred@656361595 after retry RPC after error@1222878174) -> (continuation of Deferred@1352500000 after retry RPC after error@350686947) -> (continuation of Deferred@1231470740 after retry RPC after error@483292981) -> (continuation of Deferred@553018127 after retry RPC after error@206234084) -> (continuation of Deferred@1943528089 after retry RPC after error@474960905) -> (continuation of Deferred@254976660 after retry RPC after error@1412183895), errback=(continuation of Deferred@1424342643 after retry RPC after error@1861398967) -> (continuation of Deferred@657679044 after retry RPC after error@692048482) -> (continuation of Deferred@1347483408 after retry RPC after error@735353764) -> (continuation of Deferred@399374680 after retry RPC after error@1077318913) -> (continuation of Deferred@394855008 after retry RPC after error@403681934) -> (continuation of Deferred@1617993710 after retry RPC after error@337281148) -> (continuation of Deferred@1272912541 after retry RPC after error@782322346) -> (continuation of Deferred@1246379903 after retry RPC after error@177430314) -> (continuation of Deferred@959162135 after retry RPC after error@494624386) -> (continuation of Deferred@105982869 after retry RPC after error@380329594) -> (continuation of Deferred@1918652583 after retry RPC after error@890539808) -> (continuation of Deferred@974522260 after retry RPC after error@1979897378) -> (continuation of Deferred@1724606765 after retry RPC after error@2000127835) -> (continuation of Deferred@2107053198 after retry RPC after error@491024088) -> (continuation of Deferred@553381468 after retry RPC after error@1807595591) -> (continuation of Deferred@776725210 after retry RPC after error@273116005) -> (continuation of Deferred@1865547327 after retry RPC after error@1774717982) -> (continuation of Deferred@409239247 after retry RPC after error@869475045) -> (continuation of Deferred@1408496294 after retry RPC after error@2062724154) -> (continuation of Deferred@1096492973 after retry RPC after error@1807085929) -> (continuation of Deferred@656361595 after retry RPC after error@1222878174) -> (continuation of Deferred@1352500000 after retry RPC after error@350686947) -> (continuation of Deferred@1231470740 after retry RPC after error@483292981) -> (continuation of Deferred@553018127 after retry RPC after error@206234084) -> (continuation of Deferred@1943528089 after retry RPC after error@474960905) -> (continuation of Deferred@254976660 after retry RPC after error@1412183895)))
18:32:22.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.809765  3327 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } attempt: 8
18:32:22.822 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:22.823 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:22.823 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:22.823 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:22.823 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:22.823 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:22.823 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:22.823 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:22.823 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:22.824 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:22.824 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:22.824 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:22.824 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:22.825 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29825), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [29ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [31ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [32ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [32ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [49ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [55ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [56ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [56ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [90ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [91ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [91ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [91ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [103ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [104ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [104ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [104ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [121ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [144ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [144ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [145ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [201ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [243ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [282ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [282ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [283ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [283ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [542ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [543ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1260ms] refreshing cache from master, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1263ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1801ms] refreshing cache from master, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1803ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1803ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1803ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1804ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [5541ms] refreshing cache from master, [5541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5542ms] too many traces: truncated at 100 traces, deferred=Deferred@1084215680(state=PENDING, result=null, callback=(continuation of Deferred@116572181 after retry RPC after error@1719494744) -> (continuation of Deferred@1373316681 after retry RPC after error@1870069283) -> (continuation of Deferred@2132044208 after retry RPC after error@1923539362) -> (continuation of Deferred@2051500241 after retry RPC after error@571999836) -> (continuation of Deferred@2115871302 after retry RPC after error@1005840342) -> (continuation of Deferred@2058555801 after retry RPC after error@419152501) -> (continuation of Deferred@199707838 after retry RPC after error@789497667) -> (continuation of Deferred@1297298658 after retry RPC after error@201174871) -> (continuation of Deferred@986611754 after retry RPC after error@1663266031) -> (continuation of Deferred@931373133 after retry RPC after error@1365387005) -> (continuation of Deferred@534979371 after retry RPC after error@1734303788) -> (continuation of Deferred@1299457346 after retry RPC after error@232892383) -> (continuation of Deferred@194848563 after retry RPC after error@392128620) -> (continuation of Deferred@2070741488 after retry RPC after error@2075299357) -> (continuation of Deferred@427072231 after retry RPC after error@1971621293) -> (continuation of Deferred@1727361132 after retry RPC after error@165202121) -> (continuation of Deferred@885442743 after retry RPC after error@1711198823) -> (continuation of Deferred@684046500 after retry RPC after error@1737794549) -> (continuation of Deferred@1704283328 after retry RPC after error@1986775039) -> (continuation of Deferred@1936605454 after retry RPC after error@833085341) -> (continuation of Deferred@2124117541 after retry RPC after error@1449595446) -> (continuation of Deferred@1468030917 after retry RPC after error@1481914783), errback=(continuation of Deferred@116572181 after retry RPC after error@1719494744) -> (continuation of Deferred@1373316681 after retry RPC after error@1870069283) -> (continuation of Deferred@2132044208 after retry RPC after error@1923539362) -> (continuation of Deferred@2051500241 after retry RPC after error@571999836) -> (continuation of Deferred@2115871302 after retry RPC after error@1005840342) -> (continuation of Deferred@2058555801 after retry RPC after error@419152501) -> (continuation of Deferred@199707838 after retry RPC after error@789497667) -> (continuation of Deferred@1297298658 after retry RPC after error@201174871) -> (continuation of Deferred@986611754 after retry RPC after error@1663266031) -> (continuation of Deferred@931373133 after retry RPC after error@1365387005) -> (continuation of Deferred@534979371 after retry RPC after error@1734303788) -> (continuation of Deferred@1299457346 after retry RPC after error@232892383) -> (continuation of Deferred@194848563 after retry RPC after error@392128620) -> (continuation of Deferred@2070741488 after retry RPC after error@2075299357) -> (continuation of Deferred@427072231 after retry RPC after error@1971621293) -> (continuation of Deferred@1727361132 after retry RPC after error@165202121) -> (continuation of Deferred@885442743 after retry RPC after error@1711198823) -> (continuation of Deferred@684046500 after retry RPC after error@1737794549) -> (continuation of Deferred@1704283328 after retry RPC after error@1986775039) -> (continuation of Deferred@1936605454 after retry RPC after error@833085341) -> (continuation of Deferred@2124117541 after retry RPC after error@1449595446) -> (continuation of Deferred@1468030917 after retry RPC after error@1481914783)))
18:32:22.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.827466  3327 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } has no permanent_uuid. Determining permanent_uuid...
18:32:22.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:22.833398  3327 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.43.188:36795: Network error: Client connection negotiation failed: client connection to 127.3.43.188:36795: connect: Connection refused (error 111)
18:32:22.841 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:22.841 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:22.841 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:22.842 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.842 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.842 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.842 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:22.842 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.842 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.842 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:22.842 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.842 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:22.842 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:22.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.898800  3327 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } attempt: 1
18:32:22.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.906492  3411 rpc_server.cc:307] RPC server started. Bound to: 127.3.43.188:36795
18:32:22.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.906560  3497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.43.188:36795 every 8 connection(s)
18:32:22.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.910951  3411 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/data/info.pb
18:32:22.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.921717  3246 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 3411
18:32:22.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.922339  3246 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/master-2/wal/instance
18:32:22.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.924186  3499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:22.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.942606  3499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } has no permanent_uuid. Determining permanent_uuid...
18:32:22.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.961587  3327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63: Bootstrap starting.
18:32:22.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.966523  3499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } has no permanent_uuid. Determining permanent_uuid...
18:32:22.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.970569  3327 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63: Neither blocks nor log segments found. Creating new log.
18:32:22.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.973238  3327 log.cc:826] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63: Log is configured to *not* fsync() on all Append() calls
18:32:22.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.983181  3499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } has no permanent_uuid. Determining permanent_uuid...
18:32:22.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:22.998916  3327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63: No bootstrap required, opened a new log
18:32:23.001 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535543001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:23.011 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:32:23.012 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
18:32:23.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.030943  3327 raft_consensus.cc:359] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } }
18:32:23.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.032169  3327 raft_consensus.cc:385] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:23.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.032648  3327 raft_consensus.cc:740] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dccd3d09c4904f18acbc8fa3ba91bd63, State: Initialized, Role: FOLLOWER
18:32:23.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.033849  3327 consensus_queue.cc:260] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } }
18:32:23.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.038272  3499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57: Bootstrap starting.
18:32:23.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.042873  3508 sys_catalog.cc:455] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } } }
18:32:23.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.046401  3327 sys_catalog.cc:565] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63 [sys.catalog]: configured and running, proceeding with master startup.
18:32:23.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.046782  3508 sys_catalog.cc:458] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63 [sys.catalog]: This master's current role is: FOLLOWER
18:32:23.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.053619  3499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57: Neither blocks nor log segments found. Creating new log.
18:32:23.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.055840  3499 log.cc:826] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57: Log is configured to *not* fsync() on all Append() calls
18:32:23.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.068732  3499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57: No bootstrap required, opened a new log
18:32:23.103 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:23.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:23.103884  3520 catalog_manager.cc:1593] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:32:23.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:23.104242  3520 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:32:23.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.103698  3499 raft_consensus.cc:359] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } }
18:32:23.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.104593  3499 raft_consensus.cc:385] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:23.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.104893  3499 raft_consensus.cc:740] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0c218271cc04cb9861bba527b26da57, State: Initialized, Role: FOLLOWER
18:32:23.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.106045  3499 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } }
18:32:23.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.112207  3522 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } } }
18:32:23.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.113247  3522 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [sys.catalog]: This master's current role is: FOLLOWER
18:32:23.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.113935  3499 sys_catalog.cc:565] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [sys.catalog]: configured and running, proceeding with master startup.
18:32:23.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.097417  3258 master_runner.cc:187] Error getting master registration for 127.3.43.189:32951: OK, instance_id { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" instance_seqno: 1783535540750317 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:32:23.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.135012  3258 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:32:23.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.137212  3522 raft_consensus.cc:493] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:23.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.137861  3522 raft_consensus.cc:515] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } }
18:32:23.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.142088  3302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0c218271cc04cb9861bba527b26da57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" is_pre_election: true
18:32:23.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.143265  3302 raft_consensus.cc:2468] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0c218271cc04cb9861bba527b26da57 in term 0.
18:32:23.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.143309  3522 leader_election.cc:290] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dccd3d09c4904f18acbc8fa3ba91bd63 (127.3.43.190:40613), 9a65d4fc06e14f2ab7a31b666ebfda31 (127.3.43.189:32951)
18:32:23.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.145591  3445 leader_election.cc:304] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0c218271cc04cb9861bba527b26da57, dccd3d09c4904f18acbc8fa3ba91bd63; no voters: 
18:32:23.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.146986  3522 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:32:23.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.147334  3522 raft_consensus.cc:493] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:32:23.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.147651  3522 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [term 0 FOLLOWER]: Advancing to term 1
18:32:23.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.150645  3409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } attempt: 7
18:32:23.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.162381  3522 raft_consensus.cc:515] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } }
18:32:23.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.167452  3302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0c218271cc04cb9861bba527b26da57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63"
18:32:23.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.168068  3302 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63 [term 0 FOLLOWER]: Advancing to term 1
18:32:23.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.168810  3522 leader_election.cc:290] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [CANDIDATE]: Term 1 election: Requested vote from peers dccd3d09c4904f18acbc8fa3ba91bd63 (127.3.43.190:40613), 9a65d4fc06e14f2ab7a31b666ebfda31 (127.3.43.189:32951)
18:32:23.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.176226  3302 raft_consensus.cc:2468] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0c218271cc04cb9861bba527b26da57 in term 1.
18:32:23.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.177989  3445 leader_election.cc:304] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0c218271cc04cb9861bba527b26da57, dccd3d09c4904f18acbc8fa3ba91bd63; no voters: 
18:32:23.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.178815  3522 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [term 1 FOLLOWER]: Leader election won for term 1
18:32:23.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.220155  3522 raft_consensus.cc:697] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [term 1 LEADER]: Becoming Leader. State: Replica: c0c218271cc04cb9861bba527b26da57, State: Running, Role: LEADER
18:32:23.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.221457  3522 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } }
18:32:23.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.226281  3409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31: Bootstrap starting.
18:32:23.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:23.235033  3281 tablet.cc:2406] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:32:23.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.247944  3409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31: Neither blocks nor log segments found. Creating new log.
18:32:23.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.257050  3409 log.cc:826] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31: Log is configured to *not* fsync() on all Append() calls
18:32:23.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.257164  3535 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0c218271cc04cb9861bba527b26da57. Latest consensus state: current_term: 1 leader_uuid: "c0c218271cc04cb9861bba527b26da57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } } }
18:32:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.258091  3535 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [sys.catalog]: This master's current role is: LEADER
18:32:23.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:23.270337  3534 catalog_manager.cc:1593] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:32:23.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:23.270700  3534 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:32:23.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.287268  3539 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:32:23.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.196163  3411 master_runner.cc:187] Error getting master registration for 127.3.43.189:32951: OK, instance_id { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" instance_seqno: 1783535540750317 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:32:23.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.301656  3411 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:32:23.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:23.308809  3448 tablet.cc:2406] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:32:23.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.325804  3409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31: No bootstrap required, opened a new log
18:32:23.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.347020  3539 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:32:23.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.359707  3409 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } }
18:32:23.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.360622  3409 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:23.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.360924  3409 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a65d4fc06e14f2ab7a31b666ebfda31, State: Initialized, Role: FOLLOWER
18:32:23.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.362120  3409 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } }
18:32:23.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.376811  3383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0c218271cc04cb9861bba527b26da57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" is_pre_election: true
18:32:23.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.376926  3382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0c218271cc04cb9861bba527b26da57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31"
18:32:23.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.377938  3383 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0c218271cc04cb9861bba527b26da57 in term 0.
18:32:23.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.381022  3409 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31 [sys.catalog]: configured and running, proceeding with master startup.
18:32:23.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.381894  3541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } } }
18:32:23.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.382764  3541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31 [sys.catalog]: This master's current role is: FOLLOWER
18:32:23.406 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:23.406 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:23.406 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:23.407 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:23.407 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:23.407 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:23.407 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:23.407 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:23.408 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:23.408 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:23.408 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:23.408 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:23.408 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:23.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.416105  3382 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31 [term 0 FOLLOWER]: Advancing to term 1
18:32:23.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.433982  3382 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31 [term 1 FOLLOWER]: Refusing update from remote peer c0c218271cc04cb9861bba527b26da57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:32:23.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.435824  3535 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:23.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:23.441531  3360 tablet.cc:2406] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:32:23.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.449455  3302 raft_consensus.cc:1275] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63 [term 1 FOLLOWER]: Refusing update from remote peer c0c218271cc04cb9861bba527b26da57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:32:23.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.451098  3535 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:23.463 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:23.464 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:23.464 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:23.464 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:23.464 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:23.464 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:23.464 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:23.464 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:23.464 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:23.464 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:23.464 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:23.465 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:23.465 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:23.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.480520  3541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0c218271cc04cb9861bba527b26da57. Latest consensus state: current_term: 1 leader_uuid: "c0c218271cc04cb9861bba527b26da57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } } }
18:32:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.494009  3545 mvcc.cc:204] Tried to move back new op lower bound from 7305361585815912448 to 7305361585046532096. Current Snapshot: MvccSnapshot[applied={T|T < 7305361585815912448}]
18:32:23.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535543501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:23.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.484086  3541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31 [sys.catalog]: This master's current role is: FOLLOWER
18:32:23.512 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:32:23.513 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
18:32:23.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.529199  3508 sys_catalog.cc:455] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0c218271cc04cb9861bba527b26da57. Latest consensus state: current_term: 1 leader_uuid: "c0c218271cc04cb9861bba527b26da57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } } }
18:32:23.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.530058  3508 sys_catalog.cc:458] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63 [sys.catalog]: This master's current role is: FOLLOWER
18:32:23.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.542997  3522 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c0c218271cc04cb9861bba527b26da57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } } }
18:32:23.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.543726  3522 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [sys.catalog]: This master's current role is: LEADER
18:32:23.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.553795  3541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c0c218271cc04cb9861bba527b26da57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } } }
18:32:23.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.554747  3541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31 [sys.catalog]: This master's current role is: FOLLOWER
18:32:23.566 [DEBUG - pool-150-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30001), Traces: [0ms] sending RPC to server master-127.0.106.254:32967, [3ms] received response from server master-127.0.106.254:32967: OK, deferred=null) with no deferred attached!
18:32:23.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.577143  3535 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c0c218271cc04cb9861bba527b26da57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } } }
18:32:23.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.584599  3535 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 [sys.catalog]: This master's current role is: LEADER
18:32:23.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.587044  3508 sys_catalog.cc:455] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c0c218271cc04cb9861bba527b26da57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dccd3d09c4904f18acbc8fa3ba91bd63" member_type: VOTER last_known_addr { host: "127.3.43.190" port: 40613 } } peers { permanent_uuid: "9a65d4fc06e14f2ab7a31b666ebfda31" member_type: VOTER last_known_addr { host: "127.3.43.189" port: 32951 } } peers { permanent_uuid: "c0c218271cc04cb9861bba527b26da57" member_type: VOTER last_known_addr { host: "127.3.43.188" port: 36795 } } }
18:32:23.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.588012  3508 sys_catalog.cc:458] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63 [sys.catalog]: This master's current role is: FOLLOWER
18:32:23.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.588263  3539 catalog_manager.cc:1382] Generated new cluster ID: cf4d5206555642188fef45efd39bdd34
18:32:23.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.588568  3539 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:32:23.603 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:23.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.665407  3563 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
18:32:23.683 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:23.684 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:23.684 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:23.685 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:23.685 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:23.685 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:23.686 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:23.686 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:23.686 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:23.686 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:23.686 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:23.686 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:23.686 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:23.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.722675  3539 catalog_manager.cc:1405] Generated new certificate authority record
18:32:23.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.725044  3539 catalog_manager.cc:1539] Loading token signing keys...
18:32:23.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.759999  3539 catalog_manager.cc:6069] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57: Generated new TSK 0
18:32:23.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.761472  3539 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:32:23.782 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:23.782 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:23.782 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:23.783 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:23.783 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:23.783 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:23.783 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:23.783 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:23.783 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:23.783 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:23.783 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:23.783 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:23.783 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:23.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:23.806326  3246 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:23.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:23.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/wal
18:32:23.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/data
18:32:23.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/logs
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/data/info.pb
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.43.129:0
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.43.129
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.43.129
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.43.190:40613,127.3.43.189:32951,127.3.43.188:36795
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.43.148:38361
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:23.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:32:23.952 [DEBUG - pool-154-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30003), Traces: [0ms] sending RPC to server master-127.1.59.188:33901, [19ms] received response from server master-127.1.59.188:33901: OK, deferred=null) with no deferred attached!
18:32:23.952 [DEBUG - pool-154-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30002), Traces: [0ms] sending RPC to server master-127.1.59.188:33901, [19ms] received response from server master-127.1.59.188:33901: OK, deferred=null) with no deferred attached!
18:32:23.972 [DEBUG - pool-154-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30007), Traces: [0ms] sending RPC to server master-127.1.59.188:33901, [7ms] received response from server master-127.1.59.188:33901: OK, deferred=null) with no deferred attached!
18:32:24.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535544001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:24.013 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:32:24.014 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
18:32:24.103 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:24.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:24.110214  3520 catalog_manager.cc:1294] Loaded cluster ID: cf4d5206555642188fef45efd39bdd34
18:32:24.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:24.110899  3520 catalog_manager.cc:1587] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63: loading cluster ID for follower catalog manager: success
18:32:24.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:24.118599  3520 catalog_manager.cc:1609] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63: acquiring CA information for follower catalog manager: success
18:32:24.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:24.144302  3520 catalog_manager.cc:1637] T 00000000000000000000000000000000 P dccd3d09c4904f18acbc8fa3ba91bd63: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:32:24.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:24.386689  3564 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:32:24.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:24.387372  3564 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:32:24.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:24.388116  3564 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:32:24.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:24.452374  3564 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:32:24.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:24.453756  3564 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.43.129
18:32:24.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535544501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:24.511 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:32:24.513 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:24.521497  3564 tablet_server_runner.cc:78] Tablet server non-default flags:
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.43.148:38361
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/data
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/wal
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.43.129:0
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/data/info.pb
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.43.129
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.43.190:40613,127.3.43.189:32951,127.3.43.188:36795
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.43.129
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/logs
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:32:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:32:24.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:24.523370  3564 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:32:24.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:24.525512  3564 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:32:24.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:24.559721  3574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:24.602 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:24.673 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:24.673 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:24.673 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:24.673 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:24.673 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:24.673 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:24.673 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:24.673 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:24.673 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:24.674 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:24.674 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:24.674 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:24.674 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:24.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:24.675529  3563 catalog_manager.cc:1294] Loaded cluster ID: cf4d5206555642188fef45efd39bdd34
18:32:24.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:24.675987  3563 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31: loading cluster ID for follower catalog manager: success
18:32:24.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:24.692988  3563 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31: acquiring CA information for follower catalog manager: success
18:32:24.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:24.708038  3563 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 9a65d4fc06e14f2ab7a31b666ebfda31: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:32:24.978 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:24.979 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:24.979 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:24.979 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:24.979 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:24.980 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:24.980 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:24.980 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:24.980 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:24.980 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:24.980 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:24.980 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:24.980 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:25.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535545001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:25.016 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
18:32:25.018 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
18:32:25.102 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:25.237 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:25.238 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:25.238 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:25.238 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:25.238 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:25.238 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:25.238 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:25.238 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:25.239 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:25.239 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:25.239 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:25.239 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:25.239 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:25.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535545501 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:25.513 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:32:25.514 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
18:32:25.554 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RESTARTING to RUNNING.
18:32:25.554 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job fa73e37017778341a79e5b3ef3d55eb9 from Checkpoint 69 @ 1783535448409 for fa73e37017778341a79e5b3ef3d55eb9 located at file:/tmp/junit12731664100414606042/checkpoints/fa73e37017778341a79e5b3ef3d55eb9/chk-69.
18:32:25.555 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
18:32:25.556 [INFO - flink-pekko.actor.default-dispatcher-5] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:32:25.556 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to SCHEDULED.
18:32:25.558 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:32:25.558 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from SCHEDULED to DEPLOYING.
18:32:25.558 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #5) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 1623ba59e704d1676486c6f13d60068c
18:32:25.559 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to SCHEDULED.
18:32:25.559 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 1623ba59e704d1676486c6f13d60068c.
18:32:25.560 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_5), deploy into slot with allocation id 1623ba59e704d1676486c6f13d60068c.
18:32:25.562 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:32:25.562 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from SCHEDULED to DEPLOYING.
18:32:25.563 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #5) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 409256c48f07c3602c01f545df4e7b3c
18:32:25.563 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to SCHEDULED.
18:32:25.563 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:32:25.565 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from SCHEDULED to DEPLOYING.
18:32:25.565 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #4) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 120c9de24dd4d7d83c84cb1a65b36252
18:32:25.566 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to SCHEDULED.
18:32:25.566 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 409256c48f07c3602c01f545df4e7b3c.
18:32:25.567 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from SCHEDULED to DEPLOYING.
18:32:25.567 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #5) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d
18:32:25.567 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_5), deploy into slot with allocation id 409256c48f07c3602c01f545df4e7b3c.
18:32:25.567 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:32:25.568 [INFO - Thread-31] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:32:25.569 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to DEPLOYING.
18:32:25.569 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) [DEPLOYING].
18:32:25.569 [DEBUG - Thread-31] (Connection.java:575) [peer master-127.28.68.190:40429(127.28.68.190:40429)] disconnecting while in state TERMINATED
18:32:25.570 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@17e7b545
18:32:25.570 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:25.570 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:32:25.570 [DEBUG - Thread-31] (Connection.java:575) [peer master-127.28.68.188:38393(127.28.68.188:38393)] disconnecting while in state TERMINATED
18:32:25.570 [DEBUG - Thread-31] (Connection.java:575) [peer master-127.28.68.189:33753(127.28.68.189:33753)] disconnecting while in state TERMINATED
18:32:25.571 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:25.576 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
18:32:25.576 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
18:32:25.578 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 120c9de24dd4d7d83c84cb1a65b36252.
18:32:25.579 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to DEPLOYING.
18:32:25.579 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) [DEPLOYING].
18:32:25.580 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@ba929a
18:32:25.580 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:25.580 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:32:25.580 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
18:32:25.580 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
18:32:25.581 [INFO - Thread-31] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:32:25.581 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_4), deploy into slot with allocation id 120c9de24dd4d7d83c84cb1a65b36252.
18:32:25.582 [INFO - Thread-31] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:32:25.585 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@39ce09f2
18:32:25.591 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@508e0850
18:32:25.592 [DEBUG - Thread-31] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:25.593 [INFO - Thread-31] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:32:25.597 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:25.600 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:25.600 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot fe2a3c24d55fce5c8d5a55c4e880b53d.
18:32:25.601 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_5), deploy into slot with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d.
18:32:25.602 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to DEPLOYING.
18:32:25.602 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_4) [DEPLOYING].
18:32:25.602 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:25.603 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3f46b136
18:32:25.603 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:25.604 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:32:25.604 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
18:32:25.604 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
18:32:25.607 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to DEPLOYING.
18:32:25.607 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) [DEPLOYING].
18:32:25.607 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@348fe213
18:32:25.607 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:25.608 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:32:25.609 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@31cd32c7
18:32:25.610 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:25.616 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
18:32:25.617 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
18:32:25.620 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7b15402e
18:32:25.634 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:25.635 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.637 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.646 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:25.646 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:25.646 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:25.646 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:25.647 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.654 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.659 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.660 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.660 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.660 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.667 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.668 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.668 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.668 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.671 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.671 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.672 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.672 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.672 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.673 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.673 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.673 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.673 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.673 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.673 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.674 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.675 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.687 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.688 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.688 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.688 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.689 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.689 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.689 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.689 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.690 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.690 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.690 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.691 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.695 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:25.695 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.695 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.695 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.695 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.695 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:25.695 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:25.695 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:25.695 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:25.696 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:25.696 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:25.696 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:25.696 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:25.696 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.696 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:25.696 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:25.696 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:25.696 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:25.696 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.697 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.697 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.697 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.697 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.698 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.698 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.698 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.699 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.700 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.700 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.700 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.701 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.701 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.701 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.701 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.702 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.702 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.702 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.702 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.703 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.703 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.704 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.704 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.704 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.704 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.705 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.705 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.705 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.705 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.705 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.705 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.706 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.706 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.706 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.707 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.707 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.709 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.709 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.709 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.709 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.710 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.710 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.710 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.710 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.710 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.710 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.706 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.710 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.712 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:25.712 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:25.713 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:25.714 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.714 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.714 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.714 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.714 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.715 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.715 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.715 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.715 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.716 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.716 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.717 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.720 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:25.727 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.731 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.732 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.732 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.732 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.733 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:25.735 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.736 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.736 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.737 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.747 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.747 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.747 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.748 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.748 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.749 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.749 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.749 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.754 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.754 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.755 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.755 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.755 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.755 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.755 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.755 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.755 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.757 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:25.758 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.758 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.758 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.761 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:25.762 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.762 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.762 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.767 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.767 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.767 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.767 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.767 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.767 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.767 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.768 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.768 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.768 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.768 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.768 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.768 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.769 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.769 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.769 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.769 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:25.776 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.777 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.777 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.777 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.787 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.787 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.787 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.787 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.787 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.787 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.788 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.788 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.788 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.788 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.788 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.788 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.788 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.788 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.788 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.788 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.788 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.789 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.789 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.789 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.789 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.789 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.790 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.790 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.790 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.790 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.791 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.791 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.791 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.791 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.791 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.791 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.791 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.792 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:25.794 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.795 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.795 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.795 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.795 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.795 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.795 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.795 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.795 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.796 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.796 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.796 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.796 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.803 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.804 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.804 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.804 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.805 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.805 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.806 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.806 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.806 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.806 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.806 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.806 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.814 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.815 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.815 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.815 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.815 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.815 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.815 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.815 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.816 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.816 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.816 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.816 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.816 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.816 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.816 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.815 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.816 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.816 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.816 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.816 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.816 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.816 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.816 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.816 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.817 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.817 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.817 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:25.817 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.818 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.818 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.818 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.818 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.818 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.818 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.818 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.818 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.819 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.819 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.819 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.819 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.819 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:25.819 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.819 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.820 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.820 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.818 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.820 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.820 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.820 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.820 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.820 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:25.827 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.827 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.828 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.828 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.828 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.828 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.828 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.829 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.829 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.829 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.829 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.829 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.829 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.832 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:25.833 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:25.833 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.833 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:25.833 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.833 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.833 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.833 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.833 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.833 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.833 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.833 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.833 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:25.834 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.834 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.835 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.835 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.835 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.835 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.836 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.836 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.836 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.836 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.836 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.836 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.836 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.837 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.838 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.838 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.838 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.838 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.838 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.838 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.838 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.838 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.839 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.840 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.840 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.840 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.840 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:25.852 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:25.853 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:25.853 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:25.853 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.854 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.854 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.854 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.854 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.854 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.855 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.855 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.855 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.855 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:25.855 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.855 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.855 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.856 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.856 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.856 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.856 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.856 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.856 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.857 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.857 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.857 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.857 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.861 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:25.861 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:25.861 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:25.862 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:25.862 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:25.862 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:25.862 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:25.862 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:25.862 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:25.863 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:25.863 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:25.863 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:25.863 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:25.872 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:25.873 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:25.873 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:25.873 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.873 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.873 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.873 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.873 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.873 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.875 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.875 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.875 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.875 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:25.875 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.876 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.876 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.876 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.876 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.876 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.876 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.876 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.877 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.877 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.877 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.877 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.877 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.877 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.877 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.877 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.877 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.877 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.877 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.878 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.878 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.878 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.878 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.878 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.878 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.878 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.878 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.878 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.879 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.879 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.879 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.879 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.879 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.879 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.878 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.879 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.880 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.880 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.880 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.887 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.887 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.888 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.888 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.888 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.888 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.888 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.888 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.889 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.889 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.889 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.888 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.889 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.933 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:25.933 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:25.933 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:25.934 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.934 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.934 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:25.935 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.935 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.935 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:25.935 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.935 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.935 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:25.935 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:25.937 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.937 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.938 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.938 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.938 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.938 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.938 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.939 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.939 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.939 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.939 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.939 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.939 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.954 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.954 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.955 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.955 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.955 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.955 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.956 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.956 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.956 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.956 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.957 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.957 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.957 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.957 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.957 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.957 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.957 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.957 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.957 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.958 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.958 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.958 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.958 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.958 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.958 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.958 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:25.967 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:25.967 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:25.968 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:25.968 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.968 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.968 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:25.969 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.969 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.969 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:25.969 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.969 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.969 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:25.969 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:26.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535546001 for job 4cd649562a0f5305571102b5c888c5a9.
18:32:26.017 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 4cd649562a0f5305571102b5c888c5a9 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
18:32:26.020 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
18:32:26.033 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:26.034 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:26.034 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:26.034 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:26.034 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:26.034 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:26.034 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:26.034 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:26.035 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:26.035 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:26.035 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:26.034 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:26.035 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:26.054 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:26.054 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:26.055 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.055 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.055 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.056 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:26.056 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.056 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.056 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.057 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.057 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.057 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.057 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:26.057 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:26.058 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:26.058 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:26.058 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.058 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.058 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.059 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.059 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.059 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.059 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.059 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.059 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.060 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:26.078 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:26.079 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.079 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.079 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.079 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:26.079 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:26.080 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.080 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.080 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.080 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.081 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.081 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.081 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:26.087 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:26.087 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:26.087 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:26.087 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.088 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.088 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.088 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.088 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.087 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.088 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.088 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.088 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.088 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:26.103 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:26.133 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:26.133 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:26.133 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:26.134 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:26.134 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:26.134 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:26.135 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:26.135 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:26.135 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:26.135 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:26.135 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:26.135 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:26.135 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:26.175 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:26.176 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:26.176 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:26.183 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.183 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.183 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.184 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.184 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.184 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.184 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.184 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.184 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.184 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:26.216 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:26.216 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:26.216 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:26.216 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.216 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.216 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.217 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.217 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.217 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.217 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.217 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.217 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.217 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:26.255 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:26.255 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:26.255 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:26.256 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:26.256 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:26.256 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:26.257 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:26.257 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:26.257 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:26.257 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:26.257 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:26.257 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:26.258 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:26.266 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:26.266 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:26.267 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:26.267 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:26.267 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.267 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.267 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.267 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.268 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.268 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.268 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.268 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.268 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.268 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.268 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.268 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:26.269 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:26.269 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:26.269 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.269 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.269 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.270 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.270 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.270 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.270 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.270 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:26.271 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=28746), Traces: [0ms] sending RPC to server master-127.0.106.254:32967, [1ms] received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [24ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [24ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [26ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [26ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [43ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [43ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [43ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [43ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [63ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [83ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [83ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [83ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [83ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [104ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [104ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [144ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [144ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [144ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [241ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [243ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [284ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [521ms] refreshing cache from master, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [523ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [523ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [523ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [524ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [982ms] refreshing cache from master, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [984ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [984ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [984ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [984ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1821ms] refreshing cache from master, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1822ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [3522ms] refreshing cache from master, [3522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [3523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [3523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [3524ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [3525ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [3525ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [3526ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [7001ms] refreshing cache from master, [7001ms] too many traces: truncated at 100 traces, deferred=Deferred@1988333244(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@3369f16c -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1993268586 after retry RPC after error@1453805927) -> (continuation of Deferred@1010553697 after retry RPC after error@1084602139) -> (continuation of Deferred@1073743848 after retry RPC after error@750799590) -> (continuation of Deferred@1308763332 after retry RPC after error@603082608) -> (continuation of Deferred@1670198177 after retry RPC after error@1303695948) -> (continuation of Deferred@307227450 after retry RPC after error@595046348) -> (continuation of Deferred@695046200 after retry RPC after error@1109397995) -> (continuation of Deferred@794502318 after retry RPC after error@827127622) -> (continuation of Deferred@1952800007 after retry RPC after error@906540329) -> (continuation of Deferred@1073776914 after retry RPC after error@371237011) -> (continuation of Deferred@1223903797 after retry RPC after error@1000415231) -> (continuation of Deferred@2133678464 after retry RPC after error@1813662414) -> (continuation of Deferred@1047136154 after retry RPC after error@226994511) -> (continuation of Deferred@410193958 after retry RPC after error@646014428) -> (continuation of Deferred@1211756609 after retry RPC after error@2026169816) -> (continuation of Deferred@2025208006 after retry RPC after error@1437863305) -> (continuation of Deferred@1384662150 after retry RPC after error@222138666) -> (continuation of Deferred@1141176387 after retry RPC after error@824802575) -> (continuation of Deferred@555066328 after retry RPC after error@1086374417) -> (continuation of Deferred@602274986 after retry RPC after error@1499348188) -> (continuation of Deferred@1431920460 after retry RPC after error@323997628) -> (continuation of Deferred@524513747 after retry RPC after error@928187963) -> (continuation of Deferred@678403234 after retry RPC after error@1169200188), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1993268586 after retry RPC after error@1453805927) -> (continuation of Deferred@1010553697 after retry RPC after error@1084602139) -> (continuation of Deferred@1073743848 after retry RPC after error@750799590) -> (continuation of Deferred@1308763332 after retry RPC after error@603082608) -> (continuation of Deferred@1670198177 after retry RPC after error@1303695948) -> (continuation of Deferred@307227450 after retry RPC after error@595046348) -> (continuation of Deferred@695046200 after retry RPC after error@1109397995) -> (continuation of Deferred@794502318 after retry RPC after error@827127622) -> (continuation of Deferred@1952800007 after retry RPC after error@906540329) -> (continuation of Deferred@1073776914 after retry RPC after error@371237011) -> (continuation of Deferred@1223903797 after retry RPC after error@1000415231) -> (continuation of Deferred@2133678464 after retry RPC after error@1813662414) -> (continuation of Deferred@1047136154 after retry RPC after error@226994511) -> (continuation of Deferred@410193958 after retry RPC after error@646014428) -> (continuation of Deferred@1211756609 after retry RPC after error@2026169816) -> (continuation of Deferred@2025208006 after retry RPC after error@1437863305) -> (continuation of Deferred@1384662150 after retry RPC after error@222138666) -> (continuation of Deferred@1141176387 after retry RPC after error@824802575) -> (continuation of Deferred@555066328 after retry RPC after error@1086374417) -> (continuation of Deferred@602274986 after retry RPC after error@1499348188) -> (continuation of Deferred@1431920460 after retry RPC after error@323997628) -> (continuation of Deferred@524513747 after retry RPC after error@928187963) -> (continuation of Deferred@678403234 after retry RPC after error@1169200188)))
18:32:26.272 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:26.272 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:26.272 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=28746), Traces: [0ms] sending RPC to server master-127.0.106.254:32967, [1ms] received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [24ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [24ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [26ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [26ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [43ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [43ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [43ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [43ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [63ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [83ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [83ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [83ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [83ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [104ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [104ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [144ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [144ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [144ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [241ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [243ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [284ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [521ms] refreshing cache from master, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [523ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [523ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [523ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [524ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [982ms] refreshing cache from master, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [984ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [984ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [984ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [984ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1821ms] refreshing cache from master, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1822ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [3522ms] refreshing cache from master, [3522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [3523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [3523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [3524ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [3525ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [3525ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [3526ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [7001ms] refreshing cache from master, [7001ms] too many traces: truncated at 100 traces, deferred=Deferred@1988333244(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@3369f16c -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1993268586 after retry RPC after error@1453805927) -> (continuation of Deferred@1010553697 after retry RPC after error@1084602139) -> (continuation of Deferred@1073743848 after retry RPC after error@750799590) -> (continuation of Deferred@1308763332 after retry RPC after error@603082608) -> (continuation of Deferred@1670198177 after retry RPC after error@1303695948) -> (continuation of Deferred@307227450 after retry RPC after error@595046348) -> (continuation of Deferred@695046200 after retry RPC after error@1109397995) -> (continuation of Deferred@794502318 after retry RPC after error@827127622) -> (continuation of Deferred@1952800007 after retry RPC after error@906540329) -> (continuation of Deferred@1073776914 after retry RPC after error@371237011) -> (continuation of Deferred@1223903797 after retry RPC after error@1000415231) -> (continuation of Deferred@2133678464 after retry RPC after error@1813662414) -> (continuation of Deferred@1047136154 after retry RPC after error@226994511) -> (continuation of Deferred@410193958 after retry RPC after error@646014428) -> (continuation of Deferred@1211756609 after retry RPC after error@2026169816) -> (continuation of Deferred@2025208006 after retry RPC after error@1437863305) -> (continuation of Deferred@1384662150 after retry RPC after error@222138666) -> (continuation of Deferred@1141176387 after retry RPC after error@824802575) -> (continuation of Deferred@555066328 after retry RPC after error@1086374417) -> (continuation of Deferred@602274986 after retry RPC after error@1499348188) -> (continuation of Deferred@1431920460 after retry RPC after error@323997628) -> (continuation of Deferred@524513747 after retry RPC after error@928187963) -> (continuation of Deferred@678403234 after retry RPC after error@1169200188), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1993268586 after retry RPC after error@1453805927) -> (continuation of Deferred@1010553697 after retry RPC after error@1084602139) -> (continuation of Deferred@1073743848 after retry RPC after error@750799590) -> (continuation of Deferred@1308763332 after retry RPC after error@603082608) -> (continuation of Deferred@1670198177 after retry RPC after error@1303695948) -> (continuation of Deferred@307227450 after retry RPC after error@595046348) -> (continuation of Deferred@695046200 after retry RPC after error@1109397995) -> (continuation of Deferred@794502318 after retry RPC after error@827127622) -> (continuation of Deferred@1952800007 after retry RPC after error@906540329) -> (continuation of Deferred@1073776914 after retry RPC after error@371237011) -> (continuation of Deferred@1223903797 after retry RPC after error@1000415231) -> (continuation of Deferred@2133678464 after retry RPC after error@1813662414) -> (continuation of Deferred@1047136154 after retry RPC after error@226994511) -> (continuation of Deferred@410193958 after retry RPC after error@646014428) -> (continuation of Deferred@1211756609 after retry RPC after error@2026169816) -> (continuation of Deferred@2025208006 after retry RPC after error@1437863305) -> (continuation of Deferred@1384662150 after retry RPC after error@222138666) -> (continuation of Deferred@1141176387 after retry RPC after error@824802575) -> (continuation of Deferred@555066328 after retry RPC after error@1086374417) -> (continuation of Deferred@602274986 after retry RPC after error@1499348188) -> (continuation of Deferred@1431920460 after retry RPC after error@323997628) -> (continuation of Deferred@524513747 after retry RPC after error@928187963) -> (continuation of Deferred@678403234 after retry RPC after error@1169200188)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=28746), Traces: [0ms] sending RPC to server master-127.0.106.254:32967, [1ms] received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [24ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [24ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [26ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [26ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [43ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [43ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [43ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [43ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [63ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [83ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [83ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [83ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [83ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [104ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [104ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [144ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [144ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [144ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [241ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [243ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [284ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [521ms] refreshing cache from master, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [523ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [523ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [523ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [524ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [982ms] refreshing cache from master, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [984ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [984ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [984ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [984ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1821ms] refreshing cache from master, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1822ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [3522ms] refreshing cache from master, [3522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [3523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [3523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [3524ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [3525ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [3525ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [3526ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [7001ms] refreshing cache from master, [7001ms] too many traces: truncated at 100 traces, deferred=Deferred@1988333244(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@3369f16c -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1993268586 after retry RPC after error@1453805927) -> (continuation of Deferred@1010553697 after retry RPC after error@1084602139) -> (continuation of Deferred@1073743848 after retry RPC after error@750799590) -> (continuation of Deferred@1308763332 after retry RPC after error@603082608) -> (continuation of Deferred@1670198177 after retry RPC after error@1303695948) -> (continuation of Deferred@307227450 after retry RPC after error@595046348) -> (continuation of Deferred@695046200 after retry RPC after error@1109397995) -> (continuation of Deferred@794502318 after retry RPC after error@827127622) -> (continuation of Deferred@1952800007 after retry RPC after error@906540329) -> (continuation of Deferred@1073776914 after retry RPC after error@371237011) -> (continuation of Deferred@1223903797 after retry RPC after error@1000415231) -> (continuation of Deferred@2133678464 after retry RPC after error@1813662414) -> (continuation of Deferred@1047136154 after retry RPC after error@226994511) -> (continuation of Deferred@410193958 after retry RPC after error@646014428) -> (continuation of Deferred@1211756609 after retry RPC after error@2026169816) -> (continuation of Deferred@2025208006 after retry RPC after error@1437863305) -> (continuation of Deferred@1384662150 after retry RPC after error@222138666) -> (continuation of Deferred@1141176387 after retry RPC after error@824802575) -> (continuation of Deferred@555066328 after retry RPC after error@1086374417) -> (continuation of Deferred@602274986 after retry RPC after error@1499348188) -> (continuation of Deferred@1431920460 after retry RPC after error@323997628) -> (continuation of Deferred@524513747 after retry RPC after error@928187963) -> (continuation of Deferred@678403234 after retry RPC after error@1169200188), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1993268586 after retry RPC after error@1453805927) -> (continuation of Deferred@1010553697 after retry RPC after error@1084602139) -> (continuation of Deferred@1073743848 after retry RPC after error@750799590) -> (continuation of Deferred@1308763332 after retry RPC after error@603082608) -> (continuation of Deferred@1670198177 after retry RPC after error@1303695948) -> (continuation of Deferred@307227450 after retry RPC after error@595046348) -> (continuation of Deferred@695046200 after retry RPC after error@1109397995) -> (continuation of Deferred@794502318 after retry RPC after error@827127622) -> (continuation of Deferred@1952800007 after retry RPC after error@906540329) -> (continuation of Deferred@1073776914 after retry RPC after error@371237011) -> (continuation of Deferred@1223903797 after retry RPC after error@1000415231) -> (continuation of Deferred@2133678464 after retry RPC after error@1813662414) -> (continuation of Deferred@1047136154 after retry RPC after error@226994511) -> (continuation of Deferred@410193958 after retry RPC after error@646014428) -> (continuation of Deferred@1211756609 after retry RPC after error@2026169816) -> (continuation of Deferred@2025208006 after retry RPC after error@1437863305) -> (continuation of Deferred@1384662150 after retry RPC after error@222138666) -> (continuation of Deferred@1141176387 after retry RPC after error@824802575) -> (continuation of Deferred@555066328 after retry RPC after error@1086374417) -> (continuation of Deferred@602274986 after retry RPC after error@1499348188) -> (continuation of Deferred@1431920460 after retry RPC after error@323997628) -> (continuation of Deferred@524513747 after retry RPC after error@928187963) -> (continuation of Deferred@678403234 after retry RPC after error@1169200188)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.0.106.254:32967
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:26.273 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.273 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.273 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.272 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:26.273 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.273 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.273 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.273 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.275 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.275 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.275 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:26.280 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=28746), Traces: [0ms] sending RPC to server master-127.0.106.254:32967, [1ms] received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [24ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [24ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [26ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [26ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [43ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [43ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [43ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [43ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [63ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [83ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [83ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [83ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [83ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [104ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [104ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [144ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [144ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [144ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [241ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [243ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [284ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [521ms] refreshing cache from master, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [523ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [523ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [523ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [524ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [982ms] refreshing cache from master, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [984ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [984ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [984ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [984ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1821ms] refreshing cache from master, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1822ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [3522ms] refreshing cache from master, [3522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [3523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [3523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [3524ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [3525ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [3525ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [3526ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [7001ms] refreshing cache from master, [7001ms] too many traces: truncated at 100 traces, deferred=Deferred@1988333244(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@3369f16c -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1993268586 after retry RPC after error@1453805927) -> (continuation of Deferred@1010553697 after retry RPC after error@1084602139) -> (continuation of Deferred@1073743848 after retry RPC after error@750799590) -> (continuation of Deferred@1308763332 after retry RPC after error@603082608) -> (continuation of Deferred@1670198177 after retry RPC after error@1303695948) -> (continuation of Deferred@307227450 after retry RPC after error@595046348) -> (continuation of Deferred@695046200 after retry RPC after error@1109397995) -> (continuation of Deferred@794502318 after retry RPC after error@827127622) -> (continuation of Deferred@1952800007 after retry RPC after error@906540329) -> (continuation of Deferred@1073776914 after retry RPC after error@371237011) -> (continuation of Deferred@1223903797 after retry RPC after error@1000415231) -> (continuation of Deferred@2133678464 after retry RPC after error@1813662414) -> (continuation of Deferred@1047136154 after retry RPC after error@226994511) -> (continuation of Deferred@410193958 after retry RPC after error@646014428) -> (continuation of Deferred@1211756609 after retry RPC after error@2026169816) -> (continuation of Deferred@2025208006 after retry RPC after error@1437863305) -> (continuation of Deferred@1384662150 after retry RPC after error@222138666) -> (continuation of Deferred@1141176387 after retry RPC after error@824802575) -> (continuation of Deferred@555066328 after retry RPC after error@1086374417) -> (continuation of Deferred@602274986 after retry RPC after error@1499348188) -> (continuation of Deferred@1431920460 after retry RPC after error@323997628) -> (continuation of Deferred@524513747 after retry RPC after error@928187963) -> (continuation of Deferred@678403234 after retry RPC after error@1169200188), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1993268586 after retry RPC after error@1453805927) -> (continuation of Deferred@1010553697 after retry RPC after error@1084602139) -> (continuation of Deferred@1073743848 after retry RPC after error@750799590) -> (continuation of Deferred@1308763332 after retry RPC after error@603082608) -> (continuation of Deferred@1670198177 after retry RPC after error@1303695948) -> (continuation of Deferred@307227450 after retry RPC after error@595046348) -> (continuation of Deferred@695046200 after retry RPC after error@1109397995) -> (continuation of Deferred@794502318 after retry RPC after error@827127622) -> (continuation of Deferred@1952800007 after retry RPC after error@906540329) -> (continuation of Deferred@1073776914 after retry RPC after error@371237011) -> (continuation of Deferred@1223903797 after retry RPC after error@1000415231) -> (continuation of Deferred@2133678464 after retry RPC after error@1813662414) -> (continuation of Deferred@1047136154 after retry RPC after error@226994511) -> (continuation of Deferred@410193958 after retry RPC after error@646014428) -> (continuation of Deferred@1211756609 after retry RPC after error@2026169816) -> (continuation of Deferred@2025208006 after retry RPC after error@1437863305) -> (continuation of Deferred@1384662150 after retry RPC after error@222138666) -> (continuation of Deferred@1141176387 after retry RPC after error@824802575) -> (continuation of Deferred@555066328 after retry RPC after error@1086374417) -> (continuation of Deferred@602274986 after retry RPC after error@1499348188) -> (continuation of Deferred@1431920460 after retry RPC after error@323997628) -> (continuation of Deferred@524513747 after retry RPC after error@928187963) -> (continuation of Deferred@678403234 after retry RPC after error@1169200188)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=28746), Traces: [0ms] sending RPC to server master-127.0.106.254:32967, [1ms] received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [24ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [24ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [26ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [26ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [43ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [43ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [43ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [43ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [63ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [83ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [83ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [83ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [83ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [104ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [104ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [144ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [144ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [144ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [241ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [243ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [284ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [521ms] refreshing cache from master, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [523ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [523ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [523ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [524ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [982ms] refreshing cache from master, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [984ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [984ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [984ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [984ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1821ms] refreshing cache from master, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1822ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [3522ms] refreshing cache from master, [3522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [3523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [3523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [3524ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [3525ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [3525ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [3526ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [7001ms] refreshing cache from master, [7001ms] too many traces: truncated at 100 traces, deferred=Deferred@1988333244(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@3369f16c -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1993268586 after retry RPC after error@1453805927) -> (continuation of Deferred@1010553697 after retry RPC after error@1084602139) -> (continuation of Deferred@1073743848 after retry RPC after error@750799590) -> (continuation of Deferred@1308763332 after retry RPC after error@603082608) -> (continuation of Deferred@1670198177 after retry RPC after error@1303695948) -> (continuation of Deferred@307227450 after retry RPC after error@595046348) -> (continuation of Deferred@695046200 after retry RPC after error@1109397995) -> (continuation of Deferred@794502318 after retry RPC after error@827127622) -> (continuation of Deferred@1952800007 after retry RPC after error@906540329) -> (continuation of Deferred@1073776914 after retry RPC after error@371237011) -> (continuation of Deferred@1223903797 after retry RPC after error@1000415231) -> (continuation of Deferred@2133678464 after retry RPC after error@1813662414) -> (continuation of Deferred@1047136154 after retry RPC after error@226994511) -> (continuation of Deferred@410193958 after retry RPC after error@646014428) -> (continuation of Deferred@1211756609 after retry RPC after error@2026169816) -> (continuation of Deferred@2025208006 after retry RPC after error@1437863305) -> (continuation of Deferred@1384662150 after retry RPC after error@222138666) -> (continuation of Deferred@1141176387 after retry RPC after error@824802575) -> (continuation of Deferred@555066328 after retry RPC after error@1086374417) -> (continuation of Deferred@602274986 after retry RPC after error@1499348188) -> (continuation of Deferred@1431920460 after retry RPC after error@323997628) -> (continuation of Deferred@524513747 after retry RPC after error@928187963) -> (continuation of Deferred@678403234 after retry RPC after error@1169200188), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1993268586 after retry RPC after error@1453805927) -> (continuation of Deferred@1010553697 after retry RPC after error@1084602139) -> (continuation of Deferred@1073743848 after retry RPC after error@750799590) -> (continuation of Deferred@1308763332 after retry RPC after error@603082608) -> (continuation of Deferred@1670198177 after retry RPC after error@1303695948) -> (continuation of Deferred@307227450 after retry RPC after error@595046348) -> (continuation of Deferred@695046200 after retry RPC after error@1109397995) -> (continuation of Deferred@794502318 after retry RPC after error@827127622) -> (continuation of Deferred@1952800007 after retry RPC after error@906540329) -> (continuation of Deferred@1073776914 after retry RPC after error@371237011) -> (continuation of Deferred@1223903797 after retry RPC after error@1000415231) -> (continuation of Deferred@2133678464 after retry RPC after error@1813662414) -> (continuation of Deferred@1047136154 after retry RPC after error@226994511) -> (continuation of Deferred@410193958 after retry RPC after error@646014428) -> (continuation of Deferred@1211756609 after retry RPC after error@2026169816) -> (continuation of Deferred@2025208006 after retry RPC after error@1437863305) -> (continuation of Deferred@1384662150 after retry RPC after error@222138666) -> (continuation of Deferred@1141176387 after retry RPC after error@824802575) -> (continuation of Deferred@555066328 after retry RPC after error@1086374417) -> (continuation of Deferred@602274986 after retry RPC after error@1499348188) -> (continuation of Deferred@1431920460 after retry RPC after error@323997628) -> (continuation of Deferred@524513747 after retry RPC after error@928187963) -> (continuation of Deferred@678403234 after retry RPC after error@1169200188)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.0.106.254:32967
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:26.281 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:32:26.281 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9) switched from state RUNNING to RESTARTING.
18:32:26.282 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
18:32:26.282 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
18:32:26.282 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
18:32:26.282 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
18:32:26.282 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
18:32:26.283 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
18:32:26.283 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
18:32:26.283 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
18:32:26.283 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
18:32:26.284 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
18:32:26.284 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
18:32:26.285 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:26.286 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:26.286 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:26.286 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.286 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.286 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.286 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.286 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.286 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.287 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.287 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.287 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.287 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:26.294 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:26.294 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:26.294 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:26.295 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.295 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.295 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.296 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.296 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.296 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.296 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.296 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.296 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.296 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:26.302 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
18:32:26.302 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
18:32:26.302 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
18:32:26.305 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:26.305 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.1.59.189:42073(127.1.59.189:42073)] disconnecting while in state TERMINATED
18:32:26.306 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.1.59.188:33901(127.1.59.188:33901)] disconnecting while in state TERMINATED
18:32:26.306 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.1.59.190:46863(127.1.59.190:46863)] disconnecting while in state TERMINATED
18:32:26.306 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:26.305 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:26.306 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.306 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.306 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.307 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.307 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
18:32:26.307 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.307 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.308 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
18:32:26.306 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:26.308 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.308 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.308 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.308 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:26.309 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.1.59.189:42073(127.1.59.189:42073)] disconnecting while in state TERMINATED
18:32:26.309 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.1.59.188:33901(127.1.59.188:33901)] disconnecting while in state TERMINATED
18:32:26.309 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.1.59.190:46863(127.1.59.190:46863)] disconnecting while in state TERMINATED
18:32:26.309 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:26.310 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
18:32:26.310 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
18:32:26.322 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
18:32:26.322 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
18:32:26.322 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
18:32:26.325 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:26.325 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:26.326 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:26.326 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.326 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.326 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.327 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.327 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.327 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.327 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.327 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.327 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.327 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:26.333 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.1.59.189:42073(127.1.59.189:42073)] disconnecting while in state TERMINATED
18:32:26.333 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.1.59.188:33901(127.1.59.188:33901)] disconnecting while in state TERMINATED
18:32:26.333 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.1.59.190:46863(127.1.59.190:46863)] disconnecting while in state TERMINATED
18:32:26.335 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:26.336 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
18:32:26.336 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
18:32:26.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:26.345 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:26.345 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:26.345 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:26.346 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.346 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.346 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.346 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.346 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.346 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.347 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.347 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.347 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.347 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:26.365 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:32:26.365 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:32:26.365 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
18:32:26.365 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
18:32:26.366 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:26.366 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:26.366 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:26.367 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.367 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.367 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.367 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
18:32:26.368 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
18:32:26.368 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
18:32:26.368 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.368 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.368 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.368 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.368 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.368 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.368 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:26.369 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
18:32:26.370 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
18:32:26.370 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:32:26.372 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
18:32:26.373 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:32:26.373 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
18:32:26.373 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
18:32:26.374 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
18:32:26.374 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
18:32:26.375 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:32:26.378 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 5a4601fd26394edfbfbe4479bc35fd3f(127.1.59.129:44129)] disconnecting while in state TERMINATED
18:32:26.378 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.1.59.189:42073(127.1.59.189:42073)] disconnecting while in state TERMINATED
18:32:26.378 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.1.59.188:33901(127.1.59.188:33901)] disconnecting while in state TERMINATED
18:32:26.378 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.1.59.190:46863(127.1.59.190:46863)] disconnecting while in state TERMINATED
18:32:26.379 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:26.379 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
18:32:26.379 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-2
18:32:26.379 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
18:32:26.390 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:32:26.390 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:26.390 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
18:32:26.390 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
18:32:26.391 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
18:32:26.391 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
18:32:26.392 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:32:26.395 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
18:32:26.395 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:32:26.395 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
18:32:26.395 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
18:32:26.396 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
18:32:26.396 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
18:32:26.397 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 4cd649562a0f5305571102b5c888c5a9
18:32:26.406 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:26.406 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:26.406 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:26.407 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.407 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.407 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.407 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.407 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.407 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.408 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.407 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.408 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.408 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:26.414 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:26.414 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:26.414 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:26.415 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.415 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.415 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.415 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.415 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.415 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.415 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.415 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.415 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.416 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:26.452 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:26.453 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:26.453 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:26.453 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:26.453 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:26.454 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:26.455 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:26.456 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:26.456 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:26.456 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:26.456 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:26.456 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:26.456 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:26.465 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:26.465 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:26.465 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:26.466 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.466 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.466 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.467 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.467 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.467 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.469 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.469 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.469 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.469 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:26.578 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:26.578 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:26.578 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:26.579 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.579 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.579 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.579 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.580 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.580 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.580 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.580 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.580 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.580 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:26.592 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:26.593 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:26.593 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:26.593 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:26.593 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:26.593 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:26.594 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:26.594 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:26.594 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:26.594 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:26.595 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:26.595 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:26.595 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:26.602 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:26.638 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:26.638 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:26.638 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:26.639 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:26.639 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:26.639 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:26.639 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:26.639 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:26.639 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:26.639 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:26.640 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:26.640 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:26.640 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:26.666 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:26.666 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:26.666 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:26.667 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.667 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.667 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.667 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.667 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.667 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.667 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.667 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.667 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:26.667 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:26.667 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.668 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:26.668 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:26.668 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.668 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.668 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.668 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.668 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.669 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.669 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.669 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.669 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.669 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:26.695 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:26.696 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:26.697 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:26.697 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.697 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.698 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.698 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.698 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.698 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.698 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.699 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.699 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.699 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:26.838 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:26.845 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:26.846 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:26.846 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:26.847 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.847 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.847 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.847 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.848 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.848 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.848 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.848 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.848 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.848 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:26.854 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:26.854 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:26.855 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:26.855 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.855 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.855 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:26.855 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.856 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.856 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:26.856 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.856 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.856 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:26.856 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:26.886 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:26.886 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:26.886 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:26.887 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.887 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.887 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:26.888 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.888 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.888 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:26.888 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.888 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.888 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:26.888 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:27.004 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:27.005 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:27.005 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:27.005 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:27.006 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:27.006 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:27.007 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:27.007 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:27.007 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:27.008 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:27.008 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:27.008 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:27.008 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:27.105 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:27.237 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:27.238 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:27.238 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:27.238 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:27.239 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:27.239 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:27.239 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:27.239 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:27.239 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:27.239 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:27.239 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:27.239 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:27.239 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:27.243 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:27.243 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:27.244 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:27.244 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:27.244 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:27.244 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:27.244 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:27.244 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:27.244 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:27.245 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:27.245 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:27.245 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:27.246 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:27.298 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:27.299 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:27.299 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:27.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:27.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:27.300 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:27.300 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:27.300 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:27.301 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:27.301 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:27.301 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:27.301 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:27.301 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:27.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:27.380 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9) switched from state RESTARTING to RUNNING.
18:32:27.381 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 4cd649562a0f5305571102b5c888c5a9 from Checkpoint 65 @ 1783535546001 for 4cd649562a0f5305571102b5c888c5a9 located at file:/tmp/junit5514029058471043739/checkpoints/4cd649562a0f5305571102b5c888c5a9/chk-65.
18:32:27.381 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
18:32:27.381 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:32:27.387 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
18:32:27.388 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
18:32:27.388 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id d0320e7b86362daa97e494337af6f333
18:32:27.389 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
18:32:27.389 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
18:32:27.389 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id 0abd8d1f15ad274a5029e6ed83960f8c
18:32:27.389 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
18:32:27.389 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:32:27.390 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:32:27.390 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
18:32:27.390 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id c230971fad26d6cfa2b63ff44e7a1af5
18:32:27.390 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:32:27.390 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
18:32:27.390 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:32:27.391 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot d0320e7b86362daa97e494337af6f333.
18:32:27.392 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id d0320e7b86362daa97e494337af6f333.
18:32:27.392 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 0abd8d1f15ad274a5029e6ed83960f8c.
18:32:27.393 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
18:32:27.393 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id 163e6d56962e3a45c0e4353eb3be3a9b
18:32:27.393 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
18:32:27.393 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
18:32:27.394 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id 0abd8d1f15ad274a5029e6ed83960f8c.
18:32:27.394 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@379343ab
18:32:27.394 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:27.394 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:32:27.394 [INFO - Thread-32] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:32:27.395 [DEBUG - Thread-32] (Connection.java:575) [peer master-127.0.106.253:45189(127.0.106.253:45189)] disconnecting while in state TERMINATED
18:32:27.395 [DEBUG - Thread-32] (Connection.java:575) [peer master-127.0.106.254:32967(127.0.106.254:32967)] disconnecting while in state TERMINATED
18:32:27.395 [DEBUG - Thread-32] (Connection.java:575) [peer master-127.0.106.252:46705(127.0.106.252:46705)] disconnecting while in state TERMINATED
18:32:27.395 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:27.395 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
18:32:27.396 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
18:32:27.396 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
18:32:27.397 [INFO - Thread-32] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:32:27.397 [INFO - Thread-32] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:32:27.397 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot c230971fad26d6cfa2b63ff44e7a1af5.
18:32:27.398 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id c230971fad26d6cfa2b63ff44e7a1af5.
18:32:27.399 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
18:32:27.399 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
18:32:27.400 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@775a3fde
18:32:27.400 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:27.400 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:32:27.400 [DEBUG - Thread-32] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:27.400 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
18:32:27.401 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
18:32:27.401 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
18:32:27.401 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
18:32:27.402 [INFO - Thread-32] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:32:27.406 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 163e6d56962e3a45c0e4353eb3be3a9b.
18:32:27.407 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
18:32:27.407 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
18:32:27.408 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6180d365
18:32:27.409 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id 163e6d56962e3a45c0e4353eb3be3a9b.
18:32:27.410 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3de7c8f4
18:32:27.410 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:27.411 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:32:27.411 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
18:32:27.411 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
18:32:27.412 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5516459e
18:32:27.414 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
18:32:27.414 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
18:32:27.415 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2a564fd2
18:32:27.415 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:27.415 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:32:27.415 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:27.415 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
18:32:27.415 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
18:32:27.416 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:27.421 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3a8ace67
18:32:27.422 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:27.423 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:27.423 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:27.423 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:27.432 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:27.433 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@36a8e0e5
18:32:27.435 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:27.438 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.447 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.460 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.467 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.470 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.470 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.471 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.471 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.477 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:27.477 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:27.477 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:27.478 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:27.478 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:27.478 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:27.478 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:27.479 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:27.479 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:27.479 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:27.480 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:27.480 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:27.480 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:27.480 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.480 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.480 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.481 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.497 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:27.498 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.503 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.503 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.503 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.503 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.504 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.505 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.505 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.505 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.507 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.507 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.507 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.507 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.508 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.508 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.508 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.509 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:27.510 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.510 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.510 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.511 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:27.512 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.512 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.512 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.513 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.513 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.513 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.513 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.513 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.514 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.514 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.518 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.521 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.522 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.526 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.527 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.527 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.528 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.530 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.531 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.531 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.531 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.531 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.531 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.531 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:27.531 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.531 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.531 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.532 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.536 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.536 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.536 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.537 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.538 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:27.540 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.543 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.543 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.543 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.543 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.547 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.553 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:27.553 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:27.553 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:27.554 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:27.554 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:27.554 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:27.555 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:27.555 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:27.555 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:27.557 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:27.557 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:27.557 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:27.557 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:27.558 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.571 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.572 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.572 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.574 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.574 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.574 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.575 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.575 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.576 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.576 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.576 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.577 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:27.577 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.577 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.577 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.578 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.578 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.578 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.578 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.579 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.579 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.579 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.579 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.580 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.580 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.580 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.580 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.580 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.580 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.580 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.580 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.581 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.583 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.584 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.585 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.585 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.588 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.601 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.602 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:27.616 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.647 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.648 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:27.649 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.649 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.650 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.650 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.650 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.650 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.651 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.651 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.651 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.651 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.651 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.651 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.651 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.652 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.652 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.652 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.652 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.652 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.652 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.653 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.653 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.653 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.653 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.654 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.654 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.654 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.654 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.654 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.654 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.656 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.656 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.656 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.656 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.656 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.655 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.656 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.656 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.655 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.655 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.657 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.657 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.657 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.657 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.657 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.657 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.657 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.657 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.657 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.658 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.658 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.658 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.658 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.658 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:27.658 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.658 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.659 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.659 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.659 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.659 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.659 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.659 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.659 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.660 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.660 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.660 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.660 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.660 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.661 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.661 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.662 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.662 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.662 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.662 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.662 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.662 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.662 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.662 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.662 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.662 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.663 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.667 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.667 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.667 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.667 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.668 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.668 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.668 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.668 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.668 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.668 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.668 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.668 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.668 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.668 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.669 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.669 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.669 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.669 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.670 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.670 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.670 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.670 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.670 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.671 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.671 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.671 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.678 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:27.678 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.678 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.678 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.679 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.679 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.679 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.679 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.679 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.679 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.679 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.679 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.679 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.679 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.681 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.681 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.681 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.681 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.681 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.682 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.682 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.682 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.682 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.682 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.682 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.682 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.682 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.683 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:27.683 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.684 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.684 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.687 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.687 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.687 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.688 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.688 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.688 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.688 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.688 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.688 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.688 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.688 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.688 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.688 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.689 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.689 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.689 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.688 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.689 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.689 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.689 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.689 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.689 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.689 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.690 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.690 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.690 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.694 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:27.694 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.694 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.694 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.694 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:27.695 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:27.695 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:27.695 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.695 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.695 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.695 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:27.695 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:27.695 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:27.695 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:27.695 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:27.695 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:27.695 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:27.696 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:27.696 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:27.696 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:27.696 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:27.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:25.948771  3573 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 3564
18:32:27.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:27.690472  3564 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 3.132s	user 0.407s	sys 0.783s
18:32:27.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:27.697274  3564 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 3.139s	user 0.407s	sys 0.783s
18:32:27.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:24.560901  3575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:27.699 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.699 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.699 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.699 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.699 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.699 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.700 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.700 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.700 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.700 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.700 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.700 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.700 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.711 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.711 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.711 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.712 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.712 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.712 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.712 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.712 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.712 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.713 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:27.713 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.713 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.713 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.713 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.717 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:27.717 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:27.717 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:27.718 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.718 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.718 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.718 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.718 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.718 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.719 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.719 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.719 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.719 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:27.721 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.721 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.721 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.721 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.721 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.721 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.722 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.722 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.722 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.722 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.722 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.722 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.722 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.727 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.727 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.727 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.727 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.728 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.728 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.728 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.728 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.728 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.728 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.728 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.728 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.728 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:27.734292  3564 server_base.cc:1061] running on GCE node
18:32:27.737 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:27.737 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:27.737 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:27.737 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.737 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.737 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.738 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.738 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.738 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.738 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.738 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.738 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.738 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:27.739 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.739 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.739 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.739 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.739 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.740 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.740 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.740 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.740 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.740 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.740 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.741 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.741 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:27.740031  3715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:27.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:27.741976  3564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:32:27.771 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:27.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:27.768997  3564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:32:27.771 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:27.771 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.771 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:27.771 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.772 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.772 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.772 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.772 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.772 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.771 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.772 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.772 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.772 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.772 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.773 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.773 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.773 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.773 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.773 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.773 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.773 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.773 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.773 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:27.771775  3564 hybrid_clock.cc:648] HybridClock initialized: now 1783535547771718 us; error 47 us; skew 500 ppm
18:32:27.773 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:27.773545  3564 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:32:27.774 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.774 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.774 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.774 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.773 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.774 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.774 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.777 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.777 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.777 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.777 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.778 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.778 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.778 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:27.787 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.787 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.788 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.788 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.788 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.788 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.789 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.789 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.789 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.790 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.790 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.790 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.790 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.790 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.790 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.790 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.791 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.791 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.791 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.791 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.791 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.792 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.792 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.792 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.792 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.792 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.798 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.799 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.799 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.799 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.799 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.799 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.799 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.799 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.799 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.800 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.800 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.800 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.800 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.801 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.801 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.801 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.801 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.801 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.802 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.802 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.802 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.802 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.802 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.802 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.802 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.802 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:27.814079  3564 webserver.cc:534] Webserver started at http://127.3.43.129:40539/ using document root <none> and password file <none>
18:32:27.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:27.815924  3564 fs_manager.cc:362] Metadata directory not provided
18:32:27.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:27.816236  3564 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:32:27.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:27.816938  3564 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:32:27.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:27.825294  3564 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/data/instance:
18:32:27.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bed90167029a48089d044ae7429783f7"
18:32:27.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:27 on dist-test-slave-dxnw"
18:32:27.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:27.827137  3564 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/wal/instance:
18:32:27.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bed90167029a48089d044ae7429783f7"
18:32:27.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:27 on dist-test-slave-dxnw"
18:32:27.838 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:27.839325  3564 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.004s	sys 0.005s
18:32:27.841 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.841 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.841 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.842 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.842 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.842 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.842 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.842 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.842 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.842 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.842 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.843 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.843 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.847 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.847 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.847 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.848 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.848 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.848 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.848 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.848 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.848 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.849 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.849 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.849 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.849 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:27.848551  3720 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:32:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:27.850052  3564 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
18:32:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:27.850515  3564 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/wal
18:32:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bed90167029a48089d044ae7429783f7"
18:32:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:27 on dist-test-slave-dxnw"
18:32:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:27.851052  3564 fs_report.cc:389] FS layout report
18:32:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:32:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/wal
18:32:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/wal
18:32:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/data/data
18:32:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:32:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:32:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:32:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:32:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:32:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:32:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:32:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:32:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:32:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:32:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:32:27.857 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:27.857 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:27.857 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:27.858 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.858 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.858 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.858 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.858 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.858 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.858 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.858 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.859 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:27.859 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:27.887 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.887 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.888 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.890 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.890 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.890 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.890 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.890 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.890 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.891 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.891 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.891 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.891 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.895 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:27.895 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:27.895 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:27.895 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:27.895 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:27.895 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:27.896 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:27.896 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:27.896 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:27.896 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:27.896 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:27.896 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:27.896 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:27.927 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.928 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.928 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.928 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.928 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.929 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.929 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.929 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.929 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.929 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.929 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.929 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.930 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.967 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:27.968 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:27.968 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:27.968 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.969 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.969 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:27.969 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.969 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.969 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:27.969 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.969 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.969 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:27.969 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:27.983 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:27.984 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:27.984 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:27.984 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:27.984 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:27.984 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:27.984 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:27.984 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:27.984 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:27.985 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:27.985 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:27.985 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:27.985 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:27.998 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:27.998 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:27.998 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:27.999 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.999 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.999 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:27.999 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.999 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:27.999 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:28.000 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:28.000 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:28.000 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:28.000 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:28.018 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:28.018 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:28.018 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:28.019 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:28.019 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:28.019 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:28.019 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:28.019 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:28.019 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:28.020 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:28.020 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:28.020 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:28.020 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.020 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.020 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.021 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.021 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.021 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.021 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.021 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.021 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.021 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:28.022 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:28.023 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:28.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.022642  3564 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:32:28.023 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:28.023 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:28.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.024631  3564 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:32:28.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.025202  3564 kserver.cc:163] Server-wide thread pool size limit: 3276
18:32:28.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.039933  3564 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:32:28.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.057004  3564 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:32:28.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.057313  3564 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:32:28.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.057643  3564 ts_tablet_manager.cc:616] Registered 0 tablets
18:32:28.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.057876  3564 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:32:28.078 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:28.079 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:28.079 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:28.079 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.080 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.080 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.080 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.080 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.080 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.080 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.080 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.080 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.080 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:28.087 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:28.087 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:28.088 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:28.089 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:28.089 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:28.089 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:28.089 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:28.089 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:28.090 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:28.090 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:28.090 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:28.090 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:28.090 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:28.103 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:28.212 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:28.217 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:28.217 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:28.217 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:28.218 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:28.218 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:28.218 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:28.219 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:28.219 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:28.219 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:28.219 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:28.219 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:28.219 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:28.219 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:28.237 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:28.237 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:28.237 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:28.238 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:28.238 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:28.238 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:28.238 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:28.238 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:28.239 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:28.263 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:28.264 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:28.264 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:28.264 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:28.307 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:28.308 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:28.308 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:28.308 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.308 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.308 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.309 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.309 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.309 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.309 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.309 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.309 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.309 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:28.337 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:28.341 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:28.342 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:28.342 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:28.342 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.342 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.342 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.343 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.343 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.343 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.343 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.343 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.343 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.343 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:28.367 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:28.368 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:28.368 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:28.369 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.369 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.369 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.369 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.369 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.369 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.370 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.370 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.370 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.370 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.370487  3564 rpc_server.cc:307] RPC server started. Bound to: 127.3.43.129:43071
18:32:28.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.370710  3833 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.43.129:43071 every 8 connection(s)
18:32:28.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.374042  3564 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/data/info.pb
18:32:28.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.382339  3246 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 3564
18:32:28.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.383055  3246 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-0/wal/instance
18:32:28.409 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:28.409 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:28.410 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:28.410 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.410 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.410 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.410 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.410 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.410 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.410 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.410 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.411 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.411 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:28.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.412443  3246 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:28.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:28.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/wal
18:32:28.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/data
18:32:28.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:32:28.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:32:28.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:32:28.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:28.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/logs
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/data/info.pb
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.43.130:0
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.43.130
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.43.130
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.43.190:40613,127.3.43.189:32951,127.3.43.188:36795
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.43.148:38361
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:28.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:32:28.421 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:28.421 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:28.421 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:28.422 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.422 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.422 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.422 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.422 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.422 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.422 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.422 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.422 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.422 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:28.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.439563  3836 heartbeater.cc:344] Connected to a master server at 127.3.43.190:40613
18:32:28.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.440172  3836 heartbeater.cc:461] Registering TS with master...
18:32:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.441119  3835 heartbeater.cc:344] Connected to a master server at 127.3.43.189:32951
18:32:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.441463  3836 heartbeater.cc:507] Master 127.3.43.190:40613 requested a full tablet report, sending...
18:32:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.441519  3835 heartbeater.cc:461] Registering TS with master...
18:32:28.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.442613  3835 heartbeater.cc:507] Master 127.3.43.189:32951 requested a full tablet report, sending...
18:32:28.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.445241  3292 ts_manager.cc:194] Registered new tserver with Master: bed90167029a48089d044ae7429783f7 (127.3.43.129:43071)
18:32:28.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.445875  3372 ts_manager.cc:194] Registered new tserver with Master: bed90167029a48089d044ae7429783f7 (127.3.43.129:43071)
18:32:28.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.449437  3834 heartbeater.cc:344] Connected to a master server at 127.3.43.188:36795
18:32:28.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.449719  3834 heartbeater.cc:461] Registering TS with master...
18:32:28.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.450495  3834 heartbeater.cc:507] Master 127.3.43.188:36795 requested a full tablet report, sending...
18:32:28.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.452910  3462 ts_manager.cc:194] Registered new tserver with Master: bed90167029a48089d044ae7429783f7 (127.3.43.129:43071)
18:32:28.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.455696  3462 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.43.129:49819
18:32:28.539 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:28.539 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:28.540 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:28.540 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.540 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.540 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.540 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.540 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.540 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.540 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.540 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.540 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.540 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:28.561 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:28.562 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:28.562 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:28.562 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:28.562 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:28.562 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:28.562 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:28.562 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:28.562 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:28.562 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:28.562 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:28.562 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:28.562 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:28.603 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:28.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:28.608403  3494 debug-util.cc:398] Leaking SignalData structure 0x7b08000a4700 after lost signal to thread 3417
18:32:28.661 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:28.661 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:28.661 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:28.662 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:28.662 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:28.662 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:28.662 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:28.662 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:28.662 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:28.662 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:28.662 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:28.662 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:28.662 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:28.712 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:28.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:28.785909  3844 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:32:28.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:28.786480  3844 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:32:28.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:28.787158  3844 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:32:28.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:28.824201  3844 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:32:28.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:28.825187  3844 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.43.130
18:32:28.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.865134  3844 tablet_server_runner.cc:78] Tablet server non-default flags:
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.43.148:38361
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/data
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/wal
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.43.130:0
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/data/info.pb
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.43.130
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.43.190:40613,127.3.43.189:32951,127.3.43.188:36795
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:28.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.43.130
18:32:28.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/logs
18:32:28.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:28.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:32:28.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:32:28.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:32:28.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:32:28.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:32:28.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:32:28.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:32:28.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:32:28.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:32:28.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.866726  3844 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:32:28.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:28.868531  3844 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:32:28.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:28.886865  3852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:28.895 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:28.895 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:28.895 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:28.896 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:28.896 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:28.896 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:28.896 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:28.896 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:28.896 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:28.897 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:28.897 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:28.897 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:28.897 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:28.928 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:28.928 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:28.928 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:28.929 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.929 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.929 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:28.929 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.929 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.929 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:28.929 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.929 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.929 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:28.930 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:29.022 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:29.022 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:29.023 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:29.023 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:29.023 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:29.023 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:29.023 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:29.023 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:29.023 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:29.024 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:29.024 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:29.024 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:29.024 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:29.100 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:29.101 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:29.101 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:29.102 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:29.102 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:29.102 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:29.102 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:29.102 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:29.102 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:29.103 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:29.103 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:29.103 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:29.103 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:29.103 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:29.211 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:29.238 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:29.239 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:29.239 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:29.240 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:29.240 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:29.240 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:29.241 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:29.241 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:29.241 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:29.241 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:29.241 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:29.241 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:29.241 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:29.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:29.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:29.459518  3834 heartbeater.cc:499] Master 127.3.43.188:36795 was elected leader, sending a full tablet report...
18:32:29.498 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:29.498 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:29.498 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:29.499 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:29.499 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:29.499 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:29.499 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:29.499 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:29.499 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:29.500 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:29.500 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:29.500 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:29.500 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:29.527 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:29.527 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:29.527 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:29.528 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:29.528 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:29.528 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:29.528 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:29.528 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:29.528 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:29.528 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:29.528 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:29.529 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:29.529 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:29.603 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:29.711 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:29.819 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:29.819 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:29.819 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:29.820 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:29.820 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:29.820 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:29.820 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:29.820 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:29.820 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:29.821 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:29.821 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:29.821 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:29.821 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:29.838 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:29.952 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:29.952 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:29.953 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:29.953 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:29.953 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:29.953 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:29.953 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:29.953 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:29.953 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:29.953 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:29.953 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:29.953 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:29.953 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:30.092 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:30.093 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:30.093 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:30.093 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:30.093 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:30.093 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:30.094 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:30.094 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:30.094 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:30.094 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:30.095 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:30.095 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:30.095 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:30.102 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:30.211 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:30.213 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:30.213 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:30.213 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:30.214 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:30.214 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:30.214 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:30.214 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:30.214 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:30.214 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:30.214 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:30.214 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:30.214 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:30.214 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:30.239 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:30.239 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:30.239 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:30.240 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:30.240 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:30.240 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:30.240 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:30.240 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:30.240 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:30.241 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:30.241 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:30.241 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:30.241 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:30.275 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:30.275 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:30.275 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:30.276 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:30.276 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:30.276 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:30.276 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:30.276 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:30.276 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:30.277 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:30.277 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:30.277 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:30.277 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:30.280 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:30.281 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:30.281 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:30.281 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:30.282 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:30.282 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:30.282 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:30.282 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:30.282 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:30.282 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:30.282 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:30.282 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:30.282 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:30.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:30.361 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:30.361 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:30.361 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:30.362 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:30.362 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:30.362 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:30.362 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:30.362 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:30.362 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:30.363 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:30.363 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:30.363 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:30.363 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:30.461 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:30.462 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:30.462 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:30.463 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:30.463 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:30.463 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:30.463 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:30.463 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:30.463 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:30.464 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:30.464 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:30.464 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:30.464 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:30.602 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:30.607 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:30.607 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:30.608 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:30.608 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:30.608 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:30.608 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:30.609 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:30.609 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:30.609 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:30.609 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:30.609 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:30.609 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:30.609 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:30.712 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:30.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:28.895661  3854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:30.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:28.909026  3851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:30.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:30.729375  3853 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1838 milliseconds
18:32:30.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.729522  3844 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:32:30.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.731048  3844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:32:30.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.733815  3844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:32:30.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.735220  3844 hybrid_clock.cc:648] HybridClock initialized: now 1783535550735179 us; error 55 us; skew 500 ppm
18:32:30.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.736373  3844 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:32:30.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.744678  3844 webserver.cc:534] Webserver started at http://127.3.43.130:33967/ using document root <none> and password file <none>
18:32:30.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.745862  3844 fs_manager.cc:362] Metadata directory not provided
18:32:30.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.746173  3844 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:32:30.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.747044  3844 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:32:30.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.752190  3844 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/data/instance:
18:32:30.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea"
18:32:30.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:30 on dist-test-slave-dxnw"
18:32:30.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.753444  3844 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/wal/instance:
18:32:30.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea"
18:32:30.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:30 on dist-test-slave-dxnw"
18:32:30.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.763616  3844 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.004s
18:32:30.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.771600  3867 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:32:30.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.773221  3844 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.000s	sys 0.003s
18:32:30.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.773525  3844 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/wal
18:32:30.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea"
18:32:30.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:30 on dist-test-slave-dxnw"
18:32:30.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.774066  3844 fs_report.cc:389] FS layout report
18:32:30.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:32:30.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/wal
18:32:30.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/wal
18:32:30.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/data/data
18:32:30.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:32:30.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:32:30.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:32:30.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:32:30.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:32:30.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:32:30.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:32:30.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:32:30.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:32:30.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:32:30.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:32:30.839 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.846379  3844 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:32:30.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.848721  3844 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:32:30.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.849229  3844 kserver.cc:163] Server-wide thread pool size limit: 3276
18:32:30.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.853094  3844 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:32:30.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.859192  3844 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:32:30.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.859400  3844 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:32:30.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.859598  3844 ts_tablet_manager.cc:616] Registered 0 tablets
18:32:30.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:30.859726  3844 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:32:30.863 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:30.864 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:30.864 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:30.864 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:30.864 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:30.864 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:30.864 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:30.864 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:30.864 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:30.865 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:30.865 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:30.865 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:30.865 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:30.893 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:30.893 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:30.893 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:30.894 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:30.894 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:30.894 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:30.894 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:30.894 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:30.894 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:30.894 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:30.895 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:30.895 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:30.895 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:31.015 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:31.016 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:31.018 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:31.016 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:31.018 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:31.018 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:31.019 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:31.019 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:31.019 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:31.019 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:31.019 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:31.019 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:31.019 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:31.103 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:31.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.104308  3844 rpc_server.cc:307] RPC server started. Bound to: 127.3.43.130:38355
18:32:31.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.104400  3979 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.43.130:38355 every 8 connection(s)
18:32:31.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.107374  3844 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/data/info.pb
18:32:31.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.114148  3246 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 3844
18:32:31.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.114637  3246 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-1/wal/instance
18:32:31.122 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:31.122 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:31.122 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:31.123 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:31.123 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:31.124 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:31.124 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:31.124 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:31.124 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:31.124 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:31.124 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:31.124 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:31.125 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:31.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.145270  3246 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:31.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:31.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/wal
18:32:31.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/data
18:32:31.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/logs
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/data/info.pb
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.43.131:0
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.43.131
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.43.131
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.43.190:40613,127.3.43.189:32951,127.3.43.188:36795
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.43.148:38361
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:32:31.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.194474  3981 heartbeater.cc:344] Connected to a master server at 127.3.43.189:32951
18:32:31.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.195123  3981 heartbeater.cc:461] Registering TS with master...
18:32:31.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.196547  3981 heartbeater.cc:507] Master 127.3.43.189:32951 requested a full tablet report, sending...
18:32:31.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.198946  3983 heartbeater.cc:344] Connected to a master server at 127.3.43.190:40613
18:32:31.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.199824  3983 heartbeater.cc:461] Registering TS with master...
18:32:31.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.200583  3372 ts_manager.cc:194] Registered new tserver with Master: bcff4e6242a648a5ad29bd2dc8fca9ea (127.3.43.130:38355)
18:32:31.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.200799  3983 heartbeater.cc:507] Master 127.3.43.190:40613 requested a full tablet report, sending...
18:32:31.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.206173  3292 ts_manager.cc:194] Registered new tserver with Master: bcff4e6242a648a5ad29bd2dc8fca9ea (127.3.43.130:38355)
18:32:31.211 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:31.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.217461  3980 heartbeater.cc:344] Connected to a master server at 127.3.43.188:36795
18:32:31.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.217828  3980 heartbeater.cc:461] Registering TS with master...
18:32:31.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.218780  3980 heartbeater.cc:507] Master 127.3.43.188:36795 requested a full tablet report, sending...
18:32:31.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.221798  3462 ts_manager.cc:194] Registered new tserver with Master: bcff4e6242a648a5ad29bd2dc8fca9ea (127.3.43.130:38355)
18:32:31.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.225018  3462 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.43.130:36055
18:32:31.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:31.421 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:31.421 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:31.421 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:31.421 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:31.422 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:31.422 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:31.422 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:31.422 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:31.422 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:31.422 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:31.422 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:31.422 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:31.422 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:31.434 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:31.435 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:31.435 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:31.435 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:31.435 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:31.435 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:31.435 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:31.435 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:31.435 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:31.435 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:31.435 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:31.436 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:31.436 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:31.436 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:31.436 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:31.436 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:31.436 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:31.436 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:31.436 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:31.436 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:31.436 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:31.436 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:31.436 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:31.436 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:31.436 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:31.436 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:31.463 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:31.463 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:31.464 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:31.464 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:31.464 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:31.464 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:31.464 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:31.464 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:31.464 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:31.464 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:31.464 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:31.464 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:31.464 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:31.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:31.554638  3992 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:32:31.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:31.555289  3992 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:32:31.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:31.555953  3992 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:32:31.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:31.591969  3992 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:32:31.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:31.592911  3992 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.43.131
18:32:31.603 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:31.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.634403  3992 tablet_server_runner.cc:78] Tablet server non-default flags:
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.43.148:38361
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/data
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/wal
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.43.131:0
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/data/info.pb
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.43.131
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.43.190:40613,127.3.43.189:32951,127.3.43.188:36795
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.43.131
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/logs
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:32:31.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:32:31.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.635988  3992 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:32:31.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:31.637733  3992 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:32:31.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:31.652140  3998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:31.713 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:31.837 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:31.838 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:31.838 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:31.839 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:31.839 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:31.839 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:31.839 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:31.839 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:31.839 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:31.840 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:31.840 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:31.840 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:31.840 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:31.841 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:32.037 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:32.037 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:32.037 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:32.038 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.038 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.038 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.038 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.038 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.038 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.039 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.039 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.039 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.039 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:32.103 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:32.211 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:32.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:32.230623  3980 heartbeater.cc:499] Master 127.3.43.188:36795 was elected leader, sending a full tablet report...
18:32:32.253 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:32.253 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:32.253 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:32.254 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.254 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.254 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.254 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.254 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.254 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.254 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.254 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.254 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.254 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:32.258 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:32.258 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:32.258 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:32.259 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:32.259 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:32.259 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:32.259 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:32.259 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:32.259 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:32.260 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:32.260 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:32.260 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:32.260 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:32.337 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:32.434 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:32.434 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:32.435 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:32.436 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.436 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.436 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.437 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.437 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.437 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.442 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.442 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.442 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.442 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:32.578 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:32.578 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:32.579 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:32.579 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.579 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.579 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.579 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.579 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.579 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.580 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.580 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.580 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.580 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:32.605 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:32.621 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:32.622 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:32.622 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:32.623 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:32.623 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:32.623 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:32.623 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:32.623 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:32.623 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:32.623 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:32.623 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:32.624 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:32.624 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:32.695 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:32.696 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:32.696 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.697 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.697 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.697 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.697 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.697 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.697 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:32.698 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.698 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.698 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.698 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:32.711 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:32.759 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:32.760 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:32.760 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:32.761 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:32.761 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:32.761 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:32.761 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:32.761 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:32.761 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:32.761 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:32.761 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:32.761 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:32.761 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:32.768 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:32.768 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:32.768 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:32.768 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:32.768 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:32.768 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:32.768 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:32.768 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:32.768 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:32.769 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:32.769 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:32.769 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:32.769 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:32.797 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:32.798 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:32.798 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:32.799 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.799 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.799 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:32.800 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.800 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.800 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:32.800 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.800 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.800 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:32.800 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:32.838 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:33.103 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:33.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:31.652658  3999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:33.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:33.116127  4001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:33.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:33.119773  4000 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1465 milliseconds
18:32:33.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.119840  3992 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:32:33.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.121263  3992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:32:33.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.124202  3992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:32:33.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.125644  3992 hybrid_clock.cc:648] HybridClock initialized: now 1783535553125570 us; error 82 us; skew 500 ppm
18:32:33.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.127399  3992 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:32:33.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.134481  3992 webserver.cc:534] Webserver started at http://127.3.43.131:37469/ using document root <none> and password file <none>
18:32:33.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.135789  3992 fs_manager.cc:362] Metadata directory not provided
18:32:33.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.136037  3992 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:32:33.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.136581  3992 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:32:33.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.141767  3992 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/data/instance:
18:32:33.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7ecd1039231a404dbd66f834d9290a2d"
18:32:33.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:33 on dist-test-slave-dxnw"
18:32:33.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.143201  3992 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/wal/instance:
18:32:33.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7ecd1039231a404dbd66f834d9290a2d"
18:32:33.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:33 on dist-test-slave-dxnw"
18:32:33.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.151934  3992 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
18:32:33.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.158152  4009 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:32:33.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.159364  3992 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
18:32:33.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.159646  3992 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/wal
18:32:33.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7ecd1039231a404dbd66f834d9290a2d"
18:32:33.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:33 on dist-test-slave-dxnw"
18:32:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.159945  3992 fs_report.cc:389] FS layout report
18:32:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:32:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/wal
18:32:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/wal
18:32:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/data/data
18:32:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:32:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:32:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:32:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:32:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:32:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:32:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:32:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:32:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:32:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:32:33.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:32:33.212 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:33.223 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:33.223 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:33.223 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:33.224 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:33.224 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:33.224 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:33.224 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:33.224 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:33.224 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:33.224 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:33.224 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:33.224 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:33.224 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:33.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.261669  3992 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:32:33.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.263325  3992 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:32:33.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.263739  3992 kserver.cc:163] Server-wide thread pool size limit: 3276
18:32:33.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.266368  3992 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:32:33.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.270906  3992 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:32:33.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.271171  3992 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
18:32:33.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.271509  3992 ts_tablet_manager.cc:616] Registered 0 tablets
18:32:33.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.271730  3992 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:32:33.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:33.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.458525  3992 rpc_server.cc:307] RPC server started. Bound to: 127.3.43.131:38327
18:32:33.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.458600  4123 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.43.131:38327 every 8 connection(s)
18:32:33.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.461944  3992 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/data/info.pb
18:32:33.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.463649  3246 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 3992
18:32:33.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.464193  3246 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2579977005169374793/ts-2/wal/instance
18:32:33.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.506898  4125 heartbeater.cc:344] Connected to a master server at 127.3.43.189:32951
18:32:33.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.507443  4125 heartbeater.cc:461] Registering TS with master...
18:32:33.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.507619  4126 heartbeater.cc:344] Connected to a master server at 127.3.43.190:40613
18:32:33.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.507941  4126 heartbeater.cc:461] Registering TS with master...
18:32:33.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.508489  4125 heartbeater.cc:507] Master 127.3.43.189:32951 requested a full tablet report, sending...
18:32:33.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.508860  4126 heartbeater.cc:507] Master 127.3.43.190:40613 requested a full tablet report, sending...
18:32:33.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.511524  3292 ts_manager.cc:194] Registered new tserver with Master: 7ecd1039231a404dbd66f834d9290a2d (127.3.43.131:38327)
18:32:33.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.511858  4124 heartbeater.cc:344] Connected to a master server at 127.3.43.188:36795
18:32:33.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.512180  4124 heartbeater.cc:461] Registering TS with master...
18:32:33.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.512020  3372 ts_manager.cc:194] Registered new tserver with Master: 7ecd1039231a404dbd66f834d9290a2d (127.3.43.131:38327)
18:32:33.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.513093  4124 heartbeater.cc:507] Master 127.3.43.188:36795 requested a full tablet report, sending...
18:32:33.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.515077  3461 ts_manager.cc:194] Registered new tserver with Master: 7ecd1039231a404dbd66f834d9290a2d (127.3.43.131:38327)
18:32:33.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.516726  3461 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.43.131:54451
18:32:33.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.528203  3246 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
18:32:33.538 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:33.538 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:33.538 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:33.538 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:33.538 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:33.538 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:33.538 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:33.539 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:33.539 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:33.539 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:33.539 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:33.539 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:33.539 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:33.542 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:32:33.542 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

18:32:33.543 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.3.43.190"
      port: 40613
    }
    bound_http_address {
      host: "127.3.43.190"
      port: 39499
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.3.43.189"
      port: 32951
    }
    bound_http_address {
      host: "127.3.43.189"
      port: 32833
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.3.43.188"
      port: 36795
    }
    bound_http_address {
      host: "127.3.43.188"
      port: 37753
    }
  }
}

18:32:33.544 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

18:32:33.544 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.3.43.129"
      port: 43071
    }
    bound_http_address {
      host: "127.3.43.129"
      port: 40539
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.3.43.130"
      port: 38355
    }
    bound_http_address {
      host: "127.3.43.130"
      port: 33967
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.3.43.131"
      port: 38327
    }
    bound_http_address {
      host: "127.3.43.131"
      port: 37469
    }
  }
}

18:32:33.545 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
18:32:33.546 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:33.547 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:33.547 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:33.547 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:33.547 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:33.547 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:33.547 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:33.548 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:33.548 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:33.548 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:33.548 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:33.548 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:33.548 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:33.548 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:33.549 [DEBUG - main] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:33.549 [DEBUG - main] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:33.550 [DEBUG - main] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:33.550 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.96.190:44161(127.2.96.190:44161)] Successfully connected to peer
18:32:33.551 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.96.189:33339(127.2.96.189:33339)] Successfully connected to peer
18:32:33.552 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.96.188:32989(127.2.96.188:32989)] Successfully connected to peer
18:32:33.554 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.188
18:32:33.561 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.189
18:32:33.561 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.190
18:32:33.568 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:33.570 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:33.572 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x8674547f, L:/127.0.0.1:53308 - R:/127.2.96.188:32989] using SASL/PLAIN
18:32:33.573 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:33.576 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:32:33.576 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=29), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [28ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: OK, deferred=null) after lookup
18:32:33.579 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x98923ac2, L:/127.0.0.1:37376 - R:/127.2.96.189:33339] using SASL/PLAIN
18:32:33.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.578475  2636 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53308:
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\004\0012\000\000\000\004\001\226\000\000\000"
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
18:32:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
18:32:33.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:32:33.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
18:32:33.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:32:33.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
18:32:33.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:32:33.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:32:33.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:32:33.581 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xcd10092d, L:/127.0.0.1:58396 - R:/127.2.96.190:44161] using SASL/PLAIN
18:32:33.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:33.585232  2636 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
18:32:33.605 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:33.644 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6b086cbb915d4f34838e5ef58717ef47
18:32:33.712 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:33.753 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:33.753 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:33.753 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:33.754 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:33.754 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:33.754 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:33.754 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:33.754 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:33.755 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:33.755 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:33.755 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:33.755 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:33.755 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:33.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.756356  3170 tablet_service.cc:1511] Processing CreateTablet for tablet 007ce0b42486462cb7e00e1363a68404 (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
18:32:33.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.759670  3168 tablet_service.cc:1511] Processing CreateTablet for tablet 4eb9e4eed973435997d975ece849ca7a (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
18:32:33.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.760409  3166 tablet_service.cc:1511] Processing CreateTablet for tablet 0c25f7b288564110a208c9c3d924a97b (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
18:32:33.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.760386  3170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007ce0b42486462cb7e00e1363a68404. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.762653  3169 tablet_service.cc:1511] Processing CreateTablet for tablet 3d886241527f4f569f6d9abed2c4c8aa (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
18:32:33.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.761729  3166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c25f7b288564110a208c9c3d924a97b. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.765506  3167 tablet_service.cc:1511] Processing CreateTablet for tablet fa1ae6554a4f44edb298443dd03f3989 (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
18:32:33.767 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:33.767 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:33.767 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:33.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.767210  3169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d886241527f4f569f6d9abed2c4c8aa. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.768 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:33.768 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:33.768 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:33.768 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:33.768 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:33.768 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:33.768 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:33.768 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:33.768 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:33.768 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:33.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.768158  3167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1ae6554a4f44edb298443dd03f3989. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.771715  3171 tablet_service.cc:1511] Processing CreateTablet for tablet bf82abb9dff341cf9fe05a19552b4e99 (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
18:32:33.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.773030  3171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf82abb9dff341cf9fe05a19552b4e99. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.778244  2804 tablet_service.cc:1511] Processing CreateTablet for tablet 4eb9e4eed973435997d975ece849ca7a (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
18:32:33.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.780498  2806 tablet_service.cc:1511] Processing CreateTablet for tablet 007ce0b42486462cb7e00e1363a68404 (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
18:32:33.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.781958  2804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eb9e4eed973435997d975ece849ca7a. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.782246  2803 tablet_service.cc:1511] Processing CreateTablet for tablet fa1ae6554a4f44edb298443dd03f3989 (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
18:32:33.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.783594  2803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1ae6554a4f44edb298443dd03f3989. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.785434  2805 tablet_service.cc:1511] Processing CreateTablet for tablet 3d886241527f4f569f6d9abed2c4c8aa (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
18:32:33.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.786736  2805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d886241527f4f569f6d9abed2c4c8aa. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.779023  2802 tablet_service.cc:1511] Processing CreateTablet for tablet 0c25f7b288564110a208c9c3d924a97b (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
18:32:33.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.789804  3168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eb9e4eed973435997d975ece849ca7a. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.792721  2802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c25f7b288564110a208c9c3d924a97b. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.799 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:33.799 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:33.799 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:33.800 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:33.800 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:33.800 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:33.800 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:33.800 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:33.800 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:33.801 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:33.801 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:33.801 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:33.801 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:33.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.822557  2967 tablet_service.cc:1511] Processing CreateTablet for tablet 4eb9e4eed973435997d975ece849ca7a (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
18:32:33.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.825631  2967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eb9e4eed973435997d975ece849ca7a. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.827615  2968 tablet_service.cc:1511] Processing CreateTablet for tablet 3d886241527f4f569f6d9abed2c4c8aa (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
18:32:33.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.832393  2968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d886241527f4f569f6d9abed2c4c8aa. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.826663  2969 tablet_service.cc:1511] Processing CreateTablet for tablet 007ce0b42486462cb7e00e1363a68404 (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
18:32:33.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.834589  2969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007ce0b42486462cb7e00e1363a68404. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.835 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:33.835 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:33.835 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:33.836 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:33.836 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:33.836 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:33.836 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:33.836 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:33.836 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:33.836 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:33.836 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:33.836 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:33.836 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:33.839 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:33.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.837761  2966 tablet_service.cc:1511] Processing CreateTablet for tablet fa1ae6554a4f44edb298443dd03f3989 (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
18:32:33.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.841290  4158 tablet_bootstrap.cc:492] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153: Bootstrap starting.
18:32:33.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.841902  2965 tablet_service.cc:1511] Processing CreateTablet for tablet 0c25f7b288564110a208c9c3d924a97b (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
18:32:33.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.843127  2966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1ae6554a4f44edb298443dd03f3989. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.843674  2965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c25f7b288564110a208c9c3d924a97b. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.845628  2970 tablet_service.cc:1511] Processing CreateTablet for tablet bf82abb9dff341cf9fe05a19552b4e99 (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
18:32:33.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.846793  2970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf82abb9dff341cf9fe05a19552b4e99. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.849946  4158 tablet_bootstrap.cc:654] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153: Neither blocks nor log segments found. Creating new log.
18:32:33.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.852453  4158 log.cc:826] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153: Log is configured to *not* fsync() on all Append() calls
18:32:33.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.859553  4158 tablet_bootstrap.cc:492] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153: No bootstrap required, opened a new log
18:32:33.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.860157  4158 ts_tablet_manager.cc:1403] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
18:32:33.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.861742  2807 tablet_service.cc:1511] Processing CreateTablet for tablet bf82abb9dff341cf9fe05a19552b4e99 (DEFAULT_TABLE table=replication_test_table [id=6b086cbb915d4f34838e5ef58717ef47]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
18:32:33.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.878113  2806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007ce0b42486462cb7e00e1363a68404. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.883 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:33.883 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:33.884 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:33.884 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:33.884 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:33.884 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:33.884 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:33.884 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:33.884 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:33.884 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:33.885 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:33.884 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:33.885 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:33.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.887495  2807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf82abb9dff341cf9fe05a19552b4e99. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:33.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.892064  4158 raft_consensus.cc:359] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:33.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.892999  4158 raft_consensus.cc:385] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:33.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.893309  4158 raft_consensus.cc:740] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50ba3f6f15704aa1a07abe18d2d4b153, State: Initialized, Role: FOLLOWER
18:32:33.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:33.894466  4158 consensus_queue.cc:260] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:33.917 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:33.917 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:33.918 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:33.918 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:33.918 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:33.918 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:33.919 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:33.919 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:33.919 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:33.919 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:33.919 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:33.919 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:33.919 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:34.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.001267  4162 tablet_bootstrap.cc:492] T 3d886241527f4f569f6d9abed2c4c8aa P f996ea4859274e2fa9d44a503fa0aa5a: Bootstrap starting.
18:32:34.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.002002  4158 ts_tablet_manager.cc:1434] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153: Time spent starting tablet: real 0.142s	user 0.069s	sys 0.057s
18:32:34.014 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:34.014 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:34.014 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:34.015 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:34.015 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:34.015 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:34.015 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:34.015 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:34.016 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:34.016 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:34.016 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:34.015 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:34.016 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:34.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.020147  4158 tablet_bootstrap.cc:492] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153: Bootstrap starting.
18:32:34.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.033592  4163 tablet_bootstrap.cc:492] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8: Bootstrap starting.
18:32:34.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:34.035351  3240 tablet.cc:2406] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:32:34.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.038298  4158 tablet_bootstrap.cc:654] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153: Neither blocks nor log segments found. Creating new log.
18:32:34.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.041352  4162 tablet_bootstrap.cc:654] T 3d886241527f4f569f6d9abed2c4c8aa P f996ea4859274e2fa9d44a503fa0aa5a: Neither blocks nor log segments found. Creating new log.
18:32:34.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.049708  4162 log.cc:826] T 3d886241527f4f569f6d9abed2c4c8aa P f996ea4859274e2fa9d44a503fa0aa5a: Log is configured to *not* fsync() on all Append() calls
18:32:34.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.050671  4158 tablet_bootstrap.cc:492] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153: No bootstrap required, opened a new log
18:32:34.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.051173  4158 ts_tablet_manager.cc:1403] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.008s
18:32:34.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.054102  4158 raft_consensus.cc:359] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.054788  4158 raft_consensus.cc:385] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.055706  4163 tablet_bootstrap.cc:654] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8: Neither blocks nor log segments found. Creating new log.
18:32:34.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.055200  4158 raft_consensus.cc:740] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50ba3f6f15704aa1a07abe18d2d4b153, State: Initialized, Role: FOLLOWER
18:32:34.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.057173  4158 consensus_queue.cc:260] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.059661  4158 ts_tablet_manager.cc:1434] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
18:32:34.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.060581  4158 tablet_bootstrap.cc:492] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153: Bootstrap starting.
18:32:34.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.072757  4158 tablet_bootstrap.cc:654] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153: Neither blocks nor log segments found. Creating new log.
18:32:34.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.079572  4162 tablet_bootstrap.cc:492] T 3d886241527f4f569f6d9abed2c4c8aa P f996ea4859274e2fa9d44a503fa0aa5a: No bootstrap required, opened a new log
18:32:34.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.080273  4162 ts_tablet_manager.cc:1403] T 3d886241527f4f569f6d9abed2c4c8aa P f996ea4859274e2fa9d44a503fa0aa5a: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.006s
18:32:34.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.058148  4163 log.cc:826] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8: Log is configured to *not* fsync() on all Append() calls
18:32:34.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.085459  4158 tablet_bootstrap.cc:492] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153: No bootstrap required, opened a new log
18:32:34.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.085932  4158 ts_tablet_manager.cc:1403] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.009s
18:32:34.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.088832  4158 raft_consensus.cc:359] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } }
18:32:34.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.089520  4158 raft_consensus.cc:385] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.089805  4158 raft_consensus.cc:740] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50ba3f6f15704aa1a07abe18d2d4b153, State: Initialized, Role: FOLLOWER
18:32:34.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.090548  4158 consensus_queue.cc:260] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } }
18:32:34.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.093127  4158 ts_tablet_manager.cc:1434] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
18:32:34.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.094099  4158 tablet_bootstrap.cc:492] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153: Bootstrap starting.
18:32:34.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.100968  4158 tablet_bootstrap.cc:654] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153: Neither blocks nor log segments found. Creating new log.
18:32:34.106 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:34.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.111795  4163 tablet_bootstrap.cc:492] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8: No bootstrap required, opened a new log
18:32:34.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.112393  4163 ts_tablet_manager.cc:1403] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8: Time spent bootstrapping tablet: real 0.095s	user 0.014s	sys 0.015s
18:32:34.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.113176  4158 tablet_bootstrap.cc:492] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153: No bootstrap required, opened a new log
18:32:34.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.113566  4158 ts_tablet_manager.cc:1403] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
18:32:34.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.116406  4158 raft_consensus.cc:359] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.117058  4158 raft_consensus.cc:385] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.117331  4158 raft_consensus.cc:740] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50ba3f6f15704aa1a07abe18d2d4b153, State: Initialized, Role: FOLLOWER
18:32:34.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.118204  4158 consensus_queue.cc:260] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.120641  4158 ts_tablet_manager.cc:1434] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
18:32:34.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.121627  4158 tablet_bootstrap.cc:492] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153: Bootstrap starting.
18:32:34.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.128683  4158 tablet_bootstrap.cc:654] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153: Neither blocks nor log segments found. Creating new log.
18:32:34.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.142103  4158 tablet_bootstrap.cc:492] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153: No bootstrap required, opened a new log
18:32:34.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.142402  4158 ts_tablet_manager.cc:1403] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.008s
18:32:34.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.145013  4158 raft_consensus.cc:359] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.145571  4158 raft_consensus.cc:385] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.145756  4158 raft_consensus.cc:740] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50ba3f6f15704aa1a07abe18d2d4b153, State: Initialized, Role: FOLLOWER
18:32:34.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.147403  4158 consensus_queue.cc:260] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.149698  4158 ts_tablet_manager.cc:1434] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
18:32:34.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.150542  4158 tablet_bootstrap.cc:492] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153: Bootstrap starting.
18:32:34.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.157413  4158 tablet_bootstrap.cc:654] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153: Neither blocks nor log segments found. Creating new log.
18:32:34.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.163371  4161 raft_consensus.cc:493] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:34.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.164157  4161 raft_consensus.cc:515] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.170686  4158 tablet_bootstrap.cc:492] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153: No bootstrap required, opened a new log
18:32:34.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.170325  4162 raft_consensus.cc:359] T 3d886241527f4f569f6d9abed2c4c8aa P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.171415  4162 raft_consensus.cc:385] T 3d886241527f4f569f6d9abed2c4c8aa P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.171396  4158 ts_tablet_manager.cc:1403] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
18:32:34.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.171744  4162 raft_consensus.cc:740] T 3d886241527f4f569f6d9abed2c4c8aa P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f996ea4859274e2fa9d44a503fa0aa5a, State: Initialized, Role: FOLLOWER
18:32:34.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.172202  4163 raft_consensus.cc:359] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.172762  4162 consensus_queue.cc:260] T 3d886241527f4f569f6d9abed2c4c8aa P f996ea4859274e2fa9d44a503fa0aa5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.173628  4163 raft_consensus.cc:385] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.174058  4163 raft_consensus.cc:740] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6eacdcba4a9042a9a0000123e8be6eb8, State: Initialized, Role: FOLLOWER
18:32:34.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.174206  4158 raft_consensus.cc:359] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.174896  4158 raft_consensus.cc:385] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.175176  4158 raft_consensus.cc:740] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50ba3f6f15704aa1a07abe18d2d4b153, State: Initialized, Role: FOLLOWER
18:32:34.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.175984  4158 consensus_queue.cc:260] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.183331  4161 leader_election.cc:290] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953), f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745)
18:32:34.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.188431  4163 consensus_queue.cc:260] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.193040  4158 ts_tablet_manager.cc:1434] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.006s
18:32:34.213 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:34.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.212996  2828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb9e4eed973435997d975ece849ca7a" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" is_pre_election: true
18:32:34.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:34.215071  3126 leader_election.cc:343] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953): Illegal state: must be running to vote when last-logged opid is not known
18:32:34.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.230538  2990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb9e4eed973435997d975ece849ca7a" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" is_pre_election: true
18:32:34.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.233121  4162 ts_tablet_manager.cc:1434] T 3d886241527f4f569f6d9abed2c4c8aa P f996ea4859274e2fa9d44a503fa0aa5a: Time spent starting tablet: real 0.152s	user 0.044s	sys 0.045s
18:32:34.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.234180  4162 tablet_bootstrap.cc:492] T 007ce0b42486462cb7e00e1363a68404 P f996ea4859274e2fa9d44a503fa0aa5a: Bootstrap starting.
18:32:34.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:34.234242  3125 leader_election.cc:343] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745): Illegal state: must be running to vote when last-logged opid is not known
18:32:34.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.234722  3125 leader_election.cc:304] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50ba3f6f15704aa1a07abe18d2d4b153; no voters: 6eacdcba4a9042a9a0000123e8be6eb8, f996ea4859274e2fa9d44a503fa0aa5a
18:32:34.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.237545  4163 ts_tablet_manager.cc:1434] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8: Time spent starting tablet: real 0.125s	user 0.033s	sys 0.020s
18:32:34.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.238898  4163 tablet_bootstrap.cc:492] T bf82abb9dff341cf9fe05a19552b4e99 P 6eacdcba4a9042a9a0000123e8be6eb8: Bootstrap starting.
18:32:34.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.245090  4161 raft_consensus.cc:2749] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:32:34.248 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:34.248 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:34.248 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:34.248 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:34.248 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:34.249 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:34.249 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:34.249 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:34.249 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:34.249 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:34.249 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:34.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.248245  4161 raft_consensus.cc:493] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:34.249 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:34.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.248737  4161 raft_consensus.cc:515] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.249 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:34.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.254066  4161 leader_election.cc:290] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953), f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745)
18:32:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.255720  2828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1ae6554a4f44edb298443dd03f3989" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" is_pre_election: true
18:32:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.256165  2990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1ae6554a4f44edb298443dd03f3989" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" is_pre_election: true
18:32:34.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.257467  4162 tablet_bootstrap.cc:654] T 007ce0b42486462cb7e00e1363a68404 P f996ea4859274e2fa9d44a503fa0aa5a: Neither blocks nor log segments found. Creating new log.
18:32:34.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:34.257614  3125 leader_election.cc:343] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745): Illegal state: must be running to vote when last-logged opid is not known
18:32:34.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:34.258406  3126 leader_election.cc:343] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953): Illegal state: must be running to vote when last-logged opid is not known
18:32:34.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.258893  3126 leader_election.cc:304] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50ba3f6f15704aa1a07abe18d2d4b153; no voters: 6eacdcba4a9042a9a0000123e8be6eb8, f996ea4859274e2fa9d44a503fa0aa5a
18:32:34.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.260149  4161 raft_consensus.cc:2749] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:32:34.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.261660  4163 tablet_bootstrap.cc:654] T bf82abb9dff341cf9fe05a19552b4e99 P 6eacdcba4a9042a9a0000123e8be6eb8: Neither blocks nor log segments found. Creating new log.
18:32:34.266 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:34.266 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:34.266 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:34.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:34.263849  2878 tablet.cc:2406] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:32:34.266 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:34.267 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:34.267 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:34.267 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:34.267 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:34.267 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:34.267 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:34.267 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:34.267 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:34.267 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:34.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.270978  4162 tablet_bootstrap.cc:492] T 007ce0b42486462cb7e00e1363a68404 P f996ea4859274e2fa9d44a503fa0aa5a: No bootstrap required, opened a new log
18:32:34.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.271378  4162 ts_tablet_manager.cc:1403] T 007ce0b42486462cb7e00e1363a68404 P f996ea4859274e2fa9d44a503fa0aa5a: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.006s
18:32:34.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.272092  4163 tablet_bootstrap.cc:492] T bf82abb9dff341cf9fe05a19552b4e99 P 6eacdcba4a9042a9a0000123e8be6eb8: No bootstrap required, opened a new log
18:32:34.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.272511  4163 ts_tablet_manager.cc:1403] T bf82abb9dff341cf9fe05a19552b4e99 P 6eacdcba4a9042a9a0000123e8be6eb8: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.003s
18:32:34.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.274173  4162 raft_consensus.cc:359] T 007ce0b42486462cb7e00e1363a68404 P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.274834  4162 raft_consensus.cc:385] T 007ce0b42486462cb7e00e1363a68404 P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.275131  4162 raft_consensus.cc:740] T 007ce0b42486462cb7e00e1363a68404 P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f996ea4859274e2fa9d44a503fa0aa5a, State: Initialized, Role: FOLLOWER
18:32:34.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.275326  4163 raft_consensus.cc:359] T bf82abb9dff341cf9fe05a19552b4e99 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } }
18:32:34.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.276006  4163 raft_consensus.cc:385] T bf82abb9dff341cf9fe05a19552b4e99 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.275835  4162 consensus_queue.cc:260] T 007ce0b42486462cb7e00e1363a68404 P f996ea4859274e2fa9d44a503fa0aa5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.276293  4163 raft_consensus.cc:740] T bf82abb9dff341cf9fe05a19552b4e99 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6eacdcba4a9042a9a0000123e8be6eb8, State: Initialized, Role: FOLLOWER
18:32:34.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.277241  4163 consensus_queue.cc:260] T bf82abb9dff341cf9fe05a19552b4e99 P 6eacdcba4a9042a9a0000123e8be6eb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } }
18:32:34.279 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:34.279 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:34.279 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:34.280 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:34.280 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:34.280 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:34.280 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:34.280 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:34.280 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:34.280 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:34.280 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:34.280 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:34.280 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:34.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.282296  4163 ts_tablet_manager.cc:1434] T bf82abb9dff341cf9fe05a19552b4e99 P 6eacdcba4a9042a9a0000123e8be6eb8: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
18:32:34.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.283313  4163 tablet_bootstrap.cc:492] T 007ce0b42486462cb7e00e1363a68404 P 6eacdcba4a9042a9a0000123e8be6eb8: Bootstrap starting.
18:32:34.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.293928  4163 tablet_bootstrap.cc:654] T 007ce0b42486462cb7e00e1363a68404 P 6eacdcba4a9042a9a0000123e8be6eb8: Neither blocks nor log segments found. Creating new log.
18:32:34.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.295982  4162 ts_tablet_manager.cc:1434] T 007ce0b42486462cb7e00e1363a68404 P f996ea4859274e2fa9d44a503fa0aa5a: Time spent starting tablet: real 0.024s	user 0.000s	sys 0.006s
18:32:34.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.296898  4162 tablet_bootstrap.cc:492] T bf82abb9dff341cf9fe05a19552b4e99 P f996ea4859274e2fa9d44a503fa0aa5a: Bootstrap starting.
18:32:34.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.303745  4162 tablet_bootstrap.cc:654] T bf82abb9dff341cf9fe05a19552b4e99 P f996ea4859274e2fa9d44a503fa0aa5a: Neither blocks nor log segments found. Creating new log.
18:32:34.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.306739  4163 tablet_bootstrap.cc:492] T 007ce0b42486462cb7e00e1363a68404 P 6eacdcba4a9042a9a0000123e8be6eb8: No bootstrap required, opened a new log
18:32:34.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.308393  4163 ts_tablet_manager.cc:1403] T 007ce0b42486462cb7e00e1363a68404 P 6eacdcba4a9042a9a0000123e8be6eb8: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.000s
18:32:34.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.311784  4163 raft_consensus.cc:359] T 007ce0b42486462cb7e00e1363a68404 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.312570  4163 raft_consensus.cc:385] T 007ce0b42486462cb7e00e1363a68404 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.312891  4163 raft_consensus.cc:740] T 007ce0b42486462cb7e00e1363a68404 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6eacdcba4a9042a9a0000123e8be6eb8, State: Initialized, Role: FOLLOWER
18:32:34.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.314257  4161 raft_consensus.cc:493] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:34.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.314740  4161 raft_consensus.cc:515] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.316906  4161 leader_election.cc:290] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953), f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745)
18:32:34.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.313629  4163 consensus_queue.cc:260] T 007ce0b42486462cb7e00e1363a68404 P 6eacdcba4a9042a9a0000123e8be6eb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.319464  2990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007ce0b42486462cb7e00e1363a68404" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" is_pre_election: true
18:32:34.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.320165  2990 raft_consensus.cc:2468] T 007ce0b42486462cb7e00e1363a68404 P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50ba3f6f15704aa1a07abe18d2d4b153 in term 0.
18:32:34.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.321784  4163 ts_tablet_manager.cc:1434] T 007ce0b42486462cb7e00e1363a68404 P 6eacdcba4a9042a9a0000123e8be6eb8: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
18:32:34.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.321904  3125 leader_election.cc:304] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50ba3f6f15704aa1a07abe18d2d4b153, f996ea4859274e2fa9d44a503fa0aa5a; no voters: 
18:32:34.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.322158  2828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007ce0b42486462cb7e00e1363a68404" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" is_pre_election: true
18:32:34.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.322656  4161 raft_consensus.cc:2804] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:32:34.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.322839  2828 raft_consensus.cc:2468] T 007ce0b42486462cb7e00e1363a68404 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50ba3f6f15704aa1a07abe18d2d4b153 in term 0.
18:32:34.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.323048  4161 raft_consensus.cc:493] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:32:34.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.323423  4161 raft_consensus.cc:3060] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Advancing to term 1
18:32:34.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.328933  4162 tablet_bootstrap.cc:492] T bf82abb9dff341cf9fe05a19552b4e99 P f996ea4859274e2fa9d44a503fa0aa5a: No bootstrap required, opened a new log
18:32:34.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.329360  4162 ts_tablet_manager.cc:1403] T bf82abb9dff341cf9fe05a19552b4e99 P f996ea4859274e2fa9d44a503fa0aa5a: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.004s
18:32:34.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.333120  4161 raft_consensus.cc:515] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.334697  4163 tablet_bootstrap.cc:492] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8: Bootstrap starting.
18:32:34.337 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:34.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.339480  2828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007ce0b42486462cb7e00e1363a68404" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6eacdcba4a9042a9a0000123e8be6eb8"
18:32:34.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.340207  2828 raft_consensus.cc:3060] T 007ce0b42486462cb7e00e1363a68404 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Advancing to term 1
18:32:34.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.342418  2990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "007ce0b42486462cb7e00e1363a68404" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f996ea4859274e2fa9d44a503fa0aa5a"
18:32:34.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.343019  2990 raft_consensus.cc:3060] T 007ce0b42486462cb7e00e1363a68404 P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Advancing to term 1
18:32:34.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.342633  4161 leader_election.cc:290] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 election: Requested vote from peers 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953), f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745)
18:32:34.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.348124  4163 tablet_bootstrap.cc:654] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8: Neither blocks nor log segments found. Creating new log.
18:32:34.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.348376  2828 raft_consensus.cc:2468] T 007ce0b42486462cb7e00e1363a68404 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50ba3f6f15704aa1a07abe18d2d4b153 in term 1.
18:32:34.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.349530  3126 leader_election.cc:304] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50ba3f6f15704aa1a07abe18d2d4b153, 6eacdcba4a9042a9a0000123e8be6eb8; no voters: 
18:32:34.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.350416  4161 raft_consensus.cc:2804] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 1 FOLLOWER]: Leader election won for term 1
18:32:34.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.351329  4161 raft_consensus.cc:697] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 1 LEADER]: Becoming Leader. State: Replica: 50ba3f6f15704aa1a07abe18d2d4b153, State: Running, Role: LEADER
18:32:34.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.352449  4161 consensus_queue.cc:237] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.355799  4175 raft_consensus.cc:493] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:34.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.356333  4175 raft_consensus.cc:515] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.361191  4175 leader_election.cc:290] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745), 50ba3f6f15704aa1a07abe18d2d4b153 (127.2.96.131:37979)
18:32:34.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.360724  2990 raft_consensus.cc:2468] T 007ce0b42486462cb7e00e1363a68404 P f996ea4859274e2fa9d44a503fa0aa5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50ba3f6f15704aa1a07abe18d2d4b153 in term 1.
18:32:34.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.373020  4163 tablet_bootstrap.cc:492] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8: No bootstrap required, opened a new log
18:32:34.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.373502  4163 ts_tablet_manager.cc:1403] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8: Time spent bootstrapping tablet: real 0.039s	user 0.005s	sys 0.014s
18:32:34.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.335315  4162 raft_consensus.cc:359] T bf82abb9dff341cf9fe05a19552b4e99 P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } }
18:32:34.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.375111  4162 raft_consensus.cc:385] T bf82abb9dff341cf9fe05a19552b4e99 P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.375537  4162 raft_consensus.cc:740] T bf82abb9dff341cf9fe05a19552b4e99 P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f996ea4859274e2fa9d44a503fa0aa5a, State: Initialized, Role: FOLLOWER
18:32:34.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.376749  4163 raft_consensus.cc:359] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.377595  4163 raft_consensus.cc:385] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.377923  4163 raft_consensus.cc:740] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6eacdcba4a9042a9a0000123e8be6eb8, State: Initialized, Role: FOLLOWER
18:32:34.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.377818  4162 consensus_queue.cc:260] T bf82abb9dff341cf9fe05a19552b4e99 P f996ea4859274e2fa9d44a503fa0aa5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } }
18:32:34.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.378664  4163 consensus_queue.cc:260] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.381919  4163 ts_tablet_manager.cc:1434] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
18:32:34.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.383279  4163 tablet_bootstrap.cc:492] T 3d886241527f4f569f6d9abed2c4c8aa P 6eacdcba4a9042a9a0000123e8be6eb8: Bootstrap starting.
18:32:34.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.386830  4162 ts_tablet_manager.cc:1434] T bf82abb9dff341cf9fe05a19552b4e99 P f996ea4859274e2fa9d44a503fa0aa5a: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
18:32:34.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.390723  4163 tablet_bootstrap.cc:654] T 3d886241527f4f569f6d9abed2c4c8aa P 6eacdcba4a9042a9a0000123e8be6eb8: Neither blocks nor log segments found. Creating new log.
18:32:34.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.401823  4162 tablet_bootstrap.cc:492] T fa1ae6554a4f44edb298443dd03f3989 P f996ea4859274e2fa9d44a503fa0aa5a: Bootstrap starting.
18:32:34.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.405095  4163 tablet_bootstrap.cc:492] T 3d886241527f4f569f6d9abed2c4c8aa P 6eacdcba4a9042a9a0000123e8be6eb8: No bootstrap required, opened a new log
18:32:34.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.405570  4163 ts_tablet_manager.cc:1403] T 3d886241527f4f569f6d9abed2c4c8aa P 6eacdcba4a9042a9a0000123e8be6eb8: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.012s
18:32:34.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.409237  4163 raft_consensus.cc:359] T 3d886241527f4f569f6d9abed2c4c8aa P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.410068  4163 raft_consensus.cc:385] T 3d886241527f4f569f6d9abed2c4c8aa P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.410389  4163 raft_consensus.cc:740] T 3d886241527f4f569f6d9abed2c4c8aa P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6eacdcba4a9042a9a0000123e8be6eb8, State: Initialized, Role: FOLLOWER
18:32:34.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.411237  4163 consensus_queue.cc:260] T 3d886241527f4f569f6d9abed2c4c8aa P 6eacdcba4a9042a9a0000123e8be6eb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.418540  4163 ts_tablet_manager.cc:1434] T 3d886241527f4f569f6d9abed2c4c8aa P 6eacdcba4a9042a9a0000123e8be6eb8: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
18:32:34.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.425508  4161 raft_consensus.cc:493] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:34.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.425981  4161 raft_consensus.cc:515] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.426815  4163 tablet_bootstrap.cc:492] T 4eb9e4eed973435997d975ece849ca7a P 6eacdcba4a9042a9a0000123e8be6eb8: Bootstrap starting.
18:32:34.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.428866  4161 leader_election.cc:290] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953), f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745)
18:32:34.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.429354  2828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d886241527f4f569f6d9abed2c4c8aa" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" is_pre_election: true
18:32:34.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.429944  2828 raft_consensus.cc:2468] T 3d886241527f4f569f6d9abed2c4c8aa P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50ba3f6f15704aa1a07abe18d2d4b153 in term 0.
18:32:34.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.431629  2990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d886241527f4f569f6d9abed2c4c8aa" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" is_pre_election: true
18:32:34.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.432215  2990 raft_consensus.cc:2468] T 3d886241527f4f569f6d9abed2c4c8aa P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50ba3f6f15704aa1a07abe18d2d4b153 in term 0.
18:32:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.433338  3126 leader_election.cc:304] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50ba3f6f15704aa1a07abe18d2d4b153, 6eacdcba4a9042a9a0000123e8be6eb8; no voters: 
18:32:34.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.434660  4163 tablet_bootstrap.cc:654] T 4eb9e4eed973435997d975ece849ca7a P 6eacdcba4a9042a9a0000123e8be6eb8: Neither blocks nor log segments found. Creating new log.
18:32:34.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.441501  4162 tablet_bootstrap.cc:654] T fa1ae6554a4f44edb298443dd03f3989 P f996ea4859274e2fa9d44a503fa0aa5a: Neither blocks nor log segments found. Creating new log.
18:32:34.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.445055  4175 raft_consensus.cc:493] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:34.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.445547  4175 raft_consensus.cc:515] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.447779  4175 leader_election.cc:290] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745), 50ba3f6f15704aa1a07abe18d2d4b153 (127.2.96.131:37979)
18:32:34.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.448413  4161 raft_consensus.cc:2804] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:32:34.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.450136  2990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c25f7b288564110a208c9c3d924a97b" candidate_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" is_pre_election: true
18:32:34.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.459394  2989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1ae6554a4f44edb298443dd03f3989" candidate_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" is_pre_election: true
18:32:34.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.448963  4161 raft_consensus.cc:493] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:32:34.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.454027  2635 catalog_manager.cc:5696] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50ba3f6f15704aa1a07abe18d2d4b153 (127.2.96.131). New cstate: current_term: 1 leader_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } health_report { overall_health: HEALTHY } } }
18:32:34.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.470939  4161 raft_consensus.cc:3060] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Advancing to term 1
18:32:34.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:34.477775  2762 leader_election.cc:343] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745): Illegal state: must be running to vote when last-logged opid is not known
18:32:34.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:34.480067  2762 leader_election.cc:343] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745): Illegal state: must be running to vote when last-logged opid is not known
18:32:34.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:34.480665  3049 tablet.cc:2406] T 007ce0b42486462cb7e00e1363a68404 P f996ea4859274e2fa9d44a503fa0aa5a: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:32:34.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.488567  4172 raft_consensus.cc:493] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:34.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.489266  4172 raft_consensus.cc:515] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } }
18:32:34.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.491348  4162 tablet_bootstrap.cc:492] T fa1ae6554a4f44edb298443dd03f3989 P f996ea4859274e2fa9d44a503fa0aa5a: No bootstrap required, opened a new log
18:32:34.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.491935  4162 ts_tablet_manager.cc:1403] T fa1ae6554a4f44edb298443dd03f3989 P f996ea4859274e2fa9d44a503fa0aa5a: Time spent bootstrapping tablet: real 0.090s	user 0.021s	sys 0.027s
18:32:34.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.493860  2989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf82abb9dff341cf9fe05a19552b4e99" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" is_pre_election: true
18:32:34.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.494714  2989 raft_consensus.cc:2468] T bf82abb9dff341cf9fe05a19552b4e99 P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50ba3f6f15704aa1a07abe18d2d4b153 in term 0.
18:32:34.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.494948  4162 raft_consensus.cc:359] T fa1ae6554a4f44edb298443dd03f3989 P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.495666  4162 raft_consensus.cc:385] T fa1ae6554a4f44edb298443dd03f3989 P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.495934  4162 raft_consensus.cc:740] T fa1ae6554a4f44edb298443dd03f3989 P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f996ea4859274e2fa9d44a503fa0aa5a, State: Initialized, Role: FOLLOWER
18:32:34.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.496870  4162 consensus_queue.cc:260] T fa1ae6554a4f44edb298443dd03f3989 P f996ea4859274e2fa9d44a503fa0aa5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.499147  3125 leader_election.cc:304] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50ba3f6f15704aa1a07abe18d2d4b153, f996ea4859274e2fa9d44a503fa0aa5a; no voters: 
18:32:34.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.499567  2828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf82abb9dff341cf9fe05a19552b4e99" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" is_pre_election: true
18:32:34.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.500146  2828 raft_consensus.cc:2468] T bf82abb9dff341cf9fe05a19552b4e99 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50ba3f6f15704aa1a07abe18d2d4b153 in term 0.
18:32:34.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.500844  4162 ts_tablet_manager.cc:1434] T fa1ae6554a4f44edb298443dd03f3989 P f996ea4859274e2fa9d44a503fa0aa5a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
18:32:34.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.501716  4162 tablet_bootstrap.cc:492] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a: Bootstrap starting.
18:32:34.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.498245  4172 leader_election.cc:290] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745), 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953)
18:32:34.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.504081  4172 raft_consensus.cc:2804] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:32:34.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.504674  4172 raft_consensus.cc:493] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:32:34.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.505339  4172 raft_consensus.cc:3060] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Advancing to term 1
18:32:34.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.511519  4162 tablet_bootstrap.cc:654] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a: Neither blocks nor log segments found. Creating new log.
18:32:34.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.520340  4124 heartbeater.cc:499] Master 127.3.43.188:36795 was elected leader, sending a full tablet report...
18:32:34.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.541115  4161 raft_consensus.cc:515] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.552 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:34.553 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:34.553 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:34.553 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:34.553 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:34.553 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:34.553 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:34.553 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:34.554 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:34.554 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:34.554 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:34.554 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:34.554 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:34.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.570225  4163 tablet_bootstrap.cc:492] T 4eb9e4eed973435997d975ece849ca7a P 6eacdcba4a9042a9a0000123e8be6eb8: No bootstrap required, opened a new log
18:32:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.570889  4163 ts_tablet_manager.cc:1403] T 4eb9e4eed973435997d975ece849ca7a P 6eacdcba4a9042a9a0000123e8be6eb8: Time spent bootstrapping tablet: real 0.144s	user 0.037s	sys 0.060s
18:32:34.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.545990  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c25f7b288564110a208c9c3d924a97b" candidate_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" is_pre_election: true
18:32:34.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.547483  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1ae6554a4f44edb298443dd03f3989" candidate_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" is_pre_election: true
18:32:34.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.572418  3190 raft_consensus.cc:2468] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6eacdcba4a9042a9a0000123e8be6eb8 in term 0.
18:32:34.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.574229  2760 leader_election.cc:304] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50ba3f6f15704aa1a07abe18d2d4b153, 6eacdcba4a9042a9a0000123e8be6eb8; no voters: f996ea4859274e2fa9d44a503fa0aa5a
18:32:34.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.574170  4163 raft_consensus.cc:359] T 4eb9e4eed973435997d975ece849ca7a P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.575243  4175 raft_consensus.cc:2804] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:32:34.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.575591  4175 raft_consensus.cc:493] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:32:34.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.576040  4175 raft_consensus.cc:3060] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Advancing to term 1
18:32:34.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.563879  4172 raft_consensus.cc:515] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } }
18:32:34.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.571408  4192 raft_consensus.cc:493] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:34.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.577788  4192 raft_consensus.cc:515] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.579044  3191 raft_consensus.cc:2468] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6eacdcba4a9042a9a0000123e8be6eb8 in term 0.
18:32:34.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.583050  2760 leader_election.cc:304] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50ba3f6f15704aa1a07abe18d2d4b153, 6eacdcba4a9042a9a0000123e8be6eb8; no voters: f996ea4859274e2fa9d44a503fa0aa5a
18:32:34.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.584321  4175 raft_consensus.cc:515] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.586175  4196 raft_consensus.cc:2804] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:32:34.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.587477  4196 raft_consensus.cc:493] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:32:34.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.587528  2989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1ae6554a4f44edb298443dd03f3989" candidate_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f996ea4859274e2fa9d44a503fa0aa5a"
18:32:34.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.588158  2989 raft_consensus.cc:3060] T fa1ae6554a4f44edb298443dd03f3989 P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Advancing to term 1
18:32:34.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.588376  4196 raft_consensus.cc:3060] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Advancing to term 1
18:32:34.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.589037  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1ae6554a4f44edb298443dd03f3989" candidate_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50ba3f6f15704aa1a07abe18d2d4b153"
18:32:34.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.589650  3191 raft_consensus.cc:3060] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Advancing to term 1
18:32:34.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.596962  2989 raft_consensus.cc:2468] T fa1ae6554a4f44edb298443dd03f3989 P f996ea4859274e2fa9d44a503fa0aa5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6eacdcba4a9042a9a0000123e8be6eb8 in term 1.
18:32:34.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.586598  4175 leader_election.cc:290] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [CANDIDATE]: Term 1 election: Requested vote from peers f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745), 50ba3f6f15704aa1a07abe18d2d4b153 (127.2.96.131:37979)
18:32:34.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.575028  4163 raft_consensus.cc:385] T 4eb9e4eed973435997d975ece849ca7a P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.598551  4163 raft_consensus.cc:740] T 4eb9e4eed973435997d975ece849ca7a P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6eacdcba4a9042a9a0000123e8be6eb8, State: Initialized, Role: FOLLOWER
18:32:34.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.598902  2762 leader_election.cc:304] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6eacdcba4a9042a9a0000123e8be6eb8, f996ea4859274e2fa9d44a503fa0aa5a; no voters: 
18:32:34.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.599447  2828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c25f7b288564110a208c9c3d924a97b" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" is_pre_election: true
18:32:34.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.599633  4196 raft_consensus.cc:515] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.602 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:34.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.602440  4192 leader_election.cc:290] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953), f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745)
18:32:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.603281  2989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c25f7b288564110a208c9c3d924a97b" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" is_pre_election: true
18:32:34.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:34.604537  3125 leader_election.cc:343] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745): Illegal state: must be running to vote when last-logged opid is not known
18:32:34.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.605585  2828 raft_consensus.cc:2393] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50ba3f6f15704aa1a07abe18d2d4b153 in current term 1: Already voted for candidate 6eacdcba4a9042a9a0000123e8be6eb8 in this term.
18:32:34.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.607504  2989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf82abb9dff341cf9fe05a19552b4e99" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f996ea4859274e2fa9d44a503fa0aa5a"
18:32:34.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.608037  2989 raft_consensus.cc:3060] T bf82abb9dff341cf9fe05a19552b4e99 P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Advancing to term 1
18:32:34.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.599684  4163 consensus_queue.cc:260] T 4eb9e4eed973435997d975ece849ca7a P 6eacdcba4a9042a9a0000123e8be6eb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.610495  3126 leader_election.cc:304] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50ba3f6f15704aa1a07abe18d2d4b153; no voters: 6eacdcba4a9042a9a0000123e8be6eb8, f996ea4859274e2fa9d44a503fa0aa5a
18:32:34.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.601358  4175 raft_consensus.cc:2804] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 1 FOLLOWER]: Leader election won for term 1
18:32:34.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.611810  4192 raft_consensus.cc:3060] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Advancing to term 1
18:32:34.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.613476  4163 ts_tablet_manager.cc:1434] T 4eb9e4eed973435997d975ece849ca7a P 6eacdcba4a9042a9a0000123e8be6eb8: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
18:32:34.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.613336  2990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c25f7b288564110a208c9c3d924a97b" candidate_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f996ea4859274e2fa9d44a503fa0aa5a"
18:32:34.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:34.614657  2762 leader_election.cc:343] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745): Illegal state: must be running to vote when last-logged opid is not known
18:32:34.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.616706  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c25f7b288564110a208c9c3d924a97b" candidate_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50ba3f6f15704aa1a07abe18d2d4b153"
18:32:34.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.623993  4175 raft_consensus.cc:697] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 1 LEADER]: Becoming Leader. State: Replica: 6eacdcba4a9042a9a0000123e8be6eb8, State: Running, Role: LEADER
18:32:34.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.625510  4196 leader_election.cc:290] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [CANDIDATE]: Term 1 election: Requested vote from peers f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745), 50ba3f6f15704aa1a07abe18d2d4b153 (127.2.96.131:37979)
18:32:34.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.625136  4175 consensus_queue.cc:237] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.636319  4161 leader_election.cc:290] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 election: Requested vote from peers 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953), f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745)
18:32:34.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.637022  2990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d886241527f4f569f6d9abed2c4c8aa" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f996ea4859274e2fa9d44a503fa0aa5a"
18:32:34.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.637758  2990 raft_consensus.cc:3060] T 3d886241527f4f569f6d9abed2c4c8aa P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Advancing to term 1
18:32:34.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.643952  4172 leader_election.cc:290] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 election: Requested vote from peers f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130:36745), 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953)
18:32:34.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.646957  3191 raft_consensus.cc:2468] T fa1ae6554a4f44edb298443dd03f3989 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6eacdcba4a9042a9a0000123e8be6eb8 in term 1.
18:32:34.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.652810  2828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d886241527f4f569f6d9abed2c4c8aa" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6eacdcba4a9042a9a0000123e8be6eb8"
18:32:34.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.653402  2828 raft_consensus.cc:3060] T 3d886241527f4f569f6d9abed2c4c8aa P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Advancing to term 1
18:32:34.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.653653  2990 raft_consensus.cc:2468] T 3d886241527f4f569f6d9abed2c4c8aa P f996ea4859274e2fa9d44a503fa0aa5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50ba3f6f15704aa1a07abe18d2d4b153 in term 1.
18:32:34.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.655263  3125 leader_election.cc:304] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50ba3f6f15704aa1a07abe18d2d4b153, f996ea4859274e2fa9d44a503fa0aa5a; no voters: 
18:32:34.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.657409  4172 raft_consensus.cc:2804] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [term 1 FOLLOWER]: Leader election won for term 1
18:32:34.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.657879  4172 raft_consensus.cc:697] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [term 1 LEADER]: Becoming Leader. State: Replica: 50ba3f6f15704aa1a07abe18d2d4b153, State: Running, Role: LEADER
18:32:34.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.658658  4172 consensus_queue.cc:237] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.662912  2827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf82abb9dff341cf9fe05a19552b4e99" candidate_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6eacdcba4a9042a9a0000123e8be6eb8"
18:32:34.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.663547  2827 raft_consensus.cc:3060] T bf82abb9dff341cf9fe05a19552b4e99 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Advancing to term 1
18:32:34.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.671363  2827 raft_consensus.cc:2468] T bf82abb9dff341cf9fe05a19552b4e99 P 6eacdcba4a9042a9a0000123e8be6eb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50ba3f6f15704aa1a07abe18d2d4b153 in term 1.
18:32:34.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.671713  2828 raft_consensus.cc:2468] T 3d886241527f4f569f6d9abed2c4c8aa P 6eacdcba4a9042a9a0000123e8be6eb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50ba3f6f15704aa1a07abe18d2d4b153 in term 1.
18:32:34.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.672864  3126 leader_election.cc:304] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50ba3f6f15704aa1a07abe18d2d4b153, 6eacdcba4a9042a9a0000123e8be6eb8; no voters: 
18:32:34.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.674410  4161 raft_consensus.cc:2804] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 1 FOLLOWER]: Leader election won for term 1
18:32:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.676218  4162 tablet_bootstrap.cc:492] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a: No bootstrap required, opened a new log
18:32:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.676671  4162 ts_tablet_manager.cc:1403] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a: Time spent bootstrapping tablet: real 0.175s	user 0.040s	sys 0.068s
18:32:34.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.678267  4161 raft_consensus.cc:697] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [term 1 LEADER]: Becoming Leader. State: Replica: 50ba3f6f15704aa1a07abe18d2d4b153, State: Running, Role: LEADER
18:32:34.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.679694  4161 consensus_queue.cc:237] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } }
18:32:34.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.684190  4192 raft_consensus.cc:2749] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:32:34.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.679337  4162 raft_consensus.cc:359] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.687681  4162 raft_consensus.cc:385] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.687968  4162 raft_consensus.cc:740] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f996ea4859274e2fa9d44a503fa0aa5a, State: Initialized, Role: FOLLOWER
18:32:34.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.688787  4162 consensus_queue.cc:260] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.700496  4162 ts_tablet_manager.cc:1434] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.004s
18:32:34.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.701311  2989 raft_consensus.cc:2468] T bf82abb9dff341cf9fe05a19552b4e99 P f996ea4859274e2fa9d44a503fa0aa5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50ba3f6f15704aa1a07abe18d2d4b153 in term 1.
18:32:34.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.705987  4162 tablet_bootstrap.cc:492] T 0c25f7b288564110a208c9c3d924a97b P f996ea4859274e2fa9d44a503fa0aa5a: Bootstrap starting.
18:32:34.712 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:34.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.712595  3190 raft_consensus.cc:2468] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6eacdcba4a9042a9a0000123e8be6eb8 in term 1.
18:32:34.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.713335  4162 tablet_bootstrap.cc:654] T 0c25f7b288564110a208c9c3d924a97b P f996ea4859274e2fa9d44a503fa0aa5a: Neither blocks nor log segments found. Creating new log.
18:32:34.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.714463  2760 leader_election.cc:304] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50ba3f6f15704aa1a07abe18d2d4b153, 6eacdcba4a9042a9a0000123e8be6eb8; no voters: f996ea4859274e2fa9d44a503fa0aa5a
18:32:34.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.723726  4162 tablet_bootstrap.cc:492] T 0c25f7b288564110a208c9c3d924a97b P f996ea4859274e2fa9d44a503fa0aa5a: No bootstrap required, opened a new log
18:32:34.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.724164  4162 ts_tablet_manager.cc:1403] T 0c25f7b288564110a208c9c3d924a97b P f996ea4859274e2fa9d44a503fa0aa5a: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.004s
18:32:34.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.725524  2635 catalog_manager.cc:5696] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50ba3f6f15704aa1a07abe18d2d4b153 (127.2.96.131). New cstate: current_term: 1 leader_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } health_report { overall_health: HEALTHY } } }
18:32:34.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.726848  4162 raft_consensus.cc:359] T 0c25f7b288564110a208c9c3d924a97b P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.727555  4162 raft_consensus.cc:385] T 0c25f7b288564110a208c9c3d924a97b P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:34.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.727828  4162 raft_consensus.cc:740] T 0c25f7b288564110a208c9c3d924a97b P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f996ea4859274e2fa9d44a503fa0aa5a, State: Initialized, Role: FOLLOWER
18:32:34.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.728516  4162 consensus_queue.cc:260] T 0c25f7b288564110a208c9c3d924a97b P f996ea4859274e2fa9d44a503fa0aa5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.735213  4162 ts_tablet_manager.cc:1434] T 0c25f7b288564110a208c9c3d924a97b P f996ea4859274e2fa9d44a503fa0aa5a: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
18:32:34.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.750330  2636 catalog_manager.cc:5696] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129). New cstate: current_term: 1 leader_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } health_report { overall_health: UNKNOWN } } }
18:32:34.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.751930  2635 catalog_manager.cc:5696] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50ba3f6f15704aa1a07abe18d2d4b153 (127.2.96.131). New cstate: current_term: 1 leader_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } health_report { overall_health: UNKNOWN } } }
18:32:34.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.757782  4175 raft_consensus.cc:2804] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [term 1 FOLLOWER]: Leader election won for term 1
18:32:34.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.758340  4175 raft_consensus.cc:697] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [term 1 LEADER]: Becoming Leader. State: Replica: 6eacdcba4a9042a9a0000123e8be6eb8, State: Running, Role: LEADER
18:32:34.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.759615  4175 consensus_queue.cc:237] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.776885  4171 raft_consensus.cc:493] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:34.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.777446  4171 raft_consensus.cc:515] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.784695  4171 leader_election.cc:290] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953), 50ba3f6f15704aa1a07abe18d2d4b153 (127.2.96.131:37979)
18:32:34.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.814230  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb9e4eed973435997d975ece849ca7a" candidate_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" is_pre_election: true
18:32:34.815 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:34.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.815328  3190 raft_consensus.cc:2468] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f996ea4859274e2fa9d44a503fa0aa5a in term 0.
18:32:34.815 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:34.816 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:34.816 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:34.816 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:34.816 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:34.816 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:34.816 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:34.816 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:34.816 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:34.816 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:34.816 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:34.816 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:34.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.817204  2922 leader_election.cc:304] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50ba3f6f15704aa1a07abe18d2d4b153, f996ea4859274e2fa9d44a503fa0aa5a; no voters: 
18:32:34.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.818212  4171 raft_consensus.cc:2804] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Leader pre-election won for term 1
18:32:34.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.818550  4171 raft_consensus.cc:493] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:32:34.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.818893  4171 raft_consensus.cc:3060] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Advancing to term 1
18:32:34.839 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:34.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.829526  2636 catalog_manager.cc:5696] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129). New cstate: current_term: 1 leader_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } health_report { overall_health: UNKNOWN } } }
18:32:34.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.851630  4171 raft_consensus.cc:515] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.853237  2828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb9e4eed973435997d975ece849ca7a" candidate_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" is_pre_election: true
18:32:34.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.853834  2828 raft_consensus.cc:2468] T 4eb9e4eed973435997d975ece849ca7a P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f996ea4859274e2fa9d44a503fa0aa5a in term 0.
18:32:34.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.855072  4171 leader_election.cc:290] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [CANDIDATE]: Term 1 election: Requested vote from peers 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953), 50ba3f6f15704aa1a07abe18d2d4b153 (127.2.96.131:37979)
18:32:34.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.857378  2828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb9e4eed973435997d975ece849ca7a" candidate_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6eacdcba4a9042a9a0000123e8be6eb8"
18:32:34.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.857959  2828 raft_consensus.cc:3060] T 4eb9e4eed973435997d975ece849ca7a P 6eacdcba4a9042a9a0000123e8be6eb8 [term 0 FOLLOWER]: Advancing to term 1
18:32:34.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.864346  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb9e4eed973435997d975ece849ca7a" candidate_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50ba3f6f15704aa1a07abe18d2d4b153"
18:32:34.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.864881  3190 raft_consensus.cc:3060] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153 [term 0 FOLLOWER]: Advancing to term 1
18:32:34.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.865401  2828 raft_consensus.cc:2468] T 4eb9e4eed973435997d975ece849ca7a P 6eacdcba4a9042a9a0000123e8be6eb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f996ea4859274e2fa9d44a503fa0aa5a in term 1.
18:32:34.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.866626  2925 leader_election.cc:304] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6eacdcba4a9042a9a0000123e8be6eb8, f996ea4859274e2fa9d44a503fa0aa5a; no voters: 
18:32:34.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.867647  4171 raft_consensus.cc:2804] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [term 1 FOLLOWER]: Leader election won for term 1
18:32:34.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.871313  4171 raft_consensus.cc:697] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [term 1 LEADER]: Becoming Leader. State: Replica: f996ea4859274e2fa9d44a503fa0aa5a, State: Running, Role: LEADER
18:32:34.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.872427  4171 consensus_queue.cc:237] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:34.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.874413  3190 raft_consensus.cc:2468] T 4eb9e4eed973435997d975ece849ca7a P 50ba3f6f15704aa1a07abe18d2d4b153 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f996ea4859274e2fa9d44a503fa0aa5a in term 1.
18:32:34.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.884522  2636 catalog_manager.cc:5696] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a reported cstate change: term changed from 0 to 1, leader changed from <none> to f996ea4859274e2fa9d44a503fa0aa5a (127.2.96.130). New cstate: current_term: 1 leader_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } health_report { overall_health: UNKNOWN } } }
18:32:34.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.898910  4161 consensus_queue.cc:1048] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:34.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:34.908211  4161 consensus_queue.cc:1048] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:34.975 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:34.975 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:34.975 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:34.976 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:34.976 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:34.976 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:34.976 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:34.976 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:34.976 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:34.977 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:34.977 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:34.977 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:34.977 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:35.017 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:35.017 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:35.018 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:35.018 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:35.018 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:35.018 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:35.018 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:35.018 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:35.018 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:35.018 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:35.018 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:35.018 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:35.018 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:35.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.076483  4161 consensus_queue.cc:1048] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:35.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.091723  4192 consensus_queue.cc:1048] T 3d886241527f4f569f6d9abed2c4c8aa P 50ba3f6f15704aa1a07abe18d2d4b153 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:35.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.095145  4172 consensus_queue.cc:1048] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:35.097 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:35.097 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:35.097 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.097602  4175 consensus_queue.cc:1048] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:35.098 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:35.098 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:35.098 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:35.099 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:35.099 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:35.099 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:35.099 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:35.099 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:35.099 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:35.099 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:35.102 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:35.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.117735  4175 consensus_queue.cc:1048] T fa1ae6554a4f44edb298443dd03f3989 P 6eacdcba4a9042a9a0000123e8be6eb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:32:35.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.131767  4192 consensus_queue.cc:1048] T bf82abb9dff341cf9fe05a19552b4e99 P 50ba3f6f15704aa1a07abe18d2d4b153 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:35.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.132896  4171 raft_consensus.cc:493] T 0c25f7b288564110a208c9c3d924a97b P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:35.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.133435  4171 raft_consensus.cc:515] T 0c25f7b288564110a208c9c3d924a97b P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 } } peers { permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 } } peers { permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 } }
18:32:35.136 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:35.136 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:35.136 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:35.137 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:35.137 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:35.137 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:35.137 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:35.138 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:35.138 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:35.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.137202  3190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c25f7b288564110a208c9c3d924a97b" candidate_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" is_pre_election: true
18:32:35.138 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:35.138 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:35.138 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:35.138 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:35.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.138729  3190 raft_consensus.cc:2393] T 0c25f7b288564110a208c9c3d924a97b P 50ba3f6f15704aa1a07abe18d2d4b153 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f996ea4859274e2fa9d44a503fa0aa5a in current term 1: Already voted for candidate 6eacdcba4a9042a9a0000123e8be6eb8 in this term.
18:32:35.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.139092  4171 leader_election.cc:290] T 0c25f7b288564110a208c9c3d924a97b P f996ea4859274e2fa9d44a503fa0aa5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953), 50ba3f6f15704aa1a07abe18d2d4b153 (127.2.96.131:37979)
18:32:35.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.140286  2827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c25f7b288564110a208c9c3d924a97b" candidate_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" is_pre_election: true
18:32:35.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.144847  2922 leader_election.cc:304] T 0c25f7b288564110a208c9c3d924a97b P f996ea4859274e2fa9d44a503fa0aa5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f996ea4859274e2fa9d44a503fa0aa5a; no voters: 50ba3f6f15704aa1a07abe18d2d4b153, 6eacdcba4a9042a9a0000123e8be6eb8
18:32:35.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.148176  4171 raft_consensus.cc:3060] T 0c25f7b288564110a208c9c3d924a97b P f996ea4859274e2fa9d44a503fa0aa5a [term 0 FOLLOWER]: Advancing to term 1
18:32:35.167 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:35.167 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:35.168 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:35.168 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:35.168 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:35.168 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:35.168 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:35.168 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:35.168 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:35.168 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:35.168 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:35.168 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:35.168 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:35.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.178254  4171 raft_consensus.cc:2749] T 0c25f7b288564110a208c9c3d924a97b P f996ea4859274e2fa9d44a503fa0aa5a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:32:35.211 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:35.217 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:35.217 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:35.217 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:35.218 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:35.218 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:35.218 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:35.218 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:35.218 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:35.218 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:35.218 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:35.218 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:35.218 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:35.218 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:35.221 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:35.221 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:35.221 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:35.222 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:35.222 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:35.222 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:35.222 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:35.222 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:35.222 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:35.222 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:35.222 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:35.222 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:35.222 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:35.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.230541  4175 consensus_queue.cc:1048] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:35.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.244026  4196 consensus_queue.cc:1048] T 0c25f7b288564110a208c9c3d924a97b P 6eacdcba4a9042a9a0000123e8be6eb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f996ea4859274e2fa9d44a503fa0aa5a" member_type: VOTER last_known_addr { host: "127.2.96.130" port: 36745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:35.252 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:35.252 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:35.253 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:35.253 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:35.253 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:35.253 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:35.253 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:35.253 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:35.254 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:35.254 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:35.254 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:35.254 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:35.254 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:35.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.322427  4171 consensus_queue.cc:1048] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "50ba3f6f15704aa1a07abe18d2d4b153" member_type: VOTER last_known_addr { host: "127.2.96.131" port: 37979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:35.342 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:35.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:35.343 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:35.343 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:35.344 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:35.344 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:35.344 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:35.344 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:35.344 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:35.344 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:35.344 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:35.344 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:35.344 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:35.344 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:35.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:35.338155  4171 consensus_queue.cc:1048] T 4eb9e4eed973435997d975ece849ca7a P f996ea4859274e2fa9d44a503fa0aa5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6eacdcba4a9042a9a0000123e8be6eb8" member_type: VOTER last_known_addr { host: "127.2.96.129" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:35.435 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:35.435 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:35.435 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:35.435 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:35.435 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:35.435 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:35.436 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:35.436 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:35.436 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:35.436 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:35.436 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:35.436 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:35.436 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:35.493 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:35.493 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:35.494 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:35.494 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:35.494 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:35.494 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:35.494 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:35.494 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:35.494 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:35.494 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:35.494 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:35.494 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:35.494 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:35.587 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:35.587 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:35.587 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:35.587 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:35.587 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:35.588 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:35.588 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:35.588 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:35.588 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:35.588 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:35.588 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:35.588 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:35.588 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:35.603 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:35.711 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:35.716 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6b086cbb915d4f34838e5ef58717ef47
18:32:35.721 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bf82abb9dff341cf9fe05a19552b4e99 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
18:32:35.722 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 007ce0b42486462cb7e00e1363a68404 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
18:32:35.722 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d886241527f4f569f6d9abed2c4c8aa for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
18:32:35.722 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 4eb9e4eed973435997d975ece849ca7a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:35.722 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet fa1ae6554a4f44edb298443dd03f3989 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:35.722 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 0c25f7b288564110a208c9c3d924a97b for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:35.722 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=bf82abb9dff341cf9fe05a19552b4e99@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=007ce0b42486462cb7e00e1363a68404@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=3d886241527f4f569f6d9abed2c4c8aa@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=4eb9e4eed973435997d975ece849ca7a@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fa1ae6554a4f44edb298443dd03f3989@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=0c25f7b288564110a208c9c3d924a97b@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:35.722 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=6), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.96.188:32989, [5ms] Sub RPC GetTableLocations: received response from server master-127.2.96.188:32989: OK, deferred=null) after lookup
18:32:35.723 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)] connecting to peer
18:32:35.724 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)] Successfully connected to peer
18:32:35.738 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:35.742 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x6b165c4d, L:/127.0.0.1:46154 - R:/127.2.96.131:37979] using TOKEN/null
18:32:35.774 [DEBUG - main] (Connection.java:748) [peer f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)] connecting to peer
18:32:35.775 [DEBUG - kudu-nio-4] (Connection.java:757) [peer f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)] Successfully connected to peer
18:32:35.781 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:35.781 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:35.782 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:35.782 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:35.782 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:35.782 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:35.783 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:35.783 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:35.783 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:35.783 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:35.783 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:35.783 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:35.783 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:35.794 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:35.802 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x8bdf1a85, L:/127.0.0.1:55376 - R:/127.2.96.130:36745] using TOKEN/null
18:32:35.842 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:35.878 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:35.878 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:35.878 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:35.879 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:35.879 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:35.879 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:35.879 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:35.879 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:35.879 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:35.880 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:35.880 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:35.880 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:35.880 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:35.994 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:35.994 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:35.995 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:35.995 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:35.995 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:35.995 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:35.996 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:35.996 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:35.996 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:35.996 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:35.996 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:35.996 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:35.996 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:36.047 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:36.054 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:36.062 [DEBUG - main] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:32:36.071 [DEBUG - main] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:32:36.071 [DEBUG - main] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:32:36.078 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.3.43.188:36795(127.3.43.188:36795)] Successfully connected to peer
18:32:36.079 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.3.43.189:32951(127.3.43.189:32951)] Successfully connected to peer
18:32:36.088 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.3.43.190:40613(127.3.43.190:40613)] Successfully connected to peer
18:32:36.088 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.188
18:32:36.089 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.189
18:32:36.100 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:36.100 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:36.103 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:36.104 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.190
18:32:36.105 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4731ff9b, L:/127.0.0.1:42170 - R:/127.3.43.188:36795] using SASL/PLAIN
18:32:36.105 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xad17f04e, L:/127.0.0.1:49950 - R:/127.3.43.189:32951] using SASL/PLAIN
18:32:36.112 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:36.115 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x8cf4ecb2, L:/127.0.0.1:40000 - R:/127.3.43.190:40613] using SASL/PLAIN
18:32:36.118 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:32:36.118 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=63), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [48ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: OK, deferred=null) after lookup
18:32:36.122 [DEBUG - main] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:36.122 [DEBUG - main] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:36.123 [DEBUG - main] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:36.124 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.96.189:33339(127.2.96.189:33339)] Successfully connected to peer
18:32:36.130 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.96.188:32989(127.2.96.188:32989)] Successfully connected to peer
18:32:36.131 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.96.190:44161(127.2.96.190:44161)] Successfully connected to peer
18:32:36.141 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.188
18:32:36.144 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.190
18:32:36.145 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.189
18:32:36.152 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:36.153 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:36.156 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:36.157 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x772220fa, L:/127.0.0.1:58410 - R:/127.2.96.190:44161] using SASL/PLAIN
18:32:36.157 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x8df31293, L:/127.0.0.1:37388 - R:/127.2.96.189:33339] using SASL/PLAIN
18:32:36.159 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xe5f90a2c, L:/127.0.0.1:53320 - R:/127.2.96.188:32989] using SASL/PLAIN
18:32:36.163 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:32:36.163 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=41), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [38ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: OK, [39ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: OK, [40ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: OK, deferred=null) after lookup
18:32:36.165 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6b086cbb915d4f34838e5ef58717ef47
18:32:36.169 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bf82abb9dff341cf9fe05a19552b4e99 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
18:32:36.169 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 007ce0b42486462cb7e00e1363a68404 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
18:32:36.169 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d886241527f4f569f6d9abed2c4c8aa for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
18:32:36.169 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 4eb9e4eed973435997d975ece849ca7a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:36.169 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet fa1ae6554a4f44edb298443dd03f3989 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:36.169 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 0c25f7b288564110a208c9c3d924a97b for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:36.170 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=bf82abb9dff341cf9fe05a19552b4e99@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=007ce0b42486462cb7e00e1363a68404@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=3d886241527f4f569f6d9abed2c4c8aa@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=4eb9e4eed973435997d975ece849ca7a@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fa1ae6554a4f44edb298443dd03f3989@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=0c25f7b288564110a208c9c3d924a97b@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.172914  3461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42170:
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:32:36.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\0012\000\000\000"
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:32:36.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
18:32:36.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:36.176921  3461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
18:32:36.212 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:36.288 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 430ff55bf33c43dbbd3443b21bc87300
18:32:36.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:36.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.407943  3768 tablet_service.cc:1511] Processing CreateTablet for tablet 0cba6ba156884b4c8f2a86f07bdde1fd (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
18:32:36.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.408987  3769 tablet_service.cc:1511] Processing CreateTablet for tablet 5fa379231aa347d299f56467d01e8555 (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
18:32:36.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.411216  3768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cba6ba156884b4c8f2a86f07bdde1fd. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:36.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.411954  3769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fa379231aa347d299f56467d01e8555. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:36.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.412458  4056 tablet_service.cc:1511] Processing CreateTablet for tablet 0cba6ba156884b4c8f2a86f07bdde1fd (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
18:32:36.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.414331  4056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cba6ba156884b4c8f2a86f07bdde1fd. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:36.417 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:36.417 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:36.418 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:36.418 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:36.418 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:36.418 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:36.419 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:36.419 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:36.419 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:36.419 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:36.419 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:36.419 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:36.419 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:36.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.410432  4057 tablet_service.cc:1511] Processing CreateTablet for tablet 5fa379231aa347d299f56467d01e8555 (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
18:32:36.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.423925  4057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fa379231aa347d299f56467d01e8555. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:36.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.440477  3915 tablet_service.cc:1511] Processing CreateTablet for tablet 5fa379231aa347d299f56467d01e8555 (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
18:32:36.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.444410  3914 tablet_service.cc:1511] Processing CreateTablet for tablet 0cba6ba156884b4c8f2a86f07bdde1fd (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
18:32:36.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.442797  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fa379231aa347d299f56467d01e8555. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:36.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.446692  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cba6ba156884b4c8f2a86f07bdde1fd. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:36.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.508988  4273 tablet_bootstrap.cc:492] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7: Bootstrap starting.
18:32:36.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.517654  4272 tablet_bootstrap.cc:492] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d: Bootstrap starting.
18:32:36.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.518055  4273 tablet_bootstrap.cc:654] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7: Neither blocks nor log segments found. Creating new log.
18:32:36.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.520393  4273 log.cc:826] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7: Log is configured to *not* fsync() on all Append() calls
18:32:36.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.544204  4275 tablet_bootstrap.cc:492] T 5fa379231aa347d299f56467d01e8555 P bcff4e6242a648a5ad29bd2dc8fca9ea: Bootstrap starting.
18:32:36.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.547217  4273 tablet_bootstrap.cc:492] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7: No bootstrap required, opened a new log
18:32:36.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.552783  4273 ts_tablet_manager.cc:1403] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.004s
18:32:36.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.557090  4272 tablet_bootstrap.cc:654] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d: Neither blocks nor log segments found. Creating new log.
18:32:36.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.558581  4275 tablet_bootstrap.cc:654] T 5fa379231aa347d299f56467d01e8555 P bcff4e6242a648a5ad29bd2dc8fca9ea: Neither blocks nor log segments found. Creating new log.
18:32:36.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.560851  4272 log.cc:826] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d: Log is configured to *not* fsync() on all Append() calls
18:32:36.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.560844  4275 log.cc:826] T 5fa379231aa347d299f56467d01e8555 P bcff4e6242a648a5ad29bd2dc8fca9ea: Log is configured to *not* fsync() on all Append() calls
18:32:36.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.574060  4275 tablet_bootstrap.cc:492] T 5fa379231aa347d299f56467d01e8555 P bcff4e6242a648a5ad29bd2dc8fca9ea: No bootstrap required, opened a new log
18:32:36.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.574576  4275 ts_tablet_manager.cc:1403] T 5fa379231aa347d299f56467d01e8555 P bcff4e6242a648a5ad29bd2dc8fca9ea: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.000s
18:32:36.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.576421  4273 raft_consensus.cc:359] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:36.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.577310  4273 raft_consensus.cc:385] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:36.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.577616  4273 raft_consensus.cc:740] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed90167029a48089d044ae7429783f7, State: Initialized, Role: FOLLOWER
18:32:36.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.578575  4273 consensus_queue.cc:260] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:36.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.584028  4272 tablet_bootstrap.cc:492] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d: No bootstrap required, opened a new log
18:32:36.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.584656  4272 ts_tablet_manager.cc:1403] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d: Time spent bootstrapping tablet: real 0.071s	user 0.006s	sys 0.011s
18:32:36.603 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:36.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.621196  4275 raft_consensus.cc:359] T 5fa379231aa347d299f56467d01e8555 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } }
18:32:36.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.622143  4275 raft_consensus.cc:385] T 5fa379231aa347d299f56467d01e8555 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:36.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.622604  4275 raft_consensus.cc:740] T 5fa379231aa347d299f56467d01e8555 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcff4e6242a648a5ad29bd2dc8fca9ea, State: Initialized, Role: FOLLOWER
18:32:36.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.623884  4275 consensus_queue.cc:260] T 5fa379231aa347d299f56467d01e8555 P bcff4e6242a648a5ad29bd2dc8fca9ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } }
18:32:36.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.629805  4273 ts_tablet_manager.cc:1434] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7: Time spent starting tablet: real 0.077s	user 0.025s	sys 0.046s
18:32:36.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.632400  4273 tablet_bootstrap.cc:492] T 5fa379231aa347d299f56467d01e8555 P bed90167029a48089d044ae7429783f7: Bootstrap starting.
18:32:36.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.641675  4273 tablet_bootstrap.cc:654] T 5fa379231aa347d299f56467d01e8555 P bed90167029a48089d044ae7429783f7: Neither blocks nor log segments found. Creating new log.
18:32:36.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.651887  4275 ts_tablet_manager.cc:1434] T 5fa379231aa347d299f56467d01e8555 P bcff4e6242a648a5ad29bd2dc8fca9ea: Time spent starting tablet: real 0.077s	user 0.037s	sys 0.005s
18:32:36.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.655751  4275 tablet_bootstrap.cc:492] T 0cba6ba156884b4c8f2a86f07bdde1fd P bcff4e6242a648a5ad29bd2dc8fca9ea: Bootstrap starting.
18:32:36.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:36.659579  3839 tablet.cc:2406] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:32:36.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.663501  4275 tablet_bootstrap.cc:654] T 0cba6ba156884b4c8f2a86f07bdde1fd P bcff4e6242a648a5ad29bd2dc8fca9ea: Neither blocks nor log segments found. Creating new log.
18:32:36.678 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:36.679 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:36.679 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:36.682 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:36.682 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:36.682 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:36.682 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:36.682 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:36.682 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:36.682 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:36.682 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:36.682 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:36.682 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:36.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.684724  4273 tablet_bootstrap.cc:492] T 5fa379231aa347d299f56467d01e8555 P bed90167029a48089d044ae7429783f7: No bootstrap required, opened a new log
18:32:36.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:36.684702  3989 tablet.cc:2406] T 5fa379231aa347d299f56467d01e8555 P bcff4e6242a648a5ad29bd2dc8fca9ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:32:36.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.685202  4273 ts_tablet_manager.cc:1403] T 5fa379231aa347d299f56467d01e8555 P bed90167029a48089d044ae7429783f7: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.028s
18:32:36.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.688648  4273 raft_consensus.cc:359] T 5fa379231aa347d299f56467d01e8555 P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } }
18:32:36.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.689563  4273 raft_consensus.cc:385] T 5fa379231aa347d299f56467d01e8555 P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:36.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.689909  4273 raft_consensus.cc:740] T 5fa379231aa347d299f56467d01e8555 P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed90167029a48089d044ae7429783f7, State: Initialized, Role: FOLLOWER
18:32:36.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.697521  4273 consensus_queue.cc:260] T 5fa379231aa347d299f56467d01e8555 P bed90167029a48089d044ae7429783f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } }
18:32:36.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.706504  4273 ts_tablet_manager.cc:1434] T 5fa379231aa347d299f56467d01e8555 P bed90167029a48089d044ae7429783f7: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.003s
18:32:36.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.710775  4275 tablet_bootstrap.cc:492] T 0cba6ba156884b4c8f2a86f07bdde1fd P bcff4e6242a648a5ad29bd2dc8fca9ea: No bootstrap required, opened a new log
18:32:36.712 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:36.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.711227  4275 ts_tablet_manager.cc:1403] T 0cba6ba156884b4c8f2a86f07bdde1fd P bcff4e6242a648a5ad29bd2dc8fca9ea: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.032s
18:32:36.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.704936  4272 raft_consensus.cc:359] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:36.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.715067  4272 raft_consensus.cc:385] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:36.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.715372  4272 raft_consensus.cc:740] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ecd1039231a404dbd66f834d9290a2d, State: Initialized, Role: FOLLOWER
18:32:36.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.717489  4272 consensus_queue.cc:260] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:36.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.719197  4275 raft_consensus.cc:359] T 0cba6ba156884b4c8f2a86f07bdde1fd P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:36.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.719902  4275 raft_consensus.cc:385] T 0cba6ba156884b4c8f2a86f07bdde1fd P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:36.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.720244  4275 raft_consensus.cc:740] T 0cba6ba156884b4c8f2a86f07bdde1fd P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcff4e6242a648a5ad29bd2dc8fca9ea, State: Initialized, Role: FOLLOWER
18:32:36.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.720932  4275 consensus_queue.cc:260] T 0cba6ba156884b4c8f2a86f07bdde1fd P bcff4e6242a648a5ad29bd2dc8fca9ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:36.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.723435  4275 ts_tablet_manager.cc:1434] T 0cba6ba156884b4c8f2a86f07bdde1fd P bcff4e6242a648a5ad29bd2dc8fca9ea: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
18:32:36.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.730528  4272 ts_tablet_manager.cc:1434] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d: Time spent starting tablet: real 0.146s	user 0.029s	sys 0.008s
18:32:36.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.731567  4272 tablet_bootstrap.cc:492] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d: Bootstrap starting.
18:32:36.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.740492  4272 tablet_bootstrap.cc:654] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d: Neither blocks nor log segments found. Creating new log.
18:32:36.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:36.748973  4129 tablet.cc:2406] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:32:36.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.765558  4272 tablet_bootstrap.cc:492] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d: No bootstrap required, opened a new log
18:32:36.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.766008  4272 ts_tablet_manager.cc:1403] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d: Time spent bootstrapping tablet: real 0.035s	user 0.024s	sys 0.006s
18:32:36.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.766777  4282 raft_consensus.cc:493] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:36.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.767414  4282 raft_consensus.cc:515] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:36.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.768751  4272 raft_consensus.cc:359] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } }
18:32:36.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.769388  4272 raft_consensus.cc:385] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:36.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.769660  4272 raft_consensus.cc:740] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ecd1039231a404dbd66f834d9290a2d, State: Initialized, Role: FOLLOWER
18:32:36.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.770272  4282 leader_election.cc:290] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed90167029a48089d044ae7429783f7 (127.3.43.129:43071), bcff4e6242a648a5ad29bd2dc8fca9ea (127.3.43.130:38355)
18:32:36.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.770301  4272 consensus_queue.cc:260] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } }
18:32:36.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.772948  4272 ts_tablet_manager.cc:1434] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
18:32:36.799 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:36.799 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:36.799 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:36.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.795275  4278 raft_consensus.cc:493] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:36.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.795995  4278 raft_consensus.cc:515] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:36.800 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:36.800 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:36.800 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:36.801 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:36.801 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:36.801 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:36.801 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:36.801 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:36.801 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:36.801 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:36.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.800848  3789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cba6ba156884b4c8f2a86f07bdde1fd" candidate_uuid: "7ecd1039231a404dbd66f834d9290a2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed90167029a48089d044ae7429783f7" is_pre_election: true
18:32:36.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.801692  3789 raft_consensus.cc:2468] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ecd1039231a404dbd66f834d9290a2d in term 0.
18:32:36.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.814155  4278 leader_election.cc:290] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bcff4e6242a648a5ad29bd2dc8fca9ea (127.3.43.130:38355), 7ecd1039231a404dbd66f834d9290a2d (127.3.43.131:38327)
18:32:36.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.815191  4013 leader_election.cc:304] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ecd1039231a404dbd66f834d9290a2d, bed90167029a48089d044ae7429783f7; no voters: 
18:32:36.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.816445  4282 raft_consensus.cc:2804] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Leader pre-election won for term 1
18:32:36.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.816885  4282 raft_consensus.cc:493] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:32:36.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.817281  4282 raft_consensus.cc:3060] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Advancing to term 1
18:32:36.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.830055  3935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cba6ba156884b4c8f2a86f07bdde1fd" candidate_uuid: "7ecd1039231a404dbd66f834d9290a2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" is_pre_election: true
18:32:36.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.830427  4282 raft_consensus.cc:515] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:36.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.831153  3935 raft_consensus.cc:2468] T 0cba6ba156884b4c8f2a86f07bdde1fd P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ecd1039231a404dbd66f834d9290a2d in term 0.
18:32:36.833 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:36.833 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:36.833 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:36.833 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:36.834 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:36.834 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:36.834 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:36.834 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:36.834 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:36.834 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:36.834 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:36.834 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:36.834 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:36.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.833868  3789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cba6ba156884b4c8f2a86f07bdde1fd" candidate_uuid: "7ecd1039231a404dbd66f834d9290a2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed90167029a48089d044ae7429783f7"
18:32:36.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.834436  3789 raft_consensus.cc:3060] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Advancing to term 1
18:32:36.838 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:36.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.842387  3789 raft_consensus.cc:2468] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ecd1039231a404dbd66f834d9290a2d in term 1.
18:32:36.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.843730  4013 leader_election.cc:304] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ecd1039231a404dbd66f834d9290a2d, bed90167029a48089d044ae7429783f7; no voters: 
18:32:36.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.846122  4282 leader_election.cc:290] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [CANDIDATE]: Term 1 election: Requested vote from peers bed90167029a48089d044ae7429783f7 (127.3.43.129:43071), bcff4e6242a648a5ad29bd2dc8fca9ea (127.3.43.130:38355)
18:32:36.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.847187  4282 raft_consensus.cc:2804] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [term 1 FOLLOWER]: Leader election won for term 1
18:32:36.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.847496  3935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cba6ba156884b4c8f2a86f07bdde1fd" candidate_uuid: "7ecd1039231a404dbd66f834d9290a2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea"
18:32:36.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.848122  3935 raft_consensus.cc:3060] T 0cba6ba156884b4c8f2a86f07bdde1fd P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Advancing to term 1
18:32:36.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.848011  4282 raft_consensus.cc:697] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [term 1 LEADER]: Becoming Leader. State: Replica: 7ecd1039231a404dbd66f834d9290a2d, State: Running, Role: LEADER
18:32:36.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.855986  3935 raft_consensus.cc:2468] T 0cba6ba156884b4c8f2a86f07bdde1fd P bcff4e6242a648a5ad29bd2dc8fca9ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ecd1039231a404dbd66f834d9290a2d in term 1.
18:32:36.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.857291  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cba6ba156884b4c8f2a86f07bdde1fd" candidate_uuid: "bed90167029a48089d044ae7429783f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" is_pre_election: true
18:32:36.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.858359  3934 raft_consensus.cc:2393] T 0cba6ba156884b4c8f2a86f07bdde1fd P bcff4e6242a648a5ad29bd2dc8fca9ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bed90167029a48089d044ae7429783f7 in current term 1: Already voted for candidate 7ecd1039231a404dbd66f834d9290a2d in this term.
18:32:36.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.855787  4282 consensus_queue.cc:237] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:36.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.864317  4079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cba6ba156884b4c8f2a86f07bdde1fd" candidate_uuid: "bed90167029a48089d044ae7429783f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ecd1039231a404dbd66f834d9290a2d" is_pre_election: true
18:32:36.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.866648  3721 leader_election.cc:304] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed90167029a48089d044ae7429783f7; no voters: 7ecd1039231a404dbd66f834d9290a2d, bcff4e6242a648a5ad29bd2dc8fca9ea
18:32:36.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.867795  4278 raft_consensus.cc:2749] T 0cba6ba156884b4c8f2a86f07bdde1fd P bed90167029a48089d044ae7429783f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:32:36.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:36.900985  3462 catalog_manager.cc:5696] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ecd1039231a404dbd66f834d9290a2d (127.3.43.131). New cstate: current_term: 1 leader_uuid: "7ecd1039231a404dbd66f834d9290a2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } health_report { overall_health: HEALTHY } } }
18:32:36.953 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:36.953 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:36.954 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:36.954 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:36.954 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:36.954 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:36.954 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:36.954 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:36.954 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:36.954 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:36.955 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:36.955 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:36.955 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:37.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.060967  4282 raft_consensus.cc:493] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:37.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.061483  4282 raft_consensus.cc:515] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } }
18:32:37.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.063439  4282 leader_election.cc:290] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bcff4e6242a648a5ad29bd2dc8fca9ea (127.3.43.130:38355), bed90167029a48089d044ae7429783f7 (127.3.43.129:43071)
18:32:37.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.064527  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa379231aa347d299f56467d01e8555" candidate_uuid: "7ecd1039231a404dbd66f834d9290a2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" is_pre_election: true
18:32:37.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.064627  3789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa379231aa347d299f56467d01e8555" candidate_uuid: "7ecd1039231a404dbd66f834d9290a2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed90167029a48089d044ae7429783f7" is_pre_election: true
18:32:37.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.065006  3934 raft_consensus.cc:2468] T 5fa379231aa347d299f56467d01e8555 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ecd1039231a404dbd66f834d9290a2d in term 0.
18:32:37.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.065151  3789 raft_consensus.cc:2468] T 5fa379231aa347d299f56467d01e8555 P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ecd1039231a404dbd66f834d9290a2d in term 0.
18:32:37.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.066092  4012 leader_election.cc:304] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ecd1039231a404dbd66f834d9290a2d, bcff4e6242a648a5ad29bd2dc8fca9ea; no voters: 
18:32:37.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.066895  4282 raft_consensus.cc:2804] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Leader pre-election won for term 1
18:32:37.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.067929  4282 raft_consensus.cc:493] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:32:37.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.068272  4282 raft_consensus.cc:3060] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Advancing to term 1
18:32:37.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.073827  4282 raft_consensus.cc:515] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } }
18:32:37.075 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:37.076 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:37.076 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:37.076 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:37.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.075888  4282 leader_election.cc:290] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [CANDIDATE]: Term 1 election: Requested vote from peers bcff4e6242a648a5ad29bd2dc8fca9ea (127.3.43.130:38355), bed90167029a48089d044ae7429783f7 (127.3.43.129:43071)
18:32:37.076 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:37.076 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:37.076 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:37.076 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:37.076 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:37.076 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:37.076 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:37.076 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:37.077 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:37.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.076591  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa379231aa347d299f56467d01e8555" candidate_uuid: "7ecd1039231a404dbd66f834d9290a2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea"
18:32:37.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.077180  3934 raft_consensus.cc:3060] T 5fa379231aa347d299f56467d01e8555 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Advancing to term 1
18:32:37.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.078259  3789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa379231aa347d299f56467d01e8555" candidate_uuid: "7ecd1039231a404dbd66f834d9290a2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed90167029a48089d044ae7429783f7"
18:32:37.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.078814  3789 raft_consensus.cc:3060] T 5fa379231aa347d299f56467d01e8555 P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Advancing to term 1
18:32:37.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.085304  3789 raft_consensus.cc:2468] T 5fa379231aa347d299f56467d01e8555 P bed90167029a48089d044ae7429783f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ecd1039231a404dbd66f834d9290a2d in term 1.
18:32:37.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.086372  3934 raft_consensus.cc:2468] T 5fa379231aa347d299f56467d01e8555 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ecd1039231a404dbd66f834d9290a2d in term 1.
18:32:37.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.087082  4013 leader_election.cc:304] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ecd1039231a404dbd66f834d9290a2d, bed90167029a48089d044ae7429783f7; no voters: 
18:32:37.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.087924  4282 raft_consensus.cc:2804] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [term 1 FOLLOWER]: Leader election won for term 1
18:32:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.088493  4282 raft_consensus.cc:697] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [term 1 LEADER]: Becoming Leader. State: Replica: 7ecd1039231a404dbd66f834d9290a2d, State: Running, Role: LEADER
18:32:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.089361  4282 consensus_queue.cc:237] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } }
18:32:37.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.098454  3462 catalog_manager.cc:5696] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ecd1039231a404dbd66f834d9290a2d (127.3.43.131). New cstate: current_term: 1 leader_uuid: "7ecd1039231a404dbd66f834d9290a2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } health_report { overall_health: UNKNOWN } } }
18:32:37.104 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:37.155 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:37.156 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:37.156 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:37.156 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:37.156 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:37.156 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:37.156 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:37.156 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:37.156 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:37.156 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:37.156 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:37.156 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:37.156 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:37.195 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:37.196 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:37.196 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:37.196 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:37.196 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:37.196 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:37.196 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:37.196 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:37.196 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:37.196 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:37.196 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:37.196 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:37.196 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:37.211 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:37.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.264259  4282 consensus_queue.cc:1048] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:37.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.273279  4282 consensus_queue.cc:1048] T 0cba6ba156884b4c8f2a86f07bdde1fd P 7ecd1039231a404dbd66f834d9290a2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:37.337 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:37.338 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:37.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:37.338 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:37.338 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:37.338 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:37.339 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:37.339 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:37.339 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:37.339 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:37.338 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:37.339 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:37.339 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:37.339 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:37.374 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:37.374 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:37.375 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:37.375 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:37.375 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:37.375 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:37.375 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:37.375 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:37.375 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:37.375 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:37.375 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:37.375 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:37.375 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:37.443 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:37.443 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:37.443 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:37.443 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:37.443 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:37.444 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:37.444 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:37.444 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:37.444 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:37.444 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:37.444 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:37.444 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:37.444 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:37.532 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:37.533 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:37.533 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:37.533 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:37.533 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:37.533 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:37.533 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:37.533 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:37.533 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:37.534 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:37.534 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:37.534 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:37.534 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:37.602 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:37.647 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:37.647 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:37.648 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:37.648 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:37.648 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:37.648 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:37.648 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:37.648 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:37.648 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:37.648 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:37.648 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:37.648 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:37.648 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:37.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.650345  4302 consensus_queue.cc:1048] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:37.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.660535  4282 consensus_queue.cc:1048] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:37.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.701787  3462 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42170:
18:32:37.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\0012\000\000\000\007\001\226\000\000\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
18:32:37.711 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:37.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:37.747867  3462 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2d16b8dc05e430ba368fdce09cf6cfa has no consensus state
18:32:37.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:37.752054  3462 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3cd1aa7ed7df4357ab66fc58805f62e3 has no consensus state
18:32:37.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:37.782369  3444 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet c2d16b8dc05e430ba368fdce09cf6cfa (table replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet c2d16b8dc05e430ba368fdce09cf6cfa consensus state has no leader
18:32:37.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.784854  3768 tablet_service.cc:1511] Processing CreateTablet for tablet c2d16b8dc05e430ba368fdce09cf6cfa (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
18:32:37.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.786082  3768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d16b8dc05e430ba368fdce09cf6cfa. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:37.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.789036  3915 tablet_service.cc:1511] Processing CreateTablet for tablet c2d16b8dc05e430ba368fdce09cf6cfa (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
18:32:37.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.790315  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d16b8dc05e430ba368fdce09cf6cfa. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:37.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.791960  4056 tablet_service.cc:1511] Processing CreateTablet for tablet c2d16b8dc05e430ba368fdce09cf6cfa (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
18:32:37.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.793155  4056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d16b8dc05e430ba368fdce09cf6cfa. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:37.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.798290  4057 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd1aa7ed7df4357ab66fc58805f62e3 (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
18:32:37.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.799476  4057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd1aa7ed7df4357ab66fc58805f62e3. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:37.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.803476  3914 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd1aa7ed7df4357ab66fc58805f62e3 (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
18:32:37.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.803633  3769 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd1aa7ed7df4357ab66fc58805f62e3 (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
18:32:37.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.804715  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd1aa7ed7df4357ab66fc58805f62e3. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:37.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.804877  3769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd1aa7ed7df4357ab66fc58805f62e3. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:37.818 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:37.819 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:37.819 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:37.819 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:37.819 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:37.819 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:37.820 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:37.820 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:37.820 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:37.820 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:37.820 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:37.820 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:37.820 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:37.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.824783  4319 tablet_bootstrap.cc:492] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea: Bootstrap starting.
18:32:37.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.827112  4320 tablet_bootstrap.cc:492] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bed90167029a48089d044ae7429783f7: Bootstrap starting.
18:32:37.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.831485  4319 tablet_bootstrap.cc:654] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea: Neither blocks nor log segments found. Creating new log.
18:32:37.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.833300  4320 tablet_bootstrap.cc:654] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bed90167029a48089d044ae7429783f7: Neither blocks nor log segments found. Creating new log.
18:32:37.838 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:37.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.843204  4319 tablet_bootstrap.cc:492] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea: No bootstrap required, opened a new log
18:32:37.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.843627  4319 ts_tablet_manager.cc:1403] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.002s
18:32:37.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.857558  4319 raft_consensus.cc:359] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:37.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.858428  4319 raft_consensus.cc:385] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:37.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.858788  4319 raft_consensus.cc:740] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcff4e6242a648a5ad29bd2dc8fca9ea, State: Initialized, Role: FOLLOWER
18:32:37.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.863111  4319 consensus_queue.cc:260] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:37.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.875645  4320 tablet_bootstrap.cc:492] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bed90167029a48089d044ae7429783f7: No bootstrap required, opened a new log
18:32:37.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.876101  4320 ts_tablet_manager.cc:1403] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bed90167029a48089d044ae7429783f7: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.005s
18:32:37.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.878777  4319 ts_tablet_manager.cc:1434] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
18:32:37.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.879293  4323 tablet_bootstrap.cc:492] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d: Bootstrap starting.
18:32:37.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.879683  4320 raft_consensus.cc:359] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:37.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.880385  4320 raft_consensus.cc:385] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:37.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.880676  4320 raft_consensus.cc:740] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed90167029a48089d044ae7429783f7, State: Initialized, Role: FOLLOWER
18:32:37.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.881492  4320 consensus_queue.cc:260] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bed90167029a48089d044ae7429783f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:37.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.887938  4323 tablet_bootstrap.cc:654] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d: Neither blocks nor log segments found. Creating new log.
18:32:37.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.886737  4319 tablet_bootstrap.cc:492] T c2d16b8dc05e430ba368fdce09cf6cfa P bcff4e6242a648a5ad29bd2dc8fca9ea: Bootstrap starting.
18:32:37.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.904764  4319 tablet_bootstrap.cc:654] T c2d16b8dc05e430ba368fdce09cf6cfa P bcff4e6242a648a5ad29bd2dc8fca9ea: Neither blocks nor log segments found. Creating new log.
18:32:37.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.912230  4320 ts_tablet_manager.cc:1434] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bed90167029a48089d044ae7429783f7: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
18:32:37.920 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:37.920 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:37.920 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:37.921 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:37.921 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:37.921 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:37.922 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:37.922 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:37.922 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:37.922 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:37.922 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:37.926 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:37.927 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:37.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.929668  4320 tablet_bootstrap.cc:492] T c2d16b8dc05e430ba368fdce09cf6cfa P bed90167029a48089d044ae7429783f7: Bootstrap starting.
18:32:37.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.941484  4323 tablet_bootstrap.cc:492] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d: No bootstrap required, opened a new log
18:32:37.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.942059  4323 ts_tablet_manager.cc:1403] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d: Time spent bootstrapping tablet: real 0.063s	user 0.007s	sys 0.010s
18:32:37.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.946537  4299 raft_consensus.cc:493] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:37.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.947101  4299 raft_consensus.cc:515] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:37.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.945969  4323 raft_consensus.cc:359] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:37.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.948573  4320 tablet_bootstrap.cc:654] T c2d16b8dc05e430ba368fdce09cf6cfa P bed90167029a48089d044ae7429783f7: Neither blocks nor log segments found. Creating new log.
18:32:37.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.950119  4323 raft_consensus.cc:385] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:37.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.950459  4323 raft_consensus.cc:740] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ecd1039231a404dbd66f834d9290a2d, State: Initialized, Role: FOLLOWER
18:32:37.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.951319  4323 consensus_queue.cc:260] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:37.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.955263  4299 leader_election.cc:290] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed90167029a48089d044ae7429783f7 (127.3.43.129:43071), 7ecd1039231a404dbd66f834d9290a2d (127.3.43.131:38327)
18:32:37.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.968201  4323 ts_tablet_manager.cc:1434] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d: Time spent starting tablet: real 0.026s	user 0.001s	sys 0.005s
18:32:37.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.969247  4323 tablet_bootstrap.cc:492] T 3cd1aa7ed7df4357ab66fc58805f62e3 P 7ecd1039231a404dbd66f834d9290a2d: Bootstrap starting.
18:32:37.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.985916  4323 tablet_bootstrap.cc:654] T 3cd1aa7ed7df4357ab66fc58805f62e3 P 7ecd1039231a404dbd66f834d9290a2d: Neither blocks nor log segments found. Creating new log.
18:32:37.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.987001  3462 catalog_manager.cc:6241] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57: replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300] alter complete (version 0)
18:32:37.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.998873  3789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd1aa7ed7df4357ab66fc58805f62e3" candidate_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed90167029a48089d044ae7429783f7" is_pre_election: true
18:32:37.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:37.999581  3789 raft_consensus.cc:2468] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcff4e6242a648a5ad29bd2dc8fca9ea in term 0.
18:32:38.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.002604  3871 leader_election.cc:304] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcff4e6242a648a5ad29bd2dc8fca9ea, bed90167029a48089d044ae7429783f7; no voters: 
18:32:38.004 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:38.004 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:38.004 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:38.005 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:38.005 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:38.005 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:38.005 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:38.005 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:38.005 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:38.006 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:38.006 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:38.006 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:38.006 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:38.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.012913  4299 raft_consensus.cc:2804] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Leader pre-election won for term 1
18:32:38.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.013317  4299 raft_consensus.cc:493] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:32:38.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.013702  4299 raft_consensus.cc:3060] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Advancing to term 1
18:32:38.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.015229  4323 tablet_bootstrap.cc:492] T 3cd1aa7ed7df4357ab66fc58805f62e3 P 7ecd1039231a404dbd66f834d9290a2d: No bootstrap required, opened a new log
18:32:38.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.015722  4323 ts_tablet_manager.cc:1403] T 3cd1aa7ed7df4357ab66fc58805f62e3 P 7ecd1039231a404dbd66f834d9290a2d: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.002s
18:32:38.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.016165  4320 tablet_bootstrap.cc:492] T c2d16b8dc05e430ba368fdce09cf6cfa P bed90167029a48089d044ae7429783f7: No bootstrap required, opened a new log
18:32:38.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.016630  4320 ts_tablet_manager.cc:1403] T c2d16b8dc05e430ba368fdce09cf6cfa P bed90167029a48089d044ae7429783f7: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.003s
18:32:38.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.019261  4323 raft_consensus.cc:359] T 3cd1aa7ed7df4357ab66fc58805f62e3 P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.019400  4320 raft_consensus.cc:359] T c2d16b8dc05e430ba368fdce09cf6cfa P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.020200  4320 raft_consensus.cc:385] T c2d16b8dc05e430ba368fdce09cf6cfa P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:38.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.020190  4323 raft_consensus.cc:385] T 3cd1aa7ed7df4357ab66fc58805f62e3 P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:38.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.020530  4323 raft_consensus.cc:740] T 3cd1aa7ed7df4357ab66fc58805f62e3 P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ecd1039231a404dbd66f834d9290a2d, State: Initialized, Role: FOLLOWER
18:32:38.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.021494  4323 consensus_queue.cc:260] T 3cd1aa7ed7df4357ab66fc58805f62e3 P 7ecd1039231a404dbd66f834d9290a2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.020495  4320 raft_consensus.cc:740] T c2d16b8dc05e430ba368fdce09cf6cfa P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed90167029a48089d044ae7429783f7, State: Initialized, Role: FOLLOWER
18:32:38.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.023909  4320 consensus_queue.cc:260] T c2d16b8dc05e430ba368fdce09cf6cfa P bed90167029a48089d044ae7429783f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.027798  4320 ts_tablet_manager.cc:1434] T c2d16b8dc05e430ba368fdce09cf6cfa P bed90167029a48089d044ae7429783f7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
18:32:38.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.031304  4323 ts_tablet_manager.cc:1434] T 3cd1aa7ed7df4357ab66fc58805f62e3 P 7ecd1039231a404dbd66f834d9290a2d: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
18:32:38.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.032810  4299 raft_consensus.cc:515] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.035821  4299 leader_election.cc:290] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [CANDIDATE]: Term 1 election: Requested vote from peers bed90167029a48089d044ae7429783f7 (127.3.43.129:43071), 7ecd1039231a404dbd66f834d9290a2d (127.3.43.131:38327)
18:32:38.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.036687  3789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd1aa7ed7df4357ab66fc58805f62e3" candidate_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed90167029a48089d044ae7429783f7"
18:32:38.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.037225  3789 raft_consensus.cc:3060] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Advancing to term 1
18:32:38.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.054565  3789 raft_consensus.cc:2468] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bed90167029a48089d044ae7429783f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcff4e6242a648a5ad29bd2dc8fca9ea in term 1.
18:32:38.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.055757  3871 leader_election.cc:304] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcff4e6242a648a5ad29bd2dc8fca9ea, bed90167029a48089d044ae7429783f7; no voters: 
18:32:38.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.057283  4299 raft_consensus.cc:2804] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 1 FOLLOWER]: Leader election won for term 1
18:32:38.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.061707  4319 tablet_bootstrap.cc:492] T c2d16b8dc05e430ba368fdce09cf6cfa P bcff4e6242a648a5ad29bd2dc8fca9ea: No bootstrap required, opened a new log
18:32:38.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.062260  4319 ts_tablet_manager.cc:1403] T c2d16b8dc05e430ba368fdce09cf6cfa P bcff4e6242a648a5ad29bd2dc8fca9ea: Time spent bootstrapping tablet: real 0.176s	user 0.016s	sys 0.017s
18:32:38.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.065918  4319 raft_consensus.cc:359] T c2d16b8dc05e430ba368fdce09cf6cfa P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.066900  4319 raft_consensus.cc:385] T c2d16b8dc05e430ba368fdce09cf6cfa P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:38.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.067294  4319 raft_consensus.cc:740] T c2d16b8dc05e430ba368fdce09cf6cfa P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcff4e6242a648a5ad29bd2dc8fca9ea, State: Initialized, Role: FOLLOWER
18:32:38.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.068193  4319 consensus_queue.cc:260] T c2d16b8dc05e430ba368fdce09cf6cfa P bcff4e6242a648a5ad29bd2dc8fca9ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.067808  3462 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42170:
18:32:38.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001\226\000\000\000\007\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
18:32:38.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.084332  4319 ts_tablet_manager.cc:1434] T c2d16b8dc05e430ba368fdce09cf6cfa P bcff4e6242a648a5ad29bd2dc8fca9ea: Time spent starting tablet: real 0.022s	user 0.016s	sys 0.002s
18:32:38.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.095496  4299 raft_consensus.cc:697] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 1 LEADER]: Becoming Leader. State: Replica: bcff4e6242a648a5ad29bd2dc8fca9ea, State: Running, Role: LEADER
18:32:38.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.096609  4299 consensus_queue.cc:237] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.103791  4078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd1aa7ed7df4357ab66fc58805f62e3" candidate_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ecd1039231a404dbd66f834d9290a2d"
18:32:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.104537  4078 raft_consensus.cc:3060] T 3cd1aa7ed7df4357ab66fc58805f62e3 P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Advancing to term 1
18:32:38.108 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:38.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.109263  4079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd1aa7ed7df4357ab66fc58805f62e3" candidate_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ecd1039231a404dbd66f834d9290a2d" is_pre_election: true
18:32:38.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.114405  4078 raft_consensus.cc:2468] T 3cd1aa7ed7df4357ab66fc58805f62e3 P 7ecd1039231a404dbd66f834d9290a2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcff4e6242a648a5ad29bd2dc8fca9ea in term 1.
18:32:38.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:38.123540  3462 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2d16b8dc05e430ba368fdce09cf6cfa consensus state has no leader
18:32:38.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:38.124118  3462 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49907dc63f1c46a383141035a9353a56 has no consensus state
18:32:38.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:38.126091  3462 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3cd1aa7ed7df4357ab66fc58805f62e3 consensus state has no leader
18:32:38.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:38.126650  3462 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c9d24669dd74422a060ddb81c161ceb has no consensus state
18:32:38.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.177233  3462 catalog_manager.cc:5696] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea reported cstate change: term changed from 0 to 1, leader changed from <none> to bcff4e6242a648a5ad29bd2dc8fca9ea (127.3.43.130). New cstate: current_term: 1 leader_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } health_report { overall_health: UNKNOWN } } }
18:32:38.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.184618  3915 tablet_service.cc:1511] Processing CreateTablet for tablet 49907dc63f1c46a383141035a9353a56 (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
18:32:38.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.186045  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49907dc63f1c46a383141035a9353a56. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:38.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.189071  3768 tablet_service.cc:1511] Processing CreateTablet for tablet 49907dc63f1c46a383141035a9353a56 (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
18:32:38.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.190403  3768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49907dc63f1c46a383141035a9353a56. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:38.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.191545  4056 tablet_service.cc:1511] Processing CreateTablet for tablet 49907dc63f1c46a383141035a9353a56 (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
18:32:38.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.192770  4056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49907dc63f1c46a383141035a9353a56. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:38.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.206485  3769 tablet_service.cc:1511] Processing CreateTablet for tablet 3c9d24669dd74422a060ddb81c161ceb (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
18:32:38.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.207876  3769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c9d24669dd74422a060ddb81c161ceb. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:38.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.207857  3914 tablet_service.cc:1511] Processing CreateTablet for tablet 3c9d24669dd74422a060ddb81c161ceb (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
18:32:38.211 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:38.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.209713  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c9d24669dd74422a060ddb81c161ceb. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:38.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.210932  4057 tablet_service.cc:1511] Processing CreateTablet for tablet 3c9d24669dd74422a060ddb81c161ceb (DEFAULT_TABLE table=replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
18:32:38.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.212093  4057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c9d24669dd74422a060ddb81c161ceb. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:38.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.228507  4319 tablet_bootstrap.cc:492] T 3c9d24669dd74422a060ddb81c161ceb P bcff4e6242a648a5ad29bd2dc8fca9ea: Bootstrap starting.
18:32:38.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.235428  4320 tablet_bootstrap.cc:492] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7: Bootstrap starting.
18:32:38.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.242076  4323 tablet_bootstrap.cc:492] T 3c9d24669dd74422a060ddb81c161ceb P 7ecd1039231a404dbd66f834d9290a2d: Bootstrap starting.
18:32:38.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.244256  4319 tablet_bootstrap.cc:654] T 3c9d24669dd74422a060ddb81c161ceb P bcff4e6242a648a5ad29bd2dc8fca9ea: Neither blocks nor log segments found. Creating new log.
18:32:38.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.247084  4320 tablet_bootstrap.cc:654] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7: Neither blocks nor log segments found. Creating new log.
18:32:38.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.253960  4323 tablet_bootstrap.cc:654] T 3c9d24669dd74422a060ddb81c161ceb P 7ecd1039231a404dbd66f834d9290a2d: Neither blocks nor log segments found. Creating new log.
18:32:38.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.257006  4319 tablet_bootstrap.cc:492] T 3c9d24669dd74422a060ddb81c161ceb P bcff4e6242a648a5ad29bd2dc8fca9ea: No bootstrap required, opened a new log
18:32:38.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.258078  4319 ts_tablet_manager.cc:1403] T 3c9d24669dd74422a060ddb81c161ceb P bcff4e6242a648a5ad29bd2dc8fca9ea: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.000s
18:32:38.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.262200  4320 tablet_bootstrap.cc:492] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7: No bootstrap required, opened a new log
18:32:38.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.262665  4320 ts_tablet_manager.cc:1403] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
18:32:38.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.263737  4323 tablet_bootstrap.cc:492] T 3c9d24669dd74422a060ddb81c161ceb P 7ecd1039231a404dbd66f834d9290a2d: No bootstrap required, opened a new log
18:32:38.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.264305  4323 ts_tablet_manager.cc:1403] T 3c9d24669dd74422a060ddb81c161ceb P 7ecd1039231a404dbd66f834d9290a2d: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.005s
18:32:38.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.267138  4323 raft_consensus.cc:359] T 3c9d24669dd74422a060ddb81c161ceb P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.267743  4323 raft_consensus.cc:385] T 3c9d24669dd74422a060ddb81c161ceb P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:38.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.268031  4323 raft_consensus.cc:740] T 3c9d24669dd74422a060ddb81c161ceb P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ecd1039231a404dbd66f834d9290a2d, State: Initialized, Role: FOLLOWER
18:32:38.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.268532  4319 raft_consensus.cc:359] T 3c9d24669dd74422a060ddb81c161ceb P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.269194  4319 raft_consensus.cc:385] T 3c9d24669dd74422a060ddb81c161ceb P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:38.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.268834  4323 consensus_queue.cc:260] T 3c9d24669dd74422a060ddb81c161ceb P 7ecd1039231a404dbd66f834d9290a2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.269464  4319 raft_consensus.cc:740] T 3c9d24669dd74422a060ddb81c161ceb P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcff4e6242a648a5ad29bd2dc8fca9ea, State: Initialized, Role: FOLLOWER
18:32:38.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.271148  4323 ts_tablet_manager.cc:1434] T 3c9d24669dd74422a060ddb81c161ceb P 7ecd1039231a404dbd66f834d9290a2d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
18:32:38.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.272575  4323 tablet_bootstrap.cc:492] T 49907dc63f1c46a383141035a9353a56 P 7ecd1039231a404dbd66f834d9290a2d: Bootstrap starting.
18:32:38.277 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:38.278 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:38.278 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:38.278 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:38.278 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:38.278 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:38.279 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:38.279 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:38.279 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:38.279 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:38.279 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:38.279 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:38.279 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:38.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.279636  4323 tablet_bootstrap.cc:654] T 49907dc63f1c46a383141035a9353a56 P 7ecd1039231a404dbd66f834d9290a2d: Neither blocks nor log segments found. Creating new log.
18:32:38.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.276341  4320 raft_consensus.cc:359] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.280210  4320 raft_consensus.cc:385] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:38.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.280494  4320 raft_consensus.cc:740] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed90167029a48089d044ae7429783f7, State: Initialized, Role: FOLLOWER
18:32:38.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.281394  4319 consensus_queue.cc:260] T 3c9d24669dd74422a060ddb81c161ceb P bcff4e6242a648a5ad29bd2dc8fca9ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.281172  4320 consensus_queue.cc:260] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.285763  4319 ts_tablet_manager.cc:1434] T 3c9d24669dd74422a060ddb81c161ceb P bcff4e6242a648a5ad29bd2dc8fca9ea: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
18:32:38.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.287046  4319 tablet_bootstrap.cc:492] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea: Bootstrap starting.
18:32:38.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.299540  4320 ts_tablet_manager.cc:1434] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
18:32:38.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.302562  4320 tablet_bootstrap.cc:492] T 49907dc63f1c46a383141035a9353a56 P bed90167029a48089d044ae7429783f7: Bootstrap starting.
18:32:38.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.306031  4336 raft_consensus.cc:493] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:38.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.306670  4336 raft_consensus.cc:515] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.311012  3789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d16b8dc05e430ba368fdce09cf6cfa" candidate_uuid: "7ecd1039231a404dbd66f834d9290a2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed90167029a48089d044ae7429783f7" is_pre_election: true
18:32:38.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.311836  3789 raft_consensus.cc:2468] T c2d16b8dc05e430ba368fdce09cf6cfa P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ecd1039231a404dbd66f834d9290a2d in term 0.
18:32:38.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.313784  4336 leader_election.cc:290] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed90167029a48089d044ae7429783f7 (127.3.43.129:43071), bcff4e6242a648a5ad29bd2dc8fca9ea (127.3.43.130:38355)
18:32:38.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.318017  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d16b8dc05e430ba368fdce09cf6cfa" candidate_uuid: "7ecd1039231a404dbd66f834d9290a2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" is_pre_election: true
18:32:38.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.319140  3934 raft_consensus.cc:2468] T c2d16b8dc05e430ba368fdce09cf6cfa P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ecd1039231a404dbd66f834d9290a2d in term 0.
18:32:38.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.315227  4013 leader_election.cc:304] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ecd1039231a404dbd66f834d9290a2d, bed90167029a48089d044ae7429783f7; no voters: 
18:32:38.337 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:38.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.336083  4319 tablet_bootstrap.cc:654] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea: Neither blocks nor log segments found. Creating new log.
18:32:38.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.339278  4320 tablet_bootstrap.cc:654] T 49907dc63f1c46a383141035a9353a56 P bed90167029a48089d044ae7429783f7: Neither blocks nor log segments found. Creating new log.
18:32:38.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.351150  4278 raft_consensus.cc:493] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:38.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.351629  4278 raft_consensus.cc:515] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.353775  4278 leader_election.cc:290] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bcff4e6242a648a5ad29bd2dc8fca9ea (127.3.43.130:38355), 7ecd1039231a404dbd66f834d9290a2d (127.3.43.131:38327)
18:32:38.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.356341  4302 raft_consensus.cc:2804] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Leader pre-election won for term 1
18:32:38.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.356698  4302 raft_consensus.cc:493] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:32:38.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.356930  4319 tablet_bootstrap.cc:492] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea: No bootstrap required, opened a new log
18:32:38.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.357003  4302 raft_consensus.cc:3060] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Advancing to term 1
18:32:38.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.357365  4319 ts_tablet_manager.cc:1403] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea: Time spent bootstrapping tablet: real 0.071s	user 0.003s	sys 0.007s
18:32:38.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.359565  4078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d24669dd74422a060ddb81c161ceb" candidate_uuid: "bed90167029a48089d044ae7429783f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ecd1039231a404dbd66f834d9290a2d" is_pre_election: true
18:32:38.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.359714  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d24669dd74422a060ddb81c161ceb" candidate_uuid: "bed90167029a48089d044ae7429783f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" is_pre_election: true
18:32:38.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.360189  4078 raft_consensus.cc:2468] T 3c9d24669dd74422a060ddb81c161ceb P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed90167029a48089d044ae7429783f7 in term 0.
18:32:38.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.360080  4319 raft_consensus.cc:359] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.360461  3934 raft_consensus.cc:2468] T 3c9d24669dd74422a060ddb81c161ceb P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed90167029a48089d044ae7429783f7 in term 0.
18:32:38.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.360752  4319 raft_consensus.cc:385] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:38.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.361049  4319 raft_consensus.cc:740] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcff4e6242a648a5ad29bd2dc8fca9ea, State: Initialized, Role: FOLLOWER
18:32:38.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.361778  4319 consensus_queue.cc:260] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.362561  3723 leader_election.cc:304] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcff4e6242a648a5ad29bd2dc8fca9ea, bed90167029a48089d044ae7429783f7; no voters: 
18:32:38.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.364559  4319 ts_tablet_manager.cc:1434] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
18:32:38.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:38.368198  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.43.130:38355, user_credentials={real_user=slave}} blocked reactor thread for 47182.8us
18:32:38.378 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:38.378 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:38.378 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:38.379 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:38.379 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:38.379 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:38.379 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:38.379 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:38.379 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:38.379 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:38.379 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:38.379 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:38.379 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:38.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.385749  4278 raft_consensus.cc:2804] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:32:38.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.386154  4278 raft_consensus.cc:493] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:32:38.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.386516  4278 raft_consensus.cc:3060] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Advancing to term 1
18:32:38.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.399556  4302 raft_consensus.cc:515] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.406175  3789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d16b8dc05e430ba368fdce09cf6cfa" candidate_uuid: "7ecd1039231a404dbd66f834d9290a2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed90167029a48089d044ae7429783f7"
18:32:38.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.408510  4302 leader_election.cc:290] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [CANDIDATE]: Term 1 election: Requested vote from peers bed90167029a48089d044ae7429783f7 (127.3.43.129:43071), bcff4e6242a648a5ad29bd2dc8fca9ea (127.3.43.130:38355)
18:32:38.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.408192  3789 raft_consensus.cc:3060] T c2d16b8dc05e430ba368fdce09cf6cfa P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Advancing to term 1
18:32:38.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.408197  4278 raft_consensus.cc:515] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.417322  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d24669dd74422a060ddb81c161ceb" candidate_uuid: "bed90167029a48089d044ae7429783f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea"
18:32:38.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.418102  3934 raft_consensus.cc:3060] T 3c9d24669dd74422a060ddb81c161ceb P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Advancing to term 1
18:32:38.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.418848  4320 tablet_bootstrap.cc:492] T 49907dc63f1c46a383141035a9353a56 P bed90167029a48089d044ae7429783f7: No bootstrap required, opened a new log
18:32:38.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.419288  4320 ts_tablet_manager.cc:1403] T 49907dc63f1c46a383141035a9353a56 P bed90167029a48089d044ae7429783f7: Time spent bootstrapping tablet: real 0.117s	user 0.009s	sys 0.003s
18:32:38.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.419345  4078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d24669dd74422a060ddb81c161ceb" candidate_uuid: "bed90167029a48089d044ae7429783f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ecd1039231a404dbd66f834d9290a2d"
18:32:38.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.419868  4078 raft_consensus.cc:3060] T 3c9d24669dd74422a060ddb81c161ceb P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Advancing to term 1
18:32:38.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.421924  4320 raft_consensus.cc:359] T 49907dc63f1c46a383141035a9353a56 P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.422642  4320 raft_consensus.cc:385] T 49907dc63f1c46a383141035a9353a56 P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:38.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.422943  4320 raft_consensus.cc:740] T 49907dc63f1c46a383141035a9353a56 P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed90167029a48089d044ae7429783f7, State: Initialized, Role: FOLLOWER
18:32:38.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.423669  4320 consensus_queue.cc:260] T 49907dc63f1c46a383141035a9353a56 P bed90167029a48089d044ae7429783f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.430433  4078 raft_consensus.cc:2468] T 3c9d24669dd74422a060ddb81c161ceb P 7ecd1039231a404dbd66f834d9290a2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed90167029a48089d044ae7429783f7 in term 1.
18:32:38.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.431068  4299 raft_consensus.cc:493] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:38.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.431684  3721 leader_election.cc:304] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ecd1039231a404dbd66f834d9290a2d, bed90167029a48089d044ae7429783f7; no voters: 
18:32:38.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.431684  4299 raft_consensus.cc:515] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.435381  4299 leader_election.cc:290] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed90167029a48089d044ae7429783f7 (127.3.43.129:43071), 7ecd1039231a404dbd66f834d9290a2d (127.3.43.131:38327)
18:32:38.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.437621  3788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49907dc63f1c46a383141035a9353a56" candidate_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed90167029a48089d044ae7429783f7" is_pre_election: true
18:32:38.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.438560  3788 raft_consensus.cc:2468] T 49907dc63f1c46a383141035a9353a56 P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcff4e6242a648a5ad29bd2dc8fca9ea in term 0.
18:32:38.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.440358  3871 leader_election.cc:304] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcff4e6242a648a5ad29bd2dc8fca9ea, bed90167029a48089d044ae7429783f7; no voters: 
18:32:38.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.440522  4079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49907dc63f1c46a383141035a9353a56" candidate_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ecd1039231a404dbd66f834d9290a2d" is_pre_election: true
18:32:38.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.441023  4320 ts_tablet_manager.cc:1434] T 49907dc63f1c46a383141035a9353a56 P bed90167029a48089d044ae7429783f7: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.004s
18:32:38.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.441860  4278 leader_election.cc:290] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [CANDIDATE]: Term 1 election: Requested vote from peers bcff4e6242a648a5ad29bd2dc8fca9ea (127.3.43.130:38355), 7ecd1039231a404dbd66f834d9290a2d (127.3.43.131:38327)
18:32:38.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.442660  3935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d16b8dc05e430ba368fdce09cf6cfa" candidate_uuid: "7ecd1039231a404dbd66f834d9290a2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea"
18:32:38.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.443408  3935 raft_consensus.cc:3060] T c2d16b8dc05e430ba368fdce09cf6cfa P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Advancing to term 1
18:32:38.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.466753  4299 raft_consensus.cc:2804] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Leader pre-election won for term 1
18:32:38.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.467744  4299 raft_consensus.cc:493] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:32:38.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.447582  4343 raft_consensus.cc:2804] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [term 1 FOLLOWER]: Leader election won for term 1
18:32:38.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.477313  4343 raft_consensus.cc:697] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [term 1 LEADER]: Becoming Leader. State: Replica: bed90167029a48089d044ae7429783f7, State: Running, Role: LEADER
18:32:38.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.478395  4343 consensus_queue.cc:237] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:38.486538  3868 leader_election.cc:343] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ecd1039231a404dbd66f834d9290a2d (127.3.43.131:38327): Illegal state: must be running to vote when last-logged opid is not known
18:32:38.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.488001  4299 raft_consensus.cc:3060] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 0 FOLLOWER]: Advancing to term 1
18:32:38.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.506048  3789 raft_consensus.cc:2468] T c2d16b8dc05e430ba368fdce09cf6cfa P bed90167029a48089d044ae7429783f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ecd1039231a404dbd66f834d9290a2d in term 1.
18:32:38.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.508086  4013 leader_election.cc:304] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ecd1039231a404dbd66f834d9290a2d, bed90167029a48089d044ae7429783f7; no voters: 
18:32:38.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.509491  4302 raft_consensus.cc:2804] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [term 1 FOLLOWER]: Leader election won for term 1
18:32:38.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.510100  4302 raft_consensus.cc:697] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [term 1 LEADER]: Becoming Leader. State: Replica: 7ecd1039231a404dbd66f834d9290a2d, State: Running, Role: LEADER
18:32:38.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.511260  4302 consensus_queue.cc:237] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.519569  3461 catalog_manager.cc:6241] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57: replication_test_table [id=430ff55bf33c43dbbd3443b21bc87300] alter complete (version 0)
18:32:38.529 [DEBUG - main] (Connection.java:575) [peer master-127.2.96.189:33339(127.2.96.189:33339)] disconnecting while in state READY
18:32:38.529 [DEBUG - main] (Connection.java:575) [peer master-127.2.96.188:32989(127.2.96.188:32989)] disconnecting while in state READY
18:32:38.529 [DEBUG - main] (Connection.java:575) [peer master-127.2.96.190:44161(127.2.96.190:44161)] disconnecting while in state READY
18:32:38.530 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.96.188:32989(127.2.96.188:32989)] handling channelInactive
18:32:38.530 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.96.190:44161(127.2.96.190:44161)] handling channelInactive
18:32:38.530 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state READY due to: connection closed
18:32:38.532 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:38.530 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state READY due to: connection closed
18:32:38.533 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
18:32:38.534 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
18:32:38.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.540865  3935 raft_consensus.cc:2468] T c2d16b8dc05e430ba368fdce09cf6cfa P bcff4e6242a648a5ad29bd2dc8fca9ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ecd1039231a404dbd66f834d9290a2d in term 1.
18:32:38.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.495982  3934 raft_consensus.cc:2468] T 3c9d24669dd74422a060ddb81c161ceb P bcff4e6242a648a5ad29bd2dc8fca9ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed90167029a48089d044ae7429783f7 in term 1.
18:32:38.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.566828  4323 tablet_bootstrap.cc:492] T 49907dc63f1c46a383141035a9353a56 P 7ecd1039231a404dbd66f834d9290a2d: No bootstrap required, opened a new log
18:32:38.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.567334  4323 ts_tablet_manager.cc:1403] T 49907dc63f1c46a383141035a9353a56 P 7ecd1039231a404dbd66f834d9290a2d: Time spent bootstrapping tablet: real 0.295s	user 0.077s	sys 0.179s
18:32:38.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.570299  4323 raft_consensus.cc:359] T 49907dc63f1c46a383141035a9353a56 P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.571213  4323 raft_consensus.cc:385] T 49907dc63f1c46a383141035a9353a56 P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:38.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.571609  4323 raft_consensus.cc:740] T 49907dc63f1c46a383141035a9353a56 P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ecd1039231a404dbd66f834d9290a2d, State: Initialized, Role: FOLLOWER
18:32:38.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.572458  4323 consensus_queue.cc:260] T 49907dc63f1c46a383141035a9353a56 P 7ecd1039231a404dbd66f834d9290a2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.576112  4323 ts_tablet_manager.cc:1434] T 49907dc63f1c46a383141035a9353a56 P 7ecd1039231a404dbd66f834d9290a2d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
18:32:38.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.585274  3461 catalog_manager.cc:5696] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to bed90167029a48089d044ae7429783f7 (127.3.43.129). New cstate: current_term: 1 leader_uuid: "bed90167029a48089d044ae7429783f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } health_report { overall_health: UNKNOWN } } }
18:32:38.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.593520  4299 raft_consensus.cc:515] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.596464  4333 consensus_queue.cc:1048] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:32:38.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.599677  4299 leader_election.cc:290] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [CANDIDATE]: Term 1 election: Requested vote from peers bed90167029a48089d044ae7429783f7 (127.3.43.129:43071), 7ecd1039231a404dbd66f834d9290a2d (127.3.43.131:38327)
18:32:38.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.600590  3789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49907dc63f1c46a383141035a9353a56" candidate_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed90167029a48089d044ae7429783f7"
18:32:38.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.601115  3789 raft_consensus.cc:3060] T 49907dc63f1c46a383141035a9353a56 P bed90167029a48089d044ae7429783f7 [term 0 FOLLOWER]: Advancing to term 1
18:32:38.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.601019  4079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49907dc63f1c46a383141035a9353a56" candidate_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ecd1039231a404dbd66f834d9290a2d"
18:32:38.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.601622  4079 raft_consensus.cc:3060] T 49907dc63f1c46a383141035a9353a56 P 7ecd1039231a404dbd66f834d9290a2d [term 0 FOLLOWER]: Advancing to term 1
18:32:38.605 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:38.638 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.96.189:33339(127.2.96.189:33339)] handling channelInactive
18:32:38.638 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state READY due to: connection closed
18:32:38.639 [DEBUG - main] (Connection.java:575) [peer master-127.3.43.190:40613(127.3.43.190:40613)] disconnecting while in state READY
18:32:38.639 [DEBUG - main] (Connection.java:575) [peer master-127.3.43.188:36795(127.3.43.188:36795)] disconnecting while in state READY
18:32:38.639 [DEBUG - main] (Connection.java:575) [peer master-127.3.43.189:32951(127.3.43.189:32951)] disconnecting while in state READY
18:32:38.639 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.3.43.190:40613(127.3.43.190:40613)] handling channelInactive
18:32:38.640 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state READY due to: connection closed
18:32:38.640 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.3.43.189:32951(127.3.43.189:32951)] handling channelInactive
18:32:38.640 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state READY due to: connection closed
18:32:38.640 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
18:32:38.641 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:38.642 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
18:32:38.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.640799  3462 catalog_manager.cc:5696] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ecd1039231a404dbd66f834d9290a2d (127.3.43.131). New cstate: current_term: 1 leader_uuid: "7ecd1039231a404dbd66f834d9290a2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } health_report { overall_health: HEALTHY } } }
18:32:38.642 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
18:32:38.656 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.3.43.188:36795(127.3.43.188:36795)] handling channelInactive
18:32:38.656 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state READY due to: connection closed
18:32:38.656 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
18:32:38.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.657923  3789 raft_consensus.cc:2468] T 49907dc63f1c46a383141035a9353a56 P bed90167029a48089d044ae7429783f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcff4e6242a648a5ad29bd2dc8fca9ea in term 1.
18:32:38.658 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:32:38.659 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
18:32:38.659 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
18:32:38.659 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:32:38.659 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:32:38.659 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:32:38.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.659179  3871 leader_election.cc:304] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bcff4e6242a648a5ad29bd2dc8fca9ea, bed90167029a48089d044ae7429783f7; no voters: 
18:32:38.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.660260  4299 raft_consensus.cc:2804] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 1 FOLLOWER]: Leader election won for term 1
18:32:38.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.660743  4299 raft_consensus.cc:697] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [term 1 LEADER]: Becoming Leader. State: Replica: bcff4e6242a648a5ad29bd2dc8fca9ea, State: Running, Role: LEADER
18:32:38.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.661652  4299 consensus_queue.cc:237] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } }
18:32:38.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.669956  4079 raft_consensus.cc:2468] T 49907dc63f1c46a383141035a9353a56 P 7ecd1039231a404dbd66f834d9290a2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcff4e6242a648a5ad29bd2dc8fca9ea in term 1.
18:32:38.681 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
18:32:38.681 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
18:32:38.681 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
18:32:38.681 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
18:32:38.681 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
18:32:38.681 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
18:32:38.681 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
18:32:38.697 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:38.697 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:38.697 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:38.700 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:38.700 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:38.700 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:38.700 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:38.700 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:38.701 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:38.701 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:38.701 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:38.701 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:38.701 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:38.707 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:38.708 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:38.708 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:38.708 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:38.708 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:38.708 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:38.708 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:38.708 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:38.708 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:38.709 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:38.709 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:38.709 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:38.709 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:38.712 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:38.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:38.712690  3445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.43.190:40613, user_credentials={real_user=slave}} blocked reactor thread for 72547.7us
18:32:38.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:38.713438  3443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.43.189:32951, user_credentials={real_user=slave}} blocked reactor thread for 59290.9us
18:32:38.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.717772  4299 consensus_queue.cc:1048] T 3cd1aa7ed7df4357ab66fc58805f62e3 P bcff4e6242a648a5ad29bd2dc8fca9ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:38.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.737640  3461 catalog_manager.cc:5696] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea reported cstate change: term changed from 0 to 1, leader changed from <none> to bcff4e6242a648a5ad29bd2dc8fca9ea (127.3.43.130). New cstate: current_term: 1 leader_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 } health_report { overall_health: UNKNOWN } } }
18:32:38.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:38.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.877959  4343 consensus_queue.cc:1048] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:32:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.935822  4278 consensus_queue.cc:1048] T 3c9d24669dd74422a060ddb81c161ceb P bed90167029a48089d044ae7429783f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:38.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:38.990667  4302 consensus_queue.cc:1048] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:39.001 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:39.001 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:39.002 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:39.002 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:39.002 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:39.002 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:39.002 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:39.002 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:39.002 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:39.003 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:39.003 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:39.003 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:39.003 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:39.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:39.009455  4302 consensus_queue.cc:1048] T c2d16b8dc05e430ba368fdce09cf6cfa P 7ecd1039231a404dbd66f834d9290a2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcff4e6242a648a5ad29bd2dc8fca9ea" member_type: VOTER last_known_addr { host: "127.3.43.130" port: 38355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:39.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:39.020998  2667 debug-util.cc:398] Leaking SignalData structure 0x7b0800099bc0 after lost signal to thread 2597
18:32:39.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:39.021715  2667 debug-util.cc:398] Leaking SignalData structure 0x7b080004f520 after lost signal to thread 2670
18:32:39.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:39.121 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
18:32:39.191 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
18:32:39.191 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
18:32:39.191 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
18:32:39.207 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
18:32:39.212 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:39.234 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:39.235 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:39.235 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:39.235 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:39.235 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:39.235 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:39.235 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:39.235 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:39.235 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:39.235 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:39.235 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:39.235 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:39.235 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:39.267814  4299 consensus_queue.cc:1048] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed90167029a48089d044ae7429783f7" member_type: VOTER last_known_addr { host: "127.3.43.129" port: 43071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:32:39.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:39.269009  4366 consensus_queue.cc:1048] T 49907dc63f1c46a383141035a9353a56 P bcff4e6242a648a5ad29bd2dc8fca9ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ecd1039231a404dbd66f834d9290a2d" member_type: VOTER last_known_addr { host: "127.3.43.131" port: 38327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:32:39.279 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:39.279 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:39.279 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:39.281 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:39.281 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:39.281 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:39.281 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:39.281 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:39.281 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:39.281 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:39.281 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:39.281 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:39.282 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:39.282 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:39.282 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:39.282 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:39.282 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:39.282 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:39.282 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:39.283 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:39.283 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:39.283 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:39.283 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:39.283 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:39.283 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:39.283 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:39.301 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:39.301 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:39.301 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:39.302 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:39.302 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:39.302 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:39.302 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:39.303 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:39.303 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:39.303 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:39.303 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:39.303 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:39.303 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:39.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:39.307050  3125 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.96.130:36745, user_credentials={real_user=slave}} blocked reactor thread for 74102.4us
18:32:39.333 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:39.333 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:39.333 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:39.334 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:39.334 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:39.334 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:39.334 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:39.334 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:39.334 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:39.336 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:39.336 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:39.336 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:39.336 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:39.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:39.480 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:39.481 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:39.481 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:39.481 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:39.482 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:39.482 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:39.482 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:39.482 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:39.482 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:39.482 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:39.486 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:39.486 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:39.486 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:39.527 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:39.528 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:39.528 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:39.528 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:39.528 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:39.528 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:39.529 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:39.529 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:39.529 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:39.529 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:39.529 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:39.529 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:39.529 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:39.602 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:39.617 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:39.617 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:39.618 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:39.618 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:39.618 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:39.618 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:39.618 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:39.618 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:39.618 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:39.619 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:39.619 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:39.619 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:39.619 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:39.687 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:39.687 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:39.687 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:39.687 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:39.687 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:39.687 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:39.688 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:39.688 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:39.688 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:39.688 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:39.688 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:39.688 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:39.688 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:39.712 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:39.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:39.863 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:39.863 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:39.863 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:39.863 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:39.864 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:39.864 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:39.864 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:39.864 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:39.864 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:39.864 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:39.864 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:39.864 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:39.864 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:39.937 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:39.937 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:39.937 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:39.938 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:39.938 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:39.938 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:39.938 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:39.938 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:39.938 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:39.938 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:39.939 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:39.939 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:39.939 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:39.940 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28328), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [13ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [18ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [18ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [19ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [44ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [45ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [45ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [63ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [64ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [66ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [66ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [83ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [104ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [104ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [143ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [143ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [163ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [223ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [384ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [384ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [722ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [722ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [723ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [723ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1500ms] refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1502ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3261ms] refreshing cache from master, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [3262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3262ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [6841ms] refreshing cache from master, [6841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [6842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [6842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [6842ms] too many traces: truncated at 100 traces, deferred=Deferred@506192474(state=PENDING, result=null, callback=(continuation of Deferred@1129463894 after retry RPC after error@151037581) -> (continuation of Deferred@1986906185 after retry RPC after error@924179948) -> (continuation of Deferred@1721002920 after retry RPC after error@1781308729) -> (continuation of Deferred@1922772917 after retry RPC after error@1803052727) -> (continuation of Deferred@779389275 after retry RPC after error@541003001) -> (continuation of Deferred@192047564 after retry RPC after error@597158859) -> (continuation of Deferred@698581171 after retry RPC after error@1898125754) -> (continuation of Deferred@1762079323 after retry RPC after error@1968329987) -> (continuation of Deferred@1086448898 after retry RPC after error@700893801) -> (continuation of Deferred@2038669536 after retry RPC after error@513677470) -> (continuation of Deferred@1362630586 after retry RPC after error@1311906422) -> (continuation of Deferred@718419952 after retry RPC after error@1155956956) -> (continuation of Deferred@1433586237 after retry RPC after error@189631311) -> (continuation of Deferred@815480929 after retry RPC after error@1074513614) -> (continuation of Deferred@65785808 after retry RPC after error@1679506193) -> (continuation of Deferred@241821627 after retry RPC after error@273317134) -> (continuation of Deferred@1292023192 after retry RPC after error@1887227034) -> (continuation of Deferred@837400849 after retry RPC after error@1921519663) -> (continuation of Deferred@712955283 after retry RPC after error@1014023258) -> (continuation of Deferred@1076741108 after retry RPC after error@1922480822) -> (continuation of Deferred@773335866 after retry RPC after error@342911159) -> (continuation of Deferred@988560302 after retry RPC after error@2103993679) -> (continuation of Deferred@315019299 after retry RPC after error@90449692), errback=(continuation of Deferred@1129463894 after retry RPC after error@151037581) -> (continuation of Deferred@1986906185 after retry RPC after error@924179948) -> (continuation of Deferred@1721002920 after retry RPC after error@1781308729) -> (continuation of Deferred@1922772917 after retry RPC after error@1803052727) -> (continuation of Deferred@779389275 after retry RPC after error@541003001) -> (continuation of Deferred@192047564 after retry RPC after error@597158859) -> (continuation of Deferred@698581171 after retry RPC after error@1898125754) -> (continuation of Deferred@1762079323 after retry RPC after error@1968329987) -> (continuation of Deferred@1086448898 after retry RPC after error@700893801) -> (continuation of Deferred@2038669536 after retry RPC after error@513677470) -> (continuation of Deferred@1362630586 after retry RPC after error@1311906422) -> (continuation of Deferred@718419952 after retry RPC after error@1155956956) -> (continuation of Deferred@1433586237 after retry RPC after error@189631311) -> (continuation of Deferred@815480929 after retry RPC after error@1074513614) -> (continuation of Deferred@65785808 after retry RPC after error@1679506193) -> (continuation of Deferred@241821627 after retry RPC after error@273317134) -> (continuation of Deferred@1292023192 after retry RPC after error@1887227034) -> (continuation of Deferred@837400849 after retry RPC after error@1921519663) -> (continuation of Deferred@712955283 after retry RPC after error@1014023258) -> (continuation of Deferred@1076741108 after retry RPC after error@1922480822) -> (continuation of Deferred@773335866 after retry RPC after error@342911159) -> (continuation of Deferred@988560302 after retry RPC after error@2103993679) -> (continuation of Deferred@315019299 after retry RPC after error@90449692)))
18:32:40.102 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:40.118 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:40.119 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:40.119 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:40.119 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:40.119 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:40.119 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:40.119 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:40.119 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:40.119 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:40.120 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:40.120 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:40.120 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:40.120 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:40.213 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:40.295 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:40.295 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:40.295 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:40.296 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:40.296 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:40.296 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:40.296 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:40.297 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:40.297 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:40.297 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:40.297 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:40.297 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:40.297 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:40.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:40.460 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
18:32:40.541 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:40.541 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:40.542 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:40.542 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:40.542 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:40.542 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:40.542 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:40.542 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:40.542 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:40.542 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:40.542 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:40.542 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:40.542 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:40.603 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:40.637 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:40.638 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:40.638 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:40.638 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:40.639 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:40.639 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:40.639 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:40.639 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:40.639 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:40.639 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:40.639 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:40.639 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:40.639 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:40.647 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:40.647 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:40.648 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:40.648 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:40.648 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:40.648 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:40.648 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:40.648 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:40.648 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:40.648 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:40.649 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:40.649 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:40.649 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:40.656 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:40.657 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:40.657 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:40.657 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:40.657 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:40.657 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:40.658 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:40.658 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:40.658 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:40.658 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:40.658 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:40.658 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:40.658 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:40.703 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:40.703 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:40.703 [DEBUG - pool-166-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:40.704 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:40.704 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:40.704 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:40.704 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:40.705 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:40.705 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:40.705 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:40.705 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:40.705 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:40.705 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:40.706 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29069), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [5ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [6ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [7ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [22ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [24ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [25ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [44ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [45ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [46ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [46ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [63ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [64ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [64ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [84ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [182ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [183ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [183ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [183ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [183ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [304ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [304ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [543ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [543ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [881ms] refreshing cache from master, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [882ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [882ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [882ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [883ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1003ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1561ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1563ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [4921ms] refreshing cache from master, [4921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4923ms] too many traces: truncated at 100 traces, deferred=Deferred@1661096206(state=PENDING, result=null, callback=(continuation of Deferred@1843660266 after retry RPC after error@1238679953) -> (continuation of Deferred@430212473 after retry RPC after error@1751068002) -> (continuation of Deferred@626638550 after retry RPC after error@1248738213) -> (continuation of Deferred@2010968284 after retry RPC after error@1719269240) -> (continuation of Deferred@247351919 after retry RPC after error@892795662) -> (continuation of Deferred@637314916 after retry RPC after error@202856084) -> (continuation of Deferred@1887864907 after retry RPC after error@1919607774) -> (continuation of Deferred@846048624 after retry RPC after error@75034207) -> (continuation of Deferred@1090058827 after retry RPC after error@1705612697) -> (continuation of Deferred@980464241 after retry RPC after error@2042214774) -> (continuation of Deferred@2115255976 after retry RPC after error@1463318958) -> (continuation of Deferred@1759820290 after retry RPC after error@1545788513) -> (continuation of Deferred@60573747 after retry RPC after error@394114279) -> (continuation of Deferred@1518610592 after retry RPC after error@269428293) -> (continuation of Deferred@1899182503 after retry RPC after error@185819626) -> (continuation of Deferred@1881774336 after retry RPC after error@436053070) -> (continuation of Deferred@1911245015 after retry RPC after error@1642556209) -> (continuation of Deferred@1564090260 after retry RPC after error@697376681) -> (continuation of Deferred@35080124 after retry RPC after error@1492326956) -> (continuation of Deferred@1438148633 after retry RPC after error@1953843536) -> (continuation of Deferred@1290259141 after retry RPC after error@201689871) -> (continuation of Deferred@451662390 after retry RPC after error@1141516274) -> (continuation of Deferred@910781524 after retry RPC after error@372556897) -> (continuation of Deferred@1376444147 after retry RPC after error@1202345719), errback=(continuation of Deferred@1843660266 after retry RPC after error@1238679953) -> (continuation of Deferred@430212473 after retry RPC after error@1751068002) -> (continuation of Deferred@626638550 after retry RPC after error@1248738213) -> (continuation of Deferred@2010968284 after retry RPC after error@1719269240) -> (continuation of Deferred@247351919 after retry RPC after error@892795662) -> (continuation of Deferred@637314916 after retry RPC after error@202856084) -> (continuation of Deferred@1887864907 after retry RPC after error@1919607774) -> (continuation of Deferred@846048624 after retry RPC after error@75034207) -> (continuation of Deferred@1090058827 after retry RPC after error@1705612697) -> (continuation of Deferred@980464241 after retry RPC after error@2042214774) -> (continuation of Deferred@2115255976 after retry RPC after error@1463318958) -> (continuation of Deferred@1759820290 after retry RPC after error@1545788513) -> (continuation of Deferred@60573747 after retry RPC after error@394114279) -> (continuation of Deferred@1518610592 after retry RPC after error@269428293) -> (continuation of Deferred@1899182503 after retry RPC after error@185819626) -> (continuation of Deferred@1881774336 after retry RPC after error@436053070) -> (continuation of Deferred@1911245015 after retry RPC after error@1642556209) -> (continuation of Deferred@1564090260 after retry RPC after error@697376681) -> (continuation of Deferred@35080124 after retry RPC after error@1492326956) -> (continuation of Deferred@1438148633 after retry RPC after error@1953843536) -> (continuation of Deferred@1290259141 after retry RPC after error@201689871) -> (continuation of Deferred@451662390 after retry RPC after error@1141516274) -> (continuation of Deferred@910781524 after retry RPC after error@372556897) -> (continuation of Deferred@1376444147 after retry RPC after error@1202345719)))
18:32:40.712 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:40.808 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
18:32:40.830 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
18:32:40.838 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:40.851 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
18:32:40.868 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
18:32:40.896 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
18:32:40.897 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:40.897 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:40.897 [DEBUG - pool-174-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:40.898 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:40.898 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:40.898 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:40.898 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:40.898 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:40.898 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:40.898 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:40.898 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:40.898 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:40.898 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:40.899 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26982), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [40ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [41ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [42ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [42ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [89ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [91ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [92ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [92ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [105ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [133ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [135ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [136ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [143ms] refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [144ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [145ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [146ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [146ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [163ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [203ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [285ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [285ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [285ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [285ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [383ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [604ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1003ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1341ms] refreshing cache from master, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1342ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3021ms] refreshing cache from master, [3022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3023ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [3024ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3024ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3025ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3025ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [4861ms] refreshing cache from master, [4861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4862ms] too many traces: truncated at 100 traces, deferred=Deferred@267518151(state=PENDING, result=null, callback=(continuation of Deferred@2061123782 after retry RPC after error@2105058778) -> (continuation of Deferred@803960571 after retry RPC after error@805355513) -> (continuation of Deferred@410260815 after retry RPC after error@538584558) -> (continuation of Deferred@1412613048 after retry RPC after error@1643663792) -> (continuation of Deferred@1495203501 after retry RPC after error@677020981) -> (continuation of Deferred@1782037637 after retry RPC after error@1231095202) -> (continuation of Deferred@1738826165 after retry RPC after error@464200537) -> (continuation of Deferred@1278179133 after retry RPC after error@228734735) -> (continuation of Deferred@1238324935 after retry RPC after error@196875596) -> (continuation of Deferred@1016929689 after retry RPC after error@547053386) -> (continuation of Deferred@324099312 after retry RPC after error@2024553891) -> (continuation of Deferred@747210490 after retry RPC after error@1452473646) -> (continuation of Deferred@1337822672 after retry RPC after error@1449517217) -> (continuation of Deferred@909841089 after retry RPC after error@1996612261) -> (continuation of Deferred@1416704664 after retry RPC after error@770220127) -> (continuation of Deferred@1135284793 after retry RPC after error@1002951715) -> (continuation of Deferred@1719653425 after retry RPC after error@251493113) -> (continuation of Deferred@358386629 after retry RPC after error@280961921) -> (continuation of Deferred@142193659 after retry RPC after error@1832270527) -> (continuation of Deferred@482707071 after retry RPC after error@1963920717) -> (continuation of Deferred@816615036 after retry RPC after error@1813227796) -> (continuation of Deferred@1557474455 after retry RPC after error@1371350821) -> (continuation of Deferred@87464960 after retry RPC after error@1956433595) -> (continuation of Deferred@30995755 after retry RPC after error@971275834) -> (continuation of Deferred@142812058 after retry RPC after error@444128551), errback=(continuation of Deferred@2061123782 after retry RPC after error@2105058778) -> (continuation of Deferred@803960571 after retry RPC after error@805355513) -> (continuation of Deferred@410260815 after retry RPC after error@538584558) -> (continuation of Deferred@1412613048 after retry RPC after error@1643663792) -> (continuation of Deferred@1495203501 after retry RPC after error@677020981) -> (continuation of Deferred@1782037637 after retry RPC after error@1231095202) -> (continuation of Deferred@1738826165 after retry RPC after error@464200537) -> (continuation of Deferred@1278179133 after retry RPC after error@228734735) -> (continuation of Deferred@1238324935 after retry RPC after error@196875596) -> (continuation of Deferred@1016929689 after retry RPC after error@547053386) -> (continuation of Deferred@324099312 after retry RPC after error@2024553891) -> (continuation of Deferred@747210490 after retry RPC after error@1452473646) -> (continuation of Deferred@1337822672 after retry RPC after error@1449517217) -> (continuation of Deferred@909841089 after retry RPC after error@1996612261) -> (continuation of Deferred@1416704664 after retry RPC after error@770220127) -> (continuation of Deferred@1135284793 after retry RPC after error@1002951715) -> (continuation of Deferred@1719653425 after retry RPC after error@251493113) -> (continuation of Deferred@358386629 after retry RPC after error@280961921) -> (continuation of Deferred@142193659 after retry RPC after error@1832270527) -> (continuation of Deferred@482707071 after retry RPC after error@1963920717) -> (continuation of Deferred@816615036 after retry RPC after error@1813227796) -> (continuation of Deferred@1557474455 after retry RPC after error@1371350821) -> (continuation of Deferred@87464960 after retry RPC after error@1956433595) -> (continuation of Deferred@30995755 after retry RPC after error@971275834) -> (continuation of Deferred@142812058 after retry RPC after error@444128551)))
18:32:40.900 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
18:32:40.900 [WARN - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26982), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [40ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [41ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [42ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [42ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [89ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [91ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [92ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [92ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [105ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [133ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [135ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [136ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [143ms] refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [144ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [145ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [146ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [146ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [163ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [203ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [285ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [285ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [285ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [285ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [383ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [604ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1003ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1341ms] refreshing cache from master, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1342ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3021ms] refreshing cache from master, [3022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3023ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [3024ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3024ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3025ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3025ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [4861ms] refreshing cache from master, [4861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4862ms] too many traces: truncated at 100 traces, deferred=Deferred@267518151(state=PENDING, result=null, callback=(continuation of Deferred@2061123782 after retry RPC after error@2105058778) -> (continuation of Deferred@803960571 after retry RPC after error@805355513) -> (continuation of Deferred@410260815 after retry RPC after error@538584558) -> (continuation of Deferred@1412613048 after retry RPC after error@1643663792) -> (continuation of Deferred@1495203501 after retry RPC after error@677020981) -> (continuation of Deferred@1782037637 after retry RPC after error@1231095202) -> (continuation of Deferred@1738826165 after retry RPC after error@464200537) -> (continuation of Deferred@1278179133 after retry RPC after error@228734735) -> (continuation of Deferred@1238324935 after retry RPC after error@196875596) -> (continuation of Deferred@1016929689 after retry RPC after error@547053386) -> (continuation of Deferred@324099312 after retry RPC after error@2024553891) -> (continuation of Deferred@747210490 after retry RPC after error@1452473646) -> (continuation of Deferred@1337822672 after retry RPC after error@1449517217) -> (continuation of Deferred@909841089 after retry RPC after error@1996612261) -> (continuation of Deferred@1416704664 after retry RPC after error@770220127) -> (continuation of Deferred@1135284793 after retry RPC after error@1002951715) -> (continuation of Deferred@1719653425 after retry RPC after error@251493113) -> (continuation of Deferred@358386629 after retry RPC after error@280961921) -> (continuation of Deferred@142193659 after retry RPC after error@1832270527) -> (continuation of Deferred@482707071 after retry RPC after error@1963920717) -> (continuation of Deferred@816615036 after retry RPC after error@1813227796) -> (continuation of Deferred@1557474455 after retry RPC after error@1371350821) -> (continuation of Deferred@87464960 after retry RPC after error@1956433595) -> (continuation of Deferred@30995755 after retry RPC after error@971275834) -> (continuation of Deferred@142812058 after retry RPC after error@444128551), errback=(continuation of Deferred@2061123782 after retry RPC after error@2105058778) -> (continuation of Deferred@803960571 after retry RPC after error@805355513) -> (continuation of Deferred@410260815 after retry RPC after error@538584558) -> (continuation of Deferred@1412613048 after retry RPC after error@1643663792) -> (continuation of Deferred@1495203501 after retry RPC after error@677020981) -> (continuation of Deferred@1782037637 after retry RPC after error@1231095202) -> (continuation of Deferred@1738826165 after retry RPC after error@464200537) -> (continuation of Deferred@1278179133 after retry RPC after error@228734735) -> (continuation of Deferred@1238324935 after retry RPC after error@196875596) -> (continuation of Deferred@1016929689 after retry RPC after error@547053386) -> (continuation of Deferred@324099312 after retry RPC after error@2024553891) -> (continuation of Deferred@747210490 after retry RPC after error@1452473646) -> (continuation of Deferred@1337822672 after retry RPC after error@1449517217) -> (continuation of Deferred@909841089 after retry RPC after error@1996612261) -> (continuation of Deferred@1416704664 after retry RPC after error@770220127) -> (continuation of Deferred@1135284793 after retry RPC after error@1002951715) -> (continuation of Deferred@1719653425 after retry RPC after error@251493113) -> (continuation of Deferred@358386629 after retry RPC after error@280961921) -> (continuation of Deferred@142193659 after retry RPC after error@1832270527) -> (continuation of Deferred@482707071 after retry RPC after error@1963920717) -> (continuation of Deferred@816615036 after retry RPC after error@1813227796) -> (continuation of Deferred@1557474455 after retry RPC after error@1371350821) -> (continuation of Deferred@87464960 after retry RPC after error@1956433595) -> (continuation of Deferred@30995755 after retry RPC after error@971275834) -> (continuation of Deferred@142812058 after retry RPC after error@444128551)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.125:40423
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:40.900 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
18:32:40.903 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#3 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
18:32:40.905 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26982), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [40ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [41ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [42ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [42ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [89ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [91ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [92ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [92ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [105ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [133ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [135ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [136ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [143ms] refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [144ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [145ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [146ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [146ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [163ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [203ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [285ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [285ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [285ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [285ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [383ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [604ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1003ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1341ms] refreshing cache from master, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1342ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3021ms] refreshing cache from master, [3022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3023ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [3024ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3024ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3025ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3025ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [4861ms] refreshing cache from master, [4861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4862ms] too many traces: truncated at 100 traces, deferred=Deferred@267518151(state=PENDING, result=null, callback=(continuation of Deferred@2061123782 after retry RPC after error@2105058778) -> (continuation of Deferred@803960571 after retry RPC after error@805355513) -> (continuation of Deferred@410260815 after retry RPC after error@538584558) -> (continuation of Deferred@1412613048 after retry RPC after error@1643663792) -> (continuation of Deferred@1495203501 after retry RPC after error@677020981) -> (continuation of Deferred@1782037637 after retry RPC after error@1231095202) -> (continuation of Deferred@1738826165 after retry RPC after error@464200537) -> (continuation of Deferred@1278179133 after retry RPC after error@228734735) -> (continuation of Deferred@1238324935 after retry RPC after error@196875596) -> (continuation of Deferred@1016929689 after retry RPC after error@547053386) -> (continuation of Deferred@324099312 after retry RPC after error@2024553891) -> (continuation of Deferred@747210490 after retry RPC after error@1452473646) -> (continuation of Deferred@1337822672 after retry RPC after error@1449517217) -> (continuation of Deferred@909841089 after retry RPC after error@1996612261) -> (continuation of Deferred@1416704664 after retry RPC after error@770220127) -> (continuation of Deferred@1135284793 after retry RPC after error@1002951715) -> (continuation of Deferred@1719653425 after retry RPC after error@251493113) -> (continuation of Deferred@358386629 after retry RPC after error@280961921) -> (continuation of Deferred@142193659 after retry RPC after error@1832270527) -> (continuation of Deferred@482707071 after retry RPC after error@1963920717) -> (continuation of Deferred@816615036 after retry RPC after error@1813227796) -> (continuation of Deferred@1557474455 after retry RPC after error@1371350821) -> (continuation of Deferred@87464960 after retry RPC after error@1956433595) -> (continuation of Deferred@30995755 after retry RPC after error@971275834) -> (continuation of Deferred@142812058 after retry RPC after error@444128551), errback=(continuation of Deferred@2061123782 after retry RPC after error@2105058778) -> (continuation of Deferred@803960571 after retry RPC after error@805355513) -> (continuation of Deferred@410260815 after retry RPC after error@538584558) -> (continuation of Deferred@1412613048 after retry RPC after error@1643663792) -> (continuation of Deferred@1495203501 after retry RPC after error@677020981) -> (continuation of Deferred@1782037637 after retry RPC after error@1231095202) -> (continuation of Deferred@1738826165 after retry RPC after error@464200537) -> (continuation of Deferred@1278179133 after retry RPC after error@228734735) -> (continuation of Deferred@1238324935 after retry RPC after error@196875596) -> (continuation of Deferred@1016929689 after retry RPC after error@547053386) -> (continuation of Deferred@324099312 after retry RPC after error@2024553891) -> (continuation of Deferred@747210490 after retry RPC after error@1452473646) -> (continuation of Deferred@1337822672 after retry RPC after error@1449517217) -> (continuation of Deferred@909841089 after retry RPC after error@1996612261) -> (continuation of Deferred@1416704664 after retry RPC after error@770220127) -> (continuation of Deferred@1135284793 after retry RPC after error@1002951715) -> (continuation of Deferred@1719653425 after retry RPC after error@251493113) -> (continuation of Deferred@358386629 after retry RPC after error@280961921) -> (continuation of Deferred@142193659 after retry RPC after error@1832270527) -> (continuation of Deferred@482707071 after retry RPC after error@1963920717) -> (continuation of Deferred@816615036 after retry RPC after error@1813227796) -> (continuation of Deferred@1557474455 after retry RPC after error@1371350821) -> (continuation of Deferred@87464960 after retry RPC after error@1956433595) -> (continuation of Deferred@30995755 after retry RPC after error@971275834) -> (continuation of Deferred@142812058 after retry RPC after error@444128551)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.125:40423
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:40.907 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:32:40.907 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#3) of source Source: KuduSource.
18:32:40.908 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
18:32:40.908 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state RUNNING to RESTARTING.
18:32:40.922 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
18:32:40.923 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
18:32:40.923 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
18:32:40.924 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
18:32:40.924 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
18:32:40.924 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
18:32:40.924 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
18:32:40.924 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
18:32:40.925 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
18:32:40.925 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
18:32:40.925 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
18:32:40.925 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
18:32:40.926 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
18:32:40.926 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
18:32:40.926 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
18:32:40.926 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
18:32:40.926 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
18:32:40.926 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
18:32:40.926 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
18:32:40.926 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
18:32:40.930 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
18:32:40.930 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
18:32:40.931 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
18:32:40.931 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
18:32:40.931 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_634887337a69b90ab1082f4fa1b70863/blobStorage
18:32:40.938 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:46307 - max concurrent requests: 50 - max backlog: 1000
18:32:40.983 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_634887337a69b90ab1082f4fa1b70863/blobStorage
18:32:40.991 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_634887337a69b90ab1082f4fa1b70863/blobStorage
18:32:40.999 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
18:32:41.000 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: b5c0bb97-d5b4-4dae-a260-0b572e900c6e
18:32:41.002 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 32 GB (66.67% usable)
18:32:41.003 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-2a11d994-0f19-494d-a7fb-941cd5779e0f
18:32:41.012 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-025d1e8d-505c-44a3-bd11-8e4c55e5159e
18:32:41.133 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
18:32:41.140 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
18:32:41.141 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
18:32:41.141 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
18:32:41.142 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
18:32:41.144 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_12 .
18:32:41.151 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
18:32:41.151 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-ee2528ad-2b42-49eb-90e4-8a2ee513dbbd
18:32:41.155 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
18:32:41.155 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
18:32:41.169 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
18:32:41.169 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
18:32:41.189 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:37729
18:32:41.189 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
18:32:41.200 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
18:32:41.201 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:37729 was granted leadership with leaderSessionID=c42271bc-0288-4b88-afed-8ef1ac60f64b
18:32:41.201 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:37729 , session=c42271bc-0288-4b88-afed-8ef1ac60f64b
18:32:41.207 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
18:32:41.207 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
18:32:41.208 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id ab911161-3b28-4956-badd-bd9423f2e731. Creating new DispatcherLeaderProcess.
18:32:41.212 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:41.214 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
18:32:41.214 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
18:32:41.214 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
18:32:41.218 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_13 .
18:32:41.219 [INFO - pool-207-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 0104470b-7b4a-477a-850e-c26150ed9e01.
18:32:41.221 [INFO - pool-207-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_14 .
18:32:41.222 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
18:32:41.226 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_13 , session=ab911161-3b28-4956-badd-bd9423f2e731
18:32:41.231 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:253) Starting the resource manager.
18:32:41.232 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:212) Starting the slot manager.
18:32:41.232 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:308) Starting tokens update task
18:32:41.232 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
18:32:41.232 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
18:32:41.235 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_14 , session=0104470b-7b4a-477a-850e-c26150ed9e01
18:32:41.273 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_14(850ec26150ed9e010104470b7b4a477a).
18:32:41.290 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
18:32:41.305 [INFO - flink-pekko.actor.default-dispatcher-8] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (9de81db54be40687a2a82164db1dc50b).
18:32:41.305 [INFO - flink-pekko.actor.default-dispatcher-8] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (9de81db54be40687a2a82164db1dc50b).
18:32:41.305 [INFO - flink-pekko.actor.default-dispatcher-8] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-9de81db54be40687a2a82164db1dc50b'.
18:32:41.306 [INFO - mini-cluster-io-thread-4] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 9de81db54be40687a2a82164db1dc50b was granted leadership with leader id 2f6e6c44-8fdf-41db-a5e5-370b268334c0. Creating new JobMasterServiceProcess.
18:32:41.310 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:1080) Registering TaskManager with ResourceID b5c0bb97-d5b4-4dae-a260-0b572e900c6e (pekko://flink/user/rpc/taskmanager_12) at ResourceManager
18:32:41.310 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_14 under registration id b3bf5bc7415a193d9305eee3bd05d265.
18:32:41.311 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:344) Registering task executor b5c0bb97-d5b4-4dae-a260-0b572e900c6e under b3bf5bc7415a193d9305eee3bd05d265 at the slot manager.
18:32:41.317 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_15 .
18:32:41.324 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (9de81db54be40687a2a82164db1dc50b).
18:32:41.325 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (9de81db54be40687a2a82164db1dc50b).
18:32:41.325 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 3e207c8473346af65b0f563311ef3e51 for job 9de81db54be40687a2a82164db1dc50b.
18:32:41.326 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (9de81db54be40687a2a82164db1dc50b).
18:32:41.326 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
18:32:41.327 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
18:32:41.327 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7e14b37a
18:32:41.327 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:41.327 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:32:41.328 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
18:32:41.329 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@285a5983 for Flink Streaming Job (9de81db54be40687a2a82164db1dc50b).
18:32:41.329 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_15 , session=2f6e6c44-8fdf-41db-a5e5-370b268334c0
18:32:41.330 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (9de81db54be40687a2a82164db1dc50b) under job master id a5e5370b268334c02f6e6c448fdf41db.
18:32:41.330 [INFO - flink-pekko.actor.default-dispatcher-7] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:32:41.332 [DEBUG - flink-pekko.actor.default-dispatcher-7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:41.335 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
18:32:41.335 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (9de81db54be40687a2a82164db1dc50b) switched from state CREATED to RUNNING.
18:32:41.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:41.342 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
18:32:41.342 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
18:32:41.342 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
18:32:41.343 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
18:32:41.343 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_14(850ec26150ed9e010104470b7b4a477a)
18:32:41.345 [INFO - flink-pekko.actor.default-dispatcher-9] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
18:32:41.345 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:390) Registering job manager a5e5370b268334c02f6e6c448fdf41db@pekko://flink/user/rpc/jobmanager_15 for job 9de81db54be40687a2a82164db1dc50b.
18:32:41.356 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:1015) Registered job manager a5e5370b268334c02f6e6c448fdf41db@pekko://flink/user/rpc/jobmanager_15 for job 9de81db54be40687a2a82164db1dc50b.
18:32:41.366 [INFO - flink-pekko.actor.default-dispatcher-9] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: 850ec26150ed9e010104470b7b4a477a.
18:32:41.368 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:32:41.380 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 9de81db54be40687a2a82164db1dc50b
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager b5c0bb97-d5b4-4dae-a260-0b572e900c6e
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
18:32:41.381 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 30d104af07ed84a5695abb40e9c4cdae from b5c0bb97-d5b4-4dae-a260-0b572e900c6e for job 9de81db54be40687a2a82164db1dc50b with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:32:41.381 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot e340c57f8743c3b4810a5f8fd9742fae from b5c0bb97-d5b4-4dae-a260-0b572e900c6e for job 9de81db54be40687a2a82164db1dc50b with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:32:41.382 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot afa7c94bd89aa521f7cc788a9467b76f from b5c0bb97-d5b4-4dae-a260-0b572e900c6e for job 9de81db54be40687a2a82164db1dc50b with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:32:41.382 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 2d9055e68c7827d1c77d7c11ef4f5752 from b5c0bb97-d5b4-4dae-a260-0b572e900c6e for job 9de81db54be40687a2a82164db1dc50b with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:32:41.382 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request 30d104af07ed84a5695abb40e9c4cdae for job 9de81db54be40687a2a82164db1dc50b from resource manager with leader id 850ec26150ed9e010104470b7b4a477a.
18:32:41.383 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for 30d104af07ed84a5695abb40e9c4cdae with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:32:41.388 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:41.392 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:41.393 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:41.393 [DEBUG - pool-176-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:41.393 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:41.393 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:41.393 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:41.394 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:41.394 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:41.394 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:41.394 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:41.394 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:41.394 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:41.394 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:41.395 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=27479), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [29ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [31ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [32ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [32ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [48ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [55ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [56ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [56ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [84ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [85ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [101ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [135ms] refreshing cache from master, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [137ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [138ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [138ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [138ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [162ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [203ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [323ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [402ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [783ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [783ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [783ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1680ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1682ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1900ms] refreshing cache from master, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1902ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3721ms] refreshing cache from master, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3723ms] too many traces: truncated at 100 traces, deferred=Deferred@1021121376(state=PENDING, result=null, callback=(continuation of Deferred@1864679413 after retry RPC after error@1940991629) -> (continuation of Deferred@132112930 after retry RPC after error@1397598122) -> (continuation of Deferred@425484577 after retry RPC after error@1667494337) -> (continuation of Deferred@466993533 after retry RPC after error@630932826) -> (continuation of Deferred@1605664161 after retry RPC after error@589652591) -> (continuation of Deferred@374247775 after retry RPC after error@1761650521) -> (continuation of Deferred@363169453 after retry RPC after error@496744556) -> (continuation of Deferred@2143094505 after retry RPC after error@334191656) -> (continuation of Deferred@717365270 after retry RPC after error@1792718330) -> (continuation of Deferred@2110221318 after retry RPC after error@881096074) -> (continuation of Deferred@268247452 after retry RPC after error@817307900) -> (continuation of Deferred@1985400240 after retry RPC after error@1634328277) -> (continuation of Deferred@134148773 after retry RPC after error@239571558) -> (continuation of Deferred@1312617811 after retry RPC after error@1628177719) -> (continuation of Deferred@286767209 after retry RPC after error@594660495) -> (continuation of Deferred@181281759 after retry RPC after error@199928332) -> (continuation of Deferred@663920616 after retry RPC after error@178928161) -> (continuation of Deferred@1904291952 after retry RPC after error@803561094) -> (continuation of Deferred@473688397 after retry RPC after error@1192997849) -> (continuation of Deferred@1071716858 after retry RPC after error@989159918) -> (continuation of Deferred@2043123324 after retry RPC after error@1666738150) -> (continuation of Deferred@1413582014 after retry RPC after error@1160408521) -> (continuation of Deferred@1800038 after retry RPC after error@551311316) -> (continuation of Deferred@2023754509 after retry RPC after error@1852990965) -> (continuation of Deferred@898211610 after retry RPC after error@1999182984) -> (continuation of Deferred@262768899 after retry RPC after error@1921587406), errback=(continuation of Deferred@1864679413 after retry RPC after error@1940991629) -> (continuation of Deferred@132112930 after retry RPC after error@1397598122) -> (continuation of Deferred@425484577 after retry RPC after error@1667494337) -> (continuation of Deferred@466993533 after retry RPC after error@630932826) -> (continuation of Deferred@1605664161 after retry RPC after error@589652591) -> (continuation of Deferred@374247775 after retry RPC after error@1761650521) -> (continuation of Deferred@363169453 after retry RPC after error@496744556) -> (continuation of Deferred@2143094505 after retry RPC after error@334191656) -> (continuation of Deferred@717365270 after retry RPC after error@1792718330) -> (continuation of Deferred@2110221318 after retry RPC after error@881096074) -> (continuation of Deferred@268247452 after retry RPC after error@817307900) -> (continuation of Deferred@1985400240 after retry RPC after error@1634328277) -> (continuation of Deferred@134148773 after retry RPC after error@239571558) -> (continuation of Deferred@1312617811 after retry RPC after error@1628177719) -> (continuation of Deferred@286767209 after retry RPC after error@594660495) -> (continuation of Deferred@181281759 after retry RPC after error@199928332) -> (continuation of Deferred@663920616 after retry RPC after error@178928161) -> (continuation of Deferred@1904291952 after retry RPC after error@803561094) -> (continuation of Deferred@473688397 after retry RPC after error@1192997849) -> (continuation of Deferred@1071716858 after retry RPC after error@989159918) -> (continuation of Deferred@2043123324 after retry RPC after error@1666738150) -> (continuation of Deferred@1413582014 after retry RPC after error@1160408521) -> (continuation of Deferred@1800038 after retry RPC after error@551311316) -> (continuation of Deferred@2023754509 after retry RPC after error@1852990965) -> (continuation of Deferred@898211610 after retry RPC after error@1999182984) -> (continuation of Deferred@262768899 after retry RPC after error@1921587406)))
18:32:41.396 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
18:32:41.396 [WARN - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=27479), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [29ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [31ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [32ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [32ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [48ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [55ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [56ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [56ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [84ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [85ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [101ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [135ms] refreshing cache from master, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [137ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [138ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [138ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [138ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [162ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [203ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [323ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [402ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [783ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [783ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [783ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1680ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1682ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1900ms] refreshing cache from master, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1902ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3721ms] refreshing cache from master, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3723ms] too many traces: truncated at 100 traces, deferred=Deferred@1021121376(state=PENDING, result=null, callback=(continuation of Deferred@1864679413 after retry RPC after error@1940991629) -> (continuation of Deferred@132112930 after retry RPC after error@1397598122) -> (continuation of Deferred@425484577 after retry RPC after error@1667494337) -> (continuation of Deferred@466993533 after retry RPC after error@630932826) -> (continuation of Deferred@1605664161 after retry RPC after error@589652591) -> (continuation of Deferred@374247775 after retry RPC after error@1761650521) -> (continuation of Deferred@363169453 after retry RPC after error@496744556) -> (continuation of Deferred@2143094505 after retry RPC after error@334191656) -> (continuation of Deferred@717365270 after retry RPC after error@1792718330) -> (continuation of Deferred@2110221318 after retry RPC after error@881096074) -> (continuation of Deferred@268247452 after retry RPC after error@817307900) -> (continuation of Deferred@1985400240 after retry RPC after error@1634328277) -> (continuation of Deferred@134148773 after retry RPC after error@239571558) -> (continuation of Deferred@1312617811 after retry RPC after error@1628177719) -> (continuation of Deferred@286767209 after retry RPC after error@594660495) -> (continuation of Deferred@181281759 after retry RPC after error@199928332) -> (continuation of Deferred@663920616 after retry RPC after error@178928161) -> (continuation of Deferred@1904291952 after retry RPC after error@803561094) -> (continuation of Deferred@473688397 after retry RPC after error@1192997849) -> (continuation of Deferred@1071716858 after retry RPC after error@989159918) -> (continuation of Deferred@2043123324 after retry RPC after error@1666738150) -> (continuation of Deferred@1413582014 after retry RPC after error@1160408521) -> (continuation of Deferred@1800038 after retry RPC after error@551311316) -> (continuation of Deferred@2023754509 after retry RPC after error@1852990965) -> (continuation of Deferred@898211610 after retry RPC after error@1999182984) -> (continuation of Deferred@262768899 after retry RPC after error@1921587406), errback=(continuation of Deferred@1864679413 after retry RPC after error@1940991629) -> (continuation of Deferred@132112930 after retry RPC after error@1397598122) -> (continuation of Deferred@425484577 after retry RPC after error@1667494337) -> (continuation of Deferred@466993533 after retry RPC after error@630932826) -> (continuation of Deferred@1605664161 after retry RPC after error@589652591) -> (continuation of Deferred@374247775 after retry RPC after error@1761650521) -> (continuation of Deferred@363169453 after retry RPC after error@496744556) -> (continuation of Deferred@2143094505 after retry RPC after error@334191656) -> (continuation of Deferred@717365270 after retry RPC after error@1792718330) -> (continuation of Deferred@2110221318 after retry RPC after error@881096074) -> (continuation of Deferred@268247452 after retry RPC after error@817307900) -> (continuation of Deferred@1985400240 after retry RPC after error@1634328277) -> (continuation of Deferred@134148773 after retry RPC after error@239571558) -> (continuation of Deferred@1312617811 after retry RPC after error@1628177719) -> (continuation of Deferred@286767209 after retry RPC after error@594660495) -> (continuation of Deferred@181281759 after retry RPC after error@199928332) -> (continuation of Deferred@663920616 after retry RPC after error@178928161) -> (continuation of Deferred@1904291952 after retry RPC after error@803561094) -> (continuation of Deferred@473688397 after retry RPC after error@1192997849) -> (continuation of Deferred@1071716858 after retry RPC after error@989159918) -> (continuation of Deferred@2043123324 after retry RPC after error@1666738150) -> (continuation of Deferred@1413582014 after retry RPC after error@1160408521) -> (continuation of Deferred@1800038 after retry RPC after error@551311316) -> (continuation of Deferred@2023754509 after retry RPC after error@1852990965) -> (continuation of Deferred@898211610 after retry RPC after error@1999182984) -> (continuation of Deferred@262768899 after retry RPC after error@1921587406)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:41.396 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
18:32:41.398 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#3 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
18:32:41.407 [DEBUG - main] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:32:41.416 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultJobLeaderService.java:192) Add job 9de81db54be40687a2a82164db1dc50b for job leader monitoring.
18:32:41.417 [INFO - mini-cluster-io-thread-4] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_15 with leader id 2f6e6c44-8fdf-41db-a5e5-370b268334c0.
18:32:41.459 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.96.190:44161(127.2.96.190:44161)] Successfully connected to peer
18:32:41.462 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=27479), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [29ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [31ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [32ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [32ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [48ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [55ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [56ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [56ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [84ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [85ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [101ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [135ms] refreshing cache from master, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [137ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [138ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [138ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [138ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [162ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [203ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [323ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [402ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [783ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [783ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [783ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1680ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1682ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1900ms] refreshing cache from master, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1902ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3721ms] refreshing cache from master, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3723ms] too many traces: truncated at 100 traces, deferred=Deferred@1021121376(state=PENDING, result=null, callback=(continuation of Deferred@1864679413 after retry RPC after error@1940991629) -> (continuation of Deferred@132112930 after retry RPC after error@1397598122) -> (continuation of Deferred@425484577 after retry RPC after error@1667494337) -> (continuation of Deferred@466993533 after retry RPC after error@630932826) -> (continuation of Deferred@1605664161 after retry RPC after error@589652591) -> (continuation of Deferred@374247775 after retry RPC after error@1761650521) -> (continuation of Deferred@363169453 after retry RPC after error@496744556) -> (continuation of Deferred@2143094505 after retry RPC after error@334191656) -> (continuation of Deferred@717365270 after retry RPC after error@1792718330) -> (continuation of Deferred@2110221318 after retry RPC after error@881096074) -> (continuation of Deferred@268247452 after retry RPC after error@817307900) -> (continuation of Deferred@1985400240 after retry RPC after error@1634328277) -> (continuation of Deferred@134148773 after retry RPC after error@239571558) -> (continuation of Deferred@1312617811 after retry RPC after error@1628177719) -> (continuation of Deferred@286767209 after retry RPC after error@594660495) -> (continuation of Deferred@181281759 after retry RPC after error@199928332) -> (continuation of Deferred@663920616 after retry RPC after error@178928161) -> (continuation of Deferred@1904291952 after retry RPC after error@803561094) -> (continuation of Deferred@473688397 after retry RPC after error@1192997849) -> (continuation of Deferred@1071716858 after retry RPC after error@989159918) -> (continuation of Deferred@2043123324 after retry RPC after error@1666738150) -> (continuation of Deferred@1413582014 after retry RPC after error@1160408521) -> (continuation of Deferred@1800038 after retry RPC after error@551311316) -> (continuation of Deferred@2023754509 after retry RPC after error@1852990965) -> (continuation of Deferred@898211610 after retry RPC after error@1999182984) -> (continuation of Deferred@262768899 after retry RPC after error@1921587406), errback=(continuation of Deferred@1864679413 after retry RPC after error@1940991629) -> (continuation of Deferred@132112930 after retry RPC after error@1397598122) -> (continuation of Deferred@425484577 after retry RPC after error@1667494337) -> (continuation of Deferred@466993533 after retry RPC after error@630932826) -> (continuation of Deferred@1605664161 after retry RPC after error@589652591) -> (continuation of Deferred@374247775 after retry RPC after error@1761650521) -> (continuation of Deferred@363169453 after retry RPC after error@496744556) -> (continuation of Deferred@2143094505 after retry RPC after error@334191656) -> (continuation of Deferred@717365270 after retry RPC after error@1792718330) -> (continuation of Deferred@2110221318 after retry RPC after error@881096074) -> (continuation of Deferred@268247452 after retry RPC after error@817307900) -> (continuation of Deferred@1985400240 after retry RPC after error@1634328277) -> (continuation of Deferred@134148773 after retry RPC after error@239571558) -> (continuation of Deferred@1312617811 after retry RPC after error@1628177719) -> (continuation of Deferred@286767209 after retry RPC after error@594660495) -> (continuation of Deferred@181281759 after retry RPC after error@199928332) -> (continuation of Deferred@663920616 after retry RPC after error@178928161) -> (continuation of Deferred@1904291952 after retry RPC after error@803561094) -> (continuation of Deferred@473688397 after retry RPC after error@1192997849) -> (continuation of Deferred@1071716858 after retry RPC after error@989159918) -> (continuation of Deferred@2043123324 after retry RPC after error@1666738150) -> (continuation of Deferred@1413582014 after retry RPC after error@1160408521) -> (continuation of Deferred@1800038 after retry RPC after error@551311316) -> (continuation of Deferred@2023754509 after retry RPC after error@1852990965) -> (continuation of Deferred@898211610 after retry RPC after error@1999182984) -> (continuation of Deferred@262768899 after retry RPC after error@1921587406)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:41.464 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request e340c57f8743c3b4810a5f8fd9742fae for job 9de81db54be40687a2a82164db1dc50b from resource manager with leader id 850ec26150ed9e010104470b7b4a477a.
18:32:41.464 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for e340c57f8743c3b4810a5f8fd9742fae with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:32:41.468 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:41.469 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
18:32:41.479 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request afa7c94bd89aa521f7cc788a9467b76f for job 9de81db54be40687a2a82164db1dc50b from resource manager with leader id 850ec26150ed9e010104470b7b4a477a.
18:32:41.479 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for afa7c94bd89aa521f7cc788a9467b76f with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:32:41.479 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1149) Receive slot request 2d9055e68c7827d1c77d7c11ef4f5752 for job 9de81db54be40687a2a82164db1dc50b from resource manager with leader id 850ec26150ed9e010104470b7b4a477a.
18:32:41.480 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:321) Allocated slot for 2d9055e68c7827d1c77d7c11ef4f5752 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:32:41.482 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_15 for job 9de81db54be40687a2a82164db1dc50b.
18:32:41.483 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1783) Establish JobManager connection for job 9de81db54be40687a2a82164db1dc50b.
18:32:41.483 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 9de81db54be40687a2a82164db1dc50b.
18:32:41.483 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:32:41.484 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
18:32:41.484 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id afa7c94bd89aa521f7cc788a9467b76f
18:32:41.484 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#3) of source Source: KuduSource.
18:32:41.484 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
18:32:41.485 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot afa7c94bd89aa521f7cc788a9467b76f.
18:32:41.486 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 9de81db54be40687a2a82164db1dc50b.
18:32:41.486 [INFO - flink-pekko.actor.default-dispatcher-5] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
18:32:41.486 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 9de81db54be40687a2a82164db1dc50b
18:32:41.487 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id afa7c94bd89aa521f7cc788a9467b76f.
18:32:41.494 [DEBUG - main] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:32:41.495 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.3.43.188:36795(127.3.43.188:36795)] Successfully connected to peer
18:32:41.503 [DEBUG - main] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:32:41.504 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.3.43.189:32951(127.3.43.189:32951)] Successfully connected to peer
18:32:41.509 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.189
18:32:41.520 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.188
18:32:41.523 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.190
18:32:41.527 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
18:32:41.527 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id 30d104af07ed84a5695abb40e9c4cdae
18:32:41.528 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
18:32:41.528 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id 2d9055e68c7827d1c77d7c11ef4f5752
18:32:41.529 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:41.545 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 30d104af07ed84a5695abb40e9c4cdae.
18:32:41.550 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 30d104af07ed84a5695abb40e9c4cdae.
18:32:41.552 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 2d9055e68c7827d1c77d7c11ef4f5752.
18:32:41.553 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:41.557 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 2d9055e68c7827d1c77d7c11ef4f5752.
18:32:41.559 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
18:32:41.559 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id e340c57f8743c3b4810a5f8fd9742fae
18:32:41.559 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:41.560 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot e340c57f8743c3b4810a5f8fd9742fae.
18:32:41.564 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4e108f01, L:/127.0.0.1:42180 - R:/127.3.43.188:36795] using SASL/PLAIN
18:32:41.565 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc6e61782, L:/127.0.0.1:49966 - R:/127.3.43.189:32951] using SASL/PLAIN
18:32:41.567 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:41.567 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:41.567 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:41.567 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:41.567 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:41.567 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:41.568 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:41.568 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:41.568 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:41.568 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:41.567 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:41.568 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:41.568 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:41.570 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id e340c57f8743c3b4810a5f8fd9742fae.
18:32:41.570 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
18:32:41.570 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
18:32:41.570 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:32:41.572 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
18:32:41.572 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
18:32:41.572 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=205), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: OK, [163ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: OK, deferred=null) after lookup
18:32:41.573 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1c399571
18:32:41.573 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:41.573 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:32:41.573 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
18:32:41.573 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
18:32:41.574 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.96.188:32989(127.2.96.188:32989)] Successfully connected to peer
18:32:41.572 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
18:32:41.591 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
18:32:41.592 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@8ed1575
18:32:41.592 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:41.571 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3886e1c6
18:32:41.592 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:41.592 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:32:41.589 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot afa7c94bd89aa521f7cc788a9467b76f.
18:32:41.592 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 30d104af07ed84a5695abb40e9c4cdae.
18:32:41.592 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 2d9055e68c7827d1c77d7c11ef4f5752.
18:32:41.592 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot e340c57f8743c3b4810a5f8fd9742fae.
18:32:41.592 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
18:32:41.593 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.188
18:32:41.587 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.96.189:33339(127.2.96.189:33339)] Successfully connected to peer
18:32:41.586 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:41.583 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:41.580 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
18:32:41.595 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
18:32:41.595 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:41.595 [DEBUG - pool-172-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:41.596 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@58500818
18:32:41.596 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:41.596 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:41.596 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:41.596 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:41.596 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:41.579 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.3.43.190:40613(127.3.43.190:40613)] Successfully connected to peer
18:32:41.639 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9776101d, L:/127.0.0.1:58424 - R:/127.2.96.190:44161] using SASL/PLAIN
18:32:41.640 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7bf6647c
18:32:41.577 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 430ff55bf33c43dbbd3443b21bc87300
18:32:41.641 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
18:32:41.641 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@12934df0
18:32:41.596 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:41.643 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:41.643 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:41.596 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:32:41.643 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
18:32:41.644 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
18:32:41.644 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:41.645 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:41.592 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:32:41.645 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
18:32:41.646 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1dafd509
18:32:41.647 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:41.648 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
18:32:41.648 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@38bbe22c
18:32:41.642 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:41.651 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:41.651 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:41.652 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27753), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [29ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [30ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [58ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [59ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [68ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [70ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [71ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [71ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [88ms] refreshing cache from master, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [98ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [99ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [100ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [148ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [150ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [150ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [150ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [161ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [181ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [294ms] refreshing cache from master, [294ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [295ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [295ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [296ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [296ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [296ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [305ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [483ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [562ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [562ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [563ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [563ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [700ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [702ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [704ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1160ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1163ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [4660ms] refreshing cache from master, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4662ms] too many traces: truncated at 100 traces, deferred=Deferred@1467629444(state=PENDING, result=null, callback=(continuation of Deferred@276382007 after retry RPC after error@521107130) -> (continuation of Deferred@1774558335 after retry RPC after error@1866795228) -> (continuation of Deferred@904891642 after retry RPC after error@1370588763) -> (continuation of Deferred@349359734 after retry RPC after error@1402349528) -> (continuation of Deferred@450361612 after retry RPC after error@1200174931) -> (continuation of Deferred@1168826538 after retry RPC after error@669038368) -> (continuation of Deferred@47854921 after retry RPC after error@216508910) -> (continuation of Deferred@517650280 after retry RPC after error@1017203236) -> (continuation of Deferred@1862422660 after retry RPC after error@1587227731) -> (continuation of Deferred@363966751 after retry RPC after error@603400679) -> (continuation of Deferred@1577896813 after retry RPC after error@1500683595) -> (continuation of Deferred@1104406067 after retry RPC after error@1534154751) -> (continuation of Deferred@1671346271 after retry RPC after error@785115554) -> (continuation of Deferred@1886871606 after retry RPC after error@568860520) -> (continuation of Deferred@924981066 after retry RPC after error@1180004085) -> (continuation of Deferred@224973017 after retry RPC after error@1822068035) -> (continuation of Deferred@1260740573 after retry RPC after error@644526730) -> (continuation of Deferred@1833910406 after retry RPC after error@1426536697) -> (continuation of Deferred@884825651 after retry RPC after error@1194345676) -> (continuation of Deferred@1357674460 after retry RPC after error@1010851272), errback=(continuation of Deferred@276382007 after retry RPC after error@521107130) -> (continuation of Deferred@1774558335 after retry RPC after error@1866795228) -> (continuation of Deferred@904891642 after retry RPC after error@1370588763) -> (continuation of Deferred@349359734 after retry RPC after error@1402349528) -> (continuation of Deferred@450361612 after retry RPC after error@1200174931) -> (continuation of Deferred@1168826538 after retry RPC after error@669038368) -> (continuation of Deferred@47854921 after retry RPC after error@216508910) -> (continuation of Deferred@517650280 after retry RPC after error@1017203236) -> (continuation of Deferred@1862422660 after retry RPC after error@1587227731) -> (continuation of Deferred@363966751 after retry RPC after error@603400679) -> (continuation of Deferred@1577896813 after retry RPC after error@1500683595) -> (continuation of Deferred@1104406067 after retry RPC after error@1534154751) -> (continuation of Deferred@1671346271 after retry RPC after error@785115554) -> (continuation of Deferred@1886871606 after retry RPC after error@568860520) -> (continuation of Deferred@924981066 after retry RPC after error@1180004085) -> (continuation of Deferred@224973017 after retry RPC after error@1822068035) -> (continuation of Deferred@1260740573 after retry RPC after error@644526730) -> (continuation of Deferred@1833910406 after retry RPC after error@1426536697) -> (continuation of Deferred@884825651 after retry RPC after error@1194345676) -> (continuation of Deferred@1357674460 after retry RPC after error@1010851272)))
18:32:41.653 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:32:41.653 [WARN - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27753), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [29ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [30ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [58ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [59ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [68ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [70ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [71ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [71ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [88ms] refreshing cache from master, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [98ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [99ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [100ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [148ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [150ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [150ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [150ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [161ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [181ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [294ms] refreshing cache from master, [294ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [295ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [295ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [296ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [296ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [296ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [305ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [483ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [562ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [562ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [563ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [563ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [700ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [702ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [704ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1160ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1163ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [4660ms] refreshing cache from master, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4662ms] too many traces: truncated at 100 traces, deferred=Deferred@1467629444(state=PENDING, result=null, callback=(continuation of Deferred@276382007 after retry RPC after error@521107130) -> (continuation of Deferred@1774558335 after retry RPC after error@1866795228) -> (continuation of Deferred@904891642 after retry RPC after error@1370588763) -> (continuation of Deferred@349359734 after retry RPC after error@1402349528) -> (continuation of Deferred@450361612 after retry RPC after error@1200174931) -> (continuation of Deferred@1168826538 after retry RPC after error@669038368) -> (continuation of Deferred@47854921 after retry RPC after error@216508910) -> (continuation of Deferred@517650280 after retry RPC after error@1017203236) -> (continuation of Deferred@1862422660 after retry RPC after error@1587227731) -> (continuation of Deferred@363966751 after retry RPC after error@603400679) -> (continuation of Deferred@1577896813 after retry RPC after error@1500683595) -> (continuation of Deferred@1104406067 after retry RPC after error@1534154751) -> (continuation of Deferred@1671346271 after retry RPC after error@785115554) -> (continuation of Deferred@1886871606 after retry RPC after error@568860520) -> (continuation of Deferred@924981066 after retry RPC after error@1180004085) -> (continuation of Deferred@224973017 after retry RPC after error@1822068035) -> (continuation of Deferred@1260740573 after retry RPC after error@644526730) -> (continuation of Deferred@1833910406 after retry RPC after error@1426536697) -> (continuation of Deferred@884825651 after retry RPC after error@1194345676) -> (continuation of Deferred@1357674460 after retry RPC after error@1010851272), errback=(continuation of Deferred@276382007 after retry RPC after error@521107130) -> (continuation of Deferred@1774558335 after retry RPC after error@1866795228) -> (continuation of Deferred@904891642 after retry RPC after error@1370588763) -> (continuation of Deferred@349359734 after retry RPC after error@1402349528) -> (continuation of Deferred@450361612 after retry RPC after error@1200174931) -> (continuation of Deferred@1168826538 after retry RPC after error@669038368) -> (continuation of Deferred@47854921 after retry RPC after error@216508910) -> (continuation of Deferred@517650280 after retry RPC after error@1017203236) -> (continuation of Deferred@1862422660 after retry RPC after error@1587227731) -> (continuation of Deferred@363966751 after retry RPC after error@603400679) -> (continuation of Deferred@1577896813 after retry RPC after error@1500683595) -> (continuation of Deferred@1104406067 after retry RPC after error@1534154751) -> (continuation of Deferred@1671346271 after retry RPC after error@785115554) -> (continuation of Deferred@1886871606 after retry RPC after error@568860520) -> (continuation of Deferred@924981066 after retry RPC after error@1180004085) -> (continuation of Deferred@224973017 after retry RPC after error@1822068035) -> (continuation of Deferred@1260740573 after retry RPC after error@644526730) -> (continuation of Deferred@1833910406 after retry RPC after error@1426536697) -> (continuation of Deferred@884825651 after retry RPC after error@1194345676) -> (continuation of Deferred@1357674460 after retry RPC after error@1010851272)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:41.654 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
18:32:41.655 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:41.656 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:41.657 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:41.661 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:32:41.666 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x223f7032, L:/127.0.0.1:57604 - R:/127.2.96.188:32989] using SASL/PLAIN
18:32:41.666 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 5fa379231aa347d299f56467d01e8555 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
18:32:41.667 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c2d16b8dc05e430ba368fdce09cf6cfa for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
18:32:41.667 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 49907dc63f1c46a383141035a9353a56 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
18:32:41.667 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 0cba6ba156884b4c8f2a86f07bdde1fd for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:41.667 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:41.668 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.189
18:32:41.671 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3c9d24669dd74422a060ddb81c161ceb for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:41.672 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:41.672 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:32:41.672 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:41.673 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=309), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [284ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: OK, [285ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: OK, deferred=null) after lookup
18:32:41.673 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:41.673 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:41.673 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:41.673 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:41.673 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:41.673 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:41.673 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:41.673 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:32:41.674 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:41.674 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:41.674 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:41.674 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:41.675 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299997, tablet=5fa379231aa347d299f56467d01e8555@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299996, tablet=c2d16b8dc05e430ba368fdce09cf6cfa@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299996, tablet=49907dc63f1c46a383141035a9353a56@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299996, tablet=0cba6ba156884b4c8f2a86f07bdde1fd@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299996, tablet=3cd1aa7ed7df4357ab66fc58805f62e3@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299996, tablet=3c9d24669dd74422a060ddb81c161ceb@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299996}]
18:32:41.675 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=31), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.43.188:36795, [22ms] Sub RPC GetTableLocations: received response from server master-127.3.43.188:36795: OK, deferred=null)) after lookup
18:32:41.675 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#2 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
18:32:41.675 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)] connecting to peer
18:32:41.679 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27753), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [29ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [30ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [58ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [59ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [68ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [70ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [71ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [71ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [88ms] refreshing cache from master, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [98ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [99ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [100ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [148ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [150ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [150ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [150ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [161ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [181ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [294ms] refreshing cache from master, [294ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [295ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [295ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [296ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [296ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [296ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [305ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [483ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [562ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [562ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [563ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [563ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [700ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [702ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [704ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1160ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1163ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [4660ms] refreshing cache from master, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4662ms] too many traces: truncated at 100 traces, deferred=Deferred@1467629444(state=PENDING, result=null, callback=(continuation of Deferred@276382007 after retry RPC after error@521107130) -> (continuation of Deferred@1774558335 after retry RPC after error@1866795228) -> (continuation of Deferred@904891642 after retry RPC after error@1370588763) -> (continuation of Deferred@349359734 after retry RPC after error@1402349528) -> (continuation of Deferred@450361612 after retry RPC after error@1200174931) -> (continuation of Deferred@1168826538 after retry RPC after error@669038368) -> (continuation of Deferred@47854921 after retry RPC after error@216508910) -> (continuation of Deferred@517650280 after retry RPC after error@1017203236) -> (continuation of Deferred@1862422660 after retry RPC after error@1587227731) -> (continuation of Deferred@363966751 after retry RPC after error@603400679) -> (continuation of Deferred@1577896813 after retry RPC after error@1500683595) -> (continuation of Deferred@1104406067 after retry RPC after error@1534154751) -> (continuation of Deferred@1671346271 after retry RPC after error@785115554) -> (continuation of Deferred@1886871606 after retry RPC after error@568860520) -> (continuation of Deferred@924981066 after retry RPC after error@1180004085) -> (continuation of Deferred@224973017 after retry RPC after error@1822068035) -> (continuation of Deferred@1260740573 after retry RPC after error@644526730) -> (continuation of Deferred@1833910406 after retry RPC after error@1426536697) -> (continuation of Deferred@884825651 after retry RPC after error@1194345676) -> (continuation of Deferred@1357674460 after retry RPC after error@1010851272), errback=(continuation of Deferred@276382007 after retry RPC after error@521107130) -> (continuation of Deferred@1774558335 after retry RPC after error@1866795228) -> (continuation of Deferred@904891642 after retry RPC after error@1370588763) -> (continuation of Deferred@349359734 after retry RPC after error@1402349528) -> (continuation of Deferred@450361612 after retry RPC after error@1200174931) -> (continuation of Deferred@1168826538 after retry RPC after error@669038368) -> (continuation of Deferred@47854921 after retry RPC after error@216508910) -> (continuation of Deferred@517650280 after retry RPC after error@1017203236) -> (continuation of Deferred@1862422660 after retry RPC after error@1587227731) -> (continuation of Deferred@363966751 after retry RPC after error@603400679) -> (continuation of Deferred@1577896813 after retry RPC after error@1500683595) -> (continuation of Deferred@1104406067 after retry RPC after error@1534154751) -> (continuation of Deferred@1671346271 after retry RPC after error@785115554) -> (continuation of Deferred@1886871606 after retry RPC after error@568860520) -> (continuation of Deferred@924981066 after retry RPC after error@1180004085) -> (continuation of Deferred@224973017 after retry RPC after error@1822068035) -> (continuation of Deferred@1260740573 after retry RPC after error@644526730) -> (continuation of Deferred@1833910406 after retry RPC after error@1426536697) -> (continuation of Deferred@884825651 after retry RPC after error@1194345676) -> (continuation of Deferred@1357674460 after retry RPC after error@1010851272)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:41.680 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
18:32:41.681 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:32:41.681 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#2) of source Source: KuduSource.
18:32:41.687 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:41.690 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:41.690 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6b086cbb915d4f34838e5ef58717ef47
18:32:41.693 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:41.693 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:41.693 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:41.694 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:41.694 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:41.694 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:41.694 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:41.694 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:41.695 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:41.695 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:41.695 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:41.695 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:41.695 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:41.695 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x96e818ec, L:/127.0.0.1:60168 - R:/127.3.43.190:40613] using TOKEN/null
18:32:41.696 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x7a035f64, L:/127.0.0.1:37402 - R:/127.2.96.189:33339] using SASL/PLAIN
18:32:41.698 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:32:41.698 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:32:41.704 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bf82abb9dff341cf9fe05a19552b4e99 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
18:32:41.705 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 007ce0b42486462cb7e00e1363a68404 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
18:32:41.705 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d886241527f4f569f6d9abed2c4c8aa for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
18:32:41.705 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 4eb9e4eed973435997d975ece849ca7a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:41.705 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet fa1ae6554a4f44edb298443dd03f3989 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:41.705 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 0c25f7b288564110a208c9c3d924a97b for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:41.707 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:41.707 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:41.707 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:41.707 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:41.707 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:41.708 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:41.708 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:41.708 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:41.708 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:41.708 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:41.708 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:41.708 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:41.708 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:41.710 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=bf82abb9dff341cf9fe05a19552b4e99@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=007ce0b42486462cb7e00e1363a68404@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=3d886241527f4f569f6d9abed2c4c8aa@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=4eb9e4eed973435997d975ece849ca7a@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fa1ae6554a4f44edb298443dd03f3989@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=0c25f7b288564110a208c9c3d924a97b@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299995}]
18:32:41.713 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:41.739 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:32:41.740 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.3.43.188:36795(127.3.43.188:36795)] Successfully connected to peer
18:32:41.751 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:32:41.755 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.3.43.189:32951(127.3.43.189:32951)] Successfully connected to peer
18:32:41.756 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.3.43.190:40613(127.3.43.190:40613)] Successfully connected to peer
18:32:41.763 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:32:41.764 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.3.43.188:36795(127.3.43.188:36795)] Successfully connected to peer
18:32:41.765 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:32:41.766 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.190
18:32:41.766 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.188
18:32:41.767 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.189
18:32:41.770 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.3.43.189:32951(127.3.43.189:32951)] Successfully connected to peer
18:32:41.778 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:41.779 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.3.43.190:40613(127.3.43.190:40613)] Successfully connected to peer
18:32:41.787 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:32:41.788 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.3.43.188:36795(127.3.43.188:36795)] Successfully connected to peer
18:32:41.798 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd8cbe357, L:/127.0.0.1:32986 - R:/127.3.43.188:36795] using SASL/PLAIN
18:32:41.800 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:32:41.802 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.3.43.189:32951(127.3.43.189:32951)] Successfully connected to peer
18:32:41.804 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:32:41.804 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=147), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [105ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: OK, deferred=null) after lookup
18:32:41.808 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.3.43.190:40613(127.3.43.190:40613)] Successfully connected to peer
18:32:41.809 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 430ff55bf33c43dbbd3443b21bc87300
18:32:41.811 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.188
18:32:41.812 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 430ff55bf33c43dbbd3443b21bc87300
18:32:41.812 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7bd0158e
18:32:41.814 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
18:32:41.814 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
18:32:41.824 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:41.827 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfbdd5196, L:/127.0.0.1:32988 - R:/127.3.43.188:36795] using SASL/PLAIN
18:32:41.831 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.188
18:32:41.834 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:32:41.834 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=178), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [134ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: OK, deferred=null) after lookup
18:32:41.837 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 430ff55bf33c43dbbd3443b21bc87300
18:32:41.838 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:41.840 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 430ff55bf33c43dbbd3443b21bc87300
18:32:41.840 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6f3ea72e
18:32:41.841 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:41.841 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:41.842 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:41.842 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
18:32:41.842 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:41.842 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:41.842 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:41.842 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:41.842 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:41.842 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:41.842 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:41.842 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:41.842 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:41.842 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:41.860 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
18:32:41.862 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.189
18:32:41.865 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.190
18:32:41.867 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.190
18:32:41.871 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.189
18:32:41.873 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:41.876 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5cee2d20, L:/127.0.0.1:60202 - R:/127.3.43.190:40613] using SASL/PLAIN
18:32:41.881 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:41.881 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:32:41.883 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.3.43.188:36795(127.3.43.188:36795)] Successfully connected to peer
18:32:41.887 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:41.891 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xe1fe15f8, L:/127.0.0.1:33760 - R:/127.3.43.189:32951] using SASL/PLAIN
18:32:41.933 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x510f6158, L:/127.0.0.1:60186 - R:/127.3.43.190:40613] using SASL/PLAIN
18:32:41.933 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:41.937 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:41.937 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:32:41.938 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.3.43.189:32951(127.3.43.189:32951)] Successfully connected to peer
18:32:41.941 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.188
18:32:41.942 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:41.947 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x41427156, L:/127.0.0.1:32982 - R:/127.3.43.188:36795] using SASL/PLAIN
18:32:41.948 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xf62a0b89, L:/127.0.0.1:33746 - R:/127.3.43.189:32951] using SASL/PLAIN
18:32:41.949 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:41.952 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.189
18:32:41.953 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x9c3393a4, L:/127.0.0.1:33744 - R:/127.3.43.189:32951] using SASL/PLAIN
18:32:41.963 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x8ee6a663, L:/127.0.0.1:60172 - R:/127.3.43.190:40613] using SASL/PLAIN
18:32:41.965 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:32:41.965 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=320), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [303ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: OK, deferred=null) after lookup
18:32:41.958 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.3.43.190:40613(127.3.43.190:40613)] Successfully connected to peer
18:32:41.971 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 430ff55bf33c43dbbd3443b21bc87300
18:32:41.980 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 430ff55bf33c43dbbd3443b21bc87300
18:32:41.980 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3643b958
18:32:41.982 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
18:32:41.983 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
18:32:41.983 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.43.190
18:32:41.990 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:41.996 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x206d4e95, L:/127.0.0.1:32992 - R:/127.3.43.188:36795] using SASL/PLAIN
18:32:41.998 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
18:32:41.998 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='4b8438da0ba00093f26a11e53ad3234dd8bde29fcbc895bb5f956fe4f679e7ca'}]
18:32:42.000 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:42.005 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:42.006 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:32:42.006 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=358), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [208ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [333ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: OK, deferred=null) after lookup
18:32:41.990 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:42.011 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 430ff55bf33c43dbbd3443b21bc87300
18:32:42.013 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xcfa1ba26, L:/127.0.0.1:33774 - R:/127.3.43.189:32951] using SASL/PLAIN
18:32:42.014 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
18:32:42.021 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9a12e67b, L:/127.0.0.1:60214 - R:/127.3.43.190:40613] using SASL/PLAIN
18:32:42.023 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 430ff55bf33c43dbbd3443b21bc87300
18:32:42.023 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3557ece2
18:32:42.024 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
18:32:42.024 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
18:32:42.028 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)] Successfully connected to peer
18:32:42.044 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
18:32:42.045 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='3585c2ff1d573bed63eec179d8ecbd547cd4eb43832c5e85ad0bca42fca550cf'}]
18:32:42.047 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:42.048 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
18:32:42.049 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
18:32:42.049 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='f4816f1f90b6950bdf3c614f4f466651035f0056e146a67ad8b81a433331a7bc'}]
18:32:42.051 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:42.059 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:32:42.061 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299993, tablet=007ce0b42486462cb7e00e1363a68404@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}]
18:32:42.062 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:32:42.063 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299994, tablet=bf82abb9dff341cf9fe05a19552b4e99@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}]
18:32:42.064 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:32:42.065 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:42.065 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299993, tablet=3d886241527f4f569f6d9abed2c4c8aa@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}]
18:32:42.066 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
18:32:42.066 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='14fa745fc46b3e20e4cc628dfddd8ee10c638d7e387ff916910e9e8224920a0c'}]
18:32:42.068 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:42.069 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:32:42.070 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299993, tablet=4eb9e4eed973435997d975ece849ca7a@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}]
18:32:42.071 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:42.072 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:42.073 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:42.074 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
18:32:42.074 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
18:32:42.076 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:42.077 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:42.079 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x104ef09b, L:/127.0.0.1:42370 - R:/127.3.43.131:38327] using TOKEN/null
18:32:42.097 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:42.102 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:42.107 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:42.108 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:42.112 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:42.113 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfd246f1b, L:/127.0.0.1:41852 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:42.114 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:42.118 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:42.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535562121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:42.123 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:42.128 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:42.131 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:42.131 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc381cc05, L:/127.0.0.1:41856 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:42.137 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8c9f7b98, L:/127.0.0.1:41860 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:42.138 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:42.138 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:42.138 [DEBUG - pool-169-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:42.139 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:42.139 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:42.139 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:42.139 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:42.139 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:42.139 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:42.140 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:42.140 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:42.140 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:42.140 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:42.141 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28251), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [70ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [72ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [72ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [86ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [87ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [88ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [88ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [171ms] refreshing cache from master, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [172ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [172ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [175ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [175ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [175ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [204ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [204ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [204ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [223ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [223ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [223ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [331ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [331ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [384ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [384ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [600ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [603ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1601ms] refreshing cache from master, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1602ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1760ms] refreshing cache from master, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1762ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2840ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2842ms] too many traces: truncated at 100 traces, deferred=Deferred@1022722507(state=PENDING, result=null, callback=(continuation of Deferred@1482233635 after retry RPC after error@104195613) -> (continuation of Deferred@699596731 after retry RPC after error@970573983) -> (continuation of Deferred@698949768 after retry RPC after error@8732334) -> (continuation of Deferred@1056196130 after retry RPC after error@1235156051) -> (continuation of Deferred@701708424 after retry RPC after error@660306) -> (continuation of Deferred@483622951 after retry RPC after error@571579274) -> (continuation of Deferred@305586232 after retry RPC after error@1123475887) -> (continuation of Deferred@1118081902 after retry RPC after error@1816632699) -> (continuation of Deferred@1230342123 after retry RPC after error@1021046007) -> (continuation of Deferred@1518483425 after retry RPC after error@176084367) -> (continuation of Deferred@1878090228 after retry RPC after error@212767913) -> (continuation of Deferred@1205376994 after retry RPC after error@1006035003) -> (continuation of Deferred@1600964720 after retry RPC after error@656344296) -> (continuation of Deferred@620490862 after retry RPC after error@671103986) -> (continuation of Deferred@295066058 after retry RPC after error@1324431188) -> (continuation of Deferred@896718436 after retry RPC after error@478454931) -> (continuation of Deferred@1073739456 after retry RPC after error@2029202940) -> (continuation of Deferred@1536234864 after retry RPC after error@1644729005) -> (continuation of Deferred@578892250 after retry RPC after error@1140614331) -> (continuation of Deferred@278254369 after retry RPC after error@917415524) -> (continuation of Deferred@495603338 after retry RPC after error@1030957116) -> (continuation of Deferred@54655080 after retry RPC after error@1084220386) -> (continuation of Deferred@254675813 after retry RPC after error@733540468) -> (continuation of Deferred@657907667 after retry RPC after error@403290148), errback=(continuation of Deferred@1482233635 after retry RPC after error@104195613) -> (continuation of Deferred@699596731 after retry RPC after error@970573983) -> (continuation of Deferred@698949768 after retry RPC after error@8732334) -> (continuation of Deferred@1056196130 after retry RPC after error@1235156051) -> (continuation of Deferred@701708424 after retry RPC after error@660306) -> (continuation of Deferred@483622951 after retry RPC after error@571579274) -> (continuation of Deferred@305586232 after retry RPC after error@1123475887) -> (continuation of Deferred@1118081902 after retry RPC after error@1816632699) -> (continuation of Deferred@1230342123 after retry RPC after error@1021046007) -> (continuation of Deferred@1518483425 after retry RPC after error@176084367) -> (continuation of Deferred@1878090228 after retry RPC after error@212767913) -> (continuation of Deferred@1205376994 after retry RPC after error@1006035003) -> (continuation of Deferred@1600964720 after retry RPC after error@656344296) -> (continuation of Deferred@620490862 after retry RPC after error@671103986) -> (continuation of Deferred@295066058 after retry RPC after error@1324431188) -> (continuation of Deferred@896718436 after retry RPC after error@478454931) -> (continuation of Deferred@1073739456 after retry RPC after error@2029202940) -> (continuation of Deferred@1536234864 after retry RPC after error@1644729005) -> (continuation of Deferred@578892250 after retry RPC after error@1140614331) -> (continuation of Deferred@278254369 after retry RPC after error@917415524) -> (continuation of Deferred@495603338 after retry RPC after error@1030957116) -> (continuation of Deferred@54655080 after retry RPC after error@1084220386) -> (continuation of Deferred@254675813 after retry RPC after error@733540468) -> (continuation of Deferred@657907667 after retry RPC after error@403290148)))
18:32:42.144 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:32:42.144 [WARN - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28251), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [70ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [72ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [72ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [86ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [87ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [88ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [88ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [171ms] refreshing cache from master, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [172ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [172ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [175ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [175ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [175ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [204ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [204ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [204ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [223ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [223ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [223ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [331ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [331ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [384ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [384ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [600ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [603ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1601ms] refreshing cache from master, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1602ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1760ms] refreshing cache from master, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1762ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2840ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2842ms] too many traces: truncated at 100 traces, deferred=Deferred@1022722507(state=PENDING, result=null, callback=(continuation of Deferred@1482233635 after retry RPC after error@104195613) -> (continuation of Deferred@699596731 after retry RPC after error@970573983) -> (continuation of Deferred@698949768 after retry RPC after error@8732334) -> (continuation of Deferred@1056196130 after retry RPC after error@1235156051) -> (continuation of Deferred@701708424 after retry RPC after error@660306) -> (continuation of Deferred@483622951 after retry RPC after error@571579274) -> (continuation of Deferred@305586232 after retry RPC after error@1123475887) -> (continuation of Deferred@1118081902 after retry RPC after error@1816632699) -> (continuation of Deferred@1230342123 after retry RPC after error@1021046007) -> (continuation of Deferred@1518483425 after retry RPC after error@176084367) -> (continuation of Deferred@1878090228 after retry RPC after error@212767913) -> (continuation of Deferred@1205376994 after retry RPC after error@1006035003) -> (continuation of Deferred@1600964720 after retry RPC after error@656344296) -> (continuation of Deferred@620490862 after retry RPC after error@671103986) -> (continuation of Deferred@295066058 after retry RPC after error@1324431188) -> (continuation of Deferred@896718436 after retry RPC after error@478454931) -> (continuation of Deferred@1073739456 after retry RPC after error@2029202940) -> (continuation of Deferred@1536234864 after retry RPC after error@1644729005) -> (continuation of Deferred@578892250 after retry RPC after error@1140614331) -> (continuation of Deferred@278254369 after retry RPC after error@917415524) -> (continuation of Deferred@495603338 after retry RPC after error@1030957116) -> (continuation of Deferred@54655080 after retry RPC after error@1084220386) -> (continuation of Deferred@254675813 after retry RPC after error@733540468) -> (continuation of Deferred@657907667 after retry RPC after error@403290148), errback=(continuation of Deferred@1482233635 after retry RPC after error@104195613) -> (continuation of Deferred@699596731 after retry RPC after error@970573983) -> (continuation of Deferred@698949768 after retry RPC after error@8732334) -> (continuation of Deferred@1056196130 after retry RPC after error@1235156051) -> (continuation of Deferred@701708424 after retry RPC after error@660306) -> (continuation of Deferred@483622951 after retry RPC after error@571579274) -> (continuation of Deferred@305586232 after retry RPC after error@1123475887) -> (continuation of Deferred@1118081902 after retry RPC after error@1816632699) -> (continuation of Deferred@1230342123 after retry RPC after error@1021046007) -> (continuation of Deferred@1518483425 after retry RPC after error@176084367) -> (continuation of Deferred@1878090228 after retry RPC after error@212767913) -> (continuation of Deferred@1205376994 after retry RPC after error@1006035003) -> (continuation of Deferred@1600964720 after retry RPC after error@656344296) -> (continuation of Deferred@620490862 after retry RPC after error@671103986) -> (continuation of Deferred@295066058 after retry RPC after error@1324431188) -> (continuation of Deferred@896718436 after retry RPC after error@478454931) -> (continuation of Deferred@1073739456 after retry RPC after error@2029202940) -> (continuation of Deferred@1536234864 after retry RPC after error@1644729005) -> (continuation of Deferred@578892250 after retry RPC after error@1140614331) -> (continuation of Deferred@278254369 after retry RPC after error@917415524) -> (continuation of Deferred@495603338 after retry RPC after error@1030957116) -> (continuation of Deferred@54655080 after retry RPC after error@1084220386) -> (continuation of Deferred@254675813 after retry RPC after error@733540468) -> (continuation of Deferred@657907667 after retry RPC after error@403290148)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:42.144 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
18:32:42.146 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:42.152 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 9de81db54be40687a2a82164db1dc50b (4928 bytes, checkpointDuration=31 ms, finalizationTime=0 ms).
18:32:42.155 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
18:32:42.156 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
18:32:42.160 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5fa379231aa347d299f56467d01e8555, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.161 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5fa379231aa347d299f56467d01e8555 for partition [0x00000000, 0x0000000080000032) with scanner id null
18:32:42.161 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28251), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [70ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [72ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [72ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [86ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [87ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [88ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [88ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [171ms] refreshing cache from master, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [172ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [172ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [175ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [175ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [175ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [204ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [204ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [204ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [223ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [223ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [223ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [331ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [331ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [384ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [384ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [600ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [603ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1601ms] refreshing cache from master, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1602ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1760ms] refreshing cache from master, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1762ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2840ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2842ms] too many traces: truncated at 100 traces, deferred=Deferred@1022722507(state=PENDING, result=null, callback=(continuation of Deferred@1482233635 after retry RPC after error@104195613) -> (continuation of Deferred@699596731 after retry RPC after error@970573983) -> (continuation of Deferred@698949768 after retry RPC after error@8732334) -> (continuation of Deferred@1056196130 after retry RPC after error@1235156051) -> (continuation of Deferred@701708424 after retry RPC after error@660306) -> (continuation of Deferred@483622951 after retry RPC after error@571579274) -> (continuation of Deferred@305586232 after retry RPC after error@1123475887) -> (continuation of Deferred@1118081902 after retry RPC after error@1816632699) -> (continuation of Deferred@1230342123 after retry RPC after error@1021046007) -> (continuation of Deferred@1518483425 after retry RPC after error@176084367) -> (continuation of Deferred@1878090228 after retry RPC after error@212767913) -> (continuation of Deferred@1205376994 after retry RPC after error@1006035003) -> (continuation of Deferred@1600964720 after retry RPC after error@656344296) -> (continuation of Deferred@620490862 after retry RPC after error@671103986) -> (continuation of Deferred@295066058 after retry RPC after error@1324431188) -> (continuation of Deferred@896718436 after retry RPC after error@478454931) -> (continuation of Deferred@1073739456 after retry RPC after error@2029202940) -> (continuation of Deferred@1536234864 after retry RPC after error@1644729005) -> (continuation of Deferred@578892250 after retry RPC after error@1140614331) -> (continuation of Deferred@278254369 after retry RPC after error@917415524) -> (continuation of Deferred@495603338 after retry RPC after error@1030957116) -> (continuation of Deferred@54655080 after retry RPC after error@1084220386) -> (continuation of Deferred@254675813 after retry RPC after error@733540468) -> (continuation of Deferred@657907667 after retry RPC after error@403290148), errback=(continuation of Deferred@1482233635 after retry RPC after error@104195613) -> (continuation of Deferred@699596731 after retry RPC after error@970573983) -> (continuation of Deferred@698949768 after retry RPC after error@8732334) -> (continuation of Deferred@1056196130 after retry RPC after error@1235156051) -> (continuation of Deferred@701708424 after retry RPC after error@660306) -> (continuation of Deferred@483622951 after retry RPC after error@571579274) -> (continuation of Deferred@305586232 after retry RPC after error@1123475887) -> (continuation of Deferred@1118081902 after retry RPC after error@1816632699) -> (continuation of Deferred@1230342123 after retry RPC after error@1021046007) -> (continuation of Deferred@1518483425 after retry RPC after error@176084367) -> (continuation of Deferred@1878090228 after retry RPC after error@212767913) -> (continuation of Deferred@1205376994 after retry RPC after error@1006035003) -> (continuation of Deferred@1600964720 after retry RPC after error@656344296) -> (continuation of Deferred@620490862 after retry RPC after error@671103986) -> (continuation of Deferred@295066058 after retry RPC after error@1324431188) -> (continuation of Deferred@896718436 after retry RPC after error@478454931) -> (continuation of Deferred@1073739456 after retry RPC after error@2029202940) -> (continuation of Deferred@1536234864 after retry RPC after error@1644729005) -> (continuation of Deferred@578892250 after retry RPC after error@1140614331) -> (continuation of Deferred@278254369 after retry RPC after error@917415524) -> (continuation of Deferred@495603338 after retry RPC after error@1030957116) -> (continuation of Deferred@54655080 after retry RPC after error@1084220386) -> (continuation of Deferred@254675813 after retry RPC after error@733540468) -> (continuation of Deferred@657907667 after retry RPC after error@403290148)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:42.162 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8f6466bf, L:/127.0.0.1:41862 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:42.163 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:318) Clearing resource requirements of job f6e63683f34d031c5da392b08baea20c
18:32:42.166 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
18:32:42.167 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
18:32:42.176 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c2d16b8dc05e430ba368fdce09cf6cfa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.176 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet c2d16b8dc05e430ba368fdce09cf6cfa for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
18:32:42.176 [DEBUG - main] (Connection.java:748) [peer bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)] connecting to peer
18:32:42.183 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361659342848001) for scanner KuduScanner(table=replication_test_table, tablet=3d886241527f4f569f6d9abed2c4c8aa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.184 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [3585c2ff1d573bed63eec179d8ecbd547cd4eb43832c5e85ad0bca42fca550cf]
18:32:42.184 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [3585c2ff1d573bed63eec179d8ecbd547cd4eb43832c5e85ad0bca42fca550cf]
18:32:42.185 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:32:42.185 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:32:42.186 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 3585c2ff1d573bed63eec179d8ecbd547cd4eb43832c5e85ad0bca42fca550cf finished by subtask 0; deferring removal (restored in pending)
18:32:42.187 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:42.188 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='01d0798d0d4dd4dcfdac2d913538022cf53a4df3ce2e16e42155b20eb7a39273'}]
18:32:42.188 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false, responseScanTimestamp = 7305361659342848001) for scanner KuduScanner(table=replication_test_table, tablet=4eb9e4eed973435997d975ece849ca7a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.190 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:42.191 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [14fa745fc46b3e20e4cc628dfddd8ee10c638d7e387ff916910e9e8224920a0c]
18:32:42.191 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
18:32:42.195 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:42.197 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361659342848001) for scanner KuduScanner(table=replication_test_table, tablet=007ce0b42486462cb7e00e1363a68404, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.198 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [f4816f1f90b6950bdf3c614f4f466651035f0056e146a67ad8b81a433331a7bc]
18:32:42.198 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [f4816f1f90b6950bdf3c614f4f466651035f0056e146a67ad8b81a433331a7bc]
18:32:42.198 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:32:42.198 [DEBUG - kudu-nio-4] (Connection.java:757) [peer bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)] Successfully connected to peer
18:32:42.198 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:32:42.201 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:42.201 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split f4816f1f90b6950bdf3c614f4f466651035f0056e146a67ad8b81a433331a7bc finished by subtask 2; deferring removal (restored in pending)
18:32:42.202 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:42.202 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='fb756aa48c7ecc6411075901e2a7af4857b1d0f66e53eb95edeecf792d91e0d5'}]
18:32:42.204 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:42.218 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:42.220 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 0cba6ba156884b4c8f2a86f07bdde1fd for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:42.221 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:42.221 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3c9d24669dd74422a060ddb81c161ceb for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:42.221 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=0cba6ba156884b4c8f2a86f07bdde1fd@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=3cd1aa7ed7df4357ab66fc58805f62e3@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=3c9d24669dd74422a060ddb81c161ceb@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:42.221 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 0cba6ba156884b4c8f2a86f07bdde1fd for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:42.222 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:42.222 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3c9d24669dd74422a060ddb81c161ceb for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:42.222 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=0cba6ba156884b4c8f2a86f07bdde1fd@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=3cd1aa7ed7df4357ab66fc58805f62e3@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=3c9d24669dd74422a060ddb81c161ceb@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:42.222 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 0cba6ba156884b4c8f2a86f07bdde1fd for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:42.222 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:42.223 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3c9d24669dd74422a060ddb81c161ceb for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:42.223 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=0cba6ba156884b4c8f2a86f07bdde1fd@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=3cd1aa7ed7df4357ab66fc58805f62e3@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=3c9d24669dd74422a060ddb81c161ceb@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:42.226 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 0cba6ba156884b4c8f2a86f07bdde1fd for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:42.226 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:42.226 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:42.226 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3c9d24669dd74422a060ddb81c161ceb for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:42.226 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=0cba6ba156884b4c8f2a86f07bdde1fd@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=3cd1aa7ed7df4357ab66fc58805f62e3@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=3c9d24669dd74422a060ddb81c161ceb@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:42.227 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 0cba6ba156884b4c8f2a86f07bdde1fd for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:42.228 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:42.228 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3c9d24669dd74422a060ddb81c161ceb for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:42.228 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=0cba6ba156884b4c8f2a86f07bdde1fd@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=3cd1aa7ed7df4357ab66fc58805f62e3@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=3c9d24669dd74422a060ddb81c161ceb@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:42.231 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [14fa745fc46b3e20e4cc628dfddd8ee10c638d7e387ff916910e9e8224920a0c]
18:32:42.232 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:32:42.232 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:32:42.232 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:42.232 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:42.233 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 14fa745fc46b3e20e4cc628dfddd8ee10c638d7e387ff916910e9e8224920a0c finished by subtask 3; deferring removal (restored in pending)
18:32:42.233 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x08494876, L:/127.0.0.1:40912 - R:/127.3.43.130:38355] using TOKEN/null
18:32:42.235 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 0cba6ba156884b4c8f2a86f07bdde1fd for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:42.235 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:42.235 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3c9d24669dd74422a060ddb81c161ceb for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:42.235 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=0cba6ba156884b4c8f2a86f07bdde1fd@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=3cd1aa7ed7df4357ab66fc58805f62e3@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=3c9d24669dd74422a060ddb81c161ceb@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:42.239 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:32:42.240 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299993, tablet=fa1ae6554a4f44edb298443dd03f3989@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)[L]]}]
18:32:42.247 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false, responseScanTimestamp = 7305361659342848001) for scanner KuduScanner(table=replication_test_table, tablet=bf82abb9dff341cf9fe05a19552b4e99, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.248 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [4b8438da0ba00093f26a11e53ad3234dd8bde29fcbc895bb5f956fe4f679e7ca]
18:32:42.249 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
18:32:42.252 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [4b8438da0ba00093f26a11e53ad3234dd8bde29fcbc895bb5f956fe4f679e7ca]
18:32:42.252 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:32:42.252 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:32:42.253 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:42.253 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 4b8438da0ba00093f26a11e53ad3234dd8bde29fcbc895bb5f956fe4f679e7ca finished by subtask 1; deferring removal (restored in pending)
18:32:42.253 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:42.257 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:42.258 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:42.258 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:42.258 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:42.258 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:42.258 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:42.258 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:42.258 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:42.259 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:42.259 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:42.259 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:42.259 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:42.259 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:42.266 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 5fa379231aa347d299f56467d01e8555 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
18:32:42.266 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c2d16b8dc05e430ba368fdce09cf6cfa for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
18:32:42.266 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 49907dc63f1c46a383141035a9353a56 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
18:32:42.266 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 0cba6ba156884b4c8f2a86f07bdde1fd for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:42.266 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:42.266 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3c9d24669dd74422a060ddb81c161ceb for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:42.266 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=5fa379231aa347d299f56467d01e8555@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=c2d16b8dc05e430ba368fdce09cf6cfa@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=49907dc63f1c46a383141035a9353a56@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=0cba6ba156884b4c8f2a86f07bdde1fd@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=3cd1aa7ed7df4357ab66fc58805f62e3@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=3c9d24669dd74422a060ddb81c161ceb@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:42.267 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 5fa379231aa347d299f56467d01e8555 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
18:32:42.267 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c2d16b8dc05e430ba368fdce09cf6cfa for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
18:32:42.267 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 49907dc63f1c46a383141035a9353a56 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
18:32:42.267 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 0cba6ba156884b4c8f2a86f07bdde1fd for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:42.267 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:42.268 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3c9d24669dd74422a060ddb81c161ceb for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:42.268 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=5fa379231aa347d299f56467d01e8555@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=c2d16b8dc05e430ba368fdce09cf6cfa@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=49907dc63f1c46a383141035a9353a56@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=0cba6ba156884b4c8f2a86f07bdde1fd@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=3cd1aa7ed7df4357ab66fc58805f62e3@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=3c9d24669dd74422a060ddb81c161ceb@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:42.268 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 5fa379231aa347d299f56467d01e8555 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
18:32:42.268 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c2d16b8dc05e430ba368fdce09cf6cfa for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
18:32:42.269 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 49907dc63f1c46a383141035a9353a56 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
18:32:42.269 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 0cba6ba156884b4c8f2a86f07bdde1fd for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:42.269 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:42.269 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3c9d24669dd74422a060ddb81c161ceb for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:42.269 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=5fa379231aa347d299f56467d01e8555@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=c2d16b8dc05e430ba368fdce09cf6cfa@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=49907dc63f1c46a383141035a9353a56@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=0cba6ba156884b4c8f2a86f07bdde1fd@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=3cd1aa7ed7df4357ab66fc58805f62e3@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=3c9d24669dd74422a060ddb81c161ceb@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:42.270 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 5fa379231aa347d299f56467d01e8555 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
18:32:42.270 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c2d16b8dc05e430ba368fdce09cf6cfa for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
18:32:42.270 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 49907dc63f1c46a383141035a9353a56 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
18:32:42.270 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 0cba6ba156884b4c8f2a86f07bdde1fd for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:42.270 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:42.270 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3c9d24669dd74422a060ddb81c161ceb for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:42.277 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=5fa379231aa347d299f56467d01e8555@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=c2d16b8dc05e430ba368fdce09cf6cfa@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=49907dc63f1c46a383141035a9353a56@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=0cba6ba156884b4c8f2a86f07bdde1fd@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=3cd1aa7ed7df4357ab66fc58805f62e3@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=3c9d24669dd74422a060ddb81c161ceb@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299993}]
18:32:42.279 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:32:42.280 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299993, tablet=0c25f7b288564110a208c9c3d924a97b@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)[L]]}]
18:32:42.283 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=49907dc63f1c46a383141035a9353a56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.283 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 49907dc63f1c46a383141035a9353a56 for partition [0x0000000080000096, 0x00000001) with scanner id null
18:32:42.289 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0cba6ba156884b4c8f2a86f07bdde1fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.290 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0cba6ba156884b4c8f2a86f07bdde1fd for partition [0x00000001, 0x0000000180000032) with scanner id null
18:32:42.296 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:32:42.296 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:42.296 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:42.296 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:32:42.299 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3cd1aa7ed7df4357ab66fc58805f62e3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.299 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
18:32:42.299 [DEBUG - main] (Connection.java:748) [peer bed90167029a48089d044ae7429783f7(127.3.43.129:43071)] connecting to peer
18:32:42.312 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:42.322 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:32:42.322 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:42.322 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:42.322 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
18:32:42.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:42.343 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:42.344 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:42.344 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:42.344 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:32:42.367 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:42.367 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:42.367 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:32:42.367 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:32:42.375 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:42.398 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:42.399 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:42.399 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:42.399 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:42.399 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:42.399 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:42.399 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:42.400 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:42.400 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:42.400 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:42.400 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:42.400 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:42.400 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:42.401 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:42.403 [DEBUG - kudu-nio-5] (Connection.java:757) [peer bed90167029a48089d044ae7429783f7(127.3.43.129:43071)] Successfully connected to peer
18:32:42.410 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:42.415 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:42.423 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:42.431 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:42.449 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:42.452 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x68810987, L:/127.0.0.1:41864 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:42.462 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0xaf5fb9ff, L:/127.0.0.1:34984 - R:/127.3.43.129:43071] using TOKEN/null
18:32:42.478 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361659342848001) for scanner KuduScanner(table=replication_test_table, tablet=fa1ae6554a4f44edb298443dd03f3989, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.480 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [01d0798d0d4dd4dcfdac2d913538022cf53a4df3ce2e16e42155b20eb7a39273]
18:32:42.481 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c9d24669dd74422a060ddb81c161ceb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.481 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c9d24669dd74422a060ddb81c161ceb for partition [0x0000000180000096, 0x00000002) with scanner id null
18:32:42.481 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 01d0798d0d4dd4dcfdac2d913538022cf53a4df3ce2e16e42155b20eb7a39273 finished by subtask 0; deferring removal (restored in pending)
18:32:42.482 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [01d0798d0d4dd4dcfdac2d913538022cf53a4df3ce2e16e42155b20eb7a39273]
18:32:42.485 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:42.490 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3cbab104, L:/127.0.0.1:41880 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:42.491 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:32:42.491 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:32:42.491 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:42.492 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:42.494 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:42.494 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:42.494 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:42.494 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:32:42.511 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361659342848001) for scanner KuduScanner(table=replication_test_table, tablet=0c25f7b288564110a208c9c3d924a97b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.512 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [fb756aa48c7ecc6411075901e2a7af4857b1d0f66e53eb95edeecf792d91e0d5]
18:32:42.512 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [fb756aa48c7ecc6411075901e2a7af4857b1d0f66e53eb95edeecf792d91e0d5]
18:32:42.513 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:32:42.513 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:32:42.513 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:42.514 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split fb756aa48c7ecc6411075901e2a7af4857b1d0f66e53eb95edeecf792d91e0d5 finished by subtask 2; deferring removal (restored in pending)
18:32:42.514 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:42.523 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:42.524 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:42.524 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:42.524 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:32:42.539 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5fa379231aa347d299f56467d01e8555, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.539 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5fa379231aa347d299f56467d01e8555 for partition [0x00000000, 0x0000000080000032) with scanner id null
18:32:42.566 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c2d16b8dc05e430ba368fdce09cf6cfa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.567 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet c2d16b8dc05e430ba368fdce09cf6cfa for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
18:32:42.574 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=49907dc63f1c46a383141035a9353a56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.574 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 49907dc63f1c46a383141035a9353a56 for partition [0x0000000080000096, 0x00000001) with scanner id null
18:32:42.581 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0cba6ba156884b4c8f2a86f07bdde1fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.581 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0cba6ba156884b4c8f2a86f07bdde1fd for partition [0x00000001, 0x0000000180000032) with scanner id null
18:32:42.588 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3cd1aa7ed7df4357ab66fc58805f62e3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.588 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
18:32:42.599 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c9d24669dd74422a060ddb81c161ceb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.599 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c9d24669dd74422a060ddb81c161ceb for partition [0x0000000180000096, 0x00000002) with scanner id null
18:32:42.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535562621 for job 9de81db54be40687a2a82164db1dc50b.
18:32:42.628 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=4, operationSize=253, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5bd297a6, flushNotification=Deferred@1405264104(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:32:42.629 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)] connecting to peer
18:32:42.629 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=8, operationSize=505, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@f093c6, flushNotification=Deferred@1209880736(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:32:42.630 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)] connecting to peer
18:32:42.648 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)] Successfully connected to peer
18:32:42.654 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)] Successfully connected to peer
18:32:42.674 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5fa379231aa347d299f56467d01e8555, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.675 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5fa379231aa347d299f56467d01e8555 for partition [0x00000000, 0x0000000080000032) with scanner id null
18:32:42.682 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c2d16b8dc05e430ba368fdce09cf6cfa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.682 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet c2d16b8dc05e430ba368fdce09cf6cfa for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
18:32:42.689 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=49907dc63f1c46a383141035a9353a56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.689 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 49907dc63f1c46a383141035a9353a56 for partition [0x0000000080000096, 0x00000001) with scanner id null
18:32:42.694 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:42.694 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:42.695 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:42.695 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:42.695 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:42.695 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:42.695 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:42.695 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:42.695 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:42.696 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:42.696 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:42.696 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:42.696 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:42.718 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:42.743 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0cba6ba156884b4c8f2a86f07bdde1fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.743 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0cba6ba156884b4c8f2a86f07bdde1fd for partition [0x00000001, 0x0000000180000032) with scanner id null
18:32:42.751 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3cd1aa7ed7df4357ab66fc58805f62e3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.751 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
18:32:42.760 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c9d24669dd74422a060ddb81c161ceb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.761 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c9d24669dd74422a060ddb81c161ceb for partition [0x0000000180000096, 0x00000002) with scanner id null
18:32:42.764 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:42.771 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x9b08c467, L:/127.0.0.1:42376 - R:/127.3.43.131:38327] using TOKEN/null
18:32:42.781 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:42.791 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x34ca2a49, L:/127.0.0.1:42392 - R:/127.3.43.131:38327] using TOKEN/null
18:32:42.819 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5fa379231aa347d299f56467d01e8555, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.819 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5fa379231aa347d299f56467d01e8555 for partition [0x00000000, 0x0000000080000032) with scanner id null
18:32:42.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:42.851 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c2d16b8dc05e430ba368fdce09cf6cfa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.851 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet c2d16b8dc05e430ba368fdce09cf6cfa for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
18:32:42.857 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=49907dc63f1c46a383141035a9353a56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.857 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 49907dc63f1c46a383141035a9353a56 for partition [0x0000000080000096, 0x00000001) with scanner id null
18:32:42.878 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0cba6ba156884b4c8f2a86f07bdde1fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.879 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0cba6ba156884b4c8f2a86f07bdde1fd for partition [0x00000001, 0x0000000180000032) with scanner id null
18:32:42.889 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3cd1aa7ed7df4357ab66fc58805f62e3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.890 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
18:32:42.904 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c9d24669dd74422a060ddb81c161ceb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.904 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c9d24669dd74422a060ddb81c161ceb for partition [0x0000000180000096, 0x00000002) with scanner id null
18:32:42.963 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5fa379231aa347d299f56467d01e8555, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.963 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5fa379231aa347d299f56467d01e8555 for partition [0x00000000, 0x0000000080000032) with scanner id null
18:32:42.971 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c2d16b8dc05e430ba368fdce09cf6cfa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:42.971 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet c2d16b8dc05e430ba368fdce09cf6cfa for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
18:32:43.007 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=49907dc63f1c46a383141035a9353a56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.008 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 49907dc63f1c46a383141035a9353a56 for partition [0x0000000080000096, 0x00000001) with scanner id null
18:32:43.014 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0cba6ba156884b4c8f2a86f07bdde1fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.015 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0cba6ba156884b4c8f2a86f07bdde1fd for partition [0x00000001, 0x0000000180000032) with scanner id null
18:32:43.070 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3cd1aa7ed7df4357ab66fc58805f62e3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.070 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
18:32:43.081 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c9d24669dd74422a060ddb81c161ceb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.081 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c9d24669dd74422a060ddb81c161ceb for partition [0x0000000180000096, 0x00000002) with scanner id null
18:32:43.088 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:43.088 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:43.089 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:43.089 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:43.089 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:43.089 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:43.089 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:43.089 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:43.089 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:43.090 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:43.090 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:43.090 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:43.090 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:43.121 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 9de81db54be40687a2a82164db1dc50b (4928 bytes, checkpointDuration=499 ms, finalizationTime=1 ms).
18:32:43.123 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
18:32:43.123 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 4b8438da0ba00093f26a11e53ad3234dd8bde29fcbc895bb5f956fe4f679e7ca from pending
18:32:43.123 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 14fa745fc46b3e20e4cc628dfddd8ee10c638d7e387ff916910e9e8224920a0c from pending
18:32:43.123 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 01d0798d0d4dd4dcfdac2d913538022cf53a4df3ce2e16e42155b20eb7a39273 from pending
18:32:43.123 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split f4816f1f90b6950bdf3c614f4f466651035f0056e146a67ad8b81a433331a7bc from pending
18:32:43.123 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split fb756aa48c7ecc6411075901e2a7af4857b1d0f66e53eb95edeecf792d91e0d5 from pending
18:32:43.123 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 3585c2ff1d573bed63eec179d8ecbd547cd4eb43832c5e85ad0bca42fca550cf from pending
18:32:43.123 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 2 complete: removed 6 finished splits from enumerator state
18:32:43.125 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535563122 for job 9de81db54be40687a2a82164db1dc50b.
18:32:43.144 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=21 ms, finalizationTime=0 ms).
18:32:43.145 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
18:32:43.151 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5fa379231aa347d299f56467d01e8555, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.151 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5fa379231aa347d299f56467d01e8555 for partition [0x00000000, 0x0000000080000032) with scanner id null
18:32:43.157 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c2d16b8dc05e430ba368fdce09cf6cfa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.157 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet c2d16b8dc05e430ba368fdce09cf6cfa for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
18:32:43.163 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=49907dc63f1c46a383141035a9353a56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.163 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 49907dc63f1c46a383141035a9353a56 for partition [0x0000000080000096, 0x00000001) with scanner id null
18:32:43.179 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0cba6ba156884b4c8f2a86f07bdde1fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.179 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0cba6ba156884b4c8f2a86f07bdde1fd for partition [0x00000001, 0x0000000180000032) with scanner id null
18:32:43.181 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:43.181 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:43.181 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:43.182 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.182 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.182 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.183 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.183 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.183 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.183 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.183 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.183 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.183 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:43.184 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29241), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [11ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [15ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [33ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [33ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [52ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [56ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [57ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [57ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [88ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [90ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [91ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [91ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [143ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [162ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [303ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [483ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [483ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [965ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [965ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [965ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1403ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2880ms] refreshing cache from master, [2880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2883ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2883ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2883ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3281ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3283ms] too many traces: truncated at 100 traces, deferred=Deferred@89266882(state=PENDING, result=null, callback=(continuation of Deferred@1085201021 after retry RPC after error@18318698) -> (continuation of Deferred@123150242 after retry RPC after error@315003264) -> (continuation of Deferred@613276823 after retry RPC after error@428618169) -> (continuation of Deferred@647599909 after retry RPC after error@16079079) -> (continuation of Deferred@1255556362 after retry RPC after error@850371600) -> (continuation of Deferred@1491414495 after retry RPC after error@1929208900) -> (continuation of Deferred@175870212 after retry RPC after error@1161505663) -> (continuation of Deferred@876707282 after retry RPC after error@763883610) -> (continuation of Deferred@2065868639 after retry RPC after error@1742605207) -> (continuation of Deferred@1489913171 after retry RPC after error@1247378224) -> (continuation of Deferred@615462267 after retry RPC after error@867832010) -> (continuation of Deferred@435433267 after retry RPC after error@418727878) -> (continuation of Deferred@1160555854 after retry RPC after error@653511009) -> (continuation of Deferred@507967291 after retry RPC after error@742344770) -> (continuation of Deferred@215598678 after retry RPC after error@886685293) -> (continuation of Deferred@487553250 after retry RPC after error@1260670553) -> (continuation of Deferred@151898653 after retry RPC after error@1885222791) -> (continuation of Deferred@376477958 after retry RPC after error@2144295703) -> (continuation of Deferred@418720721 after retry RPC after error@429311303) -> (continuation of Deferred@188532698 after retry RPC after error@237904457) -> (continuation of Deferred@1060387838 after retry RPC after error@279412130) -> (continuation of Deferred@2110286459 after retry RPC after error@34288609) -> (continuation of Deferred@478020501 after retry RPC after error@924788693) -> (continuation of Deferred@163186943 after retry RPC after error@1391830546) -> (continuation of Deferred@1048278386 after retry RPC after error@1888804071), errback=(continuation of Deferred@1085201021 after retry RPC after error@18318698) -> (continuation of Deferred@123150242 after retry RPC after error@315003264) -> (continuation of Deferred@613276823 after retry RPC after error@428618169) -> (continuation of Deferred@647599909 after retry RPC after error@16079079) -> (continuation of Deferred@1255556362 after retry RPC after error@850371600) -> (continuation of Deferred@1491414495 after retry RPC after error@1929208900) -> (continuation of Deferred@175870212 after retry RPC after error@1161505663) -> (continuation of Deferred@876707282 after retry RPC after error@763883610) -> (continuation of Deferred@2065868639 after retry RPC after error@1742605207) -> (continuation of Deferred@1489913171 after retry RPC after error@1247378224) -> (continuation of Deferred@615462267 after retry RPC after error@867832010) -> (continuation of Deferred@435433267 after retry RPC after error@418727878) -> (continuation of Deferred@1160555854 after retry RPC after error@653511009) -> (continuation of Deferred@507967291 after retry RPC after error@742344770) -> (continuation of Deferred@215598678 after retry RPC after error@886685293) -> (continuation of Deferred@487553250 after retry RPC after error@1260670553) -> (continuation of Deferred@151898653 after retry RPC after error@1885222791) -> (continuation of Deferred@376477958 after retry RPC after error@2144295703) -> (continuation of Deferred@418720721 after retry RPC after error@429311303) -> (continuation of Deferred@188532698 after retry RPC after error@237904457) -> (continuation of Deferred@1060387838 after retry RPC after error@279412130) -> (continuation of Deferred@2110286459 after retry RPC after error@34288609) -> (continuation of Deferred@478020501 after retry RPC after error@924788693) -> (continuation of Deferred@163186943 after retry RPC after error@1391830546) -> (continuation of Deferred@1048278386 after retry RPC after error@1888804071)))
18:32:43.187 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:43.187 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:43.187 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:43.187 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.187 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.187 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.187 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29241), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [11ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [15ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [33ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [33ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [52ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [56ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [57ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [57ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [88ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [90ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [91ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [91ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [143ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [162ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [303ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [483ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [483ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [965ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [965ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [965ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1403ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2880ms] refreshing cache from master, [2880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2883ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2883ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2883ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3281ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3283ms] too many traces: truncated at 100 traces, deferred=Deferred@89266882(state=PENDING, result=null, callback=(continuation of Deferred@1085201021 after retry RPC after error@18318698) -> (continuation of Deferred@123150242 after retry RPC after error@315003264) -> (continuation of Deferred@613276823 after retry RPC after error@428618169) -> (continuation of Deferred@647599909 after retry RPC after error@16079079) -> (continuation of Deferred@1255556362 after retry RPC after error@850371600) -> (continuation of Deferred@1491414495 after retry RPC after error@1929208900) -> (continuation of Deferred@175870212 after retry RPC after error@1161505663) -> (continuation of Deferred@876707282 after retry RPC after error@763883610) -> (continuation of Deferred@2065868639 after retry RPC after error@1742605207) -> (continuation of Deferred@1489913171 after retry RPC after error@1247378224) -> (continuation of Deferred@615462267 after retry RPC after error@867832010) -> (continuation of Deferred@435433267 after retry RPC after error@418727878) -> (continuation of Deferred@1160555854 after retry RPC after error@653511009) -> (continuation of Deferred@507967291 after retry RPC after error@742344770) -> (continuation of Deferred@215598678 after retry RPC after error@886685293) -> (continuation of Deferred@487553250 after retry RPC after error@1260670553) -> (continuation of Deferred@151898653 after retry RPC after error@1885222791) -> (continuation of Deferred@376477958 after retry RPC after error@2144295703) -> (continuation of Deferred@418720721 after retry RPC after error@429311303) -> (continuation of Deferred@188532698 after retry RPC after error@237904457) -> (continuation of Deferred@1060387838 after retry RPC after error@279412130) -> (continuation of Deferred@2110286459 after retry RPC after error@34288609) -> (continuation of Deferred@478020501 after retry RPC after error@924788693) -> (continuation of Deferred@163186943 after retry RPC after error@1391830546) -> (continuation of Deferred@1048278386 after retry RPC after error@1888804071), errback=(continuation of Deferred@1085201021 after retry RPC after error@18318698) -> (continuation of Deferred@123150242 after retry RPC after error@315003264) -> (continuation of Deferred@613276823 after retry RPC after error@428618169) -> (continuation of Deferred@647599909 after retry RPC after error@16079079) -> (continuation of Deferred@1255556362 after retry RPC after error@850371600) -> (continuation of Deferred@1491414495 after retry RPC after error@1929208900) -> (continuation of Deferred@175870212 after retry RPC after error@1161505663) -> (continuation of Deferred@876707282 after retry RPC after error@763883610) -> (continuation of Deferred@2065868639 after retry RPC after error@1742605207) -> (continuation of Deferred@1489913171 after retry RPC after error@1247378224) -> (continuation of Deferred@615462267 after retry RPC after error@867832010) -> (continuation of Deferred@435433267 after retry RPC after error@418727878) -> (continuation of Deferred@1160555854 after retry RPC after error@653511009) -> (continuation of Deferred@507967291 after retry RPC after error@742344770) -> (continuation of Deferred@215598678 after retry RPC after error@886685293) -> (continuation of Deferred@487553250 after retry RPC after error@1260670553) -> (continuation of Deferred@151898653 after retry RPC after error@1885222791) -> (continuation of Deferred@376477958 after retry RPC after error@2144295703) -> (continuation of Deferred@418720721 after retry RPC after error@429311303) -> (continuation of Deferred@188532698 after retry RPC after error@237904457) -> (continuation of Deferred@1060387838 after retry RPC after error@279412130) -> (continuation of Deferred@2110286459 after retry RPC after error@34288609) -> (continuation of Deferred@478020501 after retry RPC after error@924788693) -> (continuation of Deferred@163186943 after retry RPC after error@1391830546) -> (continuation of Deferred@1048278386 after retry RPC after error@1888804071)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29241), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [11ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [15ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [33ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [33ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [52ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [56ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [57ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [57ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [88ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [90ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [91ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [91ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [143ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [162ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [303ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [483ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [483ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [965ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [965ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [965ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1403ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2880ms] refreshing cache from master, [2880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2883ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2883ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2883ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3281ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3283ms] too many traces: truncated at 100 traces, deferred=Deferred@89266882(state=PENDING, result=null, callback=(continuation of Deferred@1085201021 after retry RPC after error@18318698) -> (continuation of Deferred@123150242 after retry RPC after error@315003264) -> (continuation of Deferred@613276823 after retry RPC after error@428618169) -> (continuation of Deferred@647599909 after retry RPC after error@16079079) -> (continuation of Deferred@1255556362 after retry RPC after error@850371600) -> (continuation of Deferred@1491414495 after retry RPC after error@1929208900) -> (continuation of Deferred@175870212 after retry RPC after error@1161505663) -> (continuation of Deferred@876707282 after retry RPC after error@763883610) -> (continuation of Deferred@2065868639 after retry RPC after error@1742605207) -> (continuation of Deferred@1489913171 after retry RPC after error@1247378224) -> (continuation of Deferred@615462267 after retry RPC after error@867832010) -> (continuation of Deferred@435433267 after retry RPC after error@418727878) -> (continuation of Deferred@1160555854 after retry RPC after error@653511009) -> (continuation of Deferred@507967291 after retry RPC after error@742344770) -> (continuation of Deferred@215598678 after retry RPC after error@886685293) -> (continuation of Deferred@487553250 after retry RPC after error@1260670553) -> (continuation of Deferred@151898653 after retry RPC after error@1885222791) -> (continuation of Deferred@376477958 after retry RPC after error@2144295703) -> (continuation of Deferred@418720721 after retry RPC after error@429311303) -> (continuation of Deferred@188532698 after retry RPC after error@237904457) -> (continuation of Deferred@1060387838 after retry RPC after error@279412130) -> (continuation of Deferred@2110286459 after retry RPC after error@34288609) -> (continuation of Deferred@478020501 after retry RPC after error@924788693) -> (continuation of Deferred@163186943 after retry RPC after error@1391830546) -> (continuation of Deferred@1048278386 after retry RPC after error@1888804071), errback=(continuation of Deferred@1085201021 after retry RPC after error@18318698) -> (continuation of Deferred@123150242 after retry RPC after error@315003264) -> (continuation of Deferred@613276823 after retry RPC after error@428618169) -> (continuation of Deferred@647599909 after retry RPC after error@16079079) -> (continuation of Deferred@1255556362 after retry RPC after error@850371600) -> (continuation of Deferred@1491414495 after retry RPC after error@1929208900) -> (continuation of Deferred@175870212 after retry RPC after error@1161505663) -> (continuation of Deferred@876707282 after retry RPC after error@763883610) -> (continuation of Deferred@2065868639 after retry RPC after error@1742605207) -> (continuation of Deferred@1489913171 after retry RPC after error@1247378224) -> (continuation of Deferred@615462267 after retry RPC after error@867832010) -> (continuation of Deferred@435433267 after retry RPC after error@418727878) -> (continuation of Deferred@1160555854 after retry RPC after error@653511009) -> (continuation of Deferred@507967291 after retry RPC after error@742344770) -> (continuation of Deferred@215598678 after retry RPC after error@886685293) -> (continuation of Deferred@487553250 after retry RPC after error@1260670553) -> (continuation of Deferred@151898653 after retry RPC after error@1885222791) -> (continuation of Deferred@376477958 after retry RPC after error@2144295703) -> (continuation of Deferred@418720721 after retry RPC after error@429311303) -> (continuation of Deferred@188532698 after retry RPC after error@237904457) -> (continuation of Deferred@1060387838 after retry RPC after error@279412130) -> (continuation of Deferred@2110286459 after retry RPC after error@34288609) -> (continuation of Deferred@478020501 after retry RPC after error@924788693) -> (continuation of Deferred@163186943 after retry RPC after error@1391830546) -> (continuation of Deferred@1048278386 after retry RPC after error@1888804071)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.11.253:35677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:43.190 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.190 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.190 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.192 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.192 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.192 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.192 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:43.199 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29241), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [11ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [15ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [33ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [33ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [52ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [56ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [57ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [57ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [88ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [90ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [91ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [91ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [143ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [162ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [303ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [483ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [483ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [965ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [965ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [965ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1403ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2880ms] refreshing cache from master, [2880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2883ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2883ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2883ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3281ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3283ms] too many traces: truncated at 100 traces, deferred=Deferred@89266882(state=PENDING, result=null, callback=(continuation of Deferred@1085201021 after retry RPC after error@18318698) -> (continuation of Deferred@123150242 after retry RPC after error@315003264) -> (continuation of Deferred@613276823 after retry RPC after error@428618169) -> (continuation of Deferred@647599909 after retry RPC after error@16079079) -> (continuation of Deferred@1255556362 after retry RPC after error@850371600) -> (continuation of Deferred@1491414495 after retry RPC after error@1929208900) -> (continuation of Deferred@175870212 after retry RPC after error@1161505663) -> (continuation of Deferred@876707282 after retry RPC after error@763883610) -> (continuation of Deferred@2065868639 after retry RPC after error@1742605207) -> (continuation of Deferred@1489913171 after retry RPC after error@1247378224) -> (continuation of Deferred@615462267 after retry RPC after error@867832010) -> (continuation of Deferred@435433267 after retry RPC after error@418727878) -> (continuation of Deferred@1160555854 after retry RPC after error@653511009) -> (continuation of Deferred@507967291 after retry RPC after error@742344770) -> (continuation of Deferred@215598678 after retry RPC after error@886685293) -> (continuation of Deferred@487553250 after retry RPC after error@1260670553) -> (continuation of Deferred@151898653 after retry RPC after error@1885222791) -> (continuation of Deferred@376477958 after retry RPC after error@2144295703) -> (continuation of Deferred@418720721 after retry RPC after error@429311303) -> (continuation of Deferred@188532698 after retry RPC after error@237904457) -> (continuation of Deferred@1060387838 after retry RPC after error@279412130) -> (continuation of Deferred@2110286459 after retry RPC after error@34288609) -> (continuation of Deferred@478020501 after retry RPC after error@924788693) -> (continuation of Deferred@163186943 after retry RPC after error@1391830546) -> (continuation of Deferred@1048278386 after retry RPC after error@1888804071), errback=(continuation of Deferred@1085201021 after retry RPC after error@18318698) -> (continuation of Deferred@123150242 after retry RPC after error@315003264) -> (continuation of Deferred@613276823 after retry RPC after error@428618169) -> (continuation of Deferred@647599909 after retry RPC after error@16079079) -> (continuation of Deferred@1255556362 after retry RPC after error@850371600) -> (continuation of Deferred@1491414495 after retry RPC after error@1929208900) -> (continuation of Deferred@175870212 after retry RPC after error@1161505663) -> (continuation of Deferred@876707282 after retry RPC after error@763883610) -> (continuation of Deferred@2065868639 after retry RPC after error@1742605207) -> (continuation of Deferred@1489913171 after retry RPC after error@1247378224) -> (continuation of Deferred@615462267 after retry RPC after error@867832010) -> (continuation of Deferred@435433267 after retry RPC after error@418727878) -> (continuation of Deferred@1160555854 after retry RPC after error@653511009) -> (continuation of Deferred@507967291 after retry RPC after error@742344770) -> (continuation of Deferred@215598678 after retry RPC after error@886685293) -> (continuation of Deferred@487553250 after retry RPC after error@1260670553) -> (continuation of Deferred@151898653 after retry RPC after error@1885222791) -> (continuation of Deferred@376477958 after retry RPC after error@2144295703) -> (continuation of Deferred@418720721 after retry RPC after error@429311303) -> (continuation of Deferred@188532698 after retry RPC after error@237904457) -> (continuation of Deferred@1060387838 after retry RPC after error@279412130) -> (continuation of Deferred@2110286459 after retry RPC after error@34288609) -> (continuation of Deferred@478020501 after retry RPC after error@924788693) -> (continuation of Deferred@163186943 after retry RPC after error@1391830546) -> (continuation of Deferred@1048278386 after retry RPC after error@1888804071)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29241), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [11ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [15ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [33ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [33ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [52ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [56ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [57ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [57ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [88ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [90ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [91ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [91ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [143ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [162ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [303ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [303ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [483ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [483ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [965ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [965ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [965ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1403ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2880ms] refreshing cache from master, [2880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2883ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2883ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2883ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3281ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3283ms] too many traces: truncated at 100 traces, deferred=Deferred@89266882(state=PENDING, result=null, callback=(continuation of Deferred@1085201021 after retry RPC after error@18318698) -> (continuation of Deferred@123150242 after retry RPC after error@315003264) -> (continuation of Deferred@613276823 after retry RPC after error@428618169) -> (continuation of Deferred@647599909 after retry RPC after error@16079079) -> (continuation of Deferred@1255556362 after retry RPC after error@850371600) -> (continuation of Deferred@1491414495 after retry RPC after error@1929208900) -> (continuation of Deferred@175870212 after retry RPC after error@1161505663) -> (continuation of Deferred@876707282 after retry RPC after error@763883610) -> (continuation of Deferred@2065868639 after retry RPC after error@1742605207) -> (continuation of Deferred@1489913171 after retry RPC after error@1247378224) -> (continuation of Deferred@615462267 after retry RPC after error@867832010) -> (continuation of Deferred@435433267 after retry RPC after error@418727878) -> (continuation of Deferred@1160555854 after retry RPC after error@653511009) -> (continuation of Deferred@507967291 after retry RPC after error@742344770) -> (continuation of Deferred@215598678 after retry RPC after error@886685293) -> (continuation of Deferred@487553250 after retry RPC after error@1260670553) -> (continuation of Deferred@151898653 after retry RPC after error@1885222791) -> (continuation of Deferred@376477958 after retry RPC after error@2144295703) -> (continuation of Deferred@418720721 after retry RPC after error@429311303) -> (continuation of Deferred@188532698 after retry RPC after error@237904457) -> (continuation of Deferred@1060387838 after retry RPC after error@279412130) -> (continuation of Deferred@2110286459 after retry RPC after error@34288609) -> (continuation of Deferred@478020501 after retry RPC after error@924788693) -> (continuation of Deferred@163186943 after retry RPC after error@1391830546) -> (continuation of Deferred@1048278386 after retry RPC after error@1888804071), errback=(continuation of Deferred@1085201021 after retry RPC after error@18318698) -> (continuation of Deferred@123150242 after retry RPC after error@315003264) -> (continuation of Deferred@613276823 after retry RPC after error@428618169) -> (continuation of Deferred@647599909 after retry RPC after error@16079079) -> (continuation of Deferred@1255556362 after retry RPC after error@850371600) -> (continuation of Deferred@1491414495 after retry RPC after error@1929208900) -> (continuation of Deferred@175870212 after retry RPC after error@1161505663) -> (continuation of Deferred@876707282 after retry RPC after error@763883610) -> (continuation of Deferred@2065868639 after retry RPC after error@1742605207) -> (continuation of Deferred@1489913171 after retry RPC after error@1247378224) -> (continuation of Deferred@615462267 after retry RPC after error@867832010) -> (continuation of Deferred@435433267 after retry RPC after error@418727878) -> (continuation of Deferred@1160555854 after retry RPC after error@653511009) -> (continuation of Deferred@507967291 after retry RPC after error@742344770) -> (continuation of Deferred@215598678 after retry RPC after error@886685293) -> (continuation of Deferred@487553250 after retry RPC after error@1260670553) -> (continuation of Deferred@151898653 after retry RPC after error@1885222791) -> (continuation of Deferred@376477958 after retry RPC after error@2144295703) -> (continuation of Deferred@418720721 after retry RPC after error@429311303) -> (continuation of Deferred@188532698 after retry RPC after error@237904457) -> (continuation of Deferred@1060387838 after retry RPC after error@279412130) -> (continuation of Deferred@2110286459 after retry RPC after error@34288609) -> (continuation of Deferred@478020501 after retry RPC after error@924788693) -> (continuation of Deferred@163186943 after retry RPC after error@1391830546) -> (continuation of Deferred@1048278386 after retry RPC after error@1888804071)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.11.253:35677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:43.201 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:32:43.201 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:43.201 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3cd1aa7ed7df4357ab66fc58805f62e3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.201 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:43.201 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
18:32:43.201 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:43.202 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.202 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.202 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.205 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.205 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.205 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.205 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.205 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.205 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.206 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:43.208 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c9d24669dd74422a060ddb81c161ceb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.208 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c9d24669dd74422a060ddb81c161ceb for partition [0x0000000180000096, 0x00000002) with scanner id null
18:32:43.211 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6b086cbb915d4f34838e5ef58717ef47
18:32:43.212 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:43.215 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 430ff55bf33c43dbbd3443b21bc87300
18:32:43.220 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6b086cbb915d4f34838e5ef58717ef47
18:32:43.221 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:43.221 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:43.221 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:43.222 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.222 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.222 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.223 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.223 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.223 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.223 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.223 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.223 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.223 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:43.224 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 430ff55bf33c43dbbd3443b21bc87300
18:32:43.229 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bf82abb9dff341cf9fe05a19552b4e99 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
18:32:43.230 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 007ce0b42486462cb7e00e1363a68404 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
18:32:43.230 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d886241527f4f569f6d9abed2c4c8aa for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
18:32:43.230 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 4eb9e4eed973435997d975ece849ca7a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:43.230 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet fa1ae6554a4f44edb298443dd03f3989 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:43.230 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 0c25f7b288564110a208c9c3d924a97b for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:43.230 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=bf82abb9dff341cf9fe05a19552b4e99@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=007ce0b42486462cb7e00e1363a68404@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=3d886241527f4f569f6d9abed2c4c8aa@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=4eb9e4eed973435997d975ece849ca7a@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fa1ae6554a4f44edb298443dd03f3989@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=0c25f7b288564110a208c9c3d924a97b@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:43.236 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 5fa379231aa347d299f56467d01e8555 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
18:32:43.236 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c2d16b8dc05e430ba368fdce09cf6cfa for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
18:32:43.236 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 49907dc63f1c46a383141035a9353a56 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
18:32:43.236 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 0cba6ba156884b4c8f2a86f07bdde1fd for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:43.236 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:43.236 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3c9d24669dd74422a060ddb81c161ceb for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:43.236 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=5fa379231aa347d299f56467d01e8555@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=c2d16b8dc05e430ba368fdce09cf6cfa@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=49907dc63f1c46a383141035a9353a56@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=0cba6ba156884b4c8f2a86f07bdde1fd@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=3cd1aa7ed7df4357ab66fc58805f62e3@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=3c9d24669dd74422a060ddb81c161ceb@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:43.240 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6b086cbb915d4f34838e5ef58717ef47
18:32:43.241 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:43.241 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:43.241 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:43.241 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.241 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.241 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.241 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.241 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.241 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.242 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.242 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.242 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.242 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:43.243 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 430ff55bf33c43dbbd3443b21bc87300
18:32:43.247 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bf82abb9dff341cf9fe05a19552b4e99 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
18:32:43.248 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 007ce0b42486462cb7e00e1363a68404 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
18:32:43.248 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d886241527f4f569f6d9abed2c4c8aa for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
18:32:43.248 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 4eb9e4eed973435997d975ece849ca7a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:43.248 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet fa1ae6554a4f44edb298443dd03f3989 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:43.249 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 0c25f7b288564110a208c9c3d924a97b for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:43.249 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=bf82abb9dff341cf9fe05a19552b4e99@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=007ce0b42486462cb7e00e1363a68404@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=3d886241527f4f569f6d9abed2c4c8aa@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=4eb9e4eed973435997d975ece849ca7a@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fa1ae6554a4f44edb298443dd03f3989@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=0c25f7b288564110a208c9c3d924a97b@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:43.249 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.96.188:32989, [4ms] Sub RPC GetTableLocations: received response from server master-127.2.96.188:32989: OK, deferred=null)) after lookup
18:32:43.260 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:43.261 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:43.261 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:43.261 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.261 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.261 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.262 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.262 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.262 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.262 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.262 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.262 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.262 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:43.276 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf82abb9dff341cf9fe05a19552b4e99, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.277 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet bf82abb9dff341cf9fe05a19552b4e99 for partition [0x00000000, 0x0000000080000032) with scanner id null
18:32:43.282 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:43.282 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:43.283 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:43.283 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.283 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.283 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.283 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.283 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.283 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.284 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.284 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.284 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.284 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:43.287 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=007ce0b42486462cb7e00e1363a68404, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.287 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 007ce0b42486462cb7e00e1363a68404 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
18:32:43.294 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3d886241527f4f569f6d9abed2c4c8aa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.294 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3d886241527f4f569f6d9abed2c4c8aa for partition [0x0000000080000096, 0x00000001) with scanner id null
18:32:43.321 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:43.322 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:43.322 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:43.322 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.322 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.322 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.323 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.323 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.323 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.323 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.323 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.323 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.323 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:43.328 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4eb9e4eed973435997d975ece849ca7a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.328 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4eb9e4eed973435997d975ece849ca7a for partition [0x00000001, 0x0000000180000032) with scanner id null
18:32:43.329 [DEBUG - main] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:43.335 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:43.335 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:43.335 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:43.335 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:43.335 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:43.335 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:43.336 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:43.336 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:43.336 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:43.336 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:43.336 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:43.336 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:43.336 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:43.337 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:43.341 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6b086cbb915d4f34838e5ef58717ef47
18:32:43.347 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:43.351 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bf82abb9dff341cf9fe05a19552b4e99 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
18:32:43.351 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 007ce0b42486462cb7e00e1363a68404 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
18:32:43.351 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d886241527f4f569f6d9abed2c4c8aa for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
18:32:43.351 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 4eb9e4eed973435997d975ece849ca7a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:43.351 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet fa1ae6554a4f44edb298443dd03f3989 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:43.351 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 0c25f7b288564110a208c9c3d924a97b for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:43.352 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=bf82abb9dff341cf9fe05a19552b4e99@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=007ce0b42486462cb7e00e1363a68404@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=3d886241527f4f569f6d9abed2c4c8aa@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=4eb9e4eed973435997d975ece849ca7a@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fa1ae6554a4f44edb298443dd03f3989@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=0c25f7b288564110a208c9c3d924a97b@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:43.359 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='abcda650a0bcdf4edf149bde78ce8023567953fc5c62333795c1784ce55944ce'}]
18:32:43.361 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:43.361 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='da9a22132477a87f9c27a09a9959b899a3bf7f534362bf7f13c5dd8f59416269'}]
18:32:43.363 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:43.363 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='08540993e7f56ab1b98810fa7db86ee1e4bc4c78c374a6697a79fddb8a22b3be'}]
18:32:43.364 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:43.364 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e3e46f1d40d64f5b483db1191a00f2e079f944d1cad8c4bb8131b02de5c45f05'}]
18:32:43.366 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:43.366 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:32:43.367 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299995, tablet=bf82abb9dff341cf9fe05a19552b4e99@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}]
18:32:43.368 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:32:43.371 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
18:32:43.372 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
18:32:43.378 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299995, tablet=007ce0b42486462cb7e00e1363a68404@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}]
18:32:43.378 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299995, tablet=4eb9e4eed973435997d975ece849ca7a@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}]
18:32:43.378 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299995, tablet=3d886241527f4f569f6d9abed2c4c8aa@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}]
18:32:43.382 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:43.389 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:43.394 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:43.407 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:43.407 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:43.408 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:43.408 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:43.408 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:43.408 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:43.408 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:43.408 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:43.408 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:43.409 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:43.409 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:43.409 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:43.409 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:43.415 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:43.416 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:43.421 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:43.421 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:43.422 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:43.422 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.422 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.422 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.422 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.422 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.422 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.423 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.423 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.423 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.423 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:43.427 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:43.427 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:43.427 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:43.428 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:43.428 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:43.428 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:43.428 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:43.428 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:43.428 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:43.429 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:43.429 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:43.429 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:43.429 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:43.438 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0xef3e617b, L:/127.0.0.1:41888 - R:/127.2.96.129:42953] using TOKEN/null
18:32:43.438 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:43.446 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:43.447 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:43.449 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:43.451 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:43.453 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:43.492 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:43.522 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:43.533 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:43.533 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:43.533 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:43.534 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:43.534 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:43.534 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:43.534 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:43.534 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:43.534 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:43.534 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:43.534 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:43.534 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:43.534 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:43.552 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:43.556 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6ea9b382, L:/127.0.0.1:41902 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:43.558 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf9a69299, L:/127.0.0.1:41892 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:43.566 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:43.567 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:43.567 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:43.567 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:43.568 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:43.568 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:43.568 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:43.568 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:43.568 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:43.568 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:43.569 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:43.569 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:43.569 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:43.569 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:43.570 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361667420160001) for scanner KuduScanner(table=replication_test_table, tablet=3d886241527f4f569f6d9abed2c4c8aa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.571 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [08540993e7f56ab1b98810fa7db86ee1e4bc4c78c374a6697a79fddb8a22b3be]
18:32:43.573 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [08540993e7f56ab1b98810fa7db86ee1e4bc4c78c374a6697a79fddb8a22b3be]
18:32:43.574 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
18:32:43.574 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
18:32:43.575 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 08540993e7f56ab1b98810fa7db86ee1e4bc4c78c374a6697a79fddb8a22b3be finished by subtask 0; deferring removal (restored in pending)
18:32:43.576 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:43.576 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='f670c7c61e50793d6ff08f169e287f261a0e06362265e0a91a10e3219e9bff83'}]
18:32:43.578 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:43.578 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
18:32:43.579 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299995, tablet=fa1ae6554a4f44edb298443dd03f3989@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)[L]]}]
18:32:43.581 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:43.583 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:43.599 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:43.600 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fa1ae6554a4f44edb298443dd03f3989, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.600 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet fa1ae6554a4f44edb298443dd03f3989 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
18:32:43.601 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3986c2fa, L:/127.0.0.1:41918 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:43.601 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:43.601 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:43.601 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:43.601 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.601 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.602 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.602 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.602 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.602 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.603 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.603 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.603 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.603 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:43.605 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:43.607 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0c25f7b288564110a208c9c3d924a97b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.607 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 0c25f7b288564110a208c9c3d924a97b for partition [0x0000000180000096, 0x00000002) with scanner id null
18:32:43.613 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 5fa379231aa347d299f56467d01e8555 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
18:32:43.613 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c2d16b8dc05e430ba368fdce09cf6cfa for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
18:32:43.613 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 49907dc63f1c46a383141035a9353a56 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
18:32:43.613 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 0cba6ba156884b4c8f2a86f07bdde1fd for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:43.613 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:43.613 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 3c9d24669dd74422a060ddb81c161ceb for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:43.613 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=5fa379231aa347d299f56467d01e8555@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=c2d16b8dc05e430ba368fdce09cf6cfa@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=49907dc63f1c46a383141035a9353a56@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=0cba6ba156884b4c8f2a86f07bdde1fd@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)[L],bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=3cd1aa7ed7df4357ab66fc58805f62e3@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)[L],bed90167029a48089d044ae7429783f7(127.3.43.129:43071)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=3c9d24669dd74422a060ddb81c161ceb@[7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327),bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355),bed90167029a48089d044ae7429783f7(127.3.43.129:43071)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:43.613 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.43.188:36795, [4ms] Sub RPC GetTableLocations: received response from server master-127.3.43.188:36795: OK, deferred=null)) after lookup
18:32:43.618 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xae1c896f, L:/127.0.0.1:41928 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:43.621 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535563621 for job 9de81db54be40687a2a82164db1dc50b.
18:32:43.636 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5fa379231aa347d299f56467d01e8555, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.636 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5fa379231aa347d299f56467d01e8555 for partition [0x00000000, 0x0000000080000032) with scanner id null
18:32:43.639 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:43.639 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:43.639 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:43.640 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:43.640 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:43.640 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:43.640 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:43.640 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:43.640 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:43.641 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:43.641 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:43.641 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:43.641 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:43.643 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 9de81db54be40687a2a82164db1dc50b (4988 bytes, checkpointDuration=22 ms, finalizationTime=0 ms).
18:32:43.647 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
18:32:43.647 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:43.647 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split 08540993e7f56ab1b98810fa7db86ee1e4bc4c78c374a6697a79fddb8a22b3be from pending
18:32:43.647 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 4 complete: removed 1 finished splits from enumerator state
18:32:43.652 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c2d16b8dc05e430ba368fdce09cf6cfa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.652 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet c2d16b8dc05e430ba368fdce09cf6cfa for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
18:32:43.658 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=49907dc63f1c46a383141035a9353a56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.659 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 49907dc63f1c46a383141035a9353a56 for partition [0x0000000080000096, 0x00000001) with scanner id null
18:32:43.659 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361667420160001) for scanner KuduScanner(table=replication_test_table, tablet=007ce0b42486462cb7e00e1363a68404, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.659 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [da9a22132477a87f9c27a09a9959b899a3bf7f534362bf7f13c5dd8f59416269]
18:32:43.659 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [da9a22132477a87f9c27a09a9959b899a3bf7f534362bf7f13c5dd8f59416269]
18:32:43.660 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:32:43.660 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:32:43.661 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split da9a22132477a87f9c27a09a9959b899a3bf7f534362bf7f13c5dd8f59416269 finished by subtask 1; deferring removal (restored in pending)
18:32:43.661 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:43.662 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:43.662 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='c2950ce8676ceea9024ca584ee25696b1346418af658f3fe6ee55936a06424da'}]
18:32:43.667 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0cba6ba156884b4c8f2a86f07bdde1fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.667 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0cba6ba156884b4c8f2a86f07bdde1fd for partition [0x00000001, 0x0000000180000032) with scanner id null
18:32:43.670 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:43.672 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3cd1aa7ed7df4357ab66fc58805f62e3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.673 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
18:32:43.675 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:43.700 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:43.701 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:43.701 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:43.702 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:43.702 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:43.702 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:43.703 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:43.703 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:43.703 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:43.703 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:43.703 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:43.703 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:43.704 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:43.704 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:43.706 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c9d24669dd74422a060ddb81c161ceb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.706 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c9d24669dd74422a060ddb81c161ceb for partition [0x0000000180000096, 0x00000002) with scanner id null
18:32:43.715 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x99e57cea, L:/127.0.0.1:41936 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:43.716 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:43.732 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361667420160001) for scanner KuduScanner(table=replication_test_table, tablet=fa1ae6554a4f44edb298443dd03f3989, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.732 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [f670c7c61e50793d6ff08f169e287f261a0e06362265e0a91a10e3219e9bff83]
18:32:43.732 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [f670c7c61e50793d6ff08f169e287f261a0e06362265e0a91a10e3219e9bff83]
18:32:43.733 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
18:32:43.733 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
18:32:43.733 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:43.735 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split f670c7c61e50793d6ff08f169e287f261a0e06362265e0a91a10e3219e9bff83 finished by subtask 0; deferring removal (restored in pending)
18:32:43.748 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361667420160001) for scanner KuduScanner(table=replication_test_table, tablet=4eb9e4eed973435997d975ece849ca7a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.749 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [e3e46f1d40d64f5b483db1191a00f2e079f944d1cad8c4bb8131b02de5c45f05]
18:32:43.749 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf82abb9dff341cf9fe05a19552b4e99, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.749 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e3e46f1d40d64f5b483db1191a00f2e079f944d1cad8c4bb8131b02de5c45f05]
18:32:43.749 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet bf82abb9dff341cf9fe05a19552b4e99 for partition [0x00000000, 0x0000000080000032) with scanner id null
18:32:43.750 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
18:32:43.750 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
18:32:43.750 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:43.751 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e3e46f1d40d64f5b483db1191a00f2e079f944d1cad8c4bb8131b02de5c45f05 finished by subtask 2; deferring removal (restored in pending)
18:32:43.751 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:43.761 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:43.761 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:43.762 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:43.762 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
18:32:43.762 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:43.774 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361667420160001) for scanner KuduScanner(table=replication_test_table, tablet=bf82abb9dff341cf9fe05a19552b4e99, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.774 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [abcda650a0bcdf4edf149bde78ce8023567953fc5c62333795c1784ce55944ce]
18:32:43.774 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [abcda650a0bcdf4edf149bde78ce8023567953fc5c62333795c1784ce55944ce]
18:32:43.775 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:32:43.775 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:32:43.776 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split abcda650a0bcdf4edf149bde78ce8023567953fc5c62333795c1784ce55944ce finished by subtask 3; deferring removal (restored in pending)
18:32:43.776 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:43.776 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:43.777 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:43.778 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:43.778 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:43.778 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:43.778 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:43.778 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:43.778 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:43.778 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:43.779 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:43.779 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:43.779 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:43.779 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:43.779 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:43.781 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:43.781 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:43.782 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:43.782 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:32:43.783 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=007ce0b42486462cb7e00e1363a68404, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.783 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 007ce0b42486462cb7e00e1363a68404 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
18:32:43.804 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3d886241527f4f569f6d9abed2c4c8aa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.805 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3d886241527f4f569f6d9abed2c4c8aa for partition [0x0000000080000096, 0x00000001) with scanner id null
18:32:43.818 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4eb9e4eed973435997d975ece849ca7a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.818 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4eb9e4eed973435997d975ece849ca7a for partition [0x00000001, 0x0000000180000032) with scanner id null
18:32:43.835 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=fa1ae6554a4f44edb298443dd03f3989, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.835 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet fa1ae6554a4f44edb298443dd03f3989 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
18:32:43.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:43.845 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0c25f7b288564110a208c9c3d924a97b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.846 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 0c25f7b288564110a208c9c3d924a97b for partition [0x0000000180000096, 0x00000002) with scanner id null
18:32:43.859 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5fa379231aa347d299f56467d01e8555, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.859 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5fa379231aa347d299f56467d01e8555 for partition [0x00000000, 0x0000000080000032) with scanner id null
18:32:43.868 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c2d16b8dc05e430ba368fdce09cf6cfa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.868 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet c2d16b8dc05e430ba368fdce09cf6cfa for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
18:32:43.878 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=49907dc63f1c46a383141035a9353a56, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.878 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 49907dc63f1c46a383141035a9353a56 for partition [0x0000000080000096, 0x00000001) with scanner id null
18:32:43.897 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:43.897 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:43.898 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:43.898 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
18:32:43.939 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0cba6ba156884b4c8f2a86f07bdde1fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.939 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0cba6ba156884b4c8f2a86f07bdde1fd for partition [0x00000001, 0x0000000180000032) with scanner id null
18:32:43.942 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:43.942 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:43.942 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
18:32:43.942 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
18:32:43.952 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:43.953 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:43.953 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:43.953 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:32:43.961 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
18:32:43.961 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3cd1aa7ed7df4357ab66fc58805f62e3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.961 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:43.961 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 3cd1aa7ed7df4357ab66fc58805f62e3 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
18:32:43.961 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:43.961 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:43.962 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.962 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.962 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:43.962 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.962 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.962 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:43.963 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.963 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.963 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:43.963 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:43.975 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3c9d24669dd74422a060ddb81c161ceb, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:43.975 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 3c9d24669dd74422a060ddb81c161ceb for partition [0x0000000180000096, 0x00000002) with scanner id null
18:32:43.975 [DEBUG - main] (Connection.java:575) [peer master-127.3.43.190:40613(127.3.43.190:40613)] disconnecting while in state READY
18:32:43.976 [DEBUG - main] (Connection.java:575) [peer bed90167029a48089d044ae7429783f7(127.3.43.129:43071)] disconnecting while in state READY
18:32:43.976 [DEBUG - main] (Connection.java:575) [peer master-127.3.43.188:36795(127.3.43.188:36795)] disconnecting while in state READY
18:32:43.976 [DEBUG - main] (Connection.java:575) [peer bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)] disconnecting while in state READY
18:32:43.976 [DEBUG - main] (Connection.java:575) [peer master-127.3.43.189:32951(127.3.43.189:32951)] disconnecting while in state READY
18:32:43.976 [DEBUG - main] (Connection.java:575) [peer 7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)] disconnecting while in state READY
18:32:43.976 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.3.43.190:40613(127.3.43.190:40613)] handling channelInactive
18:32:43.976 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state READY due to: connection closed
18:32:43.977 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.3.43.188:36795(127.3.43.188:36795)] handling channelInactive
18:32:43.977 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state READY due to: connection closed
18:32:43.977 [DEBUG - kudu-nio-4] (Connection.java:239) [peer bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)] handling channelInactive
18:32:43.977 [DEBUG - kudu-nio-4] (Connection.java:709) [peer bcff4e6242a648a5ad29bd2dc8fca9ea(127.3.43.130:38355)] cleaning up while in state READY due to: connection closed
18:32:43.978 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.3.43.189:32951(127.3.43.189:32951)] handling channelInactive
18:32:43.978 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state READY due to: connection closed
18:32:43.978 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)] handling channelInactive
18:32:43.979 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)] cleaning up while in state READY due to: connection closed
18:32:43.983 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299995, tablet=0c25f7b288564110a208c9c3d924a97b@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)[L]]}]
18:32:43.991 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:43.993 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-4
18:32:43.994 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
18:32:43.994 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-0
18:32:43.994 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
18:32:43.995 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
18:32:44.006 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state RESTARTING to RUNNING.
18:32:44.007 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job f6e63683f34d031c5da392b08baea20c from Checkpoint 74 @ 1783535501335 for f6e63683f34d031c5da392b08baea20c located at file:/tmp/junit4154231101817438778/checkpoints/f6e63683f34d031c5da392b08baea20c/chk-74.
18:32:44.007 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
18:32:44.008 [INFO - flink-pekko.actor.default-dispatcher-9] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:32:44.032 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:44.041 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:44.042 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:44.042 [DEBUG - pool-168-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:44.043 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.043 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.043 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.044 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.044 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.044 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.044 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.044 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.044 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.044 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:44.049 [DEBUG - kudu-nio-5] (Connection.java:239) [peer bed90167029a48089d044ae7429783f7(127.3.43.129:43071)] handling channelInactive
18:32:44.049 [DEBUG - kudu-nio-5] (Connection.java:709) [peer bed90167029a48089d044ae7429783f7(127.3.43.129:43071)] cleaning up while in state READY due to: connection closed
18:32:44.049 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-5
18:32:44.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:44.050482  3246 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 3564
18:32:44.059 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED.
18:32:44.060 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:32:44.061 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING.
18:32:44.061 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #3) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 13a0441c1420d35b57a28ebd584f9846
18:32:44.061 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to SCHEDULED.
18:32:44.061 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:32:44.062 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from SCHEDULED to DEPLOYING.
18:32:44.062 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #4) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id e5ed6e64fe4e0a504f52a2cb8573a359
18:32:44.062 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to SCHEDULED.
18:32:44.062 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:32:44.063 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from SCHEDULED to DEPLOYING.
18:32:44.063 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #4) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8c518d750e8767059e15b0e0577096dd
18:32:44.063 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to SCHEDULED.
18:32:44.063 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:391) Activate slot 13a0441c1420d35b57a28ebd584f9846.
18:32:44.064 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from SCHEDULED to DEPLOYING.
18:32:44.064 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #3) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8ff5a8fd5a1d7f8775f563b9a37bf60a
18:32:44.064 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id 13a0441c1420d35b57a28ebd584f9846.
18:32:44.065 [INFO - Thread-39] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:32:44.065 [DEBUG - Thread-39] (Connection.java:575) [peer master-127.30.11.253:35677(127.30.11.253:35677)] disconnecting while in state TERMINATED
18:32:44.065 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:32:44.065 [DEBUG - Thread-39] (Connection.java:575) [peer master-127.30.11.252:39405(127.30.11.252:39405)] disconnecting while in state TERMINATED
18:32:44.065 [DEBUG - Thread-39] (Connection.java:575) [peer master-127.30.11.254:41811(127.30.11.254:41811)] disconnecting while in state TERMINATED
18:32:44.065 [DEBUG - Thread-39] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:44.070 [INFO - Thread-39] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:32:44.071 [INFO - Thread-39] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:32:44.073 [DEBUG - Thread-39] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:44.073 [INFO - Thread-39] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:32:44.078 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:44.079 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:391) Activate slot e5ed6e64fe4e0a504f52a2cb8573a359.
18:32:44.081 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_4), deploy into slot with allocation id e5ed6e64fe4e0a504f52a2cb8573a359.
18:32:44.086 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:44.094 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:44.094 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
18:32:44.095 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
18:32:44.095 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@18b6f89c
18:32:44.095 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:44.096 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:32:44.096 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
18:32:44.096 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
18:32:44.105 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:391) Activate slot 8c518d750e8767059e15b0e0577096dd.
18:32:44.105 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4e23dd8d
18:32:44.121 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535564121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:44.113 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:44.136 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:44.136 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:44.136 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:44.109 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x73481b1f, L:/127.0.0.1:41944 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:44.106 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to DEPLOYING.
18:32:44.137 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_4) [DEPLOYING].
18:32:44.138 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4c4d137d
18:32:44.138 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:44.138 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:32:44.138 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
18:32:44.140 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2e76cabe
18:32:44.105 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_4), deploy into slot with allocation id 8c518d750e8767059e15b0e0577096dd.
18:32:44.142 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
18:32:44.143 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:44.159 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 9de81db54be40687a2a82164db1dc50b (4320 bytes, checkpointDuration=38 ms, finalizationTime=0 ms).
18:32:44.161 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
18:32:44.161 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split da9a22132477a87f9c27a09a9959b899a3bf7f534362bf7f13c5dd8f59416269 from pending
18:32:44.161 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split f670c7c61e50793d6ff08f169e287f261a0e06362265e0a91a10e3219e9bff83 from pending
18:32:44.161 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split abcda650a0bcdf4edf149bde78ce8023567953fc5c62333795c1784ce55944ce from pending
18:32:44.161 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split e3e46f1d40d64f5b483db1191a00f2e079f944d1cad8c4bb8131b02de5c45f05 from pending
18:32:44.161 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 4 finished splits from enumerator state
18:32:44.163 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:44.168 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361667420160001) for scanner KuduScanner(table=replication_test_table, tablet=0c25f7b288564110a208c9c3d924a97b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:44.168 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [c2950ce8676ceea9024ca584ee25696b1346418af658f3fe6ee55936a06424da]
18:32:44.168 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [c2950ce8676ceea9024ca584ee25696b1346418af658f3fe6ee55936a06424da]
18:32:44.168 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
18:32:44.168 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
18:32:44.169 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:44.170 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:391) Activate slot 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:32:44.171 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_3), deploy into slot with allocation id 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:32:44.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:44.170410  4013 connection.cc:573] client connection to 127.3.43.129:43071 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:32:44.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:44.170967  4013 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:32:44.172 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to DEPLOYING.
18:32:44.172 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_4) [DEPLOYING].
18:32:44.172 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7d5729c3
18:32:44.173 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split c2950ce8676ceea9024ca584ee25696b1346418af658f3fe6ee55936a06424da finished by subtask 1; deferring removal (restored in pending)
18:32:44.173 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:44.173 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:32:44.173 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
18:32:44.173 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:44.173 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
18:32:44.176 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@49956cd1
18:32:44.178 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:44.187 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to DEPLOYING.
18:32:44.187 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_3) [DEPLOYING].
18:32:44.188 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@fd06a5f
18:32:44.188 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:44.188 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:32:44.189 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
18:32:44.189 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
18:32:44.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:44.191694  3246 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 3844
18:32:44.206 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7f1edb5
18:32:44.217 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:44.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:44.218993  4013 consensus_peers.cc:597] T 5fa379231aa347d299f56467d01e8555 P 7ecd1039231a404dbd66f834d9290a2d -> Peer bed90167029a48089d044ae7429783f7 (127.3.43.129:43071): Couldn't send request to peer bed90167029a48089d044ae7429783f7. Status: Network error: Client connection negotiation failed: client connection to 127.3.43.129:43071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
18:32:44.225 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:44.227 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:44.227 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:44.228 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:44.228 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:44.228 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:44.228 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:44.228 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:44.229 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:44.229 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:44.229 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:44.229 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:44.229 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:44.229 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:44.233 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:44.237 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:44.244 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.251 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.252 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.252 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.252 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.258 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.259 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.259 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.259 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.266 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.266 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.266 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.266 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:44.277879  3246 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 3992
18:32:44.285 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.303 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.314 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:44.315 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.315 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.315 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.317 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:44.318 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.318 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.318 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.327 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.327 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.327 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.327 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:44.337 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:44.346 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:44.357 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:44.357 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:44.358 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:44.358 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
18:32:44.364 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.381 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.382 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.382 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.382 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.387 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.388 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.388 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.388 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.407 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.407 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.408 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.408 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.408 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)] handling channelInactive
18:32:44.408 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)] cleaning up while in state READY due to: connection closed
18:32:44.408 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)] handling channelInactive
18:32:44.408 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)] cleaning up while in state READY due to: connection closed
18:32:44.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:44.419307  3246 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 3258
18:32:44.420 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.425 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.431 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.435 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.435 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.436 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.447 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.448 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.448 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.448 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.455 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.456 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.456 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.456 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.468 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.469 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.469 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.469 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.471 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.471 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.471 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.471 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.481 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:44.481 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:44.482 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:44.482 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:44.482 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:44.482 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:44.482 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:44.482 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:44.482 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:44.483 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:44.483 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:44.483 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:44.483 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:44.483 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:44.484 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.484 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.484 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.484 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.487 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:44.487 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.487 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.487 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.500 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.3.43.190:40613(127.3.43.190:40613)] handling channelInactive
18:32:44.500 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state READY due to: connection closed
18:32:44.501 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.501 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.501 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.501 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:44.501 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.3.43.190:40613(127.3.43.190:40613)] handling channelInactive
18:32:44.501 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.3.43.190:40613(127.3.43.190:40613)] handling channelInactive
18:32:44.501 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state READY due to: connection closed
18:32:44.501 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state READY due to: connection closed
18:32:44.501 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.3.43.190:40613(127.3.43.190:40613)] handling channelInactive
18:32:44.502 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state READY due to: connection closed
18:32:44.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:44.501919  3445 connection.cc:573] client connection to 127.3.43.190:40613 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:32:44.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:44.502444  3445 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:32:44.506 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:44.509 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.510 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.510 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.510 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:44.511135  3246 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 3329
18:32:44.527 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.527 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.527 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.527 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.528 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.528 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.529 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.529 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.529 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.529 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.530 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.530 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.530 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.530 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.531 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.531 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.531 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.531 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.531 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.532 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.532 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.532 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.532 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.532 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.534 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.534 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.534 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.534 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.535 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.542 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.542 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.542 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:44.542709  3445 consensus_peers.cc:597] T 00000000000000000000000000000000 P c0c218271cc04cb9861bba527b26da57 -> Peer dccd3d09c4904f18acbc8fa3ba91bd63 (127.3.43.190:40613): Couldn't send request to peer dccd3d09c4904f18acbc8fa3ba91bd63. Status: Network error: Client connection negotiation failed: client connection to 127.3.43.190:40613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
18:32:44.544 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.545 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.545 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.545 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.545 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.545 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.545 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.545 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.546 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.546 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.546 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.546 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.546 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.546 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.546 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.549 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.549 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.549 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.549 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.559 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:44.562 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.565 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.565 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.565 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.565 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.565 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.565 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.565 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.565 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.565 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.566 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.566 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.566 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.566 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.566 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.569 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.569 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.572 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:44.573 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.573 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.573 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.574 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.574 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.574 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.574 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:44.577 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.578 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.581 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.581 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.581 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.582 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.582 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.582 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.586 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:44.586 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:44.586 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.586 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.586 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.586 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.586 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.586 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.587 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.587 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.587 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.586 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:44.587 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.587 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.587 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.587 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.587 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:44.596 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.597 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.597 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.597 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.597 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.597 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.598 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.598 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.598 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.598 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.598 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.600 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.603 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.604 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.604 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.604 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.604 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.604 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.604 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.604 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.604 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.605 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.605 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.605 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.605 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.605 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.605 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.605 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.606 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.606 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.606 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.606 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:44.606 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.606 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:44.606 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.606 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:44.607 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.607 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.3.43.189:32951(127.3.43.189:32951)] handling channelInactive
18:32:44.607 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.607 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.607 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.3.43.189:32951(127.3.43.189:32951)] handling channelInactive
18:32:44.607 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state READY due to: connection closed
18:32:44.607 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.607 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.607 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.607 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.607 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.607 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.606 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.607 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.608 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.608 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.3.43.189:32951(127.3.43.189:32951)] handling channelInactive
18:32:44.608 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.608 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:44.608 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.608 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.608 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.607 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state READY due to: connection closed
18:32:44.608 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.3.43.189:32951(127.3.43.189:32951)] handling channelInactive
18:32:44.608 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state READY due to: connection closed
18:32:44.608 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state READY due to: connection closed
18:32:44.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:44.611263  3443 connection.cc:573] client connection to 127.3.43.189:32951 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:32:44.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:44.613420  3246 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 3411
18:32:44.617 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.618 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.618 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535564622 for job 9de81db54be40687a2a82164db1dc50b.
18:32:44.624 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.624 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.625 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.625 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.625 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.625 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.625 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.625 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.625 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.629 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.629 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.629 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.629 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.636 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 9de81db54be40687a2a82164db1dc50b (1632 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
18:32:44.639 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
18:32:44.639 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 6 complete: removed split c2950ce8676ceea9024ca584ee25696b1346418af658f3fe6ee55936a06424da from pending
18:32:44.639 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 6 complete: removed 1 finished splits from enumerator state
18:32:44.640 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.642 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.642 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.642 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.644 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.644 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.644 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.644 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.645 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.645 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.645 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.645 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.645 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.645 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.645 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.645 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.646 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.646 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:44.646 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:44.646 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.646 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.646 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:44.646 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.646 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.646 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.647 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.647 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.647 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.647 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.647 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.647 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.647 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.647 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.647 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:44.661 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.661 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.662 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.662 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.664 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.664 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.664 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.665 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.665 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.665 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.665 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.665 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.665 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.665 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.665 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.666 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.666 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.675 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.675 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.675 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.675 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.676 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.676 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.676 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.676 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.677 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:44.678 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:44.678 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:44.678 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:44.678 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:44.678 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:44.678 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:44.678 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:44.678 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:44.678 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:44.678 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:44.678 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:44.678 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:44.681 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.685 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.685 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.685 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.685 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.686 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.686 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.686 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.686 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.686 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.686 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:44.686 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.687 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.687 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.687 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.687 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.687 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.687 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:44.687 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:44.687 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.687 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.687 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.687 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.688 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.688 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.688 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.688 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.688 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.688 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.688 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.688 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.689 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.689 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.689 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.689 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.689 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.689 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.689 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.689 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.689 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:44.699 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.700 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.700 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.700 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.704 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.704 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.704 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.704 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.704 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.704 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.705 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.705 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.705 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.705 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.705 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.705 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.706 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.706 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.706 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.706 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.706 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.706 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.706 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.706 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.707 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.707 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.707 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.707 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.707 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.707 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.712 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.3.43.188:36795(127.3.43.188:36795)] handling channelInactive
18:32:44.712 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state READY due to: connection closed
18:32:44.713 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.3.43.188:36795(127.3.43.188:36795)] handling channelInactive
18:32:44.713 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state READY due to: connection closed
18:32:44.713 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.3.43.188:36795(127.3.43.188:36795)] handling channelInactive
18:32:44.713 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state READY due to: connection closed
18:32:44.715 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.3.43.188:36795(127.3.43.188:36795)] handling channelInactive
18:32:44.715 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state READY due to: connection closed
18:32:44.716 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:44.716 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.716 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.716 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.716 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.717 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.717 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.717 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.717 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.720 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.721 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.721 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.721 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.721 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.721 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.722 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.722 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.722 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.722 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.722 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.722 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.722 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.725 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.725 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.725 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.725 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.725 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.725 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.726 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.726 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.726 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.726 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.726 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.726 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.726 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.738 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:44.741 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.741 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.742 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.742 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.742 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.742 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.742 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.742 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.742 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.742 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.742 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.742 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.742 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.746 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:44.746 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:44.746 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:44.746 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.746 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.747 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.747 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.747 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.747 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.747 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.747 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.747 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.747 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:44.761 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.761 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.761 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.762 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.762 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.762 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.762 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.762 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.762 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.763 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.763 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.763 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.763 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.784 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.784 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.784 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.785 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.785 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.785 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.785 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.785 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.785 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.785 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.785 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.785 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.785 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.785 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.786 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.786 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.786 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.786 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.786 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.786 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.786 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.786 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.786 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.785 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.786 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.786 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.805 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.805 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.806 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.806 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.806 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.806 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.806 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.806 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.806 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.806 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.806 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.807 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.807 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.817 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:44.818 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:44.818 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:44.818 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:44.818 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:44.818 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:44.819 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:44.819 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:44.819 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:44.819 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:44.819 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:44.819 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:44.819 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:44.821 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.821 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.821 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.822 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.822 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.822 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.822 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.822 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.822 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.822 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.822 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.822 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.822 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.838 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:44.845 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.845 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.845 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.846 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.846 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.846 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.846 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.846 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.847 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.847 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.847 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.847 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.847 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.866 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:44.866 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:44.866 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:44.867 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.867 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.867 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.867 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.867 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.867 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.868 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.868 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.868 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.868 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:44.881 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.881 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.881 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.882 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.882 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.882 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.882 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.882 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.882 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.882 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.882 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.882 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.882 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:44.906 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:44.906 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:44.906 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:44.907 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.907 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.907 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:44.907 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.907 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.907 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:44.908 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.908 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.908 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:44.908 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:44.945 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:44.945 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:44.946 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:44.946 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.946 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.946 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:44.947 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.947 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.947 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:44.947 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.947 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.947 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:44.947 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:45.008 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:45.008 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:45.008 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:45.009 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.009 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.009 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.009 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.009 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.009 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.009 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.009 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.010 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.010 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:45.017 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:45.017 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:45.017 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:45.017 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:45.017 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:45.018 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:45.018 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:45.018 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:45.018 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:45.018 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:45.018 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:45.018 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:45.019 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:45.044 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:45.044 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:45.044 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:45.045 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.045 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.045 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.045 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.045 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.045 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.045 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.045 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.046 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.046 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:45.086 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:45.087 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:45.087 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:45.087 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:45.088 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:45.088 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:45.088 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:45.088 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:45.088 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:45.089 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:45.089 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:45.089 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:45.089 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:45.105 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:45.105 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:45.106 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:45.106 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.106 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.106 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.107 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.107 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.107 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.107 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.107 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.107 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.107 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:45.121 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:45.121 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:45.121 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535565121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:45.122 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:45.122 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.122 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.122 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.123 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.123 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.123 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.123 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.123 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.123 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.123 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:45.139 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
18:32:45.141 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
18:32:45.205 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:45.206 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:45.206 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:45.206 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.206 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.207 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.207 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.207 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.207 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.207 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.207 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.207 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.207 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:45.214 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:45.238 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:45.260 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:45.261 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.261 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.262 [INFO - pool-250-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.262 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:45.262 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:45.263 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.263 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.263 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.263 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.263 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.263 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.263 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:45.265 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:45.266 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:45.266 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:45.266 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.266 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.266 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.267 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.267 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.267 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.267 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.267 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.267 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.267 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:45.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:45.340 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6b086cbb915d4f34838e5ef58717ef47
18:32:45.345 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bf82abb9dff341cf9fe05a19552b4e99 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
18:32:45.345 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 007ce0b42486462cb7e00e1363a68404 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
18:32:45.345 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d886241527f4f569f6d9abed2c4c8aa for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
18:32:45.345 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 4eb9e4eed973435997d975ece849ca7a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:45.345 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet fa1ae6554a4f44edb298443dd03f3989 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:45.345 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 0c25f7b288564110a208c9c3d924a97b for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:45.345 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=bf82abb9dff341cf9fe05a19552b4e99@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=007ce0b42486462cb7e00e1363a68404@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=3d886241527f4f569f6d9abed2c4c8aa@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=4eb9e4eed973435997d975ece849ca7a@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fa1ae6554a4f44edb298443dd03f3989@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=0c25f7b288564110a208c9c3d924a97b@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:45.351 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8c0f072ecf87870db042732f2f0fa9ed570519e7a53f3b702165d0a38bd63c57'}]
18:32:45.352 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:45.353 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='af3ecb4349862fd68602cfe18c0cfe6f367fa4454f5e5710138dfbe567670f20'}]
18:32:45.354 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:45.354 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='88f0ae0bb38e9a1ca7b5f5cdd1e03f141fcb9d888f37bca6ef230cc1a5a84b49'}]
18:32:45.356 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:45.356 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='0a8bc77a0b703467382094613951ff32aaef00db46d8b415c107f4e7b3192356'}]
18:32:45.357 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:45.357 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
18:32:45.358 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299997, tablet=bf82abb9dff341cf9fe05a19552b4e99@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}]
18:32:45.358 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
18:32:45.359 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299996, tablet=007ce0b42486462cb7e00e1363a68404@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}]
18:32:45.359 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
18:32:45.360 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299996, tablet=3d886241527f4f569f6d9abed2c4c8aa@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}]
18:32:45.360 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
18:32:45.360 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299996, tablet=4eb9e4eed973435997d975ece849ca7a@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}]
18:32:45.371 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:45.381 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:45.389 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:45.399 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:45.418 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:45.432 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:45.446 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:45.466 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:45.476 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:45.479 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:45.484 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:45.487 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:45.487 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:45.488 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:45.488 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:45.488 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:45.488 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:45.489 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:45.489 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:45.489 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:45.489 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:45.489 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:45.489 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:45.489 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:45.489 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:45.494 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:45.510 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x529c3398, L:/127.0.0.1:41948 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:45.530 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:45.530 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:45.540 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3164a248, L:/127.0.0.1:41964 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:45.545 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:45.551 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x22d3e9c8, L:/127.0.0.1:41974 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:45.551 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1f8e2342, L:/127.0.0.1:41970 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:45.566 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361675612160001) for scanner KuduScanner(table=replication_test_table, tablet=4eb9e4eed973435997d975ece849ca7a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:45.567 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [0a8bc77a0b703467382094613951ff32aaef00db46d8b415c107f4e7b3192356]
18:32:45.567 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [0a8bc77a0b703467382094613951ff32aaef00db46d8b415c107f4e7b3192356]
18:32:45.568 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
18:32:45.568 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
18:32:45.569 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 0a8bc77a0b703467382094613951ff32aaef00db46d8b415c107f4e7b3192356 finished by subtask 1; deferring removal (restored in pending)
18:32:45.570 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:45.571 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='4a00ddbe71afddaebfdb29861774e6e54f3ac7d5b1950945362938aa7e90493d'}]
18:32:45.573 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:45.574 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
18:32:45.579 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361675612160001) for scanner KuduScanner(table=replication_test_table, tablet=bf82abb9dff341cf9fe05a19552b4e99, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:45.579 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [8c0f072ecf87870db042732f2f0fa9ed570519e7a53f3b702165d0a38bd63c57]
18:32:45.580 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8c0f072ecf87870db042732f2f0fa9ed570519e7a53f3b702165d0a38bd63c57]
18:32:45.580 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
18:32:45.580 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
18:32:45.580 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:45.582 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8c0f072ecf87870db042732f2f0fa9ed570519e7a53f3b702165d0a38bd63c57 finished by subtask 0; deferring removal (restored in pending)
18:32:45.583 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='cff51eb9ba0bfd0b3c2694d481275e4a30cbe9a529a9d89c80f3f98515b908c7'}]
18:32:45.585 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:45.585 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
18:32:45.586 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299996, tablet=0c25f7b288564110a208c9c3d924a97b@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)[L]]}]
18:32:45.587 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:45.588 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299983, tablet=fa1ae6554a4f44edb298443dd03f3989@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)[L]]}]
18:32:45.589 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:45.600 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:45.601 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:45.601 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:45.601 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.602 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.602 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.602 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.602 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.602 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.603 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.603 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.603 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.603 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:45.612 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361675612160001) for scanner KuduScanner(table=replication_test_table, tablet=3d886241527f4f569f6d9abed2c4c8aa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:45.612 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [88f0ae0bb38e9a1ca7b5f5cdd1e03f141fcb9d888f37bca6ef230cc1a5a84b49]
18:32:45.612 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [88f0ae0bb38e9a1ca7b5f5cdd1e03f141fcb9d888f37bca6ef230cc1a5a84b49]
18:32:45.613 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
18:32:45.613 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
18:32:45.613 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:45.615 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 88f0ae0bb38e9a1ca7b5f5cdd1e03f141fcb9d888f37bca6ef230cc1a5a84b49 finished by subtask 3; deferring removal (restored in pending)
18:32:45.615 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:45.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535565621 for job 9de81db54be40687a2a82164db1dc50b.
18:32:45.634 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 9de81db54be40687a2a82164db1dc50b (4988 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
18:32:45.635 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
18:32:45.636 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 88f0ae0bb38e9a1ca7b5f5cdd1e03f141fcb9d888f37bca6ef230cc1a5a84b49 from pending
18:32:45.636 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 8c0f072ecf87870db042732f2f0fa9ed570519e7a53f3b702165d0a38bd63c57 from pending
18:32:45.636 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 0a8bc77a0b703467382094613951ff32aaef00db46d8b415c107f4e7b3192356 from pending
18:32:45.636 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 3 finished splits from enumerator state
18:32:45.637 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:45.641 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:45.660 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:45.660 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:45.660 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:45.660 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
18:32:45.675 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361675612160001) for scanner KuduScanner(table=replication_test_table, tablet=007ce0b42486462cb7e00e1363a68404, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:45.676 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [af3ecb4349862fd68602cfe18c0cfe6f367fa4454f5e5710138dfbe567670f20]
18:32:45.676 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [af3ecb4349862fd68602cfe18c0cfe6f367fa4454f5e5710138dfbe567670f20]
18:32:45.676 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
18:32:45.676 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
18:32:45.677 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split af3ecb4349862fd68602cfe18c0cfe6f367fa4454f5e5710138dfbe567670f20 finished by subtask 2; deferring removal (restored in pending)
18:32:45.678 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:45.678 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:45.708 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:45.711 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:45.715 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:45.724 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:45.731 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xabe448cf, L:/127.0.0.1:41980 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:45.738 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:45.765 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:45.766 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:45.766 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:45.766 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.766 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.766 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.767 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361675612160001) for scanner KuduScanner(table=replication_test_table, tablet=0c25f7b288564110a208c9c3d924a97b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:45.767 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.767 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.767 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.767 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [cff51eb9ba0bfd0b3c2694d481275e4a30cbe9a529a9d89c80f3f98515b908c7]
18:32:45.767 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.767 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.767 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.767 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [cff51eb9ba0bfd0b3c2694d481275e4a30cbe9a529a9d89c80f3f98515b908c7]
18:32:45.767 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:45.768 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
18:32:45.768 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
18:32:45.769 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split cff51eb9ba0bfd0b3c2694d481275e4a30cbe9a529a9d89c80f3f98515b908c7 finished by subtask 0; deferring removal (restored in pending)
18:32:45.769 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:45.770 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:45.770 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:45.770 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:45.771 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
18:32:45.772 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:45.784 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:45.784 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:45.784 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:45.785 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.785 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.785 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.785 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.785 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.785 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.785 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.786 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.786 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.786 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:45.795 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:45.801 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:45.804 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:45.805 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:45.805 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:45.805 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.805 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.805 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:45.806 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.806 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.806 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:45.806 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.806 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.806 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:45.806 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:45.818 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:45.818 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:45.818 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:32:45.818 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
18:32:45.830 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:45.833 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:45.833 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:45.834 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:45.834 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
18:32:45.838 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:45.840 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x93847f0c, L:/127.0.0.1:41982 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:45.853 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:45.853 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:45.853 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:45.853 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
18:32:45.857 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:45.857 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:45.857 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:45.858 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:45.858 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:45.858 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:45.858 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:45.858 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:45.858 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:45.858 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:45.859 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:45.859 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:45.859 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:45.869 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361675612160001) for scanner KuduScanner(table=replication_test_table, tablet=fa1ae6554a4f44edb298443dd03f3989, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:45.869 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [4a00ddbe71afddaebfdb29861774e6e54f3ac7d5b1950945362938aa7e90493d]
18:32:45.869 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [4a00ddbe71afddaebfdb29861774e6e54f3ac7d5b1950945362938aa7e90493d]
18:32:45.870 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
18:32:45.870 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
18:32:45.870 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 4a00ddbe71afddaebfdb29861774e6e54f3ac7d5b1950945362938aa7e90493d finished by subtask 1; deferring removal (restored in pending)
18:32:45.871 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:45.878 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:45.909 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:45.909 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:45.909 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:45.910 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
18:32:46.012 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:46.013 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:46.013 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:46.013 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:46.013 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:46.014 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:46.014 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:46.014 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:46.014 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:46.013 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:46.014 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:46.014 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:46.014 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:46.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535566121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:46.133 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 9de81db54be40687a2a82164db1dc50b (2984 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:32:46.135 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
18:32:46.135 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 4a00ddbe71afddaebfdb29861774e6e54f3ac7d5b1950945362938aa7e90493d from pending
18:32:46.135 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split af3ecb4349862fd68602cfe18c0cfe6f367fa4454f5e5710138dfbe567670f20 from pending
18:32:46.135 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split cff51eb9ba0bfd0b3c2694d481275e4a30cbe9a529a9d89c80f3f98515b908c7 from pending
18:32:46.135 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 9 complete: removed 3 finished splits from enumerator state
18:32:46.212 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:46.215 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:46.216 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:46.216 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:46.216 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:46.216 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:46.217 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:46.217 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:46.217 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:46.217 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:46.217 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:46.218 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:46.218 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:46.218 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:46.238 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:46.239 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:46.240 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:46.240 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:46.241 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:46.241 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:46.241 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:46.241 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:46.241 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:46.241 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:46.242 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:46.242 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:46.242 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:46.242 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:46.242 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:46.242 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:46.242 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:46.242 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:46.242 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:46.242 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:46.242 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:46.242 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:46.241 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:46.243 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:46.242 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:46.243 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:46.243 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:46.267 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:46.267 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:46.268 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:46.268 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:46.268 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:46.268 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:46.268 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:46.268 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:46.268 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:46.268 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:46.268 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:46.268 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:46.269 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:46.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:46.367 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:46.367 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:46.368 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:46.368 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:46.368 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:46.368 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:46.368 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:46.368 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:46.368 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:46.368 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:46.368 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:46.368 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:46.368 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:46.408 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:46.408 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:46.408 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:46.408 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:46.408 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:46.408 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:46.409 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:46.409 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:46.409 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:46.409 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:46.409 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:46.409 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:46.409 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:46.441 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:46.442 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:46.442 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:46.442 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:46.442 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:46.442 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:46.442 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:46.443 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:46.443 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:46.443 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:46.443 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:46.443 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:46.443 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:46.463 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:46.464 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:46.464 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:46.464 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:46.464 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:46.464 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:46.465 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:46.465 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:46.465 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:46.465 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:46.465 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:46.465 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:46.465 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:46.565 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:46.566 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:46.566 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:46.566 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:46.567 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:46.567 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:46.567 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:46.567 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:46.567 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:46.567 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:46.567 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:46.567 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:46.567 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:46.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535566621 for job 9de81db54be40687a2a82164db1dc50b.
18:32:46.626 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:46.626 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:46.627 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:46.628 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:46.628 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:46.628 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:46.629 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:46.629 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:46.629 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:46.629 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:46.629 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:46.629 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:46.629 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:46.634 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:32:46.635 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
18:32:46.712 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:46.715 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:46.715 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:46.715 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:46.716 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:46.716 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:46.716 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:46.716 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:46.716 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:46.716 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:46.717 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:46.717 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:46.717 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:46.717 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:46.737 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:46.838 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:46.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:32:46Z chronyd exiting
18:32:47.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535567121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:47.128 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:47.128 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:47.128 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:47.129 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:47.129 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:47.129 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:47.129 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:47.129 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:47.129 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:47.130 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:47.130 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:47.130 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:47.130 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:47.144 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=22 ms, finalizationTime=1 ms).
18:32:47.148 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
18:32:47.174 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:47.175 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:47.175 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:47.175 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:47.175 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:47.175 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:47.175 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:47.175 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:47.175 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:47.175 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:47.176 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:47.176 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:47.176 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:47.212 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:47.237 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:47.340 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 6b086cbb915d4f34838e5ef58717ef47
18:32:47.341 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:47.341 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:47.341 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:47.341 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:47.342 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:47.342 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:47.342 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:47.342 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:47.342 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:47.342 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:47.342 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:47.342 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:47.342 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:47.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:47.355 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bf82abb9dff341cf9fe05a19552b4e99 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
18:32:47.355 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 007ce0b42486462cb7e00e1363a68404 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
18:32:47.355 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d886241527f4f569f6d9abed2c4c8aa for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
18:32:47.355 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 4eb9e4eed973435997d975ece849ca7a for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
18:32:47.355 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet fa1ae6554a4f44edb298443dd03f3989 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
18:32:47.355 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 0c25f7b288564110a208c9c3d924a97b for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
18:32:47.355 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=bf82abb9dff341cf9fe05a19552b4e99@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=007ce0b42486462cb7e00e1363a68404@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=3d886241527f4f569f6d9abed2c4c8aa@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=4eb9e4eed973435997d975ece849ca7a@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=fa1ae6554a4f44edb298443dd03f3989@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=0c25f7b288564110a208c9c3d924a97b@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
18:32:47.359 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e0188504d2cf3a6cb18ba24c837825de459ef24abc40a5538337a17541e8ec71'}]
18:32:47.361 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:47.361 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
18:32:47.362 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299998, tablet=bf82abb9dff341cf9fe05a19552b4e99@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}]
18:32:47.363 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8500d02dc117838774411e6377a50834b516adde9ad844b1d9687eb02717afd7'}]
18:32:47.365 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:47.365 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
18:32:47.365 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='78c842dd39ff69482be906f4fdf41fe69761f2dc528eef91c2c262e8cb64101e'}]
18:32:47.365 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299998, tablet=007ce0b42486462cb7e00e1363a68404@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}]
18:32:47.366 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:47.366 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 6
18:32:47.367 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='f40e374b69872830de71bd00923435d729a22b9e13a2aca2c8500e48999409be'}]
18:32:47.367 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299997, tablet=3d886241527f4f569f6d9abed2c4c8aa@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)[L],f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}]
18:32:47.368 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:47.368 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
18:32:47.368 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299997, tablet=4eb9e4eed973435997d975ece849ca7a@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)[L],6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)]}]
18:32:47.375 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:47.387 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:47.388 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:47.389 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:47.400 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:47.401 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:47.401 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:47.401 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:47.401 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:47.402 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:47.402 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:47.402 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:47.402 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:47.402 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:47.402 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:47.402 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:47.403 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:47.404 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:47.406 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:47.406 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:47.406 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:47.407 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:47.407 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:47.407 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:47.407 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:47.407 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:47.407 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:47.408 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:47.408 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:47.408 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:47.409 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:47.414 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:47.418 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:47.419 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:47.419 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:47.419 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:47.419 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:47.419 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:47.420 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:47.420 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:47.420 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:47.420 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:47.420 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:47.420 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:47.420 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:47.455 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:47.456 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:47.463 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:47.467 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:47.468 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:47.476 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:47.480 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:47.482 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xed22b4d7, L:/127.0.0.1:41986 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:47.487 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6007bf82, L:/127.0.0.1:42002 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:47.493 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:47.510 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:47.513 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:47.519 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x17e0d0b9, L:/127.0.0.1:42010 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:47.533 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa4be8517, L:/127.0.0.1:42016 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:47.544 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361683804160001) for scanner KuduScanner(table=replication_test_table, tablet=bf82abb9dff341cf9fe05a19552b4e99, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:47.544 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [e0188504d2cf3a6cb18ba24c837825de459ef24abc40a5538337a17541e8ec71]
18:32:47.544 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e0188504d2cf3a6cb18ba24c837825de459ef24abc40a5538337a17541e8ec71]
18:32:47.545 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
18:32:47.545 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
18:32:47.547 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e0188504d2cf3a6cb18ba24c837825de459ef24abc40a5538337a17541e8ec71 finished by subtask 3; deferring removal (restored in pending)
18:32:47.548 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:47.549 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='ce8d39c3c1e1f7c262960556c1ebe8aff8185280317eb5473ed05b9cf32a7ee9'}]
18:32:47.551 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:47.555 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
18:32:47.556 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299997, tablet=fa1ae6554a4f44edb298443dd03f3989@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)[L]]}]
18:32:47.558 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:47.563 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361683804160001) for scanner KuduScanner(table=replication_test_table, tablet=4eb9e4eed973435997d975ece849ca7a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:47.563 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [f40e374b69872830de71bd00923435d729a22b9e13a2aca2c8500e48999409be]
18:32:47.563 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [f40e374b69872830de71bd00923435d729a22b9e13a2aca2c8500e48999409be]
18:32:47.564 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
18:32:47.564 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
18:32:47.564 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:47.565 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:47.565 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:47.566 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split f40e374b69872830de71bd00923435d729a22b9e13a2aca2c8500e48999409be finished by subtask 1; deferring removal (restored in pending)
18:32:47.567 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8ff4e67b5ae58bbbeafba609d051fa667d522912c1957ae7a1b4a7e853b43601'}]
18:32:47.570 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:47.570 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 6
18:32:47.571 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299997, tablet=0c25f7b288564110a208c9c3d924a97b@[50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979),6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953),f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)[L]]}]
18:32:47.575 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:47.577 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:47.584 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:47.584 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:47.584 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:47.584 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
18:32:47.586 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] connecting to peer
18:32:47.588 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:47.588 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:47.589 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:32:47.589 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
18:32:47.590 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] Successfully connected to peer
18:32:47.592 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.96.129
18:32:47.594 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:47.602 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:32:47.607 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x49e863c6, L:/127.0.0.1:42038 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:47.607 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x753d7763, L:/127.0.0.1:42024 - R:/127.2.96.129:42953] using SASL/PLAIN
18:32:47.618 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361683804160001) for scanner KuduScanner(table=replication_test_table, tablet=fa1ae6554a4f44edb298443dd03f3989, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:47.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535567621 for job 9de81db54be40687a2a82164db1dc50b.
18:32:47.625 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [ce8d39c3c1e1f7c262960556c1ebe8aff8185280317eb5473ed05b9cf32a7ee9]
18:32:47.625 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [ce8d39c3c1e1f7c262960556c1ebe8aff8185280317eb5473ed05b9cf32a7ee9]
18:32:47.626 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
18:32:47.626 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
18:32:47.626 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:47.627 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:47.630 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split ce8d39c3c1e1f7c262960556c1ebe8aff8185280317eb5473ed05b9cf32a7ee9 finished by subtask 3; deferring removal (restored in pending)
18:32:47.635 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 9de81db54be40687a2a82164db1dc50b (4988 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
18:32:47.640 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
18:32:47.640 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split ce8d39c3c1e1f7c262960556c1ebe8aff8185280317eb5473ed05b9cf32a7ee9 from pending
18:32:47.640 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split e0188504d2cf3a6cb18ba24c837825de459ef24abc40a5538337a17541e8ec71 from pending
18:32:47.640 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split f40e374b69872830de71bd00923435d729a22b9e13a2aca2c8500e48999409be from pending
18:32:47.640 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 12 complete: removed 3 finished splits from enumerator state
18:32:47.643 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361683804160001) for scanner KuduScanner(table=replication_test_table, tablet=3d886241527f4f569f6d9abed2c4c8aa, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:47.643 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [78c842dd39ff69482be906f4fdf41fe69761f2dc528eef91c2c262e8cb64101e]
18:32:47.643 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [78c842dd39ff69482be906f4fdf41fe69761f2dc528eef91c2c262e8cb64101e]
18:32:47.644 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 6 because it is idle.
18:32:47.644 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 6
18:32:47.644 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:47.645 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:47.645 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 78c842dd39ff69482be906f4fdf41fe69761f2dc528eef91c2c262e8cb64101e finished by subtask 0; deferring removal (restored in pending)
18:32:47.647 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:47.647 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:47.647 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
18:32:47.647 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
18:32:47.660 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:47.660 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:47.660 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:47.661 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 6 exited.
18:32:47.663 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361683804160001) for scanner KuduScanner(table=replication_test_table, tablet=007ce0b42486462cb7e00e1363a68404, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:47.663 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [8500d02dc117838774411e6377a50834b516adde9ad844b1d9687eb02717afd7]
18:32:47.664 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8500d02dc117838774411e6377a50834b516adde9ad844b1d9687eb02717afd7]
18:32:47.664 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
18:32:47.664 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
18:32:47.665 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8500d02dc117838774411e6377a50834b516adde9ad844b1d9687eb02717afd7 finished by subtask 2; deferring removal (restored in pending)
18:32:47.666 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:47.667 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361683804160001) for scanner KuduScanner(table=replication_test_table, tablet=0c25f7b288564110a208c9c3d924a97b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:32:47.667 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [8ff4e67b5ae58bbbeafba609d051fa667d522912c1957ae7a1b4a7e853b43601]
18:32:47.667 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:47.667 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8ff4e67b5ae58bbbeafba609d051fa667d522912c1957ae7a1b4a7e853b43601]
18:32:47.668 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 6 because it is idle.
18:32:47.668 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 6
18:32:47.669 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:47.669 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8ff4e67b5ae58bbbeafba609d051fa667d522912c1957ae7a1b4a7e853b43601 finished by subtask 1; deferring removal (restored in pending)
18:32:47.669 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:47.675 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:47.675 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:47.675 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:47.676 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
18:32:47.678 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:47.678 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:47.678 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:47.678 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 6 exited.
18:32:47.712 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:47.737 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:47.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:47.845 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:47.845 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:47.845 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:47.846 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:47.846 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:47.846 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:47.846 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:47.846 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:47.846 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:47.846 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:47.846 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:47.847 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:47.847 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:47.923 [DEBUG - main] (Connection.java:575) [peer f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)] disconnecting while in state READY
18:32:47.923 [DEBUG - main] (Connection.java:575) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] disconnecting while in state READY
18:32:47.923 [DEBUG - main] (Connection.java:575) [peer master-127.2.96.189:33339(127.2.96.189:33339)] disconnecting while in state READY
18:32:47.923 [DEBUG - main] (Connection.java:575) [peer master-127.2.96.188:32989(127.2.96.188:32989)] disconnecting while in state READY
18:32:47.923 [DEBUG - main] (Connection.java:575) [peer master-127.2.96.190:44161(127.2.96.190:44161)] disconnecting while in state READY
18:32:47.924 [DEBUG - main] (Connection.java:575) [peer 50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)] disconnecting while in state READY
18:32:47.924 [DEBUG - kudu-nio-4] (Connection.java:239) [peer f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)] handling channelInactive
18:32:47.924 [DEBUG - kudu-nio-4] (Connection.java:709) [peer f996ea4859274e2fa9d44a503fa0aa5a(127.2.96.130:36745)] cleaning up while in state READY due to: connection closed
18:32:47.925 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] handling channelInactive
18:32:47.925 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 6eacdcba4a9042a9a0000123e8be6eb8(127.2.96.129:42953)] cleaning up while in state READY due to: connection closed
18:32:47.925 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.96.189:33339(127.2.96.189:33339)] handling channelInactive
18:32:47.925 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state READY due to: connection closed
18:32:47.925 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.96.188:32989(127.2.96.188:32989)] handling channelInactive
18:32:47.926 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state READY due to: connection closed
18:32:47.926 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.96.190:44161(127.2.96.190:44161)] handling channelInactive
18:32:47.926 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state READY due to: connection closed
18:32:47.926 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:47.931 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
18:32:47.931 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
18:32:47.931 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:32:47.932 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-5
18:32:47.932 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-4
18:32:47.932 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)] handling channelInactive
18:32:47.932 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 50ba3f6f15704aa1a07abe18d2d4b153(127.2.96.131:37979)] cleaning up while in state READY due to: connection closed
18:32:47.932 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
18:32:47.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:47.933578  2434 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 2738
18:32:47.943 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:47.944 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:47.944 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:47.944 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:47.944 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:47.944 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:47.945 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:47.945 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:47.945 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:47.945 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:47.945 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:47.945 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:47.945 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:47.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:47.994717  2434 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 2883
18:32:48.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:48.035004  3126 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.96.129:42953: connect: Connection refused (error 111)
18:32:48.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:48.046561  3126 consensus_peers.cc:597] T 007ce0b42486462cb7e00e1363a68404 P 50ba3f6f15704aa1a07abe18d2d4b153 -> Peer 6eacdcba4a9042a9a0000123e8be6eb8 (127.2.96.129:42953): Couldn't send request to peer 6eacdcba4a9042a9a0000123e8be6eb8. Status: Network error: Client connection negotiation failed: client connection to 127.2.96.129:42953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
18:32:48.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:48.056466  2434 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 3046
18:32:48.078 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:48.078 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:48.078 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:48.079 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:48.079 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:48.079 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:48.079 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:48.079 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:48.079 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:48.079 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:48.079 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:48.079 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:48.079 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:48.097 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:48.098 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:48.098 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:48.098 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:48.098 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:48.098 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:48.098 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:48.098 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:48.098 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:48.098 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:48.098 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:48.098 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:48.098 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:48.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:48.106274  2434 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 2447
18:32:48.123 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535568121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:48.133 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 9de81db54be40687a2a82164db1dc50b (2976 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:32:48.134 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
18:32:48.134 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split 78c842dd39ff69482be906f4fdf41fe69761f2dc528eef91c2c262e8cb64101e from pending
18:32:48.134 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split 8500d02dc117838774411e6377a50834b516adde9ad844b1d9687eb02717afd7 from pending
18:32:48.134 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split 8ff4e67b5ae58bbbeafba609d051fa667d522912c1957ae7a1b4a7e853b43601 from pending
18:32:48.134 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 13 complete: removed 3 finished splits from enumerator state
18:32:48.141 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:48.141 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:48.141 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:48.141 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:48.141 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:48.142 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:48.142 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:48.142 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:48.142 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:48.142 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:48.142 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:48.142 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:48.142 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:48.146 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.96.190:44161(127.2.96.190:44161)] handling channelInactive
18:32:48.146 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state READY due to: connection closed
18:32:48.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:48.148337  2434 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 2517
18:32:48.172 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:48.173 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:48.173 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:48.173 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:48.173 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:48.173 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:48.173 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:48.173 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:48.173 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:48.173 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:48.173 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:48.173 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:48.173 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:48.184 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.96.189:33339(127.2.96.189:33339)] handling channelInactive
18:32:48.184 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state READY due to: connection closed
18:32:48.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:48.184686  2434 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 2592
18:32:48.212 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:48.226 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.96.188:32989(127.2.96.188:32989)] handling channelInactive
18:32:48.226 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state READY due to: connection closed
18:32:48.237 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:48.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:48.587 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:48.587 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:48.587 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:48.588 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:48.588 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:48.588 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:48.588 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:48.588 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:48.588 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:48.588 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:48.588 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:48.588 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:48.588 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:48.621 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535568621 for job 9de81db54be40687a2a82164db1dc50b.
18:32:48.631 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:32:48.632 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
18:32:48.711 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:48.738 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:48.838 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:48.848 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:48.848 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:48.848 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:48.848 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:48.848 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:48.848 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:48.848 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:48.849 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:48.849 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:48.849 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:48.849 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:48.849 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:48.849 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:48.988 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:48.988 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:48.988 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:48.988 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:48.989 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:48.989 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:48.989 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:48.989 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:48.989 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:48.989 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:48.989 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:48.989 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:48.989 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:49.084 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:49.084 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:49.084 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:49.084 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:49.084 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:49.085 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:49.085 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:49.085 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:49.085 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:49.085 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:49.085 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:49.085 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:49.085 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:49.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535569121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:49.131 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:32:49.132 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
18:32:49.157 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:49.158 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:49.158 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:49.158 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:49.158 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:49.159 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:49.159 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:49.159 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:49.159 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:49.159 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:49.159 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:49.159 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:49.159 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:49.211 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:49.238 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:49.336 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:49.337 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.337 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.337 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.2.96.188:32989(127.2.96.188:32989) for tablet Kudu Master: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:49.348 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:49.349 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:49.350 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.350 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:49.350 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.350 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.350 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.350 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.350 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.350 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.350 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.350 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.351 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:32:49.368 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:49.369 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:49.369 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:49.370 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.370 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.370 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.370 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.370 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.370 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.370 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.370 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.370 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.370 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:32:49.388 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:49.388 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:49.388 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:49.388 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.388 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.388 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.388 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.388 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.388 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.389 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.389 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.389 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.389 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:32:49.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:32:49Z chronyd exiting
18:32:49.407 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:49.408 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:49.408 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:49.408 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.408 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.408 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.408 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.408 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.408 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.408 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.408 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.408 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.409 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:32:49.428 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:49.429 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:49.429 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:49.429 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.429 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.429 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.429 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.429 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.429 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.429 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.429 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.430 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.430 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:32:49.468 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:49.468 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:49.468 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:49.468 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.468 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.468 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.468 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.468 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.468 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.468 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.468 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.468 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.469 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:32:49.588 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:49.588 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:49.589 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:49.589 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.589 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.589 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.589 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.589 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.589 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.589 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.589 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.589 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.589 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:32:49.608 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:49.608 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:49.608 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:49.608 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.608 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.609 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.609 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.609 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.609 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.609 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.609 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.609 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.609 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:32:49.621 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:49.621 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:49.621 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:49.621 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:49.621 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:49.621 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:49.621 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:49.622 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:49.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535569621 for job 9de81db54be40687a2a82164db1dc50b.
18:32:49.622 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:49.622 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:49.622 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:49.622 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:49.622 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:49.629 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:32:49.630 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
18:32:49.656 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:49.656 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:49.656 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:49.656 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:49.656 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:49.656 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:49.656 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:49.656 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:49.656 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:49.656 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:49.656 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:49.656 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:49.657 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:49.711 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:49.738 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:49.823 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:49.824 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:49.824 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:49.824 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:49.824 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:49.824 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:49.824 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:49.824 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:49.824 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:49.824 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:49.824 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:49.824 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:49.824 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:49.838 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:49.908 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:49.908 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:49.909 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:49.909 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.909 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.909 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.909 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.909 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:49.909 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:49.909 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.909 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.909 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:49.909 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:32:49.965 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:49.965 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:49.965 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:49.965 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:49.966 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:49.966 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:49.966 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:49.966 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:49.966 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:49.966 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:49.966 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:49.966 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:49.966 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:50.007 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:50.008 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:50.008 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:50.008 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:50.008 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:50.008 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:50.008 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:50.008 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:50.008 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:50.009 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:50.009 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:50.009 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:50.009 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:50.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535570121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:50.129 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:32:50.130 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
18:32:50.212 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:50.238 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:50.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
.18:32:50.442 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783535570442
18:32:50.442 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783535570442
18:32:50.447 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
18:32:50.451 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
18:32:50.451 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
18:32:50.451 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskSwO0Je/test-tmp
18:32:50.451 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
18:32:50.452 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskSwO0Je/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
18:32:50.455 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

18:32:50.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535570621 for job 9de81db54be40687a2a82164db1dc50b.
18:32:50.630 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:32:50.631 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
18:32:50.712 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:50.737 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:50.812 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:32:50.812 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

18:32:50.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:50.815711  4812 mini_oidc.cc:150] Starting JWKS server
18:32:50.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:50.819213  4812 webserver.cc:534] Webserver started at http://127.0.0.1:39497/ using document root <none> and password file <none>
18:32:50.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:50.819674  4812 mini_oidc.cc:186] Starting OIDC Discovery server
18:32:50.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:50.821537  4812 webserver.cc:534] Webserver started at http://127.0.0.1:34985/ using document root <none> and password file <none>
18:32:50.828 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:50.828 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:50.828 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:50.828 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:50.828 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:50.828 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:50.828 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:50.828 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:50.828 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:50.828 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:50.829 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:50.829 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:50.829 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:32:50.838 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:50.901 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:50.902 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:50.902 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:50.902 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:50.902 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:50.902 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:50.902 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:50.902 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:50.902 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:50.902 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:50.902 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:50.902 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:50.902 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:50.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:32:50Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
18:32:50.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:32:50Z Disabled control of system clock
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:50.923161  4812 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/wal
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/data
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/logs
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/data/info.pb
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:32:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.179.62:35121
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.179.62
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.179.20:42683
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.179.62:35121,127.4.179.61:44733,127.4.179.60:34679
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39497/jwks.json with env {}
18:32:50.994 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:50.995 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:50.995 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:50.995 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:50.995 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:50.995 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:50.995 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:50.995 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:50.995 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:50.995 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:50.995 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:50.995 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:50.995 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:51.007 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:51.007 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:51.007 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:51.007 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:51.007 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:51.007 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:51.007 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:51.008 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:51.008 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:51.008 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:51.008 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:51.008 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:51.008 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:51.123 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535571121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:51.132 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:32:51.133 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
18:32:51.212 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:51.237 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:51.245 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:51.245 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:51.246 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:51.246 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:51.246 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:51.246 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:51.246 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:51.246 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:51.246 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:51.246 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:51.246 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:51.246 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:51.246 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:51.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:51.269980  4824 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:32:51.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:51.270550  4824 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:32:51.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:51.271166  4824 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:32:51.277 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:51.277 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:51.277 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:51.278 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:51.278 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:51.278 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:51.278 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:51.278 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:51.278 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:51.278 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:51.278 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:51.278 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:51.278 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:51.299 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:51.299 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:51.299 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:51.300 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:51.300 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:51.300 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:51.300 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:51.300 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:51.300 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:51.300 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:51.300 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:51.300 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:51.300 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:51.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:51.309232  4824 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:32:51.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:51.309646  4824 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:32:51.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:51.309964  4824 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:32:51.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:51.310266  4824 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:32:51.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:51.310567  4824 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:32:51.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:51.310807  4824 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39497/jwks.json
18:32:51.337 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:51.350814  4824 master_runner.cc:387] Master server non-default flags:
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.179.20:42683
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/data
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/wal
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.179.62:35121,127.4.179.61:44733,127.4.179.60:34679
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.179.62:35121
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39497/jwks.json
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/data/info.pb
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.179.62
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/logs
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:32:51.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:32:51.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:51.352435  4824 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:32:51.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:51.354179  4824 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:32:51.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:51.365777  4830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:51.366 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:51.367 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:51.367 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:51.367 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:51.367 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:51.367 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:51.367 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:51.367 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:51.367 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:51.368 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:51.368 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:51.368 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:51.368 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:51.488 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:51.488 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:51.488 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:51.489 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:51.489 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:51.489 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:51.490 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:51.490 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:51.490 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:51.491 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:51.491 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:51.491 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:51.491 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:32:51.623 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535571622 for job 9de81db54be40687a2a82164db1dc50b.
18:32:51.635 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:32:51.636 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
18:32:51.712 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:51.737 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:51.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:51.927 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:51.928 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:51.928 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:51.928 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:51.928 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:51.928 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:51.929 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:51.929 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:51.929 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:51.928 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:51.929 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:51.929 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:51.929 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:51.967 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:51.968 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:51.968 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:51.969 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:51.969 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:51.969 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:51.969 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:51.969 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:51.969 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:51.969 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:51.969 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:51.969 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:51.969 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:51.997 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:51.998 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:51.998 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:51.998 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:51.998 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:51.999 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:51.999 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:51.999 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:51.999 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:51.999 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:51.999 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:51.999 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:51.999 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:52.032 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:52.033 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:52.033 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:52.033 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:52.033 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:52.033 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:52.033 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:52.033 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:52.033 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:52.034 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:52.034 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:52.034 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:52.034 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:52.083 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:52.084 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:52.084 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:52.084 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:52.084 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:52.085 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:52.085 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:52.085 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:52.085 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:52.085 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:52.085 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:52.085 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:52.085 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:52.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535572121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:52.137 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
18:32:52.138 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
18:32:52.215 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:52.233 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:52.233 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:52.233 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:52.234 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:52.234 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:52.234 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:52.235 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:52.235 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:52.235 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:52.235 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:52.235 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:52.235 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:52.235 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:52.238 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:52.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:52.457 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:52.457 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:52.457 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:52.458 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:52.458 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:52.458 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:52.458 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:52.458 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:52.458 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:52.458 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:52.458 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:52.458 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:52.458 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:52.537 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:52.538 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:52.538 [DEBUG - pool-182-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:52.538 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:52.538 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:52.538 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:52.538 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:52.538 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:52.538 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:52.539 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:52.539 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:52.539 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:52.539 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:52.539 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26941), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [52ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [53ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [54ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [55ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [68ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [69ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [69ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [69ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [168ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [169ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [170ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [170ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [171ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [184ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [184ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [204ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [204ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [244ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [244ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [303ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [424ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [442ms] refreshing cache from master, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [443ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [444ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [445ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [445ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [943ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [944ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [944ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [944ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1840ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1844ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1844ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3861ms] refreshing cache from master, [3861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3864ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3864ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [6201ms] refreshing cache from master, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [6202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [6202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [6203ms] too many traces: truncated at 100 traces, deferred=Deferred@570890612(state=PENDING, result=null, callback=(continuation of Deferred@729157752 after retry RPC after error@285866292) -> (continuation of Deferred@1080078604 after retry RPC after error@1521929421) -> (continuation of Deferred@1104732723 after retry RPC after error@533095269) -> (continuation of Deferred@1516984640 after retry RPC after error@911681124) -> (continuation of Deferred@815301607 after retry RPC after error@476644314) -> (continuation of Deferred@482928718 after retry RPC after error@329488821) -> (continuation of Deferred@1733343133 after retry RPC after error@871567230) -> (continuation of Deferred@1755454422 after retry RPC after error@1732467014) -> (continuation of Deferred@97379948 after retry RPC after error@787386708) -> (continuation of Deferred@1449808884 after retry RPC after error@731822358) -> (continuation of Deferred@1091224719 after retry RPC after error@464820683) -> (continuation of Deferred@524651706 after retry RPC after error@1104003149) -> (continuation of Deferred@1458854471 after retry RPC after error@1773267859) -> (continuation of Deferred@1512217155 after retry RPC after error@1975707362) -> (continuation of Deferred@17874047 after retry RPC after error@1729831613) -> (continuation of Deferred@690310303 after retry RPC after error@1261587119) -> (continuation of Deferred@1329980658 after retry RPC after error@1903503725) -> (continuation of Deferred@1916260968 after retry RPC after error@722045363) -> (continuation of Deferred@1259051604 after retry RPC after error@334359577) -> (continuation of Deferred@1602603166 after retry RPC after error@950441676) -> (continuation of Deferred@795374262 after retry RPC after error@1394204262) -> (continuation of Deferred@581516707 after retry RPC after error@783667148) -> (continuation of Deferred@1109714286 after retry RPC after error@1607727522) -> (continuation of Deferred@880575454 after retry RPC after error@884465970), errback=(continuation of Deferred@729157752 after retry RPC after error@285866292) -> (continuation of Deferred@1080078604 after retry RPC after error@1521929421) -> (continuation of Deferred@1104732723 after retry RPC after error@533095269) -> (continuation of Deferred@1516984640 after retry RPC after error@911681124) -> (continuation of Deferred@815301607 after retry RPC after error@476644314) -> (continuation of Deferred@482928718 after retry RPC after error@329488821) -> (continuation of Deferred@1733343133 after retry RPC after error@871567230) -> (continuation of Deferred@1755454422 after retry RPC after error@1732467014) -> (continuation of Deferred@97379948 after retry RPC after error@787386708) -> (continuation of Deferred@1449808884 after retry RPC after error@731822358) -> (continuation of Deferred@1091224719 after retry RPC after error@464820683) -> (continuation of Deferred@524651706 after retry RPC after error@1104003149) -> (continuation of Deferred@1458854471 after retry RPC after error@1773267859) -> (continuation of Deferred@1512217155 after retry RPC after error@1975707362) -> (continuation of Deferred@17874047 after retry RPC after error@1729831613) -> (continuation of Deferred@690310303 after retry RPC after error@1261587119) -> (continuation of Deferred@1329980658 after retry RPC after error@1903503725) -> (continuation of Deferred@1916260968 after retry RPC after error@722045363) -> (continuation of Deferred@1259051604 after retry RPC after error@334359577) -> (continuation of Deferred@1602603166 after retry RPC after error@950441676) -> (continuation of Deferred@795374262 after retry RPC after error@1394204262) -> (continuation of Deferred@581516707 after retry RPC after error@783667148) -> (continuation of Deferred@1109714286 after retry RPC after error@1607727522) -> (continuation of Deferred@880575454 after retry RPC after error@884465970)))
18:32:52.540 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
18:32:52.540 [WARN - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26941), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [52ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [53ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [54ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [55ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [68ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [69ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [69ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [69ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [168ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [169ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [170ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [170ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [171ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [184ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [184ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [204ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [204ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [244ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [244ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [303ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [424ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [442ms] refreshing cache from master, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [443ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [444ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [445ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [445ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [943ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [944ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [944ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [944ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1840ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1844ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1844ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3861ms] refreshing cache from master, [3861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3864ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3864ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [6201ms] refreshing cache from master, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [6202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [6202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [6203ms] too many traces: truncated at 100 traces, deferred=Deferred@570890612(state=PENDING, result=null, callback=(continuation of Deferred@729157752 after retry RPC after error@285866292) -> (continuation of Deferred@1080078604 after retry RPC after error@1521929421) -> (continuation of Deferred@1104732723 after retry RPC after error@533095269) -> (continuation of Deferred@1516984640 after retry RPC after error@911681124) -> (continuation of Deferred@815301607 after retry RPC after error@476644314) -> (continuation of Deferred@482928718 after retry RPC after error@329488821) -> (continuation of Deferred@1733343133 after retry RPC after error@871567230) -> (continuation of Deferred@1755454422 after retry RPC after error@1732467014) -> (continuation of Deferred@97379948 after retry RPC after error@787386708) -> (continuation of Deferred@1449808884 after retry RPC after error@731822358) -> (continuation of Deferred@1091224719 after retry RPC after error@464820683) -> (continuation of Deferred@524651706 after retry RPC after error@1104003149) -> (continuation of Deferred@1458854471 after retry RPC after error@1773267859) -> (continuation of Deferred@1512217155 after retry RPC after error@1975707362) -> (continuation of Deferred@17874047 after retry RPC after error@1729831613) -> (continuation of Deferred@690310303 after retry RPC after error@1261587119) -> (continuation of Deferred@1329980658 after retry RPC after error@1903503725) -> (continuation of Deferred@1916260968 after retry RPC after error@722045363) -> (continuation of Deferred@1259051604 after retry RPC after error@334359577) -> (continuation of Deferred@1602603166 after retry RPC after error@950441676) -> (continuation of Deferred@795374262 after retry RPC after error@1394204262) -> (continuation of Deferred@581516707 after retry RPC after error@783667148) -> (continuation of Deferred@1109714286 after retry RPC after error@1607727522) -> (continuation of Deferred@880575454 after retry RPC after error@884465970), errback=(continuation of Deferred@729157752 after retry RPC after error@285866292) -> (continuation of Deferred@1080078604 after retry RPC after error@1521929421) -> (continuation of Deferred@1104732723 after retry RPC after error@533095269) -> (continuation of Deferred@1516984640 after retry RPC after error@911681124) -> (continuation of Deferred@815301607 after retry RPC after error@476644314) -> (continuation of Deferred@482928718 after retry RPC after error@329488821) -> (continuation of Deferred@1733343133 after retry RPC after error@871567230) -> (continuation of Deferred@1755454422 after retry RPC after error@1732467014) -> (continuation of Deferred@97379948 after retry RPC after error@787386708) -> (continuation of Deferred@1449808884 after retry RPC after error@731822358) -> (continuation of Deferred@1091224719 after retry RPC after error@464820683) -> (continuation of Deferred@524651706 after retry RPC after error@1104003149) -> (continuation of Deferred@1458854471 after retry RPC after error@1773267859) -> (continuation of Deferred@1512217155 after retry RPC after error@1975707362) -> (continuation of Deferred@17874047 after retry RPC after error@1729831613) -> (continuation of Deferred@690310303 after retry RPC after error@1261587119) -> (continuation of Deferred@1329980658 after retry RPC after error@1903503725) -> (continuation of Deferred@1916260968 after retry RPC after error@722045363) -> (continuation of Deferred@1259051604 after retry RPC after error@334359577) -> (continuation of Deferred@1602603166 after retry RPC after error@950441676) -> (continuation of Deferred@795374262 after retry RPC after error@1394204262) -> (continuation of Deferred@581516707 after retry RPC after error@783667148) -> (continuation of Deferred@1109714286 after retry RPC after error@1607727522) -> (continuation of Deferred@880575454 after retry RPC after error@884465970)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:52.541 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_5).
18:32:52.542 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#5 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_5.
18:32:52.544 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26941), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [52ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [53ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [54ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [55ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [68ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [69ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [69ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [69ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [168ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [169ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [170ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [170ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [171ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [184ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [184ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [202ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [204ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [204ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [244ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [244ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [303ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [424ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [442ms] refreshing cache from master, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [443ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [444ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [445ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [445ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [943ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [944ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [944ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [944ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1840ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1844ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1844ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3861ms] refreshing cache from master, [3861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3863ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3864ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3864ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [6201ms] refreshing cache from master, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [6202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [6202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [6203ms] too many traces: truncated at 100 traces, deferred=Deferred@570890612(state=PENDING, result=null, callback=(continuation of Deferred@729157752 after retry RPC after error@285866292) -> (continuation of Deferred@1080078604 after retry RPC after error@1521929421) -> (continuation of Deferred@1104732723 after retry RPC after error@533095269) -> (continuation of Deferred@1516984640 after retry RPC after error@911681124) -> (continuation of Deferred@815301607 after retry RPC after error@476644314) -> (continuation of Deferred@482928718 after retry RPC after error@329488821) -> (continuation of Deferred@1733343133 after retry RPC after error@871567230) -> (continuation of Deferred@1755454422 after retry RPC after error@1732467014) -> (continuation of Deferred@97379948 after retry RPC after error@787386708) -> (continuation of Deferred@1449808884 after retry RPC after error@731822358) -> (continuation of Deferred@1091224719 after retry RPC after error@464820683) -> (continuation of Deferred@524651706 after retry RPC after error@1104003149) -> (continuation of Deferred@1458854471 after retry RPC after error@1773267859) -> (continuation of Deferred@1512217155 after retry RPC after error@1975707362) -> (continuation of Deferred@17874047 after retry RPC after error@1729831613) -> (continuation of Deferred@690310303 after retry RPC after error@1261587119) -> (continuation of Deferred@1329980658 after retry RPC after error@1903503725) -> (continuation of Deferred@1916260968 after retry RPC after error@722045363) -> (continuation of Deferred@1259051604 after retry RPC after error@334359577) -> (continuation of Deferred@1602603166 after retry RPC after error@950441676) -> (continuation of Deferred@795374262 after retry RPC after error@1394204262) -> (continuation of Deferred@581516707 after retry RPC after error@783667148) -> (continuation of Deferred@1109714286 after retry RPC after error@1607727522) -> (continuation of Deferred@880575454 after retry RPC after error@884465970), errback=(continuation of Deferred@729157752 after retry RPC after error@285866292) -> (continuation of Deferred@1080078604 after retry RPC after error@1521929421) -> (continuation of Deferred@1104732723 after retry RPC after error@533095269) -> (continuation of Deferred@1516984640 after retry RPC after error@911681124) -> (continuation of Deferred@815301607 after retry RPC after error@476644314) -> (continuation of Deferred@482928718 after retry RPC after error@329488821) -> (continuation of Deferred@1733343133 after retry RPC after error@871567230) -> (continuation of Deferred@1755454422 after retry RPC after error@1732467014) -> (continuation of Deferred@97379948 after retry RPC after error@787386708) -> (continuation of Deferred@1449808884 after retry RPC after error@731822358) -> (continuation of Deferred@1091224719 after retry RPC after error@464820683) -> (continuation of Deferred@524651706 after retry RPC after error@1104003149) -> (continuation of Deferred@1458854471 after retry RPC after error@1773267859) -> (continuation of Deferred@1512217155 after retry RPC after error@1975707362) -> (continuation of Deferred@17874047 after retry RPC after error@1729831613) -> (continuation of Deferred@690310303 after retry RPC after error@1261587119) -> (continuation of Deferred@1329980658 after retry RPC after error@1903503725) -> (continuation of Deferred@1916260968 after retry RPC after error@722045363) -> (continuation of Deferred@1259051604 after retry RPC after error@334359577) -> (continuation of Deferred@1602603166 after retry RPC after error@950441676) -> (continuation of Deferred@795374262 after retry RPC after error@1394204262) -> (continuation of Deferred@581516707 after retry RPC after error@783667148) -> (continuation of Deferred@1109714286 after retry RPC after error@1607727522) -> (continuation of Deferred@880575454 after retry RPC after error@884465970)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:52.545 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:32:52.545 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#5) of source Source: KuduSource.
18:32:52.545 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_5.
18:32:52.545 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RUNNING to RESTARTING.
18:32:52.605 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:52.606 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:52.606 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:52.606 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:52.606 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:52.606 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:52.606 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:52.606 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:52.606 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:52.607 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:52.606 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:52.607 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:52.607 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:52.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535572621 for job 9de81db54be40687a2a82164db1dc50b.
18:32:52.635 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
18:32:52.636 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
18:32:52.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:51.368119  4831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:52.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:52.685369  4833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:52.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:52.689985  4832 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1322 milliseconds
18:32:52.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.690086  4824 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:32:52.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.691887  4824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:32:52.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.695609  4824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:32:52.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.697252  4824 hybrid_clock.cc:648] HybridClock initialized: now 1783535572697214 us; error 40 us; skew 500 ppm
18:32:52.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.698518  4824 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:32:52.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.706100  4824 webserver.cc:534] Webserver started at http://127.4.179.62:32781/ using document root <none> and password file <none>
18:32:52.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.707101  4824 fs_manager.cc:362] Metadata directory not provided
18:32:52.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.707357  4824 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:32:52.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.707890  4824 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:32:52.711 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:52.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.712492  4824 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/data/instance:
18:32:52.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f8f56741aad8426f8071eb1be24cd314"
18:32:52.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:52 on dist-test-slave-dxnw"
18:32:52.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.713653  4824 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/wal/instance:
18:32:52.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f8f56741aad8426f8071eb1be24cd314"
18:32:52.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:52 on dist-test-slave-dxnw"
18:32:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.721453  4824 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
18:32:52.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.727492  4840 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:32:52.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.728747  4824 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
18:32:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.729080  4824 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/wal
18:32:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f8f56741aad8426f8071eb1be24cd314"
18:32:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:52 on dist-test-slave-dxnw"
18:32:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.729391  4824 fs_report.cc:389] FS layout report
18:32:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:32:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/wal
18:32:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/wal
18:32:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/data/data
18:32:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:32:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:32:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:32:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:32:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:32:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:32:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:32:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:32:52.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:32:52.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:32:52.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:32:52.737 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.778910  4824 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:32:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.780485  4824 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:32:52.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.780988  4824 kserver.cc:163] Server-wide thread pool size limit: 3276
18:32:52.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.862306  4824 rpc_server.cc:307] RPC server started. Bound to: 127.4.179.62:35121
18:32:52.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.862462  4891 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.179.62:35121 every 8 connection(s)
18:32:52.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.865264  4824 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/data/info.pb
18:32:52.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.871929  4892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:52.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.875957  4812 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 4824
18:32:52.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.876477  4812 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-0/wal/instance
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.881979  4812 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/wal
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/data
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/logs
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/data/info.pb
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:32:52.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:32:52.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:52.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:52.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.179.61:44733
18:32:52.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.179.61
18:32:52.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:52.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.179.20:42683
18:32:52.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:52.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:52.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:52.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:52.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.179.62:35121,127.4.179.61:44733,127.4.179.60:34679
18:32:52.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:52.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39497/jwks.json with env {}
18:32:52.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.889119  4892 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } has no permanent_uuid. Determining permanent_uuid...
18:32:52.896 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:52.896 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:52.896 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:52.897 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:52.897 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:52.897 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:52.897 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:52.897 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:52.897 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:52.898 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:52.898 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:52.898 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:52.898 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:52.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.928402  4892 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } has no permanent_uuid. Determining permanent_uuid...
18:32:52.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:52.931165  4841 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.179.61:44733: connect: Connection refused (error 111)
18:32:52.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:52.935815  4892 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.61:44733: Network error: Client connection negotiation failed: client connection to 127.4.179.61:44733: connect: Connection refused (error 111)
18:32:52.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:52.985428  4892 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } attempt: 1
18:32:52.986 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:52.986 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:52.986 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:52.987 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:52.987 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:52.987 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:52.987 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:52.987 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:52.987 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:52.987 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:52.987 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:52.987 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:52.987 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:52.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:52.991555  4892 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.61:44733: Network error: Client connection negotiation failed: client connection to 127.4.179.61:44733: connect: Connection refused (error 111)
18:32:53.012 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:53.012 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:53.013 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:53.013 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:53.013 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:53.013 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:53.013 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:53.013 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:53.013 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:53.013 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:53.013 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:53.013 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:53.013 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:53.027 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:53.028 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:53.028 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:53.028 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:53.028 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:53.028 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:53.028 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:53.028 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:53.028 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:53.028 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:53.028 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:53.028 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:53.028 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:53.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:53.059957  4892 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } attempt: 2
18:32:53.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:53.065240  4892 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.61:44733: Network error: Client connection negotiation failed: client connection to 127.4.179.61:44733: connect: Connection refused (error 111)
18:32:53.097 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:53.098 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:53.098 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:53.098 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:53.098 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:53.098 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:53.098 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:53.098 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:53.098 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:53.098 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:53.098 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:53.098 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:53.098 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:53.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535573121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:53.130 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
18:32:53.130 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
18:32:53.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:53.156915  4892 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } attempt: 3
18:32:53.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:53.161401  4892 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.61:44733: Network error: Client connection negotiation failed: client connection to 127.4.179.61:44733: connect: Connection refused (error 111)
18:32:53.187 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:53.187 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:53.188 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:53.188 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:53.188 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:53.188 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:53.188 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:53.188 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:53.188 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:53.188 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:53.188 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:53.188 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:53.188 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:53.212 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:53.225 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:53.225 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:53.225 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:53.225 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:53.225 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:53.226 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:53.226 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:53.226 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:53.226 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:53.226 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:53.226 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:53.226 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:53.226 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:53.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:53.236703  4894 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:32:53.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:53.237439  4894 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:32:53.238 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:53.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:53.238088  4894 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:32:53.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:53.272101  4894 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:32:53.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:53.272490  4894 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:32:53.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:53.272797  4894 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:32:53.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:53.273093  4894 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:32:53.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:53.273386  4894 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:32:53.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:53.273619  4894 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39497/jwks.json
18:32:53.298 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:53.299 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:53.299 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:53.299 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:53.299 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:53.299 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:53.300 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:53.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:53.300 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:53.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:53.300 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:53.300 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:53.300 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:53.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:53.304858  4892 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } attempt: 4
18:32:53.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:53.310138  4892 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.61:44733: Network error: Client connection negotiation failed: client connection to 127.4.179.61:44733: connect: Connection refused (error 111)
18:32:53.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:53.316381  4894 master_runner.cc:387] Master server non-default flags:
18:32:53.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:53.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.179.20:42683
18:32:53.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:53.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:53.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/data
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/wal
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.179.62:35121,127.4.179.61:44733,127.4.179.60:34679
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.179.61:44733
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39497/jwks.json
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/data/info.pb
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.179.61
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/logs
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:32:53.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:32:53.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:53.317842  4894 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:32:53.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:53.319552  4894 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:32:53.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:53.331878  4904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:53.401 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:53.401 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:53.401 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:53.402 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:53.402 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:53.402 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:53.402 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:53.402 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:53.402 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:53.402 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:53.402 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:53.402 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:53.403 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:53.558 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:53.558 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:53.558 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:53.559 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:53.559 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:53.559 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:53.559 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:53.560 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:53.560 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:53.560 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:53.560 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:53.560 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:53.560 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:53.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:53.609603  4892 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } attempt: 5
18:32:53.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:53.617686  4892 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.61:44733: Network error: Client connection negotiation failed: client connection to 127.4.179.61:44733: connect: Connection refused (error 111)
18:32:53.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535573621 for job 9de81db54be40687a2a82164db1dc50b.
18:32:53.637 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
18:32:53.640 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
18:32:53.684 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:53.685 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:53.685 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:53.686 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:53.686 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:53.686 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:53.686 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:53.686 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:53.686 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:53.686 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:53.686 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:53.686 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:53.686 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:53.712 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:53.738 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:54.054 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:54.055 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:54.055 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:54.055 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:54.055 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:54.055 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:54.055 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:54.056 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:54.056 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:54.056 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:54.056 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:54.056 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:54.056 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:54.123 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535574121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:54.139 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
18:32:54.140 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:54.141 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:54.141 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:54.141 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:54.142 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:54.142 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:54.142 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:54.142 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:54.142 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:54.143 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:54.143 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:54.143 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:54.143 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:54.144 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
18:32:54.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:54.165256  4892 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } attempt: 6
18:32:54.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:54.186551  4892 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.61:44733: Network error: Client connection negotiation failed: client connection to 127.4.179.61:44733: connect: Connection refused (error 111)
18:32:54.216 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:54.235 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:54.235 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:54.235 [DEBUG - pool-186-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:54.236 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:54.236 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:54.236 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:54.237 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:54.237 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:54.237 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:54.237 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:54.237 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:54.237 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:54.237 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:54.238 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28626), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [26ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [34ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [39ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [39ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [64ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [72ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [77ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [156ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [156ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [157ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [157ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [157ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [162ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [183ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [183ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [244ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [244ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [322ms] refreshing cache from master, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [324ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [324ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [324ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [549ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [550ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [550ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [550ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [583ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [583ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [583ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1064ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1065ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1065ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2060ms] refreshing cache from master, [2060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2061ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2061ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2062ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2062ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5381ms] refreshing cache from master, [5381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5384ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5384ms] too many traces: truncated at 100 traces, deferred=Deferred@643643260(state=PENDING, result=null, callback=(continuation of Deferred@26484639 after retry RPC after error@7779607) -> (continuation of Deferred@625827279 after retry RPC after error@1793353933) -> (continuation of Deferred@1261300457 after retry RPC after error@2118525078) -> (continuation of Deferred@833268148 after retry RPC after error@2017529164) -> (continuation of Deferred@1553979919 after retry RPC after error@328340378) -> (continuation of Deferred@1997664085 after retry RPC after error@122337174) -> (continuation of Deferred@623332050 after retry RPC after error@640324399) -> (continuation of Deferred@1580837880 after retry RPC after error@203243950) -> (continuation of Deferred@334752549 after retry RPC after error@1639096735) -> (continuation of Deferred@1925685306 after retry RPC after error@338792445) -> (continuation of Deferred@412611741 after retry RPC after error@1826422857) -> (continuation of Deferred@592755608 after retry RPC after error@990025320) -> (continuation of Deferred@471252617 after retry RPC after error@407710218) -> (continuation of Deferred@507759328 after retry RPC after error@836611734) -> (continuation of Deferred@412531922 after retry RPC after error@1769654448) -> (continuation of Deferred@1768823733 after retry RPC after error@891003152) -> (continuation of Deferred@407300941 after retry RPC after error@667324349) -> (continuation of Deferred@1047300931 after retry RPC after error@1444396735) -> (continuation of Deferred@2040802227 after retry RPC after error@1779230813) -> (continuation of Deferred@811618508 after retry RPC after error@1533665849) -> (continuation of Deferred@55092052 after retry RPC after error@244055392) -> (continuation of Deferred@1021258317 after retry RPC after error@682848197) -> (continuation of Deferred@1848060804 after retry RPC after error@1058454493) -> (continuation of Deferred@2061398832 after retry RPC after error@1226897129) -> (continuation of Deferred@504139586 after retry RPC after error@340662029) -> (continuation of Deferred@494973255 after retry RPC after error@1398381472), errback=(continuation of Deferred@26484639 after retry RPC after error@7779607) -> (continuation of Deferred@625827279 after retry RPC after error@1793353933) -> (continuation of Deferred@1261300457 after retry RPC after error@2118525078) -> (continuation of Deferred@833268148 after retry RPC after error@2017529164) -> (continuation of Deferred@1553979919 after retry RPC after error@328340378) -> (continuation of Deferred@1997664085 after retry RPC after error@122337174) -> (continuation of Deferred@623332050 after retry RPC after error@640324399) -> (continuation of Deferred@1580837880 after retry RPC after error@203243950) -> (continuation of Deferred@334752549 after retry RPC after error@1639096735) -> (continuation of Deferred@1925685306 after retry RPC after error@338792445) -> (continuation of Deferred@412611741 after retry RPC after error@1826422857) -> (continuation of Deferred@592755608 after retry RPC after error@990025320) -> (continuation of Deferred@471252617 after retry RPC after error@407710218) -> (continuation of Deferred@507759328 after retry RPC after error@836611734) -> (continuation of Deferred@412531922 after retry RPC after error@1769654448) -> (continuation of Deferred@1768823733 after retry RPC after error@891003152) -> (continuation of Deferred@407300941 after retry RPC after error@667324349) -> (continuation of Deferred@1047300931 after retry RPC after error@1444396735) -> (continuation of Deferred@2040802227 after retry RPC after error@1779230813) -> (continuation of Deferred@811618508 after retry RPC after error@1533665849) -> (continuation of Deferred@55092052 after retry RPC after error@244055392) -> (continuation of Deferred@1021258317 after retry RPC after error@682848197) -> (continuation of Deferred@1848060804 after retry RPC after error@1058454493) -> (continuation of Deferred@2061398832 after retry RPC after error@1226897129) -> (continuation of Deferred@504139586 after retry RPC after error@340662029) -> (continuation of Deferred@494973255 after retry RPC after error@1398381472)))
18:32:54.239 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:54.240 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
18:32:54.242 [WARN - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28626), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [26ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [34ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [39ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [39ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [64ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [72ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [77ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [156ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [156ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [157ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [157ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [157ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [162ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [183ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [183ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [244ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [244ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [322ms] refreshing cache from master, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [324ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [324ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [324ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [549ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [550ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [550ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [550ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [583ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [583ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [583ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1064ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1065ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1065ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2060ms] refreshing cache from master, [2060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2061ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2061ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2062ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2062ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5381ms] refreshing cache from master, [5381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5384ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5384ms] too many traces: truncated at 100 traces, deferred=Deferred@643643260(state=PENDING, result=null, callback=(continuation of Deferred@26484639 after retry RPC after error@7779607) -> (continuation of Deferred@625827279 after retry RPC after error@1793353933) -> (continuation of Deferred@1261300457 after retry RPC after error@2118525078) -> (continuation of Deferred@833268148 after retry RPC after error@2017529164) -> (continuation of Deferred@1553979919 after retry RPC after error@328340378) -> (continuation of Deferred@1997664085 after retry RPC after error@122337174) -> (continuation of Deferred@623332050 after retry RPC after error@640324399) -> (continuation of Deferred@1580837880 after retry RPC after error@203243950) -> (continuation of Deferred@334752549 after retry RPC after error@1639096735) -> (continuation of Deferred@1925685306 after retry RPC after error@338792445) -> (continuation of Deferred@412611741 after retry RPC after error@1826422857) -> (continuation of Deferred@592755608 after retry RPC after error@990025320) -> (continuation of Deferred@471252617 after retry RPC after error@407710218) -> (continuation of Deferred@507759328 after retry RPC after error@836611734) -> (continuation of Deferred@412531922 after retry RPC after error@1769654448) -> (continuation of Deferred@1768823733 after retry RPC after error@891003152) -> (continuation of Deferred@407300941 after retry RPC after error@667324349) -> (continuation of Deferred@1047300931 after retry RPC after error@1444396735) -> (continuation of Deferred@2040802227 after retry RPC after error@1779230813) -> (continuation of Deferred@811618508 after retry RPC after error@1533665849) -> (continuation of Deferred@55092052 after retry RPC after error@244055392) -> (continuation of Deferred@1021258317 after retry RPC after error@682848197) -> (continuation of Deferred@1848060804 after retry RPC after error@1058454493) -> (continuation of Deferred@2061398832 after retry RPC after error@1226897129) -> (continuation of Deferred@504139586 after retry RPC after error@340662029) -> (continuation of Deferred@494973255 after retry RPC after error@1398381472), errback=(continuation of Deferred@26484639 after retry RPC after error@7779607) -> (continuation of Deferred@625827279 after retry RPC after error@1793353933) -> (continuation of Deferred@1261300457 after retry RPC after error@2118525078) -> (continuation of Deferred@833268148 after retry RPC after error@2017529164) -> (continuation of Deferred@1553979919 after retry RPC after error@328340378) -> (continuation of Deferred@1997664085 after retry RPC after error@122337174) -> (continuation of Deferred@623332050 after retry RPC after error@640324399) -> (continuation of Deferred@1580837880 after retry RPC after error@203243950) -> (continuation of Deferred@334752549 after retry RPC after error@1639096735) -> (continuation of Deferred@1925685306 after retry RPC after error@338792445) -> (continuation of Deferred@412611741 after retry RPC after error@1826422857) -> (continuation of Deferred@592755608 after retry RPC after error@990025320) -> (continuation of Deferred@471252617 after retry RPC after error@407710218) -> (continuation of Deferred@507759328 after retry RPC after error@836611734) -> (continuation of Deferred@412531922 after retry RPC after error@1769654448) -> (continuation of Deferred@1768823733 after retry RPC after error@891003152) -> (continuation of Deferred@407300941 after retry RPC after error@667324349) -> (continuation of Deferred@1047300931 after retry RPC after error@1444396735) -> (continuation of Deferred@2040802227 after retry RPC after error@1779230813) -> (continuation of Deferred@811618508 after retry RPC after error@1533665849) -> (continuation of Deferred@55092052 after retry RPC after error@244055392) -> (continuation of Deferred@1021258317 after retry RPC after error@682848197) -> (continuation of Deferred@1848060804 after retry RPC after error@1058454493) -> (continuation of Deferred@2061398832 after retry RPC after error@1226897129) -> (continuation of Deferred@504139586 after retry RPC after error@340662029) -> (continuation of Deferred@494973255 after retry RPC after error@1398381472)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:54.243 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#4 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
18:32:54.245 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#4 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
18:32:54.252 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28626), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [26ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [34ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [39ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [39ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [64ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [72ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [77ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [156ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [156ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [157ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [157ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [157ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [162ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [183ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [183ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [244ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [244ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [322ms] refreshing cache from master, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [324ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [324ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [324ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [549ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [550ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [550ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [550ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [583ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [583ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [583ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1064ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1065ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1065ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2060ms] refreshing cache from master, [2060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2061ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2061ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2062ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2062ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5381ms] refreshing cache from master, [5381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5384ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5384ms] too many traces: truncated at 100 traces, deferred=Deferred@643643260(state=PENDING, result=null, callback=(continuation of Deferred@26484639 after retry RPC after error@7779607) -> (continuation of Deferred@625827279 after retry RPC after error@1793353933) -> (continuation of Deferred@1261300457 after retry RPC after error@2118525078) -> (continuation of Deferred@833268148 after retry RPC after error@2017529164) -> (continuation of Deferred@1553979919 after retry RPC after error@328340378) -> (continuation of Deferred@1997664085 after retry RPC after error@122337174) -> (continuation of Deferred@623332050 after retry RPC after error@640324399) -> (continuation of Deferred@1580837880 after retry RPC after error@203243950) -> (continuation of Deferred@334752549 after retry RPC after error@1639096735) -> (continuation of Deferred@1925685306 after retry RPC after error@338792445) -> (continuation of Deferred@412611741 after retry RPC after error@1826422857) -> (continuation of Deferred@592755608 after retry RPC after error@990025320) -> (continuation of Deferred@471252617 after retry RPC after error@407710218) -> (continuation of Deferred@507759328 after retry RPC after error@836611734) -> (continuation of Deferred@412531922 after retry RPC after error@1769654448) -> (continuation of Deferred@1768823733 after retry RPC after error@891003152) -> (continuation of Deferred@407300941 after retry RPC after error@667324349) -> (continuation of Deferred@1047300931 after retry RPC after error@1444396735) -> (continuation of Deferred@2040802227 after retry RPC after error@1779230813) -> (continuation of Deferred@811618508 after retry RPC after error@1533665849) -> (continuation of Deferred@55092052 after retry RPC after error@244055392) -> (continuation of Deferred@1021258317 after retry RPC after error@682848197) -> (continuation of Deferred@1848060804 after retry RPC after error@1058454493) -> (continuation of Deferred@2061398832 after retry RPC after error@1226897129) -> (continuation of Deferred@504139586 after retry RPC after error@340662029) -> (continuation of Deferred@494973255 after retry RPC after error@1398381472), errback=(continuation of Deferred@26484639 after retry RPC after error@7779607) -> (continuation of Deferred@625827279 after retry RPC after error@1793353933) -> (continuation of Deferred@1261300457 after retry RPC after error@2118525078) -> (continuation of Deferred@833268148 after retry RPC after error@2017529164) -> (continuation of Deferred@1553979919 after retry RPC after error@328340378) -> (continuation of Deferred@1997664085 after retry RPC after error@122337174) -> (continuation of Deferred@623332050 after retry RPC after error@640324399) -> (continuation of Deferred@1580837880 after retry RPC after error@203243950) -> (continuation of Deferred@334752549 after retry RPC after error@1639096735) -> (continuation of Deferred@1925685306 after retry RPC after error@338792445) -> (continuation of Deferred@412611741 after retry RPC after error@1826422857) -> (continuation of Deferred@592755608 after retry RPC after error@990025320) -> (continuation of Deferred@471252617 after retry RPC after error@407710218) -> (continuation of Deferred@507759328 after retry RPC after error@836611734) -> (continuation of Deferred@412531922 after retry RPC after error@1769654448) -> (continuation of Deferred@1768823733 after retry RPC after error@891003152) -> (continuation of Deferred@407300941 after retry RPC after error@667324349) -> (continuation of Deferred@1047300931 after retry RPC after error@1444396735) -> (continuation of Deferred@2040802227 after retry RPC after error@1779230813) -> (continuation of Deferred@811618508 after retry RPC after error@1533665849) -> (continuation of Deferred@55092052 after retry RPC after error@244055392) -> (continuation of Deferred@1021258317 after retry RPC after error@682848197) -> (continuation of Deferred@1848060804 after retry RPC after error@1058454493) -> (continuation of Deferred@2061398832 after retry RPC after error@1226897129) -> (continuation of Deferred@504139586 after retry RPC after error@340662029) -> (continuation of Deferred@494973255 after retry RPC after error@1398381472)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:54.255 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:32:54.258 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#4) of source Source: KuduSource.
18:32:54.259 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
18:32:54.373 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:54.373 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:54.373 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:54.374 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.374 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.374 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.375 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.375 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.375 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.375 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.375 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.375 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.375 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:54.467 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:54.468 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:54.468 [DEBUG - pool-194-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:54.469 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:54.469 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:54.469 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:54.469 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:54.469 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:54.469 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:54.470 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:54.470 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:54.470 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:54.470 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:54.471 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27054), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [35ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [85ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [97ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [97ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [132ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [133ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [139ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [140ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [170ms] refreshing cache from master, [170ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [211ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [211ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [211ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [211ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [212ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [243ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [243ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [282ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [282ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [282ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [282ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [345ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [346ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [346ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [346ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [403ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [403ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [444ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [444ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [445ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [445ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [862ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [863ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [863ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [863ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [923ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [923ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [924ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [924ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2767ms] refreshing cache from master, [2767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2768ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2768ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2768ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2768ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [6802ms] refreshing cache from master, [6802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [6802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [6802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [6803ms] too many traces: truncated at 100 traces, deferred=Deferred@1919515403(state=PENDING, result=null, callback=(continuation of Deferred@1006164301 after retry RPC after error@465606754) -> (continuation of Deferred@1680010276 after retry RPC after error@1571447432) -> (continuation of Deferred@543554241 after retry RPC after error@1064924455) -> (continuation of Deferred@1288305952 after retry RPC after error@1123645459) -> (continuation of Deferred@1296380287 after retry RPC after error@962700733) -> (continuation of Deferred@985821004 after retry RPC after error@863154663) -> (continuation of Deferred@1473814591 after retry RPC after error@1663089460) -> (continuation of Deferred@1253113875 after retry RPC after error@1818918187) -> (continuation of Deferred@2124542401 after retry RPC after error@406723642) -> (continuation of Deferred@1515009718 after retry RPC after error@1710328817) -> (continuation of Deferred@347029879 after retry RPC after error@2090352660) -> (continuation of Deferred@1339240887 after retry RPC after error@638879167) -> (continuation of Deferred@1214172403 after retry RPC after error@1987624204) -> (continuation of Deferred@544240893 after retry RPC after error@575349809) -> (continuation of Deferred@483155423 after retry RPC after error@795808663) -> (continuation of Deferred@211508507 after retry RPC after error@1997183509) -> (continuation of Deferred@156631950 after retry RPC after error@1592937112) -> (continuation of Deferred@139962328 after retry RPC after error@724455157) -> (continuation of Deferred@308109933 after retry RPC after error@1589074996) -> (continuation of Deferred@1802193245 after retry RPC after error@854326051), errback=(continuation of Deferred@1006164301 after retry RPC after error@465606754) -> (continuation of Deferred@1680010276 after retry RPC after error@1571447432) -> (continuation of Deferred@543554241 after retry RPC after error@1064924455) -> (continuation of Deferred@1288305952 after retry RPC after error@1123645459) -> (continuation of Deferred@1296380287 after retry RPC after error@962700733) -> (continuation of Deferred@985821004 after retry RPC after error@863154663) -> (continuation of Deferred@1473814591 after retry RPC after error@1663089460) -> (continuation of Deferred@1253113875 after retry RPC after error@1818918187) -> (continuation of Deferred@2124542401 after retry RPC after error@406723642) -> (continuation of Deferred@1515009718 after retry RPC after error@1710328817) -> (continuation of Deferred@347029879 after retry RPC after error@2090352660) -> (continuation of Deferred@1339240887 after retry RPC after error@638879167) -> (continuation of Deferred@1214172403 after retry RPC after error@1987624204) -> (continuation of Deferred@544240893 after retry RPC after error@575349809) -> (continuation of Deferred@483155423 after retry RPC after error@795808663) -> (continuation of Deferred@211508507 after retry RPC after error@1997183509) -> (continuation of Deferred@156631950 after retry RPC after error@1592937112) -> (continuation of Deferred@139962328 after retry RPC after error@724455157) -> (continuation of Deferred@308109933 after retry RPC after error@1589074996) -> (continuation of Deferred@1802193245 after retry RPC after error@854326051)))
18:32:54.472 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:32:54.473 [WARN - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27054), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [35ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [85ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [97ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [97ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [132ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [133ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [139ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [140ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [170ms] refreshing cache from master, [170ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [211ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [211ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [211ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [211ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [212ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [243ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [243ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [282ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [282ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [282ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [282ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [345ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [346ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [346ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [346ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [403ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [403ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [444ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [444ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [445ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [445ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [862ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [863ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [863ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [863ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [923ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [923ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [924ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [924ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2767ms] refreshing cache from master, [2767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2768ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2768ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2768ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2768ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [6802ms] refreshing cache from master, [6802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [6802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [6802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [6803ms] too many traces: truncated at 100 traces, deferred=Deferred@1919515403(state=PENDING, result=null, callback=(continuation of Deferred@1006164301 after retry RPC after error@465606754) -> (continuation of Deferred@1680010276 after retry RPC after error@1571447432) -> (continuation of Deferred@543554241 after retry RPC after error@1064924455) -> (continuation of Deferred@1288305952 after retry RPC after error@1123645459) -> (continuation of Deferred@1296380287 after retry RPC after error@962700733) -> (continuation of Deferred@985821004 after retry RPC after error@863154663) -> (continuation of Deferred@1473814591 after retry RPC after error@1663089460) -> (continuation of Deferred@1253113875 after retry RPC after error@1818918187) -> (continuation of Deferred@2124542401 after retry RPC after error@406723642) -> (continuation of Deferred@1515009718 after retry RPC after error@1710328817) -> (continuation of Deferred@347029879 after retry RPC after error@2090352660) -> (continuation of Deferred@1339240887 after retry RPC after error@638879167) -> (continuation of Deferred@1214172403 after retry RPC after error@1987624204) -> (continuation of Deferred@544240893 after retry RPC after error@575349809) -> (continuation of Deferred@483155423 after retry RPC after error@795808663) -> (continuation of Deferred@211508507 after retry RPC after error@1997183509) -> (continuation of Deferred@156631950 after retry RPC after error@1592937112) -> (continuation of Deferred@139962328 after retry RPC after error@724455157) -> (continuation of Deferred@308109933 after retry RPC after error@1589074996) -> (continuation of Deferred@1802193245 after retry RPC after error@854326051), errback=(continuation of Deferred@1006164301 after retry RPC after error@465606754) -> (continuation of Deferred@1680010276 after retry RPC after error@1571447432) -> (continuation of Deferred@543554241 after retry RPC after error@1064924455) -> (continuation of Deferred@1288305952 after retry RPC after error@1123645459) -> (continuation of Deferred@1296380287 after retry RPC after error@962700733) -> (continuation of Deferred@985821004 after retry RPC after error@863154663) -> (continuation of Deferred@1473814591 after retry RPC after error@1663089460) -> (continuation of Deferred@1253113875 after retry RPC after error@1818918187) -> (continuation of Deferred@2124542401 after retry RPC after error@406723642) -> (continuation of Deferred@1515009718 after retry RPC after error@1710328817) -> (continuation of Deferred@347029879 after retry RPC after error@2090352660) -> (continuation of Deferred@1339240887 after retry RPC after error@638879167) -> (continuation of Deferred@1214172403 after retry RPC after error@1987624204) -> (continuation of Deferred@544240893 after retry RPC after error@575349809) -> (continuation of Deferred@483155423 after retry RPC after error@795808663) -> (continuation of Deferred@211508507 after retry RPC after error@1997183509) -> (continuation of Deferred@156631950 after retry RPC after error@1592937112) -> (continuation of Deferred@139962328 after retry RPC after error@724455157) -> (continuation of Deferred@308109933 after retry RPC after error@1589074996) -> (continuation of Deferred@1802193245 after retry RPC after error@854326051)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:54.473 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
18:32:54.478 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
18:32:54.481 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED on 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27054), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [35ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [85ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [97ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [97ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [132ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [133ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [139ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [140ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [170ms] refreshing cache from master, [170ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [211ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [211ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [211ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [211ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [212ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [243ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [243ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [282ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [282ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [282ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [282ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [342ms] refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [345ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [346ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [346ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [346ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [403ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [403ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [444ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [444ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [445ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [445ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [862ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [863ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [863ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [863ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [923ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [923ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [924ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [924ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2767ms] refreshing cache from master, [2767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2767ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2768ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2768ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2768ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2768ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [6802ms] refreshing cache from master, [6802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [6802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [6802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [6803ms] too many traces: truncated at 100 traces, deferred=Deferred@1919515403(state=PENDING, result=null, callback=(continuation of Deferred@1006164301 after retry RPC after error@465606754) -> (continuation of Deferred@1680010276 after retry RPC after error@1571447432) -> (continuation of Deferred@543554241 after retry RPC after error@1064924455) -> (continuation of Deferred@1288305952 after retry RPC after error@1123645459) -> (continuation of Deferred@1296380287 after retry RPC after error@962700733) -> (continuation of Deferred@985821004 after retry RPC after error@863154663) -> (continuation of Deferred@1473814591 after retry RPC after error@1663089460) -> (continuation of Deferred@1253113875 after retry RPC after error@1818918187) -> (continuation of Deferred@2124542401 after retry RPC after error@406723642) -> (continuation of Deferred@1515009718 after retry RPC after error@1710328817) -> (continuation of Deferred@347029879 after retry RPC after error@2090352660) -> (continuation of Deferred@1339240887 after retry RPC after error@638879167) -> (continuation of Deferred@1214172403 after retry RPC after error@1987624204) -> (continuation of Deferred@544240893 after retry RPC after error@575349809) -> (continuation of Deferred@483155423 after retry RPC after error@795808663) -> (continuation of Deferred@211508507 after retry RPC after error@1997183509) -> (continuation of Deferred@156631950 after retry RPC after error@1592937112) -> (continuation of Deferred@139962328 after retry RPC after error@724455157) -> (continuation of Deferred@308109933 after retry RPC after error@1589074996) -> (continuation of Deferred@1802193245 after retry RPC after error@854326051), errback=(continuation of Deferred@1006164301 after retry RPC after error@465606754) -> (continuation of Deferred@1680010276 after retry RPC after error@1571447432) -> (continuation of Deferred@543554241 after retry RPC after error@1064924455) -> (continuation of Deferred@1288305952 after retry RPC after error@1123645459) -> (continuation of Deferred@1296380287 after retry RPC after error@962700733) -> (continuation of Deferred@985821004 after retry RPC after error@863154663) -> (continuation of Deferred@1473814591 after retry RPC after error@1663089460) -> (continuation of Deferred@1253113875 after retry RPC after error@1818918187) -> (continuation of Deferred@2124542401 after retry RPC after error@406723642) -> (continuation of Deferred@1515009718 after retry RPC after error@1710328817) -> (continuation of Deferred@347029879 after retry RPC after error@2090352660) -> (continuation of Deferred@1339240887 after retry RPC after error@638879167) -> (continuation of Deferred@1214172403 after retry RPC after error@1987624204) -> (continuation of Deferred@544240893 after retry RPC after error@575349809) -> (continuation of Deferred@483155423 after retry RPC after error@795808663) -> (continuation of Deferred@211508507 after retry RPC after error@1997183509) -> (continuation of Deferred@156631950 after retry RPC after error@1592937112) -> (continuation of Deferred@139962328 after retry RPC after error@724455157) -> (continuation of Deferred@308109933 after retry RPC after error@1589074996) -> (continuation of Deferred@1802193245 after retry RPC after error@854326051)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:54.482 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
18:32:54.483 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:32:54.483 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
18:32:54.482 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9) switched from state RUNNING to RESTARTING.
18:32:54.488 [WARN - flink-pekko.actor.default-dispatcher-9] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
18:32:54.586 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:54.586 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:54.586 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:54.587 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:54.587 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:54.587 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:54.588 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:54.588 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:54.588 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:54.588 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:54.588 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:54.588 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:54.589 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:54.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535574621 for job 9de81db54be40687a2a82164db1dc50b.
18:32:54.634 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:32:54.635 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
18:32:54.704 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:54.705 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:54.705 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:54.705 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:54.705 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:54.706 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:54.706 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:54.706 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:54.706 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:54.707 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:54.707 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:54.707 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:54.707 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:54.739 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:54.848 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:54.848 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:54.849 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:54.849 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:54.849 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:54.849 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:54.850 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:54.850 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:54.850 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:54.850 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:54.850 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:54.850 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:54.851 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:32:54.853 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:54.853 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:54.853 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:54.853 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.853 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.854 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.854 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.854 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.854 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.854 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.855 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.855 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.855 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:54.855 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29181), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [3ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [4ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [8ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [46ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [57ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [57ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [107ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [108ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [108ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [108ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [122ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [143ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [323ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [423ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [881ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [882ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [883ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1841ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1845ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1845ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3182ms] refreshing cache from master, [3182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3184ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [3184ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [3185ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3185ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [4380ms] refreshing cache from master, [4380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [4381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [4381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [4381ms] too many traces: truncated at 100 traces, deferred=Deferred@1797415282(state=PENDING, result=null, callback=(continuation of Deferred@1567822593 after retry RPC after error@1950671885) -> (continuation of Deferred@831036525 after retry RPC after error@1238975199) -> (continuation of Deferred@209173502 after retry RPC after error@1598051057) -> (continuation of Deferred@710854272 after retry RPC after error@689092270) -> (continuation of Deferred@403390521 after retry RPC after error@1166102035) -> (continuation of Deferred@423095013 after retry RPC after error@632068267) -> (continuation of Deferred@1742999215 after retry RPC after error@677000598) -> (continuation of Deferred@236749498 after retry RPC after error@1337211410) -> (continuation of Deferred@149083197 after retry RPC after error@1903015474) -> (continuation of Deferred@453964791 after retry RPC after error@1971596846) -> (continuation of Deferred@1801019295 after retry RPC after error@1998174432) -> (continuation of Deferred@459566271 after retry RPC after error@1338365091) -> (continuation of Deferred@1849806691 after retry RPC after error@1411757299) -> (continuation of Deferred@1822174044 after retry RPC after error@220043936) -> (continuation of Deferred@1841788599 after retry RPC after error@339527120) -> (continuation of Deferred@435673792 after retry RPC after error@2027854788) -> (continuation of Deferred@779757734 after retry RPC after error@1545235196) -> (continuation of Deferred@2065468005 after retry RPC after error@2005937785) -> (continuation of Deferred@147851061 after retry RPC after error@127058265) -> (continuation of Deferred@415378540 after retry RPC after error@1859594987) -> (continuation of Deferred@1723232683 after retry RPC after error@2009066541) -> (continuation of Deferred@2115444730 after retry RPC after error@700510881) -> (continuation of Deferred@2083452187 after retry RPC after error@1962450999) -> (continuation of Deferred@844532125 after retry RPC after error@481108108) -> (continuation of Deferred@388012079 after retry RPC after error@644377572) -> (continuation of Deferred@552867029 after retry RPC after error@1437133063) -> (continuation of Deferred@1188749949 after retry RPC after error@596149769), errback=(continuation of Deferred@1567822593 after retry RPC after error@1950671885) -> (continuation of Deferred@831036525 after retry RPC after error@1238975199) -> (continuation of Deferred@209173502 after retry RPC after error@1598051057) -> (continuation of Deferred@710854272 after retry RPC after error@689092270) -> (continuation of Deferred@403390521 after retry RPC after error@1166102035) -> (continuation of Deferred@423095013 after retry RPC after error@632068267) -> (continuation of Deferred@1742999215 after retry RPC after error@677000598) -> (continuation of Deferred@236749498 after retry RPC after error@1337211410) -> (continuation of Deferred@149083197 after retry RPC after error@1903015474) -> (continuation of Deferred@453964791 after retry RPC after error@1971596846) -> (continuation of Deferred@1801019295 after retry RPC after error@1998174432) -> (continuation of Deferred@459566271 after retry RPC after error@1338365091) -> (continuation of Deferred@1849806691 after retry RPC after error@1411757299) -> (continuation of Deferred@1822174044 after retry RPC after error@220043936) -> (continuation of Deferred@1841788599 after retry RPC after error@339527120) -> (continuation of Deferred@435673792 after retry RPC after error@2027854788) -> (continuation of Deferred@779757734 after retry RPC after error@1545235196) -> (continuation of Deferred@2065468005 after retry RPC after error@2005937785) -> (continuation of Deferred@147851061 after retry RPC after error@127058265) -> (continuation of Deferred@415378540 after retry RPC after error@1859594987) -> (continuation of Deferred@1723232683 after retry RPC after error@2009066541) -> (continuation of Deferred@2115444730 after retry RPC after error@700510881) -> (continuation of Deferred@2083452187 after retry RPC after error@1962450999) -> (continuation of Deferred@844532125 after retry RPC after error@481108108) -> (continuation of Deferred@388012079 after retry RPC after error@644377572) -> (continuation of Deferred@552867029 after retry RPC after error@1437133063) -> (continuation of Deferred@1188749949 after retry RPC after error@596149769)))
18:32:54.856 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:54.857 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:54.857 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:54.857 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.857 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.857 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.857 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29181), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [3ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [4ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [8ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [46ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [57ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [57ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [107ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [108ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [108ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [108ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [122ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [143ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [323ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [423ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [881ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [882ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [883ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1841ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1845ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1845ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3182ms] refreshing cache from master, [3182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3184ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [3184ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [3185ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3185ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [4380ms] refreshing cache from master, [4380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [4381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [4381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [4381ms] too many traces: truncated at 100 traces, deferred=Deferred@1797415282(state=PENDING, result=null, callback=(continuation of Deferred@1567822593 after retry RPC after error@1950671885) -> (continuation of Deferred@831036525 after retry RPC after error@1238975199) -> (continuation of Deferred@209173502 after retry RPC after error@1598051057) -> (continuation of Deferred@710854272 after retry RPC after error@689092270) -> (continuation of Deferred@403390521 after retry RPC after error@1166102035) -> (continuation of Deferred@423095013 after retry RPC after error@632068267) -> (continuation of Deferred@1742999215 after retry RPC after error@677000598) -> (continuation of Deferred@236749498 after retry RPC after error@1337211410) -> (continuation of Deferred@149083197 after retry RPC after error@1903015474) -> (continuation of Deferred@453964791 after retry RPC after error@1971596846) -> (continuation of Deferred@1801019295 after retry RPC after error@1998174432) -> (continuation of Deferred@459566271 after retry RPC after error@1338365091) -> (continuation of Deferred@1849806691 after retry RPC after error@1411757299) -> (continuation of Deferred@1822174044 after retry RPC after error@220043936) -> (continuation of Deferred@1841788599 after retry RPC after error@339527120) -> (continuation of Deferred@435673792 after retry RPC after error@2027854788) -> (continuation of Deferred@779757734 after retry RPC after error@1545235196) -> (continuation of Deferred@2065468005 after retry RPC after error@2005937785) -> (continuation of Deferred@147851061 after retry RPC after error@127058265) -> (continuation of Deferred@415378540 after retry RPC after error@1859594987) -> (continuation of Deferred@1723232683 after retry RPC after error@2009066541) -> (continuation of Deferred@2115444730 after retry RPC after error@700510881) -> (continuation of Deferred@2083452187 after retry RPC after error@1962450999) -> (continuation of Deferred@844532125 after retry RPC after error@481108108) -> (continuation of Deferred@388012079 after retry RPC after error@644377572) -> (continuation of Deferred@552867029 after retry RPC after error@1437133063) -> (continuation of Deferred@1188749949 after retry RPC after error@596149769), errback=(continuation of Deferred@1567822593 after retry RPC after error@1950671885) -> (continuation of Deferred@831036525 after retry RPC after error@1238975199) -> (continuation of Deferred@209173502 after retry RPC after error@1598051057) -> (continuation of Deferred@710854272 after retry RPC after error@689092270) -> (continuation of Deferred@403390521 after retry RPC after error@1166102035) -> (continuation of Deferred@423095013 after retry RPC after error@632068267) -> (continuation of Deferred@1742999215 after retry RPC after error@677000598) -> (continuation of Deferred@236749498 after retry RPC after error@1337211410) -> (continuation of Deferred@149083197 after retry RPC after error@1903015474) -> (continuation of Deferred@453964791 after retry RPC after error@1971596846) -> (continuation of Deferred@1801019295 after retry RPC after error@1998174432) -> (continuation of Deferred@459566271 after retry RPC after error@1338365091) -> (continuation of Deferred@1849806691 after retry RPC after error@1411757299) -> (continuation of Deferred@1822174044 after retry RPC after error@220043936) -> (continuation of Deferred@1841788599 after retry RPC after error@339527120) -> (continuation of Deferred@435673792 after retry RPC after error@2027854788) -> (continuation of Deferred@779757734 after retry RPC after error@1545235196) -> (continuation of Deferred@2065468005 after retry RPC after error@2005937785) -> (continuation of Deferred@147851061 after retry RPC after error@127058265) -> (continuation of Deferred@415378540 after retry RPC after error@1859594987) -> (continuation of Deferred@1723232683 after retry RPC after error@2009066541) -> (continuation of Deferred@2115444730 after retry RPC after error@700510881) -> (continuation of Deferred@2083452187 after retry RPC after error@1962450999) -> (continuation of Deferred@844532125 after retry RPC after error@481108108) -> (continuation of Deferred@388012079 after retry RPC after error@644377572) -> (continuation of Deferred@552867029 after retry RPC after error@1437133063) -> (continuation of Deferred@1188749949 after retry RPC after error@596149769)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29181), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [3ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [4ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [8ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [46ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [57ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [57ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [107ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [108ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [108ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [108ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [122ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [143ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [323ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [423ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [881ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [882ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [883ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1841ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1845ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1845ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3182ms] refreshing cache from master, [3182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3184ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [3184ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [3185ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3185ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [4380ms] refreshing cache from master, [4380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [4381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [4381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [4381ms] too many traces: truncated at 100 traces, deferred=Deferred@1797415282(state=PENDING, result=null, callback=(continuation of Deferred@1567822593 after retry RPC after error@1950671885) -> (continuation of Deferred@831036525 after retry RPC after error@1238975199) -> (continuation of Deferred@209173502 after retry RPC after error@1598051057) -> (continuation of Deferred@710854272 after retry RPC after error@689092270) -> (continuation of Deferred@403390521 after retry RPC after error@1166102035) -> (continuation of Deferred@423095013 after retry RPC after error@632068267) -> (continuation of Deferred@1742999215 after retry RPC after error@677000598) -> (continuation of Deferred@236749498 after retry RPC after error@1337211410) -> (continuation of Deferred@149083197 after retry RPC after error@1903015474) -> (continuation of Deferred@453964791 after retry RPC after error@1971596846) -> (continuation of Deferred@1801019295 after retry RPC after error@1998174432) -> (continuation of Deferred@459566271 after retry RPC after error@1338365091) -> (continuation of Deferred@1849806691 after retry RPC after error@1411757299) -> (continuation of Deferred@1822174044 after retry RPC after error@220043936) -> (continuation of Deferred@1841788599 after retry RPC after error@339527120) -> (continuation of Deferred@435673792 after retry RPC after error@2027854788) -> (continuation of Deferred@779757734 after retry RPC after error@1545235196) -> (continuation of Deferred@2065468005 after retry RPC after error@2005937785) -> (continuation of Deferred@147851061 after retry RPC after error@127058265) -> (continuation of Deferred@415378540 after retry RPC after error@1859594987) -> (continuation of Deferred@1723232683 after retry RPC after error@2009066541) -> (continuation of Deferred@2115444730 after retry RPC after error@700510881) -> (continuation of Deferred@2083452187 after retry RPC after error@1962450999) -> (continuation of Deferred@844532125 after retry RPC after error@481108108) -> (continuation of Deferred@388012079 after retry RPC after error@644377572) -> (continuation of Deferred@552867029 after retry RPC after error@1437133063) -> (continuation of Deferred@1188749949 after retry RPC after error@596149769), errback=(continuation of Deferred@1567822593 after retry RPC after error@1950671885) -> (continuation of Deferred@831036525 after retry RPC after error@1238975199) -> (continuation of Deferred@209173502 after retry RPC after error@1598051057) -> (continuation of Deferred@710854272 after retry RPC after error@689092270) -> (continuation of Deferred@403390521 after retry RPC after error@1166102035) -> (continuation of Deferred@423095013 after retry RPC after error@632068267) -> (continuation of Deferred@1742999215 after retry RPC after error@677000598) -> (continuation of Deferred@236749498 after retry RPC after error@1337211410) -> (continuation of Deferred@149083197 after retry RPC after error@1903015474) -> (continuation of Deferred@453964791 after retry RPC after error@1971596846) -> (continuation of Deferred@1801019295 after retry RPC after error@1998174432) -> (continuation of Deferred@459566271 after retry RPC after error@1338365091) -> (continuation of Deferred@1849806691 after retry RPC after error@1411757299) -> (continuation of Deferred@1822174044 after retry RPC after error@220043936) -> (continuation of Deferred@1841788599 after retry RPC after error@339527120) -> (continuation of Deferred@435673792 after retry RPC after error@2027854788) -> (continuation of Deferred@779757734 after retry RPC after error@1545235196) -> (continuation of Deferred@2065468005 after retry RPC after error@2005937785) -> (continuation of Deferred@147851061 after retry RPC after error@127058265) -> (continuation of Deferred@415378540 after retry RPC after error@1859594987) -> (continuation of Deferred@1723232683 after retry RPC after error@2009066541) -> (continuation of Deferred@2115444730 after retry RPC after error@700510881) -> (continuation of Deferred@2083452187 after retry RPC after error@1962450999) -> (continuation of Deferred@844532125 after retry RPC after error@481108108) -> (continuation of Deferred@388012079 after retry RPC after error@644377572) -> (continuation of Deferred@552867029 after retry RPC after error@1437133063) -> (continuation of Deferred@1188749949 after retry RPC after error@596149769)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.68.188:38393
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:54.858 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.858 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.858 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.859 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.859 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.859 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.859 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:54.872 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:54.873 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:54.873 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:54.874 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.874 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.874 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.874 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.874 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.874 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.875 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.875 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.875 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.875 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:54.880 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29181), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [3ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [4ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [8ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [46ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [57ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [57ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [107ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [108ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [108ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [108ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [122ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [143ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [323ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [423ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [881ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [882ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [883ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1841ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1845ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1845ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3182ms] refreshing cache from master, [3182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3184ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [3184ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [3185ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3185ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [4380ms] refreshing cache from master, [4380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [4381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [4381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [4381ms] too many traces: truncated at 100 traces, deferred=Deferred@1797415282(state=PENDING, result=null, callback=(continuation of Deferred@1567822593 after retry RPC after error@1950671885) -> (continuation of Deferred@831036525 after retry RPC after error@1238975199) -> (continuation of Deferred@209173502 after retry RPC after error@1598051057) -> (continuation of Deferred@710854272 after retry RPC after error@689092270) -> (continuation of Deferred@403390521 after retry RPC after error@1166102035) -> (continuation of Deferred@423095013 after retry RPC after error@632068267) -> (continuation of Deferred@1742999215 after retry RPC after error@677000598) -> (continuation of Deferred@236749498 after retry RPC after error@1337211410) -> (continuation of Deferred@149083197 after retry RPC after error@1903015474) -> (continuation of Deferred@453964791 after retry RPC after error@1971596846) -> (continuation of Deferred@1801019295 after retry RPC after error@1998174432) -> (continuation of Deferred@459566271 after retry RPC after error@1338365091) -> (continuation of Deferred@1849806691 after retry RPC after error@1411757299) -> (continuation of Deferred@1822174044 after retry RPC after error@220043936) -> (continuation of Deferred@1841788599 after retry RPC after error@339527120) -> (continuation of Deferred@435673792 after retry RPC after error@2027854788) -> (continuation of Deferred@779757734 after retry RPC after error@1545235196) -> (continuation of Deferred@2065468005 after retry RPC after error@2005937785) -> (continuation of Deferred@147851061 after retry RPC after error@127058265) -> (continuation of Deferred@415378540 after retry RPC after error@1859594987) -> (continuation of Deferred@1723232683 after retry RPC after error@2009066541) -> (continuation of Deferred@2115444730 after retry RPC after error@700510881) -> (continuation of Deferred@2083452187 after retry RPC after error@1962450999) -> (continuation of Deferred@844532125 after retry RPC after error@481108108) -> (continuation of Deferred@388012079 after retry RPC after error@644377572) -> (continuation of Deferred@552867029 after retry RPC after error@1437133063) -> (continuation of Deferred@1188749949 after retry RPC after error@596149769), errback=(continuation of Deferred@1567822593 after retry RPC after error@1950671885) -> (continuation of Deferred@831036525 after retry RPC after error@1238975199) -> (continuation of Deferred@209173502 after retry RPC after error@1598051057) -> (continuation of Deferred@710854272 after retry RPC after error@689092270) -> (continuation of Deferred@403390521 after retry RPC after error@1166102035) -> (continuation of Deferred@423095013 after retry RPC after error@632068267) -> (continuation of Deferred@1742999215 after retry RPC after error@677000598) -> (continuation of Deferred@236749498 after retry RPC after error@1337211410) -> (continuation of Deferred@149083197 after retry RPC after error@1903015474) -> (continuation of Deferred@453964791 after retry RPC after error@1971596846) -> (continuation of Deferred@1801019295 after retry RPC after error@1998174432) -> (continuation of Deferred@459566271 after retry RPC after error@1338365091) -> (continuation of Deferred@1849806691 after retry RPC after error@1411757299) -> (continuation of Deferred@1822174044 after retry RPC after error@220043936) -> (continuation of Deferred@1841788599 after retry RPC after error@339527120) -> (continuation of Deferred@435673792 after retry RPC after error@2027854788) -> (continuation of Deferred@779757734 after retry RPC after error@1545235196) -> (continuation of Deferred@2065468005 after retry RPC after error@2005937785) -> (continuation of Deferred@147851061 after retry RPC after error@127058265) -> (continuation of Deferred@415378540 after retry RPC after error@1859594987) -> (continuation of Deferred@1723232683 after retry RPC after error@2009066541) -> (continuation of Deferred@2115444730 after retry RPC after error@700510881) -> (continuation of Deferred@2083452187 after retry RPC after error@1962450999) -> (continuation of Deferred@844532125 after retry RPC after error@481108108) -> (continuation of Deferred@388012079 after retry RPC after error@644377572) -> (continuation of Deferred@552867029 after retry RPC after error@1437133063) -> (continuation of Deferred@1188749949 after retry RPC after error@596149769)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29181), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [3ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [4ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [8ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [46ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [50ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [57ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [57ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [107ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [108ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [108ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [108ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [122ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [143ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [163ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [323ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [423ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [423ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [881ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [882ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [883ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [883ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1841ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1845ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1845ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3182ms] refreshing cache from master, [3182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3184ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [3184ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [3185ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3185ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [4380ms] refreshing cache from master, [4380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [4381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [4381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [4381ms] too many traces: truncated at 100 traces, deferred=Deferred@1797415282(state=PENDING, result=null, callback=(continuation of Deferred@1567822593 after retry RPC after error@1950671885) -> (continuation of Deferred@831036525 after retry RPC after error@1238975199) -> (continuation of Deferred@209173502 after retry RPC after error@1598051057) -> (continuation of Deferred@710854272 after retry RPC after error@689092270) -> (continuation of Deferred@403390521 after retry RPC after error@1166102035) -> (continuation of Deferred@423095013 after retry RPC after error@632068267) -> (continuation of Deferred@1742999215 after retry RPC after error@677000598) -> (continuation of Deferred@236749498 after retry RPC after error@1337211410) -> (continuation of Deferred@149083197 after retry RPC after error@1903015474) -> (continuation of Deferred@453964791 after retry RPC after error@1971596846) -> (continuation of Deferred@1801019295 after retry RPC after error@1998174432) -> (continuation of Deferred@459566271 after retry RPC after error@1338365091) -> (continuation of Deferred@1849806691 after retry RPC after error@1411757299) -> (continuation of Deferred@1822174044 after retry RPC after error@220043936) -> (continuation of Deferred@1841788599 after retry RPC after error@339527120) -> (continuation of Deferred@435673792 after retry RPC after error@2027854788) -> (continuation of Deferred@779757734 after retry RPC after error@1545235196) -> (continuation of Deferred@2065468005 after retry RPC after error@2005937785) -> (continuation of Deferred@147851061 after retry RPC after error@127058265) -> (continuation of Deferred@415378540 after retry RPC after error@1859594987) -> (continuation of Deferred@1723232683 after retry RPC after error@2009066541) -> (continuation of Deferred@2115444730 after retry RPC after error@700510881) -> (continuation of Deferred@2083452187 after retry RPC after error@1962450999) -> (continuation of Deferred@844532125 after retry RPC after error@481108108) -> (continuation of Deferred@388012079 after retry RPC after error@644377572) -> (continuation of Deferred@552867029 after retry RPC after error@1437133063) -> (continuation of Deferred@1188749949 after retry RPC after error@596149769), errback=(continuation of Deferred@1567822593 after retry RPC after error@1950671885) -> (continuation of Deferred@831036525 after retry RPC after error@1238975199) -> (continuation of Deferred@209173502 after retry RPC after error@1598051057) -> (continuation of Deferred@710854272 after retry RPC after error@689092270) -> (continuation of Deferred@403390521 after retry RPC after error@1166102035) -> (continuation of Deferred@423095013 after retry RPC after error@632068267) -> (continuation of Deferred@1742999215 after retry RPC after error@677000598) -> (continuation of Deferred@236749498 after retry RPC after error@1337211410) -> (continuation of Deferred@149083197 after retry RPC after error@1903015474) -> (continuation of Deferred@453964791 after retry RPC after error@1971596846) -> (continuation of Deferred@1801019295 after retry RPC after error@1998174432) -> (continuation of Deferred@459566271 after retry RPC after error@1338365091) -> (continuation of Deferred@1849806691 after retry RPC after error@1411757299) -> (continuation of Deferred@1822174044 after retry RPC after error@220043936) -> (continuation of Deferred@1841788599 after retry RPC after error@339527120) -> (continuation of Deferred@435673792 after retry RPC after error@2027854788) -> (continuation of Deferred@779757734 after retry RPC after error@1545235196) -> (continuation of Deferred@2065468005 after retry RPC after error@2005937785) -> (continuation of Deferred@147851061 after retry RPC after error@127058265) -> (continuation of Deferred@415378540 after retry RPC after error@1859594987) -> (continuation of Deferred@1723232683 after retry RPC after error@2009066541) -> (continuation of Deferred@2115444730 after retry RPC after error@700510881) -> (continuation of Deferred@2083452187 after retry RPC after error@1962450999) -> (continuation of Deferred@844532125 after retry RPC after error@481108108) -> (continuation of Deferred@388012079 after retry RPC after error@644377572) -> (continuation of Deferred@552867029 after retry RPC after error@1437133063) -> (continuation of Deferred@1188749949 after retry RPC after error@596149769)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.68.188:38393
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:54.883 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:32:54.884 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#5) of source Source: KuduSource.
18:32:54.884 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to CANCELING.
18:32:54.885 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
18:32:54.886 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to CANCELING.
18:32:54.886 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
18:32:54.887 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#5) of source Source: KuduSource.
18:32:54.887 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to CANCELING.
18:32:54.892 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:54.893 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:54.893 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:54.894 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.894 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.894 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.894 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.894 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.894 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.895 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.895 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.895 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.895 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:54.900 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
18:32:54.900 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CANCELING to CANCELED.
18:32:54.900 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
18:32:54.901 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
18:32:54.901 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to CANCELING.
18:32:54.901 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
18:32:54.903 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
18:32:54.903 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CANCELING to CANCELED.
18:32:54.903 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
18:32:54.905 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#5 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_5.
18:32:54.906 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#5 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
18:32:54.906 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CANCELING to CANCELED.
18:32:54.907 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:32:54.907 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CANCELING to CANCELED.
18:32:54.907 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job fa73e37017778341a79e5b3ef3d55eb9
18:32:54.912 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:54.913 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:54.913 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:54.914 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.914 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.914 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.914 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.914 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.914 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.932 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:54.932 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:54.932 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:54.933 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:54.933 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:54.933 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:54.933 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:54.933 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:54.933 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:54.934 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:54.934 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:54.934 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:54.934 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:54.935 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.935 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.935 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.935 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:54.953 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:54.953 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:54.953 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:54.954 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.954 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.954 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.954 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.954 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.954 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.955 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.955 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.955 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.955 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:54.973 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:54.973 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:54.973 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:54.974 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.974 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.974 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:54.974 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.974 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.975 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.975 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.975 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:54.975 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:54.975 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:55.033 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:55.033 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:55.034 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:55.034 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:55.035 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:55.035 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:55.035 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:55.035 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:55.035 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:55.036 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:55.036 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:55.036 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:55.036 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:55.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535575121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:55.137 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
18:32:55.139 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
18:32:55.152 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:55.153 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:55.153 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:55.153 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:55.154 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:55.154 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:55.154 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:55.154 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:55.154 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:55.155 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:55.155 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:55.155 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:55.155 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:55.213 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:55.213 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:55.213 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:55.214 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:55.214 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:55.214 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:55.215 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:55.215 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:55.215 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:55.215 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:55.215 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:55.215 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:55.215 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:55.226 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:55.227 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:55.227 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:55.227 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:55.227 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:55.228 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:55.228 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:55.228 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:55.228 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:55.228 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:55.229 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:55.229 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:55.229 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:55.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:53.334012  4905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:55.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:54.738435  4903 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 4894
18:32:55.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.233840  4894 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.901s	user 0.721s	sys 1.172s
18:32:55.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.235728  4894 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.903s	user 0.721s	sys 1.173s
18:32:55.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.237309  4907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:55.238 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:55.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.240216  4906 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1902 milliseconds
18:32:55.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.240231  4894 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:32:55.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.241654  4894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:32:55.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.244278  4894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:32:55.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.245705  4894 hybrid_clock.cc:648] HybridClock initialized: now 1783535575245660 us; error 63 us; skew 500 ppm
18:32:55.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.246685  4894 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:32:55.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.247179  4892 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } attempt: 7
18:32:55.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.256165  4894 webserver.cc:534] Webserver started at http://127.4.179.61:45831/ using document root <none> and password file <none>
18:32:55.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.256969  4892 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.61:44733: Network error: Client connection negotiation failed: client connection to 127.4.179.61:44733: connect: Connection refused (error 111)
18:32:55.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.257499  4894 fs_manager.cc:362] Metadata directory not provided
18:32:55.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.257818  4894 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:32:55.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.258384  4894 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:32:55.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.264282  4894 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/data/instance:
18:32:55.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23"
18:32:55.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:55 on dist-test-slave-dxnw"
18:32:55.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.265849  4894 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/wal/instance:
18:32:55.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23"
18:32:55.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:55 on dist-test-slave-dxnw"
18:32:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.274794  4894 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.001s
18:32:55.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.281812  4924 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:32:55.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.282948  4894 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.007s	sys 0.000s
18:32:55.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.283317  4894 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/wal
18:32:55.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23"
18:32:55.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:55 on dist-test-slave-dxnw"
18:32:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.283682  4894 fs_report.cc:389] FS layout report
18:32:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:32:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/wal
18:32:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/wal
18:32:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/data/data
18:32:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:32:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:32:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:32:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:32:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:32:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:32:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:32:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:32:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:32:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:32:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:32:55.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.338140  4894 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:32:55.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.339828  4894 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:32:55.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.340235  4894 kserver.cc:163] Server-wide thread pool size limit: 3276
18:32:55.387 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:55.387 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:55.388 [DEBUG - pool-184-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:55.388 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:55.388 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:55.388 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:55.388 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:55.388 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:55.388 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:55.388 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:55.388 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:55.388 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:55.388 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:55.389 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29788), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [26ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [27ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [49ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [49ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [64ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [64ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [64ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [103ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [109ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [109ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [109ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [122ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [143ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [183ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [183ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [183ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [243ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [323ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [323ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [442ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [621ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [622ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1023ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1023ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1023ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2441ms] refreshing cache from master, [2441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2443ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2443ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2444ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2444ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3880ms] refreshing cache from master, [3881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3882ms] too many traces: truncated at 100 traces, deferred=Deferred@496640940(state=PENDING, result=null, callback=(continuation of Deferred@1273132419 after retry RPC after error@1021886347) -> (continuation of Deferred@988858236 after retry RPC after error@1983583437) -> (continuation of Deferred@783100388 after retry RPC after error@1472257885) -> (continuation of Deferred@1798781438 after retry RPC after error@1166333225) -> (continuation of Deferred@35731060 after retry RPC after error@1397373786) -> (continuation of Deferred@23068676 after retry RPC after error@1647222940) -> (continuation of Deferred@1773647931 after retry RPC after error@1797643964) -> (continuation of Deferred@1791263740 after retry RPC after error@2105140344) -> (continuation of Deferred@693890444 after retry RPC after error@1817056805) -> (continuation of Deferred@584819507 after retry RPC after error@280222004) -> (continuation of Deferred@1727160611 after retry RPC after error@2047978726) -> (continuation of Deferred@86792876 after retry RPC after error@198723908) -> (continuation of Deferred@2128005733 after retry RPC after error@156712901) -> (continuation of Deferred@1850342777 after retry RPC after error@655498141) -> (continuation of Deferred@1876916472 after retry RPC after error@1606863825) -> (continuation of Deferred@2126858085 after retry RPC after error@1237087699) -> (continuation of Deferred@1563479204 after retry RPC after error@876682384) -> (continuation of Deferred@1626053394 after retry RPC after error@1255372849) -> (continuation of Deferred@291362851 after retry RPC after error@759489284) -> (continuation of Deferred@298569397 after retry RPC after error@1082666573) -> (continuation of Deferred@1072396991 after retry RPC after error@893252229) -> (continuation of Deferred@2060201201 after retry RPC after error@2067242915) -> (continuation of Deferred@535637240 after retry RPC after error@1168002138) -> (continuation of Deferred@1580092348 after retry RPC after error@421727581) -> (continuation of Deferred@1868527725 after retry RPC after error@1477711168) -> (continuation of Deferred@1951127125 after retry RPC after error@1971545188) -> (continuation of Deferred@1636558505 after retry RPC after error@424497613), errback=(continuation of Deferred@1273132419 after retry RPC after error@1021886347) -> (continuation of Deferred@988858236 after retry RPC after error@1983583437) -> (continuation of Deferred@783100388 after retry RPC after error@1472257885) -> (continuation of Deferred@1798781438 after retry RPC after error@1166333225) -> (continuation of Deferred@35731060 after retry RPC after error@1397373786) -> (continuation of Deferred@23068676 after retry RPC after error@1647222940) -> (continuation of Deferred@1773647931 after retry RPC after error@1797643964) -> (continuation of Deferred@1791263740 after retry RPC after error@2105140344) -> (continuation of Deferred@693890444 after retry RPC after error@1817056805) -> (continuation of Deferred@584819507 after retry RPC after error@280222004) -> (continuation of Deferred@1727160611 after retry RPC after error@2047978726) -> (continuation of Deferred@86792876 after retry RPC after error@198723908) -> (continuation of Deferred@2128005733 after retry RPC after error@156712901) -> (continuation of Deferred@1850342777 after retry RPC after error@655498141) -> (continuation of Deferred@1876916472 after retry RPC after error@1606863825) -> (continuation of Deferred@2126858085 after retry RPC after error@1237087699) -> (continuation of Deferred@1563479204 after retry RPC after error@876682384) -> (continuation of Deferred@1626053394 after retry RPC after error@1255372849) -> (continuation of Deferred@291362851 after retry RPC after error@759489284) -> (continuation of Deferred@298569397 after retry RPC after error@1082666573) -> (continuation of Deferred@1072396991 after retry RPC after error@893252229) -> (continuation of Deferred@2060201201 after retry RPC after error@2067242915) -> (continuation of Deferred@535637240 after retry RPC after error@1168002138) -> (continuation of Deferred@1580092348 after retry RPC after error@421727581) -> (continuation of Deferred@1868527725 after retry RPC after error@1477711168) -> (continuation of Deferred@1951127125 after retry RPC after error@1971545188) -> (continuation of Deferred@1636558505 after retry RPC after error@424497613)))
18:32:55.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.420994  4894 rpc_server.cc:307] RPC server started. Bound to: 127.4.179.61:44733
18:32:55.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.421141  4976 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.179.61:44733 every 8 connection(s)
18:32:55.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.423945  4894 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/data/info.pb
18:32:55.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.430281  4977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:55.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.433979  4812 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 4894
18:32:55.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.434491  4812 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-1/wal/instance
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.436990  4812 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/wal
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/data
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/logs
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/data/info.pb
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.179.60:34679
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.179.60
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.179.20:42683
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.179.62:35121,127.4.179.61:44733,127.4.179.60:34679
18:32:55.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:55.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39497/jwks.json with env {}
18:32:55.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.441730  4977 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } has no permanent_uuid. Determining permanent_uuid...
18:32:55.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.466616  4977 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } has no permanent_uuid. Determining permanent_uuid...
18:32:55.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.481151  4977 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } has no permanent_uuid. Determining permanent_uuid...
18:32:55.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.483767  4927 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.179.60:34679: connect: Connection refused (error 111)
18:32:55.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.488430  4977 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.60:34679: Network error: Client connection negotiation failed: client connection to 127.4.179.60:34679: connect: Connection refused (error 111)
18:32:55.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.537971  4977 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } attempt: 1
18:32:55.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.542976  4977 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.60:34679: Network error: Client connection negotiation failed: client connection to 127.4.179.60:34679: connect: Connection refused (error 111)
18:32:55.574 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:32:55.574 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:32:55.575 [DEBUG - pool-188-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:32:55.575 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:55.575 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:55.575 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:55.575 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:32:55.575 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:55.575 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:55.575 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:55.575 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:32:55.575 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:32:55.575 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:32:55.576 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29941), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [46ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [47ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [48ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [48ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [78ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [93ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [94ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [123ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [133ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [135ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [135ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [162ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [182ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [182ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [224ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [225ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [303ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [403ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [641ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [642ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [642ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [642ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [761ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [761ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [761ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [762ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1202ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2240ms] refreshing cache from master, [2240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2241ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2242ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5780ms] refreshing cache from master, [5780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5781ms] too many traces: truncated at 100 traces, deferred=Deferred@1786893360(state=PENDING, result=null, callback=(continuation of Deferred@346074153 after retry RPC after error@1743686773) -> (continuation of Deferred@133709215 after retry RPC after error@1673283844) -> (continuation of Deferred@1919705278 after retry RPC after error@1634912162) -> (continuation of Deferred@664799958 after retry RPC after error@651531087) -> (continuation of Deferred@934117051 after retry RPC after error@1083568187) -> (continuation of Deferred@1732551749 after retry RPC after error@1828789257) -> (continuation of Deferred@830865332 after retry RPC after error@1593755031) -> (continuation of Deferred@475669633 after retry RPC after error@2036236887) -> (continuation of Deferred@1731766935 after retry RPC after error@1329727898) -> (continuation of Deferred@40977119 after retry RPC after error@263202044) -> (continuation of Deferred@763255695 after retry RPC after error@1924110691) -> (continuation of Deferred@2059422291 after retry RPC after error@1960384051) -> (continuation of Deferred@723814660 after retry RPC after error@625899906) -> (continuation of Deferred@1571040682 after retry RPC after error@1643172003) -> (continuation of Deferred@1846741296 after retry RPC after error@944238361) -> (continuation of Deferred@1148341446 after retry RPC after error@593557795) -> (continuation of Deferred@1439444726 after retry RPC after error@1383345265) -> (continuation of Deferred@79056517 after retry RPC after error@540743377) -> (continuation of Deferred@338962366 after retry RPC after error@1741723373) -> (continuation of Deferred@1361325812 after retry RPC after error@701573023) -> (continuation of Deferred@476966092 after retry RPC after error@2137618002) -> (continuation of Deferred@264938693 after retry RPC after error@789022588), errback=(continuation of Deferred@346074153 after retry RPC after error@1743686773) -> (continuation of Deferred@133709215 after retry RPC after error@1673283844) -> (continuation of Deferred@1919705278 after retry RPC after error@1634912162) -> (continuation of Deferred@664799958 after retry RPC after error@651531087) -> (continuation of Deferred@934117051 after retry RPC after error@1083568187) -> (continuation of Deferred@1732551749 after retry RPC after error@1828789257) -> (continuation of Deferred@830865332 after retry RPC after error@1593755031) -> (continuation of Deferred@475669633 after retry RPC after error@2036236887) -> (continuation of Deferred@1731766935 after retry RPC after error@1329727898) -> (continuation of Deferred@40977119 after retry RPC after error@263202044) -> (continuation of Deferred@763255695 after retry RPC after error@1924110691) -> (continuation of Deferred@2059422291 after retry RPC after error@1960384051) -> (continuation of Deferred@723814660 after retry RPC after error@625899906) -> (continuation of Deferred@1571040682 after retry RPC after error@1643172003) -> (continuation of Deferred@1846741296 after retry RPC after error@944238361) -> (continuation of Deferred@1148341446 after retry RPC after error@593557795) -> (continuation of Deferred@1439444726 after retry RPC after error@1383345265) -> (continuation of Deferred@79056517 after retry RPC after error@540743377) -> (continuation of Deferred@338962366 after retry RPC after error@1741723373) -> (continuation of Deferred@1361325812 after retry RPC after error@701573023) -> (continuation of Deferred@476966092 after retry RPC after error@2137618002) -> (continuation of Deferred@264938693 after retry RPC after error@789022588)))
18:32:55.592 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:55.592 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:55.593 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:55.593 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:55.593 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:55.593 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:55.593 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:55.593 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:55.593 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:55.593 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:55.593 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:55.593 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:55.593 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:55.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.611449  4977 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } attempt: 2
18:32:55.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.615865  4977 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.60:34679: Network error: Client connection negotiation failed: client connection to 127.4.179.60:34679: connect: Connection refused (error 111)
18:32:55.621 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535575621 for job 9de81db54be40687a2a82164db1dc50b.
18:32:55.631 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:32:55.632 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
18:32:55.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.707331  4977 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } attempt: 3
18:32:55.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.712296  4977 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.60:34679: Network error: Client connection negotiation failed: client connection to 127.4.179.60:34679: connect: Connection refused (error 111)
18:32:55.737 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:55.748 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:55.748 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:55.748 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:55.748 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:55.748 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:55.749 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:55.749 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:55.749 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:55.749 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:55.749 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:55.749 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:55.749 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:55.749 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:55.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.772009  4979 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:32:55.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.772610  4979 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:32:55.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.773192  4979 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:32:55.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.807724  4979 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:32:55.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.808007  4979 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:32:55.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.808213  4979 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:32:55.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.808415  4979 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:32:55.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.808610  4979 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:32:55.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.808827  4979 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39497/jwks.json
18:32:55.818 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:55.818 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:55.818 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:55.818 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.818 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.818 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.818 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.818 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.818 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.818 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.818 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.818 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.818 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:55.819 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28365), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [13ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [34ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [34ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [34ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [80ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [159ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [161ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [161ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [187ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [197ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [198ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [198ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [221ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [221ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [222ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [222ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [240ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [241ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [241ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [241ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [274ms] refreshing cache from master, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [275ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [280ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [281ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [281ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [361ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [361ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [361ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [362ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [502ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [502ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [503ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [503ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [522ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [522ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [526ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [526ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [720ms] refreshing cache from master, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [721ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [722ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1603ms] refreshing cache from master, [1603ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1604ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1604ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1605ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1605ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1606ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1606ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1741ms] refreshing cache from master, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1743ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1744ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1744ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1744ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [4760ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [4762ms] too many traces: truncated at 100 traces, deferred=Deferred@914392299(state=PENDING, result=null, callback=(continuation of Deferred@607197596 after retry RPC after error@1018145216) -> (continuation of Deferred@1314448736 after retry RPC after error@2085455772) -> (continuation of Deferred@1344048240 after retry RPC after error@297590298) -> (continuation of Deferred@415652520 after retry RPC after error@145186635) -> (continuation of Deferred@1022115107 after retry RPC after error@1272408234) -> (continuation of Deferred@1634629730 after retry RPC after error@1400974851) -> (continuation of Deferred@240718965 after retry RPC after error@2126233388) -> (continuation of Deferred@1812231665 after retry RPC after error@909098820) -> (continuation of Deferred@1880354632 after retry RPC after error@1408400569) -> (continuation of Deferred@471216331 after retry RPC after error@1460169106) -> (continuation of Deferred@948872596 after retry RPC after error@2027491720) -> (continuation of Deferred@1432679984 after retry RPC after error@1093947895) -> (continuation of Deferred@207351360 after retry RPC after error@1010756370) -> (continuation of Deferred@1310281683 after retry RPC after error@767624206) -> (continuation of Deferred@2117850648 after retry RPC after error@899073206) -> (continuation of Deferred@838164992 after retry RPC after error@347201860) -> (continuation of Deferred@882540252 after retry RPC after error@925544333) -> (continuation of Deferred@768949770 after retry RPC after error@922046773) -> (continuation of Deferred@1375643049 after retry RPC after error@860503772) -> (continuation of Deferred@929784785 after retry RPC after error@730591472) -> (continuation of Deferred@268225477 after retry RPC after error@1839380536) -> (continuation of Deferred@20655030 after retry RPC after error@1967343377) -> (continuation of Deferred@478681247 after retry RPC after error@1687359566), errback=(continuation of Deferred@607197596 after retry RPC after error@1018145216) -> (continuation of Deferred@1314448736 after retry RPC after error@2085455772) -> (continuation of Deferred@1344048240 after retry RPC after error@297590298) -> (continuation of Deferred@415652520 after retry RPC after error@145186635) -> (continuation of Deferred@1022115107 after retry RPC after error@1272408234) -> (continuation of Deferred@1634629730 after retry RPC after error@1400974851) -> (continuation of Deferred@240718965 after retry RPC after error@2126233388) -> (continuation of Deferred@1812231665 after retry RPC after error@909098820) -> (continuation of Deferred@1880354632 after retry RPC after error@1408400569) -> (continuation of Deferred@471216331 after retry RPC after error@1460169106) -> (continuation of Deferred@948872596 after retry RPC after error@2027491720) -> (continuation of Deferred@1432679984 after retry RPC after error@1093947895) -> (continuation of Deferred@207351360 after retry RPC after error@1010756370) -> (continuation of Deferred@1310281683 after retry RPC after error@767624206) -> (continuation of Deferred@2117850648 after retry RPC after error@899073206) -> (continuation of Deferred@838164992 after retry RPC after error@347201860) -> (continuation of Deferred@882540252 after retry RPC after error@925544333) -> (continuation of Deferred@768949770 after retry RPC after error@922046773) -> (continuation of Deferred@1375643049 after retry RPC after error@860503772) -> (continuation of Deferred@929784785 after retry RPC after error@730591472) -> (continuation of Deferred@268225477 after retry RPC after error@1839380536) -> (continuation of Deferred@20655030 after retry RPC after error@1967343377) -> (continuation of Deferred@478681247 after retry RPC after error@1687359566)))
18:32:55.820 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:55.820 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:55.819 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28365), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [13ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [34ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [34ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [34ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [80ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [159ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [161ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [161ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [187ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [197ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [198ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [198ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [221ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [221ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [222ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [222ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [240ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [241ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [241ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [241ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [274ms] refreshing cache from master, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [275ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [280ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [281ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [281ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [361ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [361ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [361ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [362ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [502ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [502ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [503ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [503ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [522ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [522ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [526ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [526ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [720ms] refreshing cache from master, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [721ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [722ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1603ms] refreshing cache from master, [1603ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1604ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1604ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1605ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1605ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1606ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1606ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1741ms] refreshing cache from master, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1743ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1744ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1744ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1744ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [4760ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [4762ms] too many traces: truncated at 100 traces, deferred=Deferred@914392299(state=PENDING, result=null, callback=(continuation of Deferred@607197596 after retry RPC after error@1018145216) -> (continuation of Deferred@1314448736 after retry RPC after error@2085455772) -> (continuation of Deferred@1344048240 after retry RPC after error@297590298) -> (continuation of Deferred@415652520 after retry RPC after error@145186635) -> (continuation of Deferred@1022115107 after retry RPC after error@1272408234) -> (continuation of Deferred@1634629730 after retry RPC after error@1400974851) -> (continuation of Deferred@240718965 after retry RPC after error@2126233388) -> (continuation of Deferred@1812231665 after retry RPC after error@909098820) -> (continuation of Deferred@1880354632 after retry RPC after error@1408400569) -> (continuation of Deferred@471216331 after retry RPC after error@1460169106) -> (continuation of Deferred@948872596 after retry RPC after error@2027491720) -> (continuation of Deferred@1432679984 after retry RPC after error@1093947895) -> (continuation of Deferred@207351360 after retry RPC after error@1010756370) -> (continuation of Deferred@1310281683 after retry RPC after error@767624206) -> (continuation of Deferred@2117850648 after retry RPC after error@899073206) -> (continuation of Deferred@838164992 after retry RPC after error@347201860) -> (continuation of Deferred@882540252 after retry RPC after error@925544333) -> (continuation of Deferred@768949770 after retry RPC after error@922046773) -> (continuation of Deferred@1375643049 after retry RPC after error@860503772) -> (continuation of Deferred@929784785 after retry RPC after error@730591472) -> (continuation of Deferred@268225477 after retry RPC after error@1839380536) -> (continuation of Deferred@20655030 after retry RPC after error@1967343377) -> (continuation of Deferred@478681247 after retry RPC after error@1687359566), errback=(continuation of Deferred@607197596 after retry RPC after error@1018145216) -> (continuation of Deferred@1314448736 after retry RPC after error@2085455772) -> (continuation of Deferred@1344048240 after retry RPC after error@297590298) -> (continuation of Deferred@415652520 after retry RPC after error@145186635) -> (continuation of Deferred@1022115107 after retry RPC after error@1272408234) -> (continuation of Deferred@1634629730 after retry RPC after error@1400974851) -> (continuation of Deferred@240718965 after retry RPC after error@2126233388) -> (continuation of Deferred@1812231665 after retry RPC after error@909098820) -> (continuation of Deferred@1880354632 after retry RPC after error@1408400569) -> (continuation of Deferred@471216331 after retry RPC after error@1460169106) -> (continuation of Deferred@948872596 after retry RPC after error@2027491720) -> (continuation of Deferred@1432679984 after retry RPC after error@1093947895) -> (continuation of Deferred@207351360 after retry RPC after error@1010756370) -> (continuation of Deferred@1310281683 after retry RPC after error@767624206) -> (continuation of Deferred@2117850648 after retry RPC after error@899073206) -> (continuation of Deferred@838164992 after retry RPC after error@347201860) -> (continuation of Deferred@882540252 after retry RPC after error@925544333) -> (continuation of Deferred@768949770 after retry RPC after error@922046773) -> (continuation of Deferred@1375643049 after retry RPC after error@860503772) -> (continuation of Deferred@929784785 after retry RPC after error@730591472) -> (continuation of Deferred@268225477 after retry RPC after error@1839380536) -> (continuation of Deferred@20655030 after retry RPC after error@1967343377) -> (continuation of Deferred@478681247 after retry RPC after error@1687359566)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28365), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [13ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [34ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [34ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [34ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [80ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [159ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [161ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [161ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [187ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [197ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [198ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [198ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [221ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [221ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [222ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [222ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [240ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [241ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [241ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [241ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [274ms] refreshing cache from master, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [275ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [280ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [281ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [281ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [361ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [361ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [361ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [362ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [502ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [502ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [503ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [503ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [522ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [522ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [526ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [526ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [720ms] refreshing cache from master, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [721ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [722ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1603ms] refreshing cache from master, [1603ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1604ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1604ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1605ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1605ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1606ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1606ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1741ms] refreshing cache from master, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1743ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1744ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1744ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1744ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [4760ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [4762ms] too many traces: truncated at 100 traces, deferred=Deferred@914392299(state=PENDING, result=null, callback=(continuation of Deferred@607197596 after retry RPC after error@1018145216) -> (continuation of Deferred@1314448736 after retry RPC after error@2085455772) -> (continuation of Deferred@1344048240 after retry RPC after error@297590298) -> (continuation of Deferred@415652520 after retry RPC after error@145186635) -> (continuation of Deferred@1022115107 after retry RPC after error@1272408234) -> (continuation of Deferred@1634629730 after retry RPC after error@1400974851) -> (continuation of Deferred@240718965 after retry RPC after error@2126233388) -> (continuation of Deferred@1812231665 after retry RPC after error@909098820) -> (continuation of Deferred@1880354632 after retry RPC after error@1408400569) -> (continuation of Deferred@471216331 after retry RPC after error@1460169106) -> (continuation of Deferred@948872596 after retry RPC after error@2027491720) -> (continuation of Deferred@1432679984 after retry RPC after error@1093947895) -> (continuation of Deferred@207351360 after retry RPC after error@1010756370) -> (continuation of Deferred@1310281683 after retry RPC after error@767624206) -> (continuation of Deferred@2117850648 after retry RPC after error@899073206) -> (continuation of Deferred@838164992 after retry RPC after error@347201860) -> (continuation of Deferred@882540252 after retry RPC after error@925544333) -> (continuation of Deferred@768949770 after retry RPC after error@922046773) -> (continuation of Deferred@1375643049 after retry RPC after error@860503772) -> (continuation of Deferred@929784785 after retry RPC after error@730591472) -> (continuation of Deferred@268225477 after retry RPC after error@1839380536) -> (continuation of Deferred@20655030 after retry RPC after error@1967343377) -> (continuation of Deferred@478681247 after retry RPC after error@1687359566), errback=(continuation of Deferred@607197596 after retry RPC after error@1018145216) -> (continuation of Deferred@1314448736 after retry RPC after error@2085455772) -> (continuation of Deferred@1344048240 after retry RPC after error@297590298) -> (continuation of Deferred@415652520 after retry RPC after error@145186635) -> (continuation of Deferred@1022115107 after retry RPC after error@1272408234) -> (continuation of Deferred@1634629730 after retry RPC after error@1400974851) -> (continuation of Deferred@240718965 after retry RPC after error@2126233388) -> (continuation of Deferred@1812231665 after retry RPC after error@909098820) -> (continuation of Deferred@1880354632 after retry RPC after error@1408400569) -> (continuation of Deferred@471216331 after retry RPC after error@1460169106) -> (continuation of Deferred@948872596 after retry RPC after error@2027491720) -> (continuation of Deferred@1432679984 after retry RPC after error@1093947895) -> (continuation of Deferred@207351360 after retry RPC after error@1010756370) -> (continuation of Deferred@1310281683 after retry RPC after error@767624206) -> (continuation of Deferred@2117850648 after retry RPC after error@899073206) -> (continuation of Deferred@838164992 after retry RPC after error@347201860) -> (continuation of Deferred@882540252 after retry RPC after error@925544333) -> (continuation of Deferred@768949770 after retry RPC after error@922046773) -> (continuation of Deferred@1375643049 after retry RPC after error@860503772) -> (continuation of Deferred@929784785 after retry RPC after error@730591472) -> (continuation of Deferred@268225477 after retry RPC after error@1839380536) -> (continuation of Deferred@20655030 after retry RPC after error@1967343377) -> (continuation of Deferred@478681247 after retry RPC after error@1687359566)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.0.106.252:46705
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:55.820 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.820 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.820 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.820 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.820 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.820 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.820 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:55.821 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.821 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.821 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.821 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:55.823 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28365), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [13ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [34ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [34ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [34ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [80ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [159ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [161ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [161ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [187ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [197ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [198ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [198ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [221ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [221ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [222ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [222ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [240ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [241ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [241ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [241ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [274ms] refreshing cache from master, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [275ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [280ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [281ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [281ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [361ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [361ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [361ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [362ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [502ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [502ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [503ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [503ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [522ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [522ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [526ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [526ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [720ms] refreshing cache from master, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [721ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [722ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1603ms] refreshing cache from master, [1603ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1604ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1604ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1605ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1605ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1606ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1606ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1741ms] refreshing cache from master, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1743ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1744ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1744ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1744ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [4760ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [4762ms] too many traces: truncated at 100 traces, deferred=Deferred@914392299(state=PENDING, result=null, callback=(continuation of Deferred@607197596 after retry RPC after error@1018145216) -> (continuation of Deferred@1314448736 after retry RPC after error@2085455772) -> (continuation of Deferred@1344048240 after retry RPC after error@297590298) -> (continuation of Deferred@415652520 after retry RPC after error@145186635) -> (continuation of Deferred@1022115107 after retry RPC after error@1272408234) -> (continuation of Deferred@1634629730 after retry RPC after error@1400974851) -> (continuation of Deferred@240718965 after retry RPC after error@2126233388) -> (continuation of Deferred@1812231665 after retry RPC after error@909098820) -> (continuation of Deferred@1880354632 after retry RPC after error@1408400569) -> (continuation of Deferred@471216331 after retry RPC after error@1460169106) -> (continuation of Deferred@948872596 after retry RPC after error@2027491720) -> (continuation of Deferred@1432679984 after retry RPC after error@1093947895) -> (continuation of Deferred@207351360 after retry RPC after error@1010756370) -> (continuation of Deferred@1310281683 after retry RPC after error@767624206) -> (continuation of Deferred@2117850648 after retry RPC after error@899073206) -> (continuation of Deferred@838164992 after retry RPC after error@347201860) -> (continuation of Deferred@882540252 after retry RPC after error@925544333) -> (continuation of Deferred@768949770 after retry RPC after error@922046773) -> (continuation of Deferred@1375643049 after retry RPC after error@860503772) -> (continuation of Deferred@929784785 after retry RPC after error@730591472) -> (continuation of Deferred@268225477 after retry RPC after error@1839380536) -> (continuation of Deferred@20655030 after retry RPC after error@1967343377) -> (continuation of Deferred@478681247 after retry RPC after error@1687359566), errback=(continuation of Deferred@607197596 after retry RPC after error@1018145216) -> (continuation of Deferred@1314448736 after retry RPC after error@2085455772) -> (continuation of Deferred@1344048240 after retry RPC after error@297590298) -> (continuation of Deferred@415652520 after retry RPC after error@145186635) -> (continuation of Deferred@1022115107 after retry RPC after error@1272408234) -> (continuation of Deferred@1634629730 after retry RPC after error@1400974851) -> (continuation of Deferred@240718965 after retry RPC after error@2126233388) -> (continuation of Deferred@1812231665 after retry RPC after error@909098820) -> (continuation of Deferred@1880354632 after retry RPC after error@1408400569) -> (continuation of Deferred@471216331 after retry RPC after error@1460169106) -> (continuation of Deferred@948872596 after retry RPC after error@2027491720) -> (continuation of Deferred@1432679984 after retry RPC after error@1093947895) -> (continuation of Deferred@207351360 after retry RPC after error@1010756370) -> (continuation of Deferred@1310281683 after retry RPC after error@767624206) -> (continuation of Deferred@2117850648 after retry RPC after error@899073206) -> (continuation of Deferred@838164992 after retry RPC after error@347201860) -> (continuation of Deferred@882540252 after retry RPC after error@925544333) -> (continuation of Deferred@768949770 after retry RPC after error@922046773) -> (continuation of Deferred@1375643049 after retry RPC after error@860503772) -> (continuation of Deferred@929784785 after retry RPC after error@730591472) -> (continuation of Deferred@268225477 after retry RPC after error@1839380536) -> (continuation of Deferred@20655030 after retry RPC after error@1967343377) -> (continuation of Deferred@478681247 after retry RPC after error@1687359566)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28365), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [13ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [34ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [34ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [34ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [80ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [159ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [161ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [161ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [187ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [197ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [198ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [198ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [221ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [221ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [222ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [222ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [240ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [241ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [241ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [241ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [274ms] refreshing cache from master, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [275ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [280ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [281ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [281ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [361ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [361ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [361ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [362ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [502ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [502ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [503ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [503ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [522ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [522ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [526ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [526ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [720ms] refreshing cache from master, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [721ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [722ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1603ms] refreshing cache from master, [1603ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1604ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1604ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1605ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1605ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1606ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1606ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1741ms] refreshing cache from master, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1743ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1744ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1744ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1744ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [4760ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [4762ms] too many traces: truncated at 100 traces, deferred=Deferred@914392299(state=PENDING, result=null, callback=(continuation of Deferred@607197596 after retry RPC after error@1018145216) -> (continuation of Deferred@1314448736 after retry RPC after error@2085455772) -> (continuation of Deferred@1344048240 after retry RPC after error@297590298) -> (continuation of Deferred@415652520 after retry RPC after error@145186635) -> (continuation of Deferred@1022115107 after retry RPC after error@1272408234) -> (continuation of Deferred@1634629730 after retry RPC after error@1400974851) -> (continuation of Deferred@240718965 after retry RPC after error@2126233388) -> (continuation of Deferred@1812231665 after retry RPC after error@909098820) -> (continuation of Deferred@1880354632 after retry RPC after error@1408400569) -> (continuation of Deferred@471216331 after retry RPC after error@1460169106) -> (continuation of Deferred@948872596 after retry RPC after error@2027491720) -> (continuation of Deferred@1432679984 after retry RPC after error@1093947895) -> (continuation of Deferred@207351360 after retry RPC after error@1010756370) -> (continuation of Deferred@1310281683 after retry RPC after error@767624206) -> (continuation of Deferred@2117850648 after retry RPC after error@899073206) -> (continuation of Deferred@838164992 after retry RPC after error@347201860) -> (continuation of Deferred@882540252 after retry RPC after error@925544333) -> (continuation of Deferred@768949770 after retry RPC after error@922046773) -> (continuation of Deferred@1375643049 after retry RPC after error@860503772) -> (continuation of Deferred@929784785 after retry RPC after error@730591472) -> (continuation of Deferred@268225477 after retry RPC after error@1839380536) -> (continuation of Deferred@20655030 after retry RPC after error@1967343377) -> (continuation of Deferred@478681247 after retry RPC after error@1687359566), errback=(continuation of Deferred@607197596 after retry RPC after error@1018145216) -> (continuation of Deferred@1314448736 after retry RPC after error@2085455772) -> (continuation of Deferred@1344048240 after retry RPC after error@297590298) -> (continuation of Deferred@415652520 after retry RPC after error@145186635) -> (continuation of Deferred@1022115107 after retry RPC after error@1272408234) -> (continuation of Deferred@1634629730 after retry RPC after error@1400974851) -> (continuation of Deferred@240718965 after retry RPC after error@2126233388) -> (continuation of Deferred@1812231665 after retry RPC after error@909098820) -> (continuation of Deferred@1880354632 after retry RPC after error@1408400569) -> (continuation of Deferred@471216331 after retry RPC after error@1460169106) -> (continuation of Deferred@948872596 after retry RPC after error@2027491720) -> (continuation of Deferred@1432679984 after retry RPC after error@1093947895) -> (continuation of Deferred@207351360 after retry RPC after error@1010756370) -> (continuation of Deferred@1310281683 after retry RPC after error@767624206) -> (continuation of Deferred@2117850648 after retry RPC after error@899073206) -> (continuation of Deferred@838164992 after retry RPC after error@347201860) -> (continuation of Deferred@882540252 after retry RPC after error@925544333) -> (continuation of Deferred@768949770 after retry RPC after error@922046773) -> (continuation of Deferred@1375643049 after retry RPC after error@860503772) -> (continuation of Deferred@929784785 after retry RPC after error@730591472) -> (continuation of Deferred@268225477 after retry RPC after error@1839380536) -> (continuation of Deferred@20655030 after retry RPC after error@1967343377) -> (continuation of Deferred@478681247 after retry RPC after error@1687359566)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.0.106.252:46705
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:32:55.823 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:32:55.824 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
18:32:55.824 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to CANCELING.
18:32:55.824 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
18:32:55.824 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
18:32:55.824 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
18:32:55.824 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to CANCELING.
18:32:55.824 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
18:32:55.825 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to CANCELING.
18:32:55.825 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
18:32:55.825 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
18:32:55.826 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:32:55.826 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
18:32:55.826 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
18:32:55.826 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CANCELING to CANCELED.
18:32:55.826 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
18:32:55.827 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:32:55.827 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
18:32:55.827 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
18:32:55.827 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
18:32:55.827 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to CANCELING.
18:32:55.827 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
18:32:55.828 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:32:55.828 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
18:32:55.828 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
18:32:55.828 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
18:32:55.828 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
18:32:55.829 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
18:32:55.829 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CANCELING to CANCELED.
18:32:55.830 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:32:55.830 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
18:32:55.830 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
18:32:55.831 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:32:55.831 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 4cd649562a0f5305571102b5c888c5a9
18:32:55.832 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:55.832 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:55.832 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:55.835 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:55.835 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:55.835 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:55.835 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:55.835 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:55.835 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:55.835 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:55.835 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:55.835 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:55.835 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:55.837 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:55.838 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:55.838 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:55.838 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.838 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.838 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.839 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.838 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.838 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.839 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.839 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.839 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.839 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:55.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.855734  4977 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } attempt: 4
18:32:55.857 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:55.858 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:55.858 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:55.858 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.858 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.858 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.859 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.859 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.859 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.859 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.859 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.860 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.860 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:55.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.862275  4977 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.60:34679: Network error: Client connection negotiation failed: client connection to 127.4.179.60:34679: connect: Connection refused (error 111)
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.862687  4979 master_runner.cc:387] Master server non-default flags:
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.179.20:42683
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/data
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/wal
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.179.62:35121,127.4.179.61:44733,127.4.179.60:34679
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.179.60:34679
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39497/jwks.json
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/data/info.pb
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.179.60
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/logs
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:32:55.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:32:55.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.864439  4979 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:32:55.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:55.866400  4979 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:32:55.877 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:55.878 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:55.878 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:55.878 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.878 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.878 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.878 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.878 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.879 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.878 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.879 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.879 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.879 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:55.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.882311  4998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:55.897 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:55.898 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:55.898 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:55.898 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.898 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.899 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.899 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.899 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.899 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.899 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.899 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.899 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.899 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:55.901 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:55.901 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:55.901 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:55.901 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:55.902 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:55.902 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:55.902 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:55.902 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:55.902 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:55.902 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:55.902 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:55.902 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:55.902 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:55.938 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:55.938 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:55.939 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.939 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.939 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.939 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.939 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.939 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:55.939 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.940 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.940 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.940 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.940 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:55.978 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:55.978 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:55.978 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:55.979 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.979 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.979 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:55.979 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.979 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.979 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:55.979 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.980 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.980 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:55.980 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:56.017 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:56.018 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:56.018 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.018 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.018 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.019 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.019 [DEBUG - pool-190-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:56.020 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.020 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.020 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.020 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.020 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.020 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:56.070 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9) switched from state RESTARTING to RUNNING.
18:32:56.071 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 4cd649562a0f5305571102b5c888c5a9 from Checkpoint 65 @ 1783535546001 for 4cd649562a0f5305571102b5c888c5a9 located at file:/tmp/junit5514029058471043739/checkpoints/4cd649562a0f5305571102b5c888c5a9/chk-65.
18:32:56.072 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
18:32:56.073 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:32:56.074 [INFO - Thread-41] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:32:56.074 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
18:32:56.074 [DEBUG - Thread-41] (Connection.java:575) [peer master-127.0.106.253:45189(127.0.106.253:45189)] disconnecting while in state TERMINATED
18:32:56.074 [DEBUG - Thread-41] (Connection.java:575) [peer master-127.0.106.254:32967(127.0.106.254:32967)] disconnecting while in state TERMINATED
18:32:56.074 [DEBUG - Thread-41] (Connection.java:575) [peer master-127.0.106.252:46705(127.0.106.252:46705)] disconnecting while in state TERMINATED
18:32:56.075 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:32:56.076 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:32:56.076 [INFO - Thread-41] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:32:56.077 [INFO - Thread-41] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:32:56.077 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
18:32:56.077 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id d0320e7b86362daa97e494337af6f333
18:32:56.077 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot d0320e7b86362daa97e494337af6f333.
18:32:56.079 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id d0320e7b86362daa97e494337af6f333.
18:32:56.079 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
18:32:56.079 [DEBUG - Thread-41] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:56.080 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:32:56.080 [INFO - Thread-41] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:32:56.080 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
18:32:56.080 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id 0abd8d1f15ad274a5029e6ed83960f8c
18:32:56.081 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
18:32:56.081 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:32:56.082 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
18:32:56.082 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id c230971fad26d6cfa2b63ff44e7a1af5
18:32:56.082 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
18:32:56.083 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:32:56.084 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
18:32:56.084 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id 163e6d56962e3a45c0e4353eb3be3a9b
18:32:56.085 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:56.085 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:56.086 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:56.086 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:56.086 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:56.086 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:56.086 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:56.086 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:56.086 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:56.087 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:56.087 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:56.087 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:56.087 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:56.087 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 0abd8d1f15ad274a5029e6ed83960f8c.
18:32:56.088 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:56.088 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id 0abd8d1f15ad274a5029e6ed83960f8c.
18:32:56.088 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:56.088 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:56.088 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:32:56.089 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
18:32:56.089 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
18:32:56.090 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5c36358c
18:32:56.090 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:56.090 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:32:56.091 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
18:32:56.091 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
18:32:56.093 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot c230971fad26d6cfa2b63ff44e7a1af5.
18:32:56.094 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id c230971fad26d6cfa2b63ff44e7a1af5.
18:32:56.095 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
18:32:56.095 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
18:32:56.097 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@377dc20
18:32:56.097 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:56.098 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:32:56.099 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
18:32:56.099 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
18:32:56.101 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:56.101 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:56.101 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:56.102 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:56.102 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:56.102 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:56.102 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@350fc46b
18:32:56.102 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:56.103 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:56.103 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:56.103 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:56.103 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:56.103 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:56.103 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:56.106 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 163e6d56962e3a45c0e4353eb3be3a9b.
18:32:56.107 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id 163e6d56962e3a45c0e4353eb3be3a9b.
18:32:56.108 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
18:32:56.108 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:56.109 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3a926e48
18:32:56.108 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
18:32:56.110 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6b24461
18:32:56.110 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:56.111 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:56.113 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:32:56.113 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
18:32:56.114 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
18:32:56.116 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
18:32:56.116 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
18:32:56.117 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1d8cb2c4
18:32:56.117 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:32:56.117 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:32:56.118 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
18:32:56.118 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
18:32:56.120 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@16796180
18:32:56.121 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535576121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:56.123 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:56.124 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:56.125 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6120df8b
18:32:56.128 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:32:56.129 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:32:56.131 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
18:32:56.135 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.136 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.139 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:56.139 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.139 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.140 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.156 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.157 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.158 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.158 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.158 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.159 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:56.161943  4977 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } attempt: 5
18:32:56.167 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:56.173717  4977 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.60:34679: Network error: Client connection negotiation failed: client connection to 127.4.179.60:34679: connect: Connection refused (error 111)
18:32:56.175 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.175 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.175 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.175 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.176 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.176 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.176 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.178 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.178 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.178 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.178 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.179 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.180 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.180 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.180 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.181 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.181 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.181 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.181 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.182 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:56.182 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.182 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.183 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.188 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.188 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.188 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.188 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:56.191 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.192 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.192 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.192 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.196 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.199 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.200 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.200 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.200 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.203 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:56.208 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.208 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.208 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.208 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.209 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.210 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.210 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.210 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.211 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.211 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.211 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.212 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.212 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.212 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.213 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.213 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.215 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.215 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.216 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.217 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.217 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.217 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.217 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.218 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.218 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.218 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.219 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.219 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.219 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.219 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.219 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.220 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:56.221 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.221 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.221 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.222 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.223 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.223 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.223 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.223 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.224 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.224 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.224 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.225 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.225 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.225 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.225 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.227 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:56.227 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.227 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.227 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.229 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.229 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.229 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.229 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:56.231 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.231 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.232 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.232 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.232 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.232 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.232 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.232 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.234 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.234 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.234 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.234 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.235 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.235 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.236 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.236 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.236 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.236 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.236 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.236 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.236 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.236 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.236 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.236 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.236 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.236 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.237 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:56.239 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.239 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.240 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.240 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.240 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.240 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.241 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.241 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.241 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.241 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.241 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.241 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.241 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.241 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.243 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.243 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:56.244 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.244 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.244 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.251 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.251 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.251 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.251 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.252 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.252 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.252 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.253 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.253 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.253 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.253 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.253 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:56.254 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.254 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.254 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.254 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.254 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.254 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.254 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.254 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.255 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.255 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.255 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:56.255 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.255 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.255 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.255 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.255 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.256 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.256 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.256 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:56.256 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.256 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.256 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.256 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.256 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.257 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.257 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.257 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.257 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.257 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.257 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.257 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.257 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.258 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.258 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.258 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.258 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.258 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.258 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.258 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.259 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.259 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.259 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.259 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.259 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.259 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.260 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.260 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.260 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.260 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.260 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.263 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.263 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:56.263 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.263 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.263 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:56.263 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.263 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:56.264 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.264 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.264 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.264 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.264 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.264 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.265 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.265 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.265 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.265 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:56.266 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.266 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.266 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.266 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.276 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.276 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.276 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.276 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.276 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.277 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.277 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.277 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.277 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.277 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.277 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.277 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.277 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.277 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.277 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.277 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.277 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.277 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.278 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.278 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.278 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.278 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.278 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.278 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.278 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.278 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.278 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.278 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.278 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.278 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.279 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.279 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.279 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.279 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.279 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.279 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.279 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.279 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.279 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.280 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.280 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.280 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.281 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.281 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.319 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:56.319 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:56.320 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:56.320 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.320 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.321 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.321 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.321 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.321 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.321 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.321 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.321 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.320 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.322 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.322 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.322 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.322 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.322 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.322 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.321 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.322 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.322 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.322 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.325 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.325 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.324 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.325 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.325 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.324 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.325 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.325 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.324 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.325 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.325 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.323 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.325 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.325 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.325 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.323 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.326 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.326 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.323 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.326 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.326 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.323 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.326 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.326 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.326 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.323 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.327 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.327 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.327 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.327 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.327 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.323 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.327 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.327 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.327 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.327 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:56.327 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.339 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.340 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.340 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.340 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.340 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.340 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.340 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.340 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.340 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.341 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.341 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.341 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.341 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:56.356 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.356 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.356 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.357 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.357 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.357 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.357 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.357 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.357 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.357 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.357 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.357 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.358 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.359 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.359 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.360 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.360 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.360 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.360 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.360 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.361 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.361 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.361 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.361 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.361 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.361 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.363 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:56.363 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:56.363 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:56.363 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.363 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.363 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.364 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.364 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.364 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.364 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.364 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.364 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.364 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:56.376 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.376 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.376 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.377 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.377 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.377 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.377 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.377 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.377 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.377 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.377 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.377 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.377 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.377 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.377 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.377 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.378 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.378 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.378 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.378 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.378 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.378 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.378 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.378 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.378 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.378 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.397 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.397 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.397 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.398 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.398 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.398 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.398 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.398 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.398 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.399 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.399 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.399 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.399 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.419 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.419 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.419 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.420 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.420 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.420 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.421 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.421 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.421 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.421 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.421 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.421 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.421 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.421 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.421 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.421 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.421 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.422 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.422 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.422 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.422 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.422 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.422 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.422 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.423 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.423 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.423 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:56.423 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:56.423 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:56.423 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.424 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.424 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.424 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.424 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.424 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.424 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.424 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.424 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.424 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:56.456 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.456 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.456 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.457 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.457 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.457 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.458 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.458 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.458 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.458 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.459 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.459 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.463 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.463 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.463 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.464 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.464 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.464 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.465 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.465 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.465 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.465 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.466 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:56.467 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:56.467 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:56.467 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:56.467 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:56.467 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:56.468 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:56.468 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:56.468 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:56.468 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:56.468 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:56.469 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:56.469 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:56.470 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.470 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.470 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.470 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.479 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.479 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.480 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.480 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.480 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.480 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.481 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.481 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.481 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.481 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.481 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.482 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.482 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.496 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.496 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.497 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.497 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.497 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.497 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.497 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.497 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.497 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.498 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.498 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.498 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.498 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.544 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:56.545 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:56.545 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:56.545 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:56.545 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:56.545 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:56.546 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:56.546 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:56.546 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:56.546 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:56.546 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:56.546 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:56.546 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:56.563 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:56.564 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:56.564 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:56.564 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.564 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.564 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.564 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.565 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.565 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.565 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.564 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.565 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.565 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:56.597 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.598 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.598 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.599 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.599 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.599 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.599 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.599 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.599 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.599 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.599 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.599 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.600 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.615 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.616 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.616 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.616 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.616 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.616 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.617 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.617 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.617 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.617 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.617 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.617 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.617 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535576621 for job 9de81db54be40687a2a82164db1dc50b.
18:32:56.633 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:32:56.635 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
18:32:56.641 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.641 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.642 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.642 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.642 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.642 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.642 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.643 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.643 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.643 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.643 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.643 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.643 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.663 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:56.663 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:56.664 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.664 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.664 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.664 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:56.664 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.664 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.665 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.665 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.665 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.665 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.665 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:56.696 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.697 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.697 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.697 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.697 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.698 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.698 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.698 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.698 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.698 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.698 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.698 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.698 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.699 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.699 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.700 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.700 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.700 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.700 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.700 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.700 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.700 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.700 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.700 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.701 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.701 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:56.721289  4977 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } attempt: 6
18:32:56.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:56.732971  4977 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.60:34679: Network error: Client connection negotiation failed: client connection to 127.4.179.60:34679: connect: Connection refused (error 111)
18:32:56.737 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:56.741 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:56.741 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:56.741 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:56.742 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.742 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.742 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.742 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:56.742 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.742 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:56.743 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.743 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.743 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:56.743 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:56.855 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:56.963 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:56.964 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:56.964 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:56.965 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.965 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.965 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:56.965 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.965 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.965 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.965 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:56.965 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.965 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:56.965 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:57.019 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:57.020 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:57.020 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.020 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.020 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.020 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.021 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.021 [INFO - pool-282-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.021 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:57.022 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.022 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.022 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.022 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:57.026 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:57.027 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:57.027 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:57.027 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:57.027 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:57.028 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:57.028 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:57.028 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:57.028 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:57.029 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:57.029 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:57.029 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:57.029 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:57.037 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:57.037 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:57.037 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:57.037 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.037 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.037 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.038 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.038 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.038 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.038 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.038 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.038 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.038 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:57.061 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:57.062 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:57.062 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:57.062 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.062 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.062 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.062 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.062 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.062 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.063 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.063 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.063 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.063 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:57.063 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29629), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [43ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [48ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [71ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [71ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [116ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [120ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [120ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [120ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [193ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [193ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [194ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [194ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [196ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [196ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [203ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [261ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [262ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [310ms] refreshing cache from master, [311ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [312ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [312ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [313ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [313ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [314ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [314ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [342ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [342ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [342ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [342ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [380ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [382ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [382ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [382ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [383ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [881ms] refreshing cache from master, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [882ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [883ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [883ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [883ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [960ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [962ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [962ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [962ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [962ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2900ms] refreshing cache from master, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2902ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2902ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2903ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2903ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [3961ms] refreshing cache from master, [3961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [3961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [3961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [3962ms] too many traces: truncated at 100 traces, deferred=Deferred@8186424(state=PENDING, result=null, callback=(continuation of Deferred@925332398 after retry RPC after error@91431214) -> (continuation of Deferred@1959337480 after retry RPC after error@327358339) -> (continuation of Deferred@523611230 after retry RPC after error@55805127) -> (continuation of Deferred@1062659067 after retry RPC after error@878892189) -> (continuation of Deferred@109566227 after retry RPC after error@426574008) -> (continuation of Deferred@296513877 after retry RPC after error@860395969) -> (continuation of Deferred@197100026 after retry RPC after error@2057709813) -> (continuation of Deferred@141744173 after retry RPC after error@2130959987) -> (continuation of Deferred@138686520 after retry RPC after error@1139687493) -> (continuation of Deferred@1564695461 after retry RPC after error@1020458552) -> (continuation of Deferred@364827754 after retry RPC after error@618877680) -> (continuation of Deferred@1673178042 after retry RPC after error@1223881411) -> (continuation of Deferred@722231859 after retry RPC after error@365351280) -> (continuation of Deferred@597118729 after retry RPC after error@2083312978) -> (continuation of Deferred@888749342 after retry RPC after error@395786144) -> (continuation of Deferred@241290588 after retry RPC after error@352132999) -> (continuation of Deferred@1771164107 after retry RPC after error@1201000814) -> (continuation of Deferred@1193209837 after retry RPC after error@996393390) -> (continuation of Deferred@1545293952 after retry RPC after error@896328908) -> (continuation of Deferred@96273419 after retry RPC after error@553044899) -> (continuation of Deferred@653201517 after retry RPC after error@1962400504) -> (continuation of Deferred@419894577 after retry RPC after error@263876193) -> (continuation of Deferred@1367899011 after retry RPC after error@459426640) -> (continuation of Deferred@988638096 after retry RPC after error@1727583178) -> (continuation of Deferred@1958668533 after retry RPC after error@2098140665) -> (continuation of Deferred@745492515 after retry RPC after error@212447463), errback=(continuation of Deferred@925332398 after retry RPC after error@91431214) -> (continuation of Deferred@1959337480 after retry RPC after error@327358339) -> (continuation of Deferred@523611230 after retry RPC after error@55805127) -> (continuation of Deferred@1062659067 after retry RPC after error@878892189) -> (continuation of Deferred@109566227 after retry RPC after error@426574008) -> (continuation of Deferred@296513877 after retry RPC after error@860395969) -> (continuation of Deferred@197100026 after retry RPC after error@2057709813) -> (continuation of Deferred@141744173 after retry RPC after error@2130959987) -> (continuation of Deferred@138686520 after retry RPC after error@1139687493) -> (continuation of Deferred@1564695461 after retry RPC after error@1020458552) -> (continuation of Deferred@364827754 after retry RPC after error@618877680) -> (continuation of Deferred@1673178042 after retry RPC after error@1223881411) -> (continuation of Deferred@722231859 after retry RPC after error@365351280) -> (continuation of Deferred@597118729 after retry RPC after error@2083312978) -> (continuation of Deferred@888749342 after retry RPC after error@395786144) -> (continuation of Deferred@241290588 after retry RPC after error@352132999) -> (continuation of Deferred@1771164107 after retry RPC after error@1201000814) -> (continuation of Deferred@1193209837 after retry RPC after error@996393390) -> (continuation of Deferred@1545293952 after retry RPC after error@896328908) -> (continuation of Deferred@96273419 after retry RPC after error@553044899) -> (continuation of Deferred@653201517 after retry RPC after error@1962400504) -> (continuation of Deferred@419894577 after retry RPC after error@263876193) -> (continuation of Deferred@1367899011 after retry RPC after error@459426640) -> (continuation of Deferred@988638096 after retry RPC after error@1727583178) -> (continuation of Deferred@1958668533 after retry RPC after error@2098140665) -> (continuation of Deferred@745492515 after retry RPC after error@212447463)))
18:32:57.096 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:57.096 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:57.096 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:57.096 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.096 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.096 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.097 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.097 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.097 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.097 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.097 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.097 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.097 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:57.107 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:57.107 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:57.107 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:57.107 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.108 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.108 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.108 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.108 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.108 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.108 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.108 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.108 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.108 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:57.109 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29672), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [64ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [105ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [107ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [114ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [183ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [184ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [189ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [193ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [203ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [204ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [204ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [223ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [223ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [243ms] refreshing cache from master, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [245ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [245ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [246ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [246ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [305ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [305ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [306ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [307ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [307ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [323ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [323ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [323ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [462ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [462ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [463ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [502ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [502ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [502ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [502ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [942ms] refreshing cache from master, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [943ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [943ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [943ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [944ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [944ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1460ms] refreshing cache from master, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1463ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [3140ms] refreshing cache from master, [3140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [3140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [3141ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [3142ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [5300ms] refreshing cache from master, [5300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [5301ms] too many traces: truncated at 100 traces, deferred=Deferred@1593606654(state=PENDING, result=null, callback=(continuation of Deferred@1369060045 after retry RPC after error@2105388264) -> (continuation of Deferred@1483564644 after retry RPC after error@1654976486) -> (continuation of Deferred@1646834981 after retry RPC after error@1923243876) -> (continuation of Deferred@1104103698 after retry RPC after error@72434962) -> (continuation of Deferred@595024160 after retry RPC after error@1129212757) -> (continuation of Deferred@2029137399 after retry RPC after error@1980079662) -> (continuation of Deferred@1872918423 after retry RPC after error@1594273269) -> (continuation of Deferred@921878135 after retry RPC after error@1818014313) -> (continuation of Deferred@272531130 after retry RPC after error@2059206733) -> (continuation of Deferred@1503594603 after retry RPC after error@1348024011) -> (continuation of Deferred@871455188 after retry RPC after error@568101007) -> (continuation of Deferred@10555535 after retry RPC after error@433557822) -> (continuation of Deferred@542196777 after retry RPC after error@1703684188) -> (continuation of Deferred@1839294730 after retry RPC after error@1222269921) -> (continuation of Deferred@1644179167 after retry RPC after error@1724527627) -> (continuation of Deferred@4585697 after retry RPC after error@450543195) -> (continuation of Deferred@2035227913 after retry RPC after error@1318192199) -> (continuation of Deferred@1639939972 after retry RPC after error@777530766) -> (continuation of Deferred@796842521 after retry RPC after error@1896891277) -> (continuation of Deferred@1799967092 after retry RPC after error@76690894) -> (continuation of Deferred@1566939479 after retry RPC after error@781886813) -> (continuation of Deferred@259625739 after retry RPC after error@441510767), errback=(continuation of Deferred@1369060045 after retry RPC after error@2105388264) -> (continuation of Deferred@1483564644 after retry RPC after error@1654976486) -> (continuation of Deferred@1646834981 after retry RPC after error@1923243876) -> (continuation of Deferred@1104103698 after retry RPC after error@72434962) -> (continuation of Deferred@595024160 after retry RPC after error@1129212757) -> (continuation of Deferred@2029137399 after retry RPC after error@1980079662) -> (continuation of Deferred@1872918423 after retry RPC after error@1594273269) -> (continuation of Deferred@921878135 after retry RPC after error@1818014313) -> (continuation of Deferred@272531130 after retry RPC after error@2059206733) -> (continuation of Deferred@1503594603 after retry RPC after error@1348024011) -> (continuation of Deferred@871455188 after retry RPC after error@568101007) -> (continuation of Deferred@10555535 after retry RPC after error@433557822) -> (continuation of Deferred@542196777 after retry RPC after error@1703684188) -> (continuation of Deferred@1839294730 after retry RPC after error@1222269921) -> (continuation of Deferred@1644179167 after retry RPC after error@1724527627) -> (continuation of Deferred@4585697 after retry RPC after error@450543195) -> (continuation of Deferred@2035227913 after retry RPC after error@1318192199) -> (continuation of Deferred@1639939972 after retry RPC after error@777530766) -> (continuation of Deferred@796842521 after retry RPC after error@1896891277) -> (continuation of Deferred@1799967092 after retry RPC after error@76690894) -> (continuation of Deferred@1566939479 after retry RPC after error@781886813) -> (continuation of Deferred@259625739 after retry RPC after error@441510767)))
18:32:57.109 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:57.109 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:57.109 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:57.109 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:57.109 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:57.110 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:57.110 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:57.110 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:57.110 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:57.110 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:57.110 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:57.110 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:57.110 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:32:57.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535577121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:57.130 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
18:32:57.131 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
18:32:57.196 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:57.196 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:57.197 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:57.197 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.197 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.197 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.197 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.197 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.197 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.197 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.197 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.197 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.197 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:57.198 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:57.198 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:57.198 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:57.198 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.198 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.198 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.199 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.199 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.199 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.199 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.198 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.199 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.199 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:57.220 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:57.220 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:57.220 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:57.220 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.220 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.220 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.221 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.221 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.221 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.221 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.220 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.221 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.221 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:57.237 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:57.237 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:57.237 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:57.237 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.237 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.237 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.238 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.238 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.238 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.238 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.238 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.238 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.238 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:57.238 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:57.261 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:57.262 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:57.262 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:57.262 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:57.262 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:57.262 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:57.262 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:57.262 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:57.262 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:57.263 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:57.262 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:57.263 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:57.263 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:57.317 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:57.317 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:57.317 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:57.318 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.318 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.318 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.318 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.318 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.318 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.318 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.318 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.319 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.319 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:57.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:57.284058  4997 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 4979
18:32:57.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:55.884714  4999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:57.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:57.325704  4997 kernel_stack_watchdog.cc:198] Thread 4979 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 399ms:
18:32:57.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:32:57.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:32:57.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:32:57.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:32:57.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:57.325822  4979 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.444s	user 0.513s	sys 0.923s
18:32:57.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:57.326222  4979 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.445s	user 0.513s	sys 0.923s
18:32:57.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.334272  4979 server_base.cc:1061] running on GCE node
18:32:57.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:57.334374  5057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:57.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.335830  4979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:32:57.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.338260  4979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:32:57.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.339659  4979 hybrid_clock.cc:648] HybridClock initialized: now 1783535577339612 us; error 30 us; skew 500 ppm
18:32:57.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.340683  4979 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:32:57.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.347339  4892 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } attempt: 8
18:32:57.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.348035  4979 webserver.cc:534] Webserver started at http://127.4.179.60:36431/ using document root <none> and password file <none>
18:32:57.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.349382  4979 fs_manager.cc:362] Metadata directory not provided
18:32:57.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.349902  4979 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:32:57.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.350651  4979 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:32:57.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:57.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.356287  4979 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/data/instance:
18:32:57.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "840832beb9ac40e78e6fe89520f53d43"
18:32:57.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:57 on dist-test-slave-dxnw"
18:32:57.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.357640  4979 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/wal/instance:
18:32:57.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "840832beb9ac40e78e6fe89520f53d43"
18:32:57.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:57 on dist-test-slave-dxnw"
18:32:57.358 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:57.359 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:57.359 [DEBUG - pool-192-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:57.359 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.359 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.359 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.359 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.360 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.360 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.360 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.360 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.360 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.360 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:57.361 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29945), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [33ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [67ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [69ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [69ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [89ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [93ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [98ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [99ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [213ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [214ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [214ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [215ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [241ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [241ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [241ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [241ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [261ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [262ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [301ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [303ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [362ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [362ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [582ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [583ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [583ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [583ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [642ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [642ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [642ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [642ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1101ms] refreshing cache from master, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1102ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2800ms] refreshing cache from master, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2803ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2803ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [5321ms] refreshing cache from master, [5321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [5322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [5322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [5323ms] too many traces: truncated at 100 traces, deferred=Deferred@1191153343(state=PENDING, result=null, callback=(continuation of Deferred@1382406258 after retry RPC after error@1591438926) -> (continuation of Deferred@1401458502 after retry RPC after error@1765308926) -> (continuation of Deferred@367172323 after retry RPC after error@273559311) -> (continuation of Deferred@128671999 after retry RPC after error@771104381) -> (continuation of Deferred@750959778 after retry RPC after error@1301661794) -> (continuation of Deferred@291890615 after retry RPC after error@209519632) -> (continuation of Deferred@904109713 after retry RPC after error@1448515223) -> (continuation of Deferred@1755351479 after retry RPC after error@211373367) -> (continuation of Deferred@631725347 after retry RPC after error@1202160942) -> (continuation of Deferred@732320092 after retry RPC after error@1829781994) -> (continuation of Deferred@1925273390 after retry RPC after error@154411693) -> (continuation of Deferred@276938342 after retry RPC after error@2146542221) -> (continuation of Deferred@133292666 after retry RPC after error@796432739) -> (continuation of Deferred@848781412 after retry RPC after error@1073764721) -> (continuation of Deferred@1223332153 after retry RPC after error@598915782) -> (continuation of Deferred@707750548 after retry RPC after error@1747350897) -> (continuation of Deferred@1960399381 after retry RPC after error@1108062914) -> (continuation of Deferred@320936925 after retry RPC after error@1215789365) -> (continuation of Deferred@1988150228 after retry RPC after error@1770185316) -> (continuation of Deferred@1927734138 after retry RPC after error@28021442) -> (continuation of Deferred@1908764480 after retry RPC after error@254419678) -> (continuation of Deferred@1242758514 after retry RPC after error@393366384) -> (continuation of Deferred@1293392305 after retry RPC after error@334851615) -> (continuation of Deferred@1322383486 after retry RPC after error@1266483999) -> (continuation of Deferred@987152848 after retry RPC after error@49009923), errback=(continuation of Deferred@1382406258 after retry RPC after error@1591438926) -> (continuation of Deferred@1401458502 after retry RPC after error@1765308926) -> (continuation of Deferred@367172323 after retry RPC after error@273559311) -> (continuation of Deferred@128671999 after retry RPC after error@771104381) -> (continuation of Deferred@750959778 after retry RPC after error@1301661794) -> (continuation of Deferred@291890615 after retry RPC after error@209519632) -> (continuation of Deferred@904109713 after retry RPC after error@1448515223) -> (continuation of Deferred@1755351479 after retry RPC after error@211373367) -> (continuation of Deferred@631725347 after retry RPC after error@1202160942) -> (continuation of Deferred@732320092 after retry RPC after error@1829781994) -> (continuation of Deferred@1925273390 after retry RPC after error@154411693) -> (continuation of Deferred@276938342 after retry RPC after error@2146542221) -> (continuation of Deferred@133292666 after retry RPC after error@796432739) -> (continuation of Deferred@848781412 after retry RPC after error@1073764721) -> (continuation of Deferred@1223332153 after retry RPC after error@598915782) -> (continuation of Deferred@707750548 after retry RPC after error@1747350897) -> (continuation of Deferred@1960399381 after retry RPC after error@1108062914) -> (continuation of Deferred@320936925 after retry RPC after error@1215789365) -> (continuation of Deferred@1988150228 after retry RPC after error@1770185316) -> (continuation of Deferred@1927734138 after retry RPC after error@28021442) -> (continuation of Deferred@1908764480 after retry RPC after error@254419678) -> (continuation of Deferred@1242758514 after retry RPC after error@393366384) -> (continuation of Deferred@1293392305 after retry RPC after error@334851615) -> (continuation of Deferred@1322383486 after retry RPC after error@1266483999) -> (continuation of Deferred@987152848 after retry RPC after error@49009923)))
18:32:57.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.368856  4979 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.011s	sys 0.001s
18:32:57.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.371349  4892 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } has no permanent_uuid. Determining permanent_uuid...
18:32:57.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:57.378647  4892 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.60:34679: Network error: Client connection negotiation failed: client connection to 127.4.179.60:34679: connect: Connection refused (error 111)
18:32:57.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.379758  5066 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:32:57.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.381156  4979 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.004s	sys 0.001s
18:32:57.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.381480  4979 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/wal
18:32:57.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "840832beb9ac40e78e6fe89520f53d43"
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:32:57 on dist-test-slave-dxnw"
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.381915  4979 fs_report.cc:389] FS layout report
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/wal
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/wal
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/data/data
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:32:57.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:32:57.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.444113  4892 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } attempt: 1
18:32:57.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.445827  4979 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:32:57.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.448024  4979 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:32:57.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.448640  4979 kserver.cc:163] Server-wide thread pool size limit: 3276
18:32:57.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:57.452091  4892 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.60:34679: Network error: Client connection negotiation failed: client connection to 127.4.179.60:34679: connect: Connection refused (error 111)
18:32:57.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.505541  4892 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } attempt: 2
18:32:57.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:57.511775  4892 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.179.60:34679: Network error: Client connection negotiation failed: client connection to 127.4.179.60:34679: connect: Connection refused (error 111)
18:32:57.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.562758  4979 rpc_server.cc:307] RPC server started. Bound to: 127.4.179.60:34679
18:32:57.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.562837  5117 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.179.60:34679 every 8 connection(s)
18:32:57.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.566725  4979 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/data/info.pb
18:32:57.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.571370  4812 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 4979
18:32:57.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.572026  4812 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/master-2/wal/instance
18:32:57.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.574649  5118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:32:57.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.589083  4892 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } attempt: 3
18:32:57.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.602691  5118 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } has no permanent_uuid. Determining permanent_uuid...
18:32:57.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535577621 for job 9de81db54be40687a2a82164db1dc50b.
18:32:57.633 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:32:57.633 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
18:32:57.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.644045  5118 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } has no permanent_uuid. Determining permanent_uuid...
18:32:57.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.658933  5118 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } has no permanent_uuid. Determining permanent_uuid...
18:32:57.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.657668  4892 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314: Bootstrap starting.
18:32:57.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.668200  4892 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314: Neither blocks nor log segments found. Creating new log.
18:32:57.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.670617  4892 log.cc:826] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314: Log is configured to *not* fsync() on all Append() calls
18:32:57.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.684221  5118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43: Bootstrap starting.
18:32:57.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.691697  5118 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43: Neither blocks nor log segments found. Creating new log.
18:32:57.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.694243  5118 log.cc:826] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43: Log is configured to *not* fsync() on all Append() calls
18:32:57.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.698918  4892 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314: No bootstrap required, opened a new log
18:32:57.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.705689  5118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43: No bootstrap required, opened a new log
18:32:57.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.720758  4892 raft_consensus.cc:359] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } }
18:32:57.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.722034  4892 raft_consensus.cc:385] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:57.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.722505  4892 raft_consensus.cc:740] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8f56741aad8426f8071eb1be24cd314, State: Initialized, Role: FOLLOWER
18:32:57.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.723529  4892 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } }
18:32:57.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.727208  5128 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } } }
18:32:57.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.728062  5128 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [sys.catalog]: This master's current role is: FOLLOWER
18:32:57.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.729190  4892 sys_catalog.cc:565] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [sys.catalog]: configured and running, proceeding with master startup.
18:32:57.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.732599  5118 raft_consensus.cc:359] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } }
18:32:57.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.733494  5118 raft_consensus.cc:385] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:57.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.733783  5118 raft_consensus.cc:740] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 840832beb9ac40e78e6fe89520f53d43, State: Initialized, Role: FOLLOWER
18:32:57.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.734790  5118 consensus_queue.cc:260] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } }
18:32:57.738 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:57.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.743093  5131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } } }
18:32:57.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.743830  5131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43 [sys.catalog]: This master's current role is: FOLLOWER
18:32:57.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.745956  5118 sys_catalog.cc:565] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43 [sys.catalog]: configured and running, proceeding with master startup.
18:32:57.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:57.780052  5147 catalog_manager.cc:1593] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:32:57.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:57.781054  5147 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:32:57.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.787961  5128 raft_consensus.cc:493] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:57.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.788527  5128 raft_consensus.cc:515] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } }
18:32:57.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:57.792658  4846 tablet.cc:2406] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:32:57.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.793497  4977 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } attempt: 7
18:32:57.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.794174  5093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f8f56741aad8426f8071eb1be24cd314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "840832beb9ac40e78e6fe89520f53d43" is_pre_election: true
18:32:57.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.795055  5093 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8f56741aad8426f8071eb1be24cd314 in term 0.
18:32:57.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.795432  5128 leader_election.cc:290] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb0e8c87bcf24eb8a944bdeddcd73a23 (127.4.179.61:44733), 840832beb9ac40e78e6fe89520f53d43 (127.4.179.60:34679)
18:32:57.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.796618  4843 leader_election.cc:304] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 840832beb9ac40e78e6fe89520f53d43, f8f56741aad8426f8071eb1be24cd314; no voters: 
18:32:57.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.797807  5128 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:32:57.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.798923  5128 raft_consensus.cc:493] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:32:57.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.800261  5128 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [term 0 FOLLOWER]: Advancing to term 1
18:32:57.832 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:32:57.833 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:32:57.833 [DEBUG - pool-180-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:32:57.833 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:57.833 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:57.833 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:32:57.834 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:57.834 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:57.834 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:32:57.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.826275  5128 raft_consensus.cc:515] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } }
18:32:57.834 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:57.834 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:57.834 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:32:57.834 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:32:57.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.836819  5128 leader_election.cc:290] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [CANDIDATE]: Term 1 election: Requested vote from peers eb0e8c87bcf24eb8a944bdeddcd73a23 (127.4.179.61:44733), 840832beb9ac40e78e6fe89520f53d43 (127.4.179.60:34679)
18:32:57.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.838093  5093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f8f56741aad8426f8071eb1be24cd314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "840832beb9ac40e78e6fe89520f53d43"
18:32:57.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.838682  5093 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43 [term 0 FOLLOWER]: Advancing to term 1
18:32:57.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:57.840304  5152 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:32:57.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:57.851399  5152 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:32:57.855 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:57.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.855610  4977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23: Bootstrap starting.
18:32:57.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.859892  5093 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8f56741aad8426f8071eb1be24cd314 in term 1.
18:32:57.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.864539  4843 leader_election.cc:304] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 840832beb9ac40e78e6fe89520f53d43, f8f56741aad8426f8071eb1be24cd314; no voters: 
18:32:57.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.865559  5128 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [term 1 FOLLOWER]: Leader election won for term 1
18:32:57.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.814567  4979 master_runner.cc:187] Error getting master registration for 127.4.179.61:44733: OK, instance_id { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" instance_seqno: 1783535575399385 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:32:57.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.869338  4979 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:32:57.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.880282  5128 raft_consensus.cc:697] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [term 1 LEADER]: Becoming Leader. State: Replica: f8f56741aad8426f8071eb1be24cd314, State: Running, Role: LEADER
18:32:57.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.880723  4977 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23: Neither blocks nor log segments found. Creating new log.
18:32:57.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.881445  5128 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } }
18:32:57.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.885134  4977 log.cc:826] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23: Log is configured to *not* fsync() on all Append() calls
18:32:57.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.779588  4824 master_runner.cc:187] Error getting master registration for 127.4.179.61:44733: OK, instance_id { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" instance_seqno: 1783535575399385 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:32:57.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.892242  4824 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:32:57.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.901038  4977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23: No bootstrap required, opened a new log
18:32:57.903 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:57.903 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:57.904 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:57.904 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:57.904 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:57.904 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:57.905 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:57.905 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:57.905 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:57.905 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:57.905 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:57.905 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:57.905 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:57.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.913879  5155 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8f56741aad8426f8071eb1be24cd314. Latest consensus state: current_term: 1 leader_uuid: "f8f56741aad8426f8071eb1be24cd314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } } }
18:32:57.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.915819  5155 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [sys.catalog]: This master's current role is: LEADER
18:32:57.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.933298  5158 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:32:57.937 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:57.937 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:57.937 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:57.938 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.938 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.938 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:57.938 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.938 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.938 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:57.938 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.938 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.938 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:57.938 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:57.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.962118  4977 raft_consensus.cc:359] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } }
18:32:57.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:57.963804  5072 tablet.cc:2406] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:32:57.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.966671  5158 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:32:57.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.963248  4977 raft_consensus.cc:385] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:32:57.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.971712  4977 raft_consensus.cc:740] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb0e8c87bcf24eb8a944bdeddcd73a23, State: Initialized, Role: FOLLOWER
18:32:57.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.972997  4977 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } }
18:32:57.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.976492  5159 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } } }
18:32:57.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.977401  5159 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [sys.catalog]: This master's current role is: FOLLOWER
18:32:57.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.983695  4977 sys_catalog.cc:565] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [sys.catalog]: configured and running, proceeding with master startup.
18:32:57.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.983888  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f8f56741aad8426f8071eb1be24cd314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" is_pre_election: true
18:32:57.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.984144  5159 raft_consensus.cc:493] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:32:57.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.984647  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f8f56741aad8426f8071eb1be24cd314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23"
18:32:57.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.996313  5159 raft_consensus.cc:515] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } }
18:32:57.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:57.997634  4951 raft_consensus.cc:2468] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8f56741aad8426f8071eb1be24cd314 in term 0.
18:32:58.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.000725  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8f56741aad8426f8071eb1be24cd314" is_pre_election: true
18:32:58.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.000809  5159 leader_election.cc:290] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8f56741aad8426f8071eb1be24cd314 (127.4.179.62:35121), 840832beb9ac40e78e6fe89520f53d43 (127.4.179.60:34679)
18:32:58.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.004118  5093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "840832beb9ac40e78e6fe89520f53d43" is_pre_election: true
18:32:58.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.004949  5093 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb0e8c87bcf24eb8a944bdeddcd73a23 in current term 1: Already voted for candidate f8f56741aad8426f8071eb1be24cd314 in this term.
18:32:58.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.006289  4927 leader_election.cc:304] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb0e8c87bcf24eb8a944bdeddcd73a23; no voters: 840832beb9ac40e78e6fe89520f53d43, f8f56741aad8426f8071eb1be24cd314
18:32:58.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.007380  5159 raft_consensus.cc:3060] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [term 0 FOLLOWER]: Advancing to term 1
18:32:58.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.027776  5093 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43 [term 1 FOLLOWER]: Refusing update from remote peer f8f56741aad8426f8071eb1be24cd314: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:32:58.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.029608  5128 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:58.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.031955  5159 raft_consensus.cc:2749] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:32:58.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.034562  4951 raft_consensus.cc:1275] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [term 1 FOLLOWER]: Refusing update from remote peer f8f56741aad8426f8071eb1be24cd314: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:32:58.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.038365  5128 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:32:58.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.068845  5131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8f56741aad8426f8071eb1be24cd314. Latest consensus state: current_term: 1 leader_uuid: "f8f56741aad8426f8071eb1be24cd314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } } }
18:32:58.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.069841  5131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43 [sys.catalog]: This master's current role is: FOLLOWER
18:32:58.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.077667  5161 mvcc.cc:204] Tried to move back new op lower bound from 7305361727581147136 to 7305361727013007360. Current Snapshot: MvccSnapshot[applied={T|T < 7305361727581147136}]
18:32:58.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.088531  5131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f8f56741aad8426f8071eb1be24cd314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } } }
18:32:58.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.089468  5131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43 [sys.catalog]: This master's current role is: FOLLOWER
18:32:58.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.095762  5155 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f8f56741aad8426f8071eb1be24cd314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } } }
18:32:58.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.096521  5155 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [sys.catalog]: This master's current role is: LEADER
18:32:58.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:58.098879  4930 tablet.cc:2406] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:32:58.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.101333  5158 catalog_manager.cc:1382] Generated new cluster ID: 6beebe1ac30e49669e3716473a7ec851
18:32:58.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.101630  5158 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:32:58.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.103492  5159 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8f56741aad8426f8071eb1be24cd314. Latest consensus state: current_term: 1 leader_uuid: "f8f56741aad8426f8071eb1be24cd314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } } }
18:32:58.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.104599  5159 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [sys.catalog]: This master's current role is: FOLLOWER
18:32:58.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.112368  5128 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f8f56741aad8426f8071eb1be24cd314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } } }
18:32:58.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.115983  5167 mvcc.cc:204] Tried to move back new op lower bound from 7305361727581147136 to 7305361727013007360. Current Snapshot: MvccSnapshot[applied={T|T < 7305361727581147136}]
18:32:58.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.120431  5159 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f8f56741aad8426f8071eb1be24cd314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8f56741aad8426f8071eb1be24cd314" member_type: VOTER last_known_addr { host: "127.4.179.62" port: 35121 } } peers { permanent_uuid: "eb0e8c87bcf24eb8a944bdeddcd73a23" member_type: VOTER last_known_addr { host: "127.4.179.61" port: 44733 } } peers { permanent_uuid: "840832beb9ac40e78e6fe89520f53d43" member_type: VOTER last_known_addr { host: "127.4.179.60" port: 34679 } } }
18:32:58.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.121177  5159 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23 [sys.catalog]: This master's current role is: FOLLOWER
18:32:58.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535578121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:58.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.116398  5128 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314 [sys.catalog]: This master's current role is: LEADER
18:32:58.133 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:32:58.134 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
18:32:58.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.158787  5179 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
18:32:58.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.175561  5158 catalog_manager.cc:1405] Generated new certificate authority record
18:32:58.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.177846  5158 catalog_manager.cc:1539] Loading token signing keys...
18:32:58.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.217221  5158 catalog_manager.cc:6069] T 00000000000000000000000000000000 P f8f56741aad8426f8071eb1be24cd314: Generated new TSK 0
18:32:58.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.218663  5158 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.236068  4812 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/wal
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/data
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/logs
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/data/info.pb
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:32:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:32:58.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.179.1:0
18:32:58.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.179.1
18:32:58.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.179.1
18:32:58.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:58.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.179.62:35121,127.4.179.61:44733,127.4.179.60:34679
18:32:58.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.179.20:42683
18:32:58.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:58.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:58.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:32:58.237 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:58.296 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:58.297 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:58.297 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:58.298 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:58.298 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:58.298 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:58.298 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:58.298 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:58.298 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:58.298 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:58.299 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:58.299 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:58.299 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:58.304 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:58.304 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:58.304 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:58.304 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:58.304 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:58.304 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:58.305 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:58.305 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:58.305 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:58.305 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:58.305 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:58.305 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:58.305 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:58.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:58.476 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:58.476 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:58.476 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:58.477 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:58.477 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:58.477 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:58.477 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:58.477 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:58.477 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:58.477 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:58.477 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:58.477 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:58.477 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:58.497 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:58.497 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:58.498 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:58.498 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:58.498 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:58.498 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:58.498 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:58.498 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:58.498 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:58.498 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:58.498 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:58.498 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:58.498 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:58.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535578621 for job 9de81db54be40687a2a82164db1dc50b.
18:32:58.639 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
18:32:58.640 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
18:32:58.683 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:32:58.684 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:32:58.684 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:58.685 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:58.685 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:32:58.685 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:58.685 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:58.685 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:32:58.687 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:32:58.687 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:58.687 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:58.687 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:32:58.687 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:32:58.720 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:58.720 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:58.720 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:58.720 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:58.721 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:58.721 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:58.721 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:58.721 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:58.721 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:58.721 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:58.721 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:58.721 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:58.721 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:58.737 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:58.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:58.742981  5180 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:32:58.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:58.743770  5180 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:32:58.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:58.744586  5180 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:32:58.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:58.798825  5180 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:32:58.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:58.799908  5180 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.179.1
18:32:58.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.852229  5180 tablet_server_runner.cc:78] Tablet server non-default flags:
18:32:58.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:32:58.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.179.20:42683
18:32:58.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:32:58.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:32:58.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/data
18:32:58.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/wal
18:32:58.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:32:58.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:32:58.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.179.1:0
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/data/info.pb
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.179.1
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.179.62:35121,127.4.179.61:44733,127.4.179.60:34679
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.179.1
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/logs
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:32:58.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:32:58.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.854875  5180 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:32:58.855 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:58.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.857142  5180 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:32:58.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.858705  5152 catalog_manager.cc:1294] Loaded cluster ID: 6beebe1ac30e49669e3716473a7ec851
18:32:58.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.859117  5152 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43: loading cluster ID for follower catalog manager: success
18:32:58.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.869001  5152 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43: acquiring CA information for follower catalog manager: success
18:32:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:58.875172  5152 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 840832beb9ac40e78e6fe89520f53d43: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:32:58.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:58.915786  5188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:32:59.041 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:59.041 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:59.041 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:59.042 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:59.042 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:59.042 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:59.042 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:59.042 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:59.042 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:59.043 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:59.043 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:59.043 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:59.043 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:59.096 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:59.096 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:59.096 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:59.097 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:59.097 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:59.097 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:59.097 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:59.097 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:59.097 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:59.098 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:59.098 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:59.098 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:59.098 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:32:59.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535579121 for job 9de81db54be40687a2a82164db1dc50b.
18:32:59.126 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:32:59.127 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:32:59.127 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:32:59.127 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:59.127 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:59.127 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:32:59.128 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:59.128 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:59.128 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:32:59.128 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:59.128 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:59.129 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:32:59.129 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:32:59.138 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
18:32:59.139 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
18:32:59.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:59.203088  5179 catalog_manager.cc:1294] Loaded cluster ID: 6beebe1ac30e49669e3716473a7ec851
18:32:59.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:59.203814  5179 catalog_manager.cc:1587] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23: loading cluster ID for follower catalog manager: success
18:32:59.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:59.235846  5179 catalog_manager.cc:1609] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23: acquiring CA information for follower catalog manager: success
18:32:59.237 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:59.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:32:59.252447  5179 catalog_manager.cc:1637] T 00000000000000000000000000000000 P eb0e8c87bcf24eb8a944bdeddcd73a23: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:32:59.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:59.621 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535579621 for job 9de81db54be40687a2a82164db1dc50b.
18:32:59.633 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:32:59.638 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
18:32:59.737 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:59.806 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:59.806 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:59.807 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:59.807 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:59.807 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:59.808 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:59.808 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:59.808 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:59.808 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:59.808 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:59.808 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:59.809 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:59.809 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:59.846 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:32:59.847 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:32:59.847 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:32:59.847 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:59.847 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:59.848 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:32:59.848 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:59.848 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:59.848 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:32:59.848 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:59.848 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:59.849 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:32:59.849 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:32:59.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:32:59.868 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:32:59.868 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:32:59.868 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:32:59.869 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:59.869 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:59.869 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:32:59.869 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:59.869 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:59.869 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:32:59.869 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:59.870 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:59.870 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:32:59.870 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:32:59.956 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:32:59.956 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:32:59.957 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:32:59.957 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:59.957 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:59.957 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:32:59.957 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:59.957 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:59.957 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:32:59.957 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:59.957 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:59.957 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:32:59.957 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:00.005 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:00.006 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:00.006 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:00.007 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:00.007 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:00.007 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:00.007 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:00.007 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:00.007 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:00.007 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:00.007 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:00.007 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:00.007 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:00.088 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:00.089 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:00.089 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:00.089 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:00.089 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:00.089 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:00.089 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:00.089 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:00.089 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:00.090 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:00.090 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:00.090 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:00.090 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:00.121 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535580121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:00.131 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:33:00.133 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
18:33:00.225 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RESTARTING to RUNNING.
18:33:00.225 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job fa73e37017778341a79e5b3ef3d55eb9 from Checkpoint 69 @ 1783535448409 for fa73e37017778341a79e5b3ef3d55eb9 located at file:/tmp/junit12731664100414606042/checkpoints/fa73e37017778341a79e5b3ef3d55eb9/chk-69.
18:33:00.226 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
18:33:00.227 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:33:00.237 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to SCHEDULED.
18:33:00.238 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from SCHEDULED to DEPLOYING.
18:33:00.239 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #6) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 1623ba59e704d1676486c6f13d60068c
18:33:00.239 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to SCHEDULED.
18:33:00.239 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from SCHEDULED to DEPLOYING.
18:33:00.239 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 1623ba59e704d1676486c6f13d60068c.
18:33:00.240 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:33:00.240 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:00.241 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:33:00.241 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_6), deploy into slot with allocation id 1623ba59e704d1676486c6f13d60068c.
18:33:00.240 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #6) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 409256c48f07c3602c01f545df4e7b3c
18:33:00.242 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to SCHEDULED.
18:33:00.243 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:00.244 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from SCHEDULED to DEPLOYING.
18:33:00.244 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #5) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 120c9de24dd4d7d83c84cb1a65b36252
18:33:00.244 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to SCHEDULED.
18:33:00.244 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:33:00.245 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from SCHEDULED to DEPLOYING.
18:33:00.245 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #6) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d
18:33:00.255 [INFO - Thread-42] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:33:00.255 [DEBUG - Thread-42] (Connection.java:575) [peer master-127.28.68.190:40429(127.28.68.190:40429)] disconnecting while in state TERMINATED
18:33:00.255 [DEBUG - Thread-42] (Connection.java:575) [peer master-127.28.68.188:38393(127.28.68.188:38393)] disconnecting while in state TERMINATED
18:33:00.256 [DEBUG - Thread-42] (Connection.java:575) [peer master-127.28.68.189:33753(127.28.68.189:33753)] disconnecting while in state TERMINATED
18:33:00.256 [DEBUG - Thread-42] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:00.257 [INFO - Thread-42] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:33:00.258 [INFO - Thread-42] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:33:00.260 [DEBUG - Thread-42] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:00.266 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 409256c48f07c3602c01f545df4e7b3c.
18:33:00.267 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_6), deploy into slot with allocation id 409256c48f07c3602c01f545df4e7b3c.
18:33:00.268 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to DEPLOYING.
18:33:00.268 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_6) [DEPLOYING].
18:33:00.269 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4e5a7e90
18:33:00.269 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:00.270 [INFO - Thread-42] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:33:00.271 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 120c9de24dd4d7d83c84cb1a65b36252.
18:33:00.272 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:33:00.272 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_5), deploy into slot with allocation id 120c9de24dd4d7d83c84cb1a65b36252.
18:33:00.272 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
18:33:00.273 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
18:33:00.274 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to DEPLOYING.
18:33:00.274 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_6) [DEPLOYING].
18:33:00.275 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@40874c89
18:33:00.275 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:00.275 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4777c023
18:33:00.275 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:33:00.287 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
18:33:00.287 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot fe2a3c24d55fce5c8d5a55c4e880b53d.
18:33:00.287 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
18:33:00.288 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_6), deploy into slot with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d.
18:33:00.288 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to DEPLOYING.
18:33:00.288 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) [DEPLOYING].
18:33:00.288 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1999d6f6
18:33:00.288 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:00.289 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:33:00.289 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
18:33:00.289 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
18:33:00.291 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3ed000f8
18:33:00.292 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to DEPLOYING.
18:33:00.292 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) [DEPLOYING].
18:33:00.293 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@684e551a
18:33:00.293 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:00.293 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:33:00.293 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
18:33:00.293 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:00.294 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:00.291 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7660431b
18:33:00.293 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
18:33:00.295 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:00.295 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:00.295 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:00.295 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:00.297 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.303 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4906abd3
18:33:00.305 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:00.306 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:00.308 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.316 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.317 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.317 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.317 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.331 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.337 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.337 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.337 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.347 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.354 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:00.355 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.386 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.387 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.387 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.387 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.395 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.395 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.397 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.398 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.398 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.398 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.402 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.403 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.405 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:00.408 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.408 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.409 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.409 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.409 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.419 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.419 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.419 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.420 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.431 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:00.441 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.441 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.441 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.441 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.441 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.441 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.442 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.442 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.442 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.443 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.443 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.443 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.443 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.443 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.444 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.444 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.452 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:00.453 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.453 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.453 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.455 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.457 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.472 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:00.472 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.473 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.473 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.473 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.473 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.473 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.473 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:00.487 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.488 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.488 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.488 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.492 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.492 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:00.493 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.493 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.493 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.503 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.503 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.503 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.504 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.508 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.512 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.512 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.512 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.512 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.526 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.527 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.527 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.527 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.528 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.535 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.536 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.536 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.536 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.539 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.547 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.547 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.547 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.551 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.551 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.551 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.551 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.566 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.567 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.567 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.567 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.577 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.578 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.578 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.578 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.578 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.586 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:00.587 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.587 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.587 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.595 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.596 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:00.597 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.597 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.597 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.607 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.607 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.607 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.607 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:00.611 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.611 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:00.612 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.612 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.621 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535580621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:00.622 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.625 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.626 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.626 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.626 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.627 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.627 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.627 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.627 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.632 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:33:00.633 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
18:33:00.637 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.637 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.637 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.637 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.638 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.638 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.638 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.638 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.638 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.638 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.638 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.638 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.638 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.638 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.639 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.639 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.639 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.639 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.640 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.640 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.640 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.640 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.640 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.640 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.640 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.652 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.656 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.656 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.656 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.656 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.656 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.656 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.656 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.656 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.656 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.657 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.657 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.657 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.657 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.657 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.657 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.657 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.657 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.657 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.657 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.657 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.658 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.658 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.658 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.658 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.658 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.658 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.660 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.660 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.661 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.666 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.666 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.666 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.666 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.667 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.667 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.667 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.667 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.672 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.673 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.673 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.673 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.675 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.676 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.676 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.676 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.676 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.676 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.677 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.677 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.677 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.677 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.677 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.677 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.677 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.677 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.677 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.677 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.677 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.677 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.678 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.678 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.678 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.678 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.678 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.678 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.678 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.678 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.686 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.687 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.687 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.687 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.688 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.688 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.688 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.689 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.689 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.689 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.689 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.689 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.689 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.690 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.690 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.690 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.690 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.692 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.692 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.692 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.692 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.695 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.695 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.696 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.696 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.696 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.696 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.696 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.697 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.697 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.697 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.698 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.698 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.698 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.698 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.698 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.698 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.699 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.699 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.699 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.699 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.699 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.699 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.703 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.703 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.703 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.703 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.707 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.708 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.708 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.708 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.709 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.709 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.709 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.709 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.709 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.709 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.709 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.709 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.710 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.710 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.715 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:00.716 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:00.716 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.716 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.716 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.716 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.717 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.717 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.717 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.717 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.717 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.717 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:00.719 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.719 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.719 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.719 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.722 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.722 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.722 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.722 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.722 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.722 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.722 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.722 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.727 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.727 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.727 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.727 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.727 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.727 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.727 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.727 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.728 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.728 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.728 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.728 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.728 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.728 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.729 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.729 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.729 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.729 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.729 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.730 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.730 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.730 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.730 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.730 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.730 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.730 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.732 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:00.732 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:00.732 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.733 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.733 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:00.733 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.733 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.733 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.733 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.733 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.733 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.733 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.734 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:00.735 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.735 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.735 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.736 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.736 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.736 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.736 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.736 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.736 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.737 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.737 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.737 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.737 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.738 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:00.748 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.748 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.748 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.748 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.748 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.748 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.748 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.749 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.749 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.749 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.749 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.749 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.749 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.752 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:00.752 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:00.752 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.752 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.752 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.753 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.753 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.753 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.752 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:00.753 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.753 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.753 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.753 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:00.768 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.768 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.768 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.769 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.769 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.769 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.769 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.769 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.769 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.769 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.769 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.769 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.770 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.788 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.788 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.788 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.788 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.789 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.789 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.789 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.789 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.789 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.789 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.789 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.789 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.789 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.789 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.789 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.789 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.789 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.789 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.789 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.789 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.789 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.789 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.790 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.790 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.790 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.790 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.791 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:00.791 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:00.792 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.792 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:00.792 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.792 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.792 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.792 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.792 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.792 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.792 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.792 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.792 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:00.812 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:00.812 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:00.813 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:00.813 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.813 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.813 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.814 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.814 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.814 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.814 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.814 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.814 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.814 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:00.815 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.815 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.815 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.816 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.816 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.816 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.816 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.816 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.816 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.817 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.817 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.817 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.817 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.817 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.817 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.817 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.817 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.817 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.817 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.818 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.818 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.818 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.818 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.818 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.818 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.818 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.848 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.848 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.848 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.848 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.848 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.849 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.849 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.849 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.849 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.851 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.851 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.851 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.851 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:00.906 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:00.937 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:00.937 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:00.937 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:00.937 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:00.938 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:00.938 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:00.938 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:00.938 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:00.938 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:00.938 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:00.938 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:00.938 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:00.938 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:00.952 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:00.952 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:00.953 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:00.953 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.953 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.953 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:00.953 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.954 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.954 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:00.954 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.954 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.954 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:00.954 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:00.967 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.968 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.968 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.968 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.968 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.968 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.968 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.968 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.968 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.968 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.969 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.969 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.969 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:00.969 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:00.969 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:00.969 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:00.970 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.970 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.970 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:00.970 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.970 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.970 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:00.970 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.970 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.970 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:00.971 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:01.037 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:01.038 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:01.038 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:01.038 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.038 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.038 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.039 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.039 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.039 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.039 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.039 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.039 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.039 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:01.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:00.287372  5187 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 5180
18:33:01.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:01.061126  5187 kernel_stack_watchdog.cc:198] Thread 5180 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 378ms:
18:33:01.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:33:01.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:33:01.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:33:01.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:33:01.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:01.061280  5180 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.154s	user 0.618s	sys 0.982s
18:33:01.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:32:58.918967  5189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:01.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:01.061873  5180 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.154s	user 0.618s	sys 0.983s
18:33:01.068 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:01.068 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:01.069 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:01.069 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.069 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.069 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.069 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.069 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.069 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.070 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.070 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.070 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.070 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:01.076 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:01.076 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:01.076 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:01.077 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.077 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.077 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.077 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.077 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.077 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.078 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.078 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.078 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.078 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:01.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.082957  5180 server_base.cc:1061] running on GCE node
18:33:01.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:01.082772  5250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:01.084 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:01.084 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:01.084 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:01.084 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:01.084 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:01.084 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:01.084 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:01.084 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:01.084 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:01.084 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:01.084 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:01.085 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:01.085 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:01.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.086215  5180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:33:01.108 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:01.108 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:01.108 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:01.108 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:01.109 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:01.109 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:01.109 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.109 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.109 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.109 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.109 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.109 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.109 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.109 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.110 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.109 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.110 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.110 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.110 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.110 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.110 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.110 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:01.111 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.111 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.111 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.111 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:01.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.111821  5180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:33:01.117 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:01.118 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:01.118 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:01.118 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.118 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.118 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.118 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.118 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.118 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.119 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.119 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.119 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.119 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:01.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535581121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:01.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.128866  5180 hybrid_clock.cc:648] HybridClock initialized: now 1783535581128729 us; error 123 us; skew 500 ppm
18:33:01.131 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:33:01.132 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
18:33:01.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.132622  5180 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:33:01.172 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:01.172 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:01.173 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:01.173 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:01.173 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:01.173 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:01.174 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:01.174 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:01.174 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:01.174 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:01.174 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:01.174 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:01.174 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:01.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.175972  5180 webserver.cc:534] Webserver started at http://127.4.179.1:46103/ using document root <none> and password file <none>
18:33:01.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.177836  5180 fs_manager.cc:362] Metadata directory not provided
18:33:01.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.178257  5180 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:33:01.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.178992  5180 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:33:01.185 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:01.186 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:01.186 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:01.186 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:01.186 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:01.186 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:01.186 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:01.187 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:01.187 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:01.187 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:01.187 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:01.187 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:01.187 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:01.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.189255  5180 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/data/instance:
18:33:01.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6008cdf76d9e456ca635ad5aeccc6c61"
18:33:01.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:01 on dist-test-slave-dxnw"
18:33:01.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.190892  5180 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/wal/instance:
18:33:01.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6008cdf76d9e456ca635ad5aeccc6c61"
18:33:01.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:01 on dist-test-slave-dxnw"
18:33:01.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.209107  5180 fs_manager.cc:696] Time spent creating directory manager: real 0.017s	user 0.006s	sys 0.008s
18:33:01.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.224166  5256 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:33:01.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.226930  5180 fs_manager.cc:730] Time spent opening block manager: real 0.013s	user 0.005s	sys 0.004s
18:33:01.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.227483  5180 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/wal
18:33:01.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6008cdf76d9e456ca635ad5aeccc6c61"
18:33:01.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:01 on dist-test-slave-dxnw"
18:33:01.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.227964  5180 fs_report.cc:389] FS layout report
18:33:01.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:33:01.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/wal
18:33:01.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/wal
18:33:01.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/data/data
18:33:01.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:33:01.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:33:01.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:33:01.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:33:01.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:33:01.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:33:01.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:33:01.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:33:01.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:33:01.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:33:01.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:33:01.235 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:01.236 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:01.236 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:01.236 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.236 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.236 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.237 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.237 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.237 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.237 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.237 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.237 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.237 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:01.238 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:01.315 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:01.316 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:01.316 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:01.316 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.317 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.317 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.317 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.317 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.317 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.317 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.317 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.317 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.317 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:01.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:01.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.369966  5180 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:33:01.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.372252  5180 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:33:01.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.372885  5180 kserver.cc:163] Server-wide thread pool size limit: 3276
18:33:01.383 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:01.383 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:01.383 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:01.384 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:01.384 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:01.384 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:01.384 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:01.384 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:01.384 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:01.385 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:01.385 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:01.385 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:01.385 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:01.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.387192  5180 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:33:01.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.400436  5180 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:33:01.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.400724  5180 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:33:01.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.401181  5180 ts_tablet_manager.cc:616] Registered 0 tablets
18:33:01.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:01.401408  5180 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:33:01.405 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:01.405 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:01.405 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:01.406 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:01.406 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:01.406 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:01.406 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:01.406 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:01.406 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:01.406 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:01.407 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:01.407 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:01.407 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:01.407 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:01.440 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:01.441 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:01.441 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:01.441 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:01.441 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:01.441 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:01.442 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:01.442 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:01.442 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:01.442 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:01.442 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:01.442 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:01.442 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:01.567 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:01.568 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:01.568 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:01.568 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.568 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.569 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.569 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.569 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.569 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.569 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.569 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.570 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.570 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:01.596 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:01.597 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:01.597 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:01.597 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:01.597 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:01.598 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:01.598 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:01.598 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:01.598 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:01.598 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:01.598 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:01.598 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:01.598 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:01.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535581621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:01.624 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:01.625 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:01.625 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:01.627 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:01.627 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:01.627 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:01.628 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:01.628 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:01.628 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:01.628 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:01.628 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:01.628 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:01.628 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:01.634 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
18:33:01.637 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
18:33:01.672 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:01.672 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:01.672 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:01.673 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:01.673 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:01.673 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:01.674 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:01.674 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:01.674 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:01.674 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:01.674 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:01.674 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:01.674 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:01.738 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:01.820 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:01.820 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:01.821 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:01.821 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:01.822 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:01.822 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:01.822 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:01.822 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:01.822 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:01.823 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:01.823 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:01.823 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:01.823 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:01.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:01.906 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:01.992 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:01.993 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:01.993 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:01.993 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:01.994 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:01.994 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:01.994 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:01.994 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:01.994 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:01.994 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:01.995 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:01.995 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:01.995 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:01.997 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:01.997 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:01.997 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:01.997 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.997 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.998 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:01.998 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.998 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.998 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:01.998 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.998 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.998 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:01.998 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:02.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.039032  5180 rpc_server.cc:307] RPC server started. Bound to: 127.4.179.1:45253
18:33:02.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.039146  5370 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.179.1:45253 every 8 connection(s)
18:33:02.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.042184  5180 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/data/info.pb
18:33:02.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.049906  4812 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 5180
18:33:02.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.050542  4812 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-0/wal/instance
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.073915  4812 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/wal
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/data
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/logs
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/data/info.pb
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.179.2:0
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.179.2
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.179.2
18:33:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:02.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.179.62:35121,127.4.179.61:44733,127.4.179.60:34679
18:33:02.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.179.20:42683
18:33:02.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:02.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:02.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:33:02.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535582121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:02.130 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:33:02.131 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
18:33:02.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.136821  5372 heartbeater.cc:344] Connected to a master server at 127.4.179.61:44733
18:33:02.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.137307  5372 heartbeater.cc:461] Registering TS with master...
18:33:02.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.138484  5372 heartbeater.cc:507] Master 127.4.179.61:44733 requested a full tablet report, sending...
18:33:02.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.140372  5371 heartbeater.cc:344] Connected to a master server at 127.4.179.60:34679
18:33:02.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.140769  5371 heartbeater.cc:461] Registering TS with master...
18:33:02.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.141731  5371 heartbeater.cc:507] Master 127.4.179.60:34679 requested a full tablet report, sending...
18:33:02.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.142534  4941 ts_manager.cc:194] Registered new tserver with Master: 6008cdf76d9e456ca635ad5aeccc6c61 (127.4.179.1:45253)
18:33:02.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.145288  5083 ts_manager.cc:194] Registered new tserver with Master: 6008cdf76d9e456ca635ad5aeccc6c61 (127.4.179.1:45253)
18:33:02.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.146559  5375 heartbeater.cc:344] Connected to a master server at 127.4.179.62:35121
18:33:02.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.146944  5375 heartbeater.cc:461] Registering TS with master...
18:33:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.147923  5375 heartbeater.cc:507] Master 127.4.179.62:35121 requested a full tablet report, sending...
18:33:02.148 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:02.149 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:02.149 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:02.149 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:02.149 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:02.149 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:02.150 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:02.150 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:02.150 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:02.150 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:02.149 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:02.150 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:02.150 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:02.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.151811  4857 ts_manager.cc:194] Registered new tserver with Master: 6008cdf76d9e456ca635ad5aeccc6c61 (127.4.179.1:45253)
18:33:02.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.154816  4857 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.179.1:52039
18:33:02.238 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:02.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:02.406 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:02.456 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:02.456 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:02.457 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:02.457 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:02.457 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:02.457 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:02.457 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:02.458 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:02.458 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:02.458 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:02.457 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:02.458 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:02.458 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:02.498234  5378 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:33:02.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:02.498932  5378 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:33:02.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:02.499643  5378 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:33:02.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:02.537719  5378 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:33:02.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:02.538655  5378 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.179.2
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.580994  5378 tablet_server_runner.cc:78] Tablet server non-default flags:
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.179.20:42683
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/data
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/wal
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.179.2:0
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/data/info.pb
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.179.2
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.179.62:35121,127.4.179.61:44733,127.4.179.60:34679
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.179.2
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/logs
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:33:02.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:33:02.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:33:02.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:33:02.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:33:02.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.583299  5378 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:33:02.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:02.585083  5378 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:33:02.596 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:02.596 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:02.596 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:02.597 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:02.597 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:02.597 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:02.598 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:02.598 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:02.598 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:02.598 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:02.598 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:02.598 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:02.599 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:02.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:02.610266  5387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:02.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535582621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:02.631 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:33:02.632 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
18:33:02.737 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:02.788 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:02.788 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:02.788 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:02.789 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:02.789 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:02.789 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:02.789 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:02.789 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:02.789 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:02.789 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:02.789 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:02.789 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:02.789 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:02.855 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:02.876 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:02.877 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:02.878 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:02.878 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:02.879 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:02.879 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:02.879 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:02.879 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:02.879 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:02.880 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:02.880 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:02.880 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:02.881 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:02.881 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:02.881 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:02.881 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:02.882 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:02.882 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:02.882 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:02.883 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:02.883 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:02.883 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:02.887 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:02.887 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:02.887 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:02.887 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:02.905 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:03.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535583121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:03.136 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
18:33:03.137 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
18:33:03.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:03.158836  5375 heartbeater.cc:499] Master 127.4.179.62:35121 was elected leader, sending a full tablet report...
18:33:03.192 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:03.192 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:03.192 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:03.193 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:03.193 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:03.193 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:03.193 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:03.193 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:03.193 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:03.194 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:03.194 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:03.194 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:03.194 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:03.220 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:03.221 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:03.221 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:03.221 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:03.222 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:03.222 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:03.222 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:03.222 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:03.222 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:03.223 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:03.223 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:03.223 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:03.223 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:03.238 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:03.241 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:03.242 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:03.242 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:03.243 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:03.243 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:03.243 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:03.243 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:03.243 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:03.243 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:03.244 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:03.244 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:03.244 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:03.244 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:03.284 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:03.284 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:03.284 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:03.285 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:03.285 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:03.285 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:03.286 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:03.286 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:03.286 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:03.287 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:03.287 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:03.287 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:03.287 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:03.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:03.405 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:03.587 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:03.587 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:03.587 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:03.587 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:03.587 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:03.588 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:03.588 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:03.588 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:03.588 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:03.588 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:03.588 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:03.588 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:03.588 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:03.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535583621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:03.633 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:33:03.634 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
18:33:03.692 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:03.692 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:03.693 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:03.693 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:03.693 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:03.693 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:03.694 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:03.694 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:03.694 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:03.694 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:03.695 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:03.695 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:03.695 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:03.708 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:03.708 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:03.708 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:03.709 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:03.709 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:03.709 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:03.709 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:03.709 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:03.709 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:03.710 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:03.710 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:03.710 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:03.710 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:03.710 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:03.710 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:03.710 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:03.710 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:03.710 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:03.711 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:03.711 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:03.711 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:03.711 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:03.711 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:03.712 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:03.712 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:03.712 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:03.717 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:03.718 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:03.718 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:03.718 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:03.719 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:03.719 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:03.719 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:03.719 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:03.719 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:03.720 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:03.720 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:03.720 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:03.720 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:03.725 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:03.725 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:03.725 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:03.725 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:03.725 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:03.725 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:03.726 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:03.726 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:03.726 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:03.726 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:03.726 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:03.726 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:03.726 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:03.737 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:03.832 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:03.832 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:03.832 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:03.833 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:03.833 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:03.833 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:03.834 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:03.834 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:03.834 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:03.834 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:03.834 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:03.835 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:03.835 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:03.855 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:03.905 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:03.908 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:03.909 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:03.909 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:03.909 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:03.910 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:03.910 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:03.910 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:03.910 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:03.910 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:03.911 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:03.911 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:03.911 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:03.911 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:04.066 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:04.066 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:04.067 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:04.067 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:04.067 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:04.067 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:04.067 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:04.067 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:04.067 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:04.067 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:04.067 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:04.067 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:04.068 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:04.121 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535584121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:04.135 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
18:33:04.136 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
18:33:04.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:04.002718  5386 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 5378
18:33:04.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:02.612061  5388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:04.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:04.184949  5386 kernel_stack_watchdog.cc:198] Thread 5378 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 389ms:
18:33:04.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:33:04.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:33:04.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:33:04.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:33:04.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:04.185050  5378 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.575s	user 0.423s	sys 0.801s
18:33:04.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:04.185503  5378 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.576s	user 0.423s	sys 0.801s
18:33:04.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:04.188055  5390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:04.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:04.191522  5389 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1579 milliseconds
18:33:04.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.191545  5378 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:33:04.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.192932  5378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:33:04.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.195680  5378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:33:04.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.197077  5378 hybrid_clock.cc:648] HybridClock initialized: now 1783535584197041 us; error 35 us; skew 500 ppm
18:33:04.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.197996  5378 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:33:04.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.204968  5378 webserver.cc:534] Webserver started at http://127.4.179.2:35607/ using document root <none> and password file <none>
18:33:04.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.206403  5378 fs_manager.cc:362] Metadata directory not provided
18:33:04.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.206722  5378 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:33:04.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.207341  5378 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:33:04.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.214823  5378 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/data/instance:
18:33:04.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5454fd94967f4e178a493e84ecdce8e2"
18:33:04.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:04 on dist-test-slave-dxnw"
18:33:04.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.216503  5378 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/wal/instance:
18:33:04.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5454fd94967f4e178a493e84ecdce8e2"
18:33:04.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:04 on dist-test-slave-dxnw"
18:33:04.221 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:04.221 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:04.221 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:04.222 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:04.222 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:04.222 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:04.222 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:04.222 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:04.222 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:04.222 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:04.222 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:04.222 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:04.222 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:04.225 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:04.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.225279  5378 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.003s	sys 0.006s
18:33:04.225 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:04.226 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:04.226 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:04.226 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:04.226 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:04.226 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:04.226 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:04.226 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:04.226 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:04.226 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:04.226 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:04.226 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:04.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.232124  5398 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:33:04.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.233367  5378 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.233683  5378 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/wal
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5454fd94967f4e178a493e84ecdce8e2"
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:04 on dist-test-slave-dxnw"
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.234014  5378 fs_report.cc:389] FS layout report
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/wal
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/wal
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/data/data
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:33:04.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:33:04.238 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:04.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.294064  5378 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:33:04.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.295806  5378 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:33:04.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.296370  5378 kserver.cc:163] Server-wide thread pool size limit: 3276
18:33:04.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.299844  5378 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:33:04.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.305233  5378 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:33:04.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.305464  5378 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:33:04.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.305691  5378 ts_tablet_manager.cc:616] Registered 0 tablets
18:33:04.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.305843  5378 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:33:04.324 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:04.324 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:04.325 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:04.325 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:04.325 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:04.325 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:04.325 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:04.325 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:04.325 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:04.325 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:04.325 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:04.325 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:04.326 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:04.354 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:04.406 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:04.443 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:04.444 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:04.444 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:04.444 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:04.444 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:04.445 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:04.445 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:04.445 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:04.445 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:04.445 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:04.445 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:04.445 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:04.445 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:04.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.472663  5378 rpc_server.cc:307] RPC server started. Bound to: 127.4.179.2:33745
18:33:04.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.472764  5511 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.179.2:33745 every 8 connection(s)
18:33:04.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.475283  5378 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/data/info.pb
18:33:04.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.480358  4812 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 5378
18:33:04.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.480844  4812 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-1/wal/instance
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.499661  4812 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/wal
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/data
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/logs
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/data/info.pb
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.179.3:0
18:33:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.179.3
18:33:04.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.179.3
18:33:04.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:04.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.179.62:35121,127.4.179.61:44733,127.4.179.60:34679
18:33:04.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.179.20:42683
18:33:04.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:04.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:04.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:33:04.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.540699  5512 heartbeater.cc:344] Connected to a master server at 127.4.179.60:34679
18:33:04.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.541296  5512 heartbeater.cc:461] Registering TS with master...
18:33:04.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.542795  5512 heartbeater.cc:507] Master 127.4.179.60:34679 requested a full tablet report, sending...
18:33:04.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.546531  5083 ts_manager.cc:194] Registered new tserver with Master: 5454fd94967f4e178a493e84ecdce8e2 (127.4.179.2:33745)
18:33:04.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.549634  5513 heartbeater.cc:344] Connected to a master server at 127.4.179.61:44733
18:33:04.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.549968  5513 heartbeater.cc:461] Registering TS with master...
18:33:04.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.550971  5513 heartbeater.cc:507] Master 127.4.179.61:44733 requested a full tablet report, sending...
18:33:04.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.551062  5514 heartbeater.cc:344] Connected to a master server at 127.4.179.62:35121
18:33:04.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.551460  5514 heartbeater.cc:461] Registering TS with master...
18:33:04.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.552413  5514 heartbeater.cc:507] Master 127.4.179.62:35121 requested a full tablet report, sending...
18:33:04.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.553966  4941 ts_manager.cc:194] Registered new tserver with Master: 5454fd94967f4e178a493e84ecdce8e2 (127.4.179.2:33745)
18:33:04.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.554836  4857 ts_manager.cc:194] Registered new tserver with Master: 5454fd94967f4e178a493e84ecdce8e2 (127.4.179.2:33745)
18:33:04.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.556310  4857 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.179.2:37967
18:33:04.607 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:04.607 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:04.608 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:04.608 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:04.608 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:04.608 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:04.608 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:04.608 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:04.608 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:04.608 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:04.608 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:04.608 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:04.608 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:04.621 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535584621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:04.630 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:33:04.631 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
18:33:04.738 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:04.844 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:04.844 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:04.845 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:04.845 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:04.845 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:04.845 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:04.845 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:04.845 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:04.845 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:04.845 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:04.846 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:04.846 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:04.846 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:04.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:04.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:04.886190  5519 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:33:04.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:04.886722  5519 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:33:04.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:04.887326  5519 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:33:04.906 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:04.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:04.924490  5519 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:33:04.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:04.925379  5519 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.179.3
18:33:04.956 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:04.957 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:04.957 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:04.957 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:04.957 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:04.957 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:04.957 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:04.957 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:04.957 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:04.957 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:04.957 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:04.957 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:04.958 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:04.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.963435  5519 tablet_server_runner.cc:78] Tablet server non-default flags:
18:33:04.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:04.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.179.20:42683
18:33:04.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:04.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:04.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/data
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/wal
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.179.3:0
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/data/info.pb
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.179.3
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.179.62:35121,127.4.179.61:44733,127.4.179.60:34679
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.179.3
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/logs
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:33:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.964761  5519 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:33:04.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:04.966583  5519 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:33:04.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:04.980599  5529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:05.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535585121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:05.135 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
18:33:05.136 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
18:33:05.238 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:05.239 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:05.239 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:05.240 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:05.240 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:05.240 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:05.240 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:05.240 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:05.240 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:05.240 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:05.241 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:05.241 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:05.241 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:05.241 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:05.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:05.406 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:05.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:05.560164  5514 heartbeater.cc:499] Master 127.4.179.62:35121 was elected leader, sending a full tablet report...
18:33:05.625 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535585621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:05.643 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=21 ms, finalizationTime=0 ms).
18:33:05.645 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
18:33:05.684 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:05.685 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:05.685 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:05.686 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:05.686 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:05.686 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:05.686 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:05.687 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:05.687 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:05.687 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:05.686 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:05.687 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:05.687 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:05.738 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:05.855 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:05.875 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:05.876 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:05.876 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:05.877 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:05.877 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:05.877 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:05.877 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:05.877 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:05.878 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:05.878 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:05.878 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:05.878 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:05.878 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:05.879 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:05.879 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:05.879 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:05.879 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:05.879 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:05.879 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:05.879 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:05.879 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:05.879 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:05.880 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:05.880 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:05.880 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:05.880 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:05.906 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:06.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535586121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:06.132 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:33:06.133 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
18:33:06.177 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:06.177 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:06.177 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:06.178 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:06.178 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:06.178 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:06.178 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:06.178 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:06.178 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:06.178 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:06.178 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:06.178 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:06.178 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:06.238 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:06.266 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:06.267 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:06.267 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:06.267 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:06.267 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:06.267 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:06.268 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:06.268 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:06.268 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:06.268 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:06.268 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:06.268 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:06.268 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:06.305 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:06.306 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:06.306 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:06.306 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:06.306 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:06.306 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:06.306 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:06.306 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:06.306 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:06.307 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:06.307 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:06.307 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:06.307 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:06.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:06.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:04.982298  5530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:06.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:06.399260  5531 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1414 milliseconds
18:33:06.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:06.400586  5532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:06.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.400748  5519 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:33:06.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.402190  5519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:33:06.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.404876  5519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:33:06.406 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:06.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.406278  5519 hybrid_clock.cc:648] HybridClock initialized: now 1783535586406224 us; error 70 us; skew 500 ppm
18:33:06.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.407478  5519 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:33:06.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.414731  5519 webserver.cc:534] Webserver started at http://127.4.179.3:36381/ using document root <none> and password file <none>
18:33:06.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.415812  5519 fs_manager.cc:362] Metadata directory not provided
18:33:06.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.416019  5519 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:33:06.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.416441  5519 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:33:06.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.421284  5519 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/data/instance:
18:33:06.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "928ff5a5022c4c84be872c8cd7fd3581"
18:33:06.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:06 on dist-test-slave-dxnw"
18:33:06.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.422593  5519 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/wal/instance:
18:33:06.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "928ff5a5022c4c84be872c8cd7fd3581"
18:33:06.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:06 on dist-test-slave-dxnw"
18:33:06.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.431131  5519 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
18:33:06.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.438385  5540 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:33:06.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.439841  5519 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.000s
18:33:06.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.440147  5519 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/wal
18:33:06.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "928ff5a5022c4c84be872c8cd7fd3581"
18:33:06.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:06 on dist-test-slave-dxnw"
18:33:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.440487  5519 fs_report.cc:389] FS layout report
18:33:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:33:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/wal
18:33:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/wal
18:33:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/data/data
18:33:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:33:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:33:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:33:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:33:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:33:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:33:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:33:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:33:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:33:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:33:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:33:06.481 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:06.481 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:06.481 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:06.481 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:06.482 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:06.482 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:06.482 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:06.482 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:06.482 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:06.482 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:06.482 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:06.482 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:06.482 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:06.496 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:06.496 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:06.496 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:06.497 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:06.497 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:06.497 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:06.497 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:06.497 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:06.497 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:06.497 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:06.497 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:06.497 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:06.497 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:06.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.500730  5519 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:33:06.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.502564  5519 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:33:06.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.503134  5519 kserver.cc:163] Server-wide thread pool size limit: 3276
18:33:06.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.506201  5519 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:33:06.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.511530  5519 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:33:06.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.511852  5519 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:33:06.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.512256  5519 ts_tablet_manager.cc:616] Registered 0 tablets
18:33:06.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.512468  5519 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:33:06.548 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:06.549 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:06.549 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:06.549 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:06.549 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:06.549 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:06.549 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:06.549 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:06.549 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:06.549 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:06.550 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:06.550 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:06.550 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:06.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535586621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:06.635 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
18:33:06.636 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
18:33:06.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.683874  5519 rpc_server.cc:307] RPC server started. Bound to: 127.4.179.3:43889
18:33:06.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.683970  5653 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.179.3:43889 every 8 connection(s)
18:33:06.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.686961  5519 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/data/info.pb
18:33:06.688 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:06.689 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:06.689 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:06.689 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:06.689 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:06.689 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:06.689 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:06.689 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:06.689 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:06.689 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:06.690 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:06.689 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:06.690 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:06.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.688977  4812 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 5519
18:33:06.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.689584  4812 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14214224375211934662/ts-2/wal/instance
18:33:06.738 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:06.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.740268  5655 heartbeater.cc:344] Connected to a master server at 127.4.179.61:44733
18:33:06.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.741214  5655 heartbeater.cc:461] Registering TS with master...
18:33:06.743 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:06.744 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:06.744 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:06.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.744289  5656 heartbeater.cc:344] Connected to a master server at 127.4.179.62:35121
18:33:06.744 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:06.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.744629  5656 heartbeater.cc:461] Registering TS with master...
18:33:06.744 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:06.744 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:06.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.744778  5654 heartbeater.cc:344] Connected to a master server at 127.4.179.60:34679
18:33:06.745 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:06.745 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:06.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.745126  5654 heartbeater.cc:461] Registering TS with master...
18:33:06.745 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:06.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.745637  5656 heartbeater.cc:507] Master 127.4.179.62:35121 requested a full tablet report, sending...
18:33:06.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.746106  5654 heartbeater.cc:507] Master 127.4.179.60:34679 requested a full tablet report, sending...
18:33:06.747 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:06.747 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:06.747 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:06.747 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:06.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.742823  5655 heartbeater.cc:507] Master 127.4.179.61:44733 requested a full tablet report, sending...
18:33:06.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.748538  4857 ts_manager.cc:194] Registered new tserver with Master: 928ff5a5022c4c84be872c8cd7fd3581 (127.4.179.3:43889)
18:33:06.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.749747  5083 ts_manager.cc:194] Registered new tserver with Master: 928ff5a5022c4c84be872c8cd7fd3581 (127.4.179.3:43889)
18:33:06.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.750188  4857 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.179.3:60815
18:33:06.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.752218  4940 ts_manager.cc:194] Registered new tserver with Master: 928ff5a5022c4c84be872c8cd7fd3581 (127.4.179.3:43889)
18:33:06.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:06.772404  4812 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
18:33:06.784 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:33:06.784 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

18:33:06.785 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.4.179.62"
      port: 35121
    }
    bound_http_address {
      host: "127.4.179.62"
      port: 32781
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.4.179.61"
      port: 44733
    }
    bound_http_address {
      host: "127.4.179.61"
      port: 45831
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.4.179.60"
      port: 34679
    }
    bound_http_address {
      host: "127.4.179.60"
      port: 36431
    }
  }
}

18:33:06.785 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

18:33:06.787 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.4.179.1"
      port: 45253
    }
    bound_http_address {
      host: "127.4.179.1"
      port: 46103
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.4.179.2"
      port: 33745
    }
    bound_http_address {
      host: "127.4.179.2"
      port: 35607
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.4.179.3"
      port: 43889
    }
    bound_http_address {
      host: "127.4.179.3"
      port: 36381
    }
  }
}

18:33:06.788 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
18:33:06.789 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:06.789 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
18:33:06.789 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskSwO0Je/test-tmp
18:33:06.790 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
18:33:06.790 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskSwO0Je/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
18:33:06.794 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

18:33:06.855 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:06.905 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:07.039 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:07.040 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:07.040 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:07.040 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:07.040 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:07.040 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:07.040 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:07.040 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:07.040 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:07.041 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:07.041 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:07.041 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:07.041 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:07.112 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:07.112 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:07.113 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:07.113 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:07.113 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:07.113 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:07.113 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:07.113 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:07.113 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:07.114 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:07.114 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:07.114 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:07.114 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:07.116 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:07.116 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:07.116 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:07.116 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:07.116 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:07.116 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:07.117 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:07.117 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:07.117 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:07.117 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:07.117 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:07.117 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:07.117 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:07.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535587121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:07.130 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:33:07.131 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
18:33:07.186 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:33:07.186 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

18:33:07.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:07.189778  5664 mini_oidc.cc:150] Starting JWKS server
18:33:07.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:07.193137  5664 webserver.cc:534] Webserver started at http://127.0.0.1:46535/ using document root <none> and password file <none>
18:33:07.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:07.193617  5664 mini_oidc.cc:186] Starting OIDC Discovery server
18:33:07.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:07.195539  5664 webserver.cc:534] Webserver started at http://127.0.0.1:41729/ using document root <none> and password file <none>
18:33:07.237 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:07.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:33:07Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
18:33:07.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:33:07Z Disabled control of system clock
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:07.259564  5664 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/wal
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/data
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/logs
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/data/info.pb
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.136.62:42905
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.136.62
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.136.20:33349
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.5.136.62:42905,127.5.136.61:43625,127.5.136.60:39171
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:33:07.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46535/jwks.json with env {}
18:33:07.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:07.405 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:07.448 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:07.448 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:07.448 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:07.448 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:07.448 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:07.449 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:07.449 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:07.449 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:07.449 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:07.449 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:07.449 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:07.449 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:07.449 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:07.452 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:07.452 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:07.452 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:07.452 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:07.452 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:07.452 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:07.452 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:07.452 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:07.452 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:07.452 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:07.452 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:07.452 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:07.453 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:07.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535587622 for job 9de81db54be40687a2a82164db1dc50b.
18:33:07.631 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
18:33:07.632 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
18:33:07.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:07.651714  5676 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:33:07.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:07.652419  5676 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:33:07.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:07.653043  5676 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:33:07.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:07.690228  5676 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:33:07.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:07.690512  5676 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:33:07.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:07.690779  5676 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:33:07.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:07.691072  5676 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:33:07.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:07.691284  5676 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:33:07.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:07.691495  5676 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46535/jwks.json
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:07.732066  5676 master_runner.cc:387] Master server non-default flags:
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.136.20:33349
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/data
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/wal
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.5.136.62:42905,127.5.136.61:43625,127.5.136.60:39171
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.136.62:42905
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46535/jwks.json
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/data/info.pb
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.136.62
18:33:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/logs
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:33:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:07.733386  5676 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:33:07.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:07.734959  5676 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:33:07.737 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:07.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:07.746924  5682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:07.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:07.755750  5656 heartbeater.cc:499] Master 127.4.179.62:35121 was elected leader, sending a full tablet report...
18:33:07.809 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:07.809 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:07.809 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:07.810 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:07.810 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:07.810 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:07.810 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:07.810 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:07.811 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:07.811 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:07.811 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:07.811 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:07.811 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:07.855 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:07.905 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:08.007 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:08.008 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:08.008 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:08.009 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:08.009 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:08.011 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:08.011 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:08.011 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:08.012 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:08.012 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:08.012 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:08.012 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:08.012 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:08.121 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535588121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:08.137 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
18:33:08.138 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
18:33:08.217 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:08.218 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:08.218 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:08.218 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:08.218 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:08.219 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:08.219 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:08.219 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:08.219 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:08.219 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:08.219 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:08.219 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:08.219 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:08.238 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:08.257 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:08.257 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:08.258 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:08.258 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:08.258 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:08.258 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:08.258 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:08.258 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:08.258 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:08.259 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:08.259 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:08.259 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:08.259 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:08.267 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:08.267 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:08.267 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:08.268 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:08.268 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:08.268 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:08.269 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:08.269 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:08.269 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:08.270 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:08.270 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:08.270 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:08.270 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:08.285 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:08.285 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:08.285 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:08.286 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:08.286 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:08.286 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:08.287 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:08.287 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:08.287 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:08.287 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:08.287 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:08.287 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:08.287 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:08.288 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:08.288 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:08.288 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:08.289 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:08.289 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:08.289 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:08.289 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:08.289 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:08.289 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:08.290 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:08.290 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:08.290 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:08.290 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:08.359 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:08.406 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:08.601 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:08.602 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:08.602 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:08.603 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:08.603 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:08.603 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:08.603 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:08.603 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:08.603 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:08.603 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:08.603 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:08.603 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:08.603 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:08.616 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:08.616 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:08.617 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:08.617 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:08.617 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:08.617 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:08.617 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:08.617 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:08.617 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:08.618 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:08.618 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:08.618 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:08.618 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:08.623 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535588621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:08.635 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
18:33:08.636 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
18:33:08.738 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:08.796 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:08.796 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:08.797 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:08.797 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:08.798 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:08.798 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:08.799 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:08.799 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:08.799 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:08.799 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:08.800 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:08.800 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:08.800 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:08.846 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:08.847 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:08.847 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:08.848 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:08.848 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:08.848 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:08.850 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:08.850 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:08.850 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:08.851 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:08.851 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:08.851 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:08.851 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:08.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:08.875 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:08.876 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:08.876 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:08.876 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:08.876 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:08.876 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:08.877 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:08.877 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:08.877 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:08.877 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:08.877 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:08.878 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:08.878 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:08.895 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:08.896 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:08.896 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:08.896 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:08.896 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:08.896 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:08.896 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:08.896 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:08.896 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:08.896 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:08.897 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:08.897 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:08.897 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:08.905 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:09.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535589121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:09.133 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:33:09.134 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
18:33:09.238 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:09.354 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:09.406 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:09.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:09.152426  5681 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 5676
18:33:09.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:07.747674  5683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:09.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:09.453909  5676 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.706s	user 0.562s	sys 1.130s
18:33:09.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:09.456442  5676 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.709s	user 0.562s	sys 1.130s
18:33:09.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:09.457181  5685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:09.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:09.461373  5684 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1708 milliseconds
18:33:09.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.461473  5676 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:33:09.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.463078  5676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:33:09.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.466281  5676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:33:09.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.467844  5676 hybrid_clock.cc:648] HybridClock initialized: now 1783535589467721 us; error 100 us; skew 500 ppm
18:33:09.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.469266  5676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:33:09.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.479288  5676 webserver.cc:534] Webserver started at http://127.5.136.62:44661/ using document root <none> and password file <none>
18:33:09.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.480923  5676 fs_manager.cc:362] Metadata directory not provided
18:33:09.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.481606  5676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:33:09.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.482355  5676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:33:09.484 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:09.484 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:09.484 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:09.485 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:09.485 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:09.485 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:09.485 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:09.485 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:09.485 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:09.485 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:09.485 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:09.485 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:09.485 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:09.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.488001  5676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/data/instance:
18:33:09.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9749d6e6ecd14ac2982f6cf232a3f779"
18:33:09.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:09 on dist-test-slave-dxnw"
18:33:09.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.489321  5676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/wal/instance:
18:33:09.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9749d6e6ecd14ac2982f6cf232a3f779"
18:33:09.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:09 on dist-test-slave-dxnw"
18:33:09.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.497884  5676 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.005s
18:33:09.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.504954  5695 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:33:09.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.506467  5676 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.002s
18:33:09.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.506913  5676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/wal
18:33:09.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9749d6e6ecd14ac2982f6cf232a3f779"
18:33:09.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:09 on dist-test-slave-dxnw"
18:33:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.507393  5676 fs_report.cc:389] FS layout report
18:33:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:33:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/wal
18:33:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/wal
18:33:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/data/data
18:33:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:33:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:33:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:33:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:33:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:33:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:33:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:33:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:33:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:33:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:33:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:33:09.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.612279  5676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:33:09.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.613924  5676 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:33:09.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.614430  5676 kserver.cc:163] Server-wide thread pool size limit: 3276
18:33:09.621 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535589621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:09.629 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
18:33:09.630 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
18:33:09.637 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:09.637 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:09.637 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:09.638 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:09.638 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:09.638 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:09.638 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:09.638 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:09.638 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:09.638 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:09.638 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:09.638 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:09.638 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:09.677 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:09.678 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:09.678 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:09.678 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:09.678 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:09.678 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:09.678 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:09.678 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:09.678 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:09.678 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:09.678 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:09.679 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:09.679 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:09.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.709650  5676 rpc_server.cc:307] RPC server started. Bound to: 127.5.136.62:42905
18:33:09.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.709725  5746 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.136.62:42905 every 8 connection(s)
18:33:09.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.712638  5676 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/data/info.pb
18:33:09.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.718561  5664 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 5676
18:33:09.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.719091  5664 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-0/wal/instance
18:33:09.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.720149  5747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.724750  5664 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/wal
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/data
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/logs
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/data/info.pb
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.136.61:43625
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.136.61
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.136.20:33349
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.5.136.62:42905,127.5.136.61:43625,127.5.136.60:39171
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:33:09.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46535/jwks.json with env {}
18:33:09.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.735021  5747 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } has no permanent_uuid. Determining permanent_uuid...
18:33:09.738 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:09.748 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:09.749 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:09.749 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:09.749 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:09.749 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:09.749 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:09.749 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:09.749 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:09.749 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:09.749 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:09.749 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:09.749 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:09.749 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:09.756 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:09.756 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:09.756 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:09.756 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:09.756 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:09.756 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:09.757 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:09.757 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:09.757 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:09.757 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:09.757 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:09.757 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:09.757 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:09.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.764091  5747 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } has no permanent_uuid. Determining permanent_uuid...
18:33:09.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:09.767040  5699 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.136.61:43625: connect: Connection refused (error 111)
18:33:09.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:09.771894  5747 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.136.61:43625: Network error: Client connection negotiation failed: client connection to 127.5.136.61:43625: connect: Connection refused (error 111)
18:33:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.821440  5747 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } attempt: 1
18:33:09.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:09.826980  5747 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.136.61:43625: Network error: Client connection negotiation failed: client connection to 127.5.136.61:43625: connect: Connection refused (error 111)
18:33:09.855 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:09.883 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:09.884 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:09.884 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:09.884 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:09.884 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:09.884 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:09.884 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:09.884 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:09.884 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:09.885 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:09.885 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:09.885 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:09.885 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:09.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.895447  5747 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } attempt: 2
18:33:09.899 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:09.900 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:09.900 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:09.900 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:09.900 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:09.900 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:09.900 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:09.900 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:09.901 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:09.901 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:09.901 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:09.901 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:09.901 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:09.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:09.901314  5747 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.136.61:43625: Network error: Client connection negotiation failed: client connection to 127.5.136.61:43625: connect: Connection refused (error 111)
18:33:09.906 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:09.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:09.992767  5747 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } attempt: 3
18:33:09.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:09.997939  5747 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.136.61:43625: Network error: Client connection negotiation failed: client connection to 127.5.136.61:43625: connect: Connection refused (error 111)
18:33:10.032 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:10.033 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:10.033 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:10.033 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:10.033 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:10.033 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:10.033 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:10.033 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:10.033 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:10.034 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:10.034 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:10.034 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:10.034 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:10.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:10.074559  5750 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:33:10.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:10.075429  5750 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:33:10.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:10.076296  5750 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:33:10.097 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:10.097 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:10.097 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:10.097 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:10.097 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:10.097 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:10.097 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:10.097 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:10.097 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:10.097 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:10.098 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:10.098 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:10.098 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:10.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:10.113476  5750 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:33:10.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:10.113852  5750 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:33:10.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:10.114151  5750 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:33:10.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:10.114370  5750 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:33:10.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:10.114568  5750 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:33:10.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:10.114740  5750 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46535/jwks.json
18:33:10.121 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535590121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:10.129 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:33:10.130 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
18:33:10.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:10.141382  5747 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } attempt: 4
18:33:10.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:10.146695  5747 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.136.61:43625: Network error: Client connection negotiation failed: client connection to 127.5.136.61:43625: connect: Connection refused (error 111)
18:33:10.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:10.160398  5750 master_runner.cc:387] Master server non-default flags:
18:33:10.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:10.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.136.20:33349
18:33:10.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:10.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/data
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/wal
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.5.136.62:42905,127.5.136.61:43625,127.5.136.60:39171
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.136.61:43625
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46535/jwks.json
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/data/info.pb
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.136.61
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/logs
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:33:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:33:10.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:10.161921  5750 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:33:10.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:10.163630  5750 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:33:10.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:10.176194  5759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:10.237 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:10.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:10.355 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:10.356 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:10.356 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:10.356 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:10.357 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:10.357 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:10.357 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:10.357 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:10.357 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:10.358 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:10.358 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:10.358 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:10.358 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:10.406 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:10.428 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:10.429 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:10.429 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:10.429 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:10.429 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:10.429 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:10.429 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:10.429 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:10.429 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:10.430 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:10.430 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:10.430 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:10.430 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:10.437 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:10.437 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:10.437 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:10.437 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:10.437 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:10.437 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:10.437 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:10.437 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:10.437 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:10.438 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:10.438 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:10.438 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:10.438 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:10.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:10.446177  5747 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } attempt: 5
18:33:10.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:10.455188  5747 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.136.61:43625: Network error: Client connection negotiation failed: client connection to 127.5.136.61:43625: connect: Connection refused (error 111)
18:33:10.545 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:10.546 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:10.546 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:10.547 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:10.547 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:10.547 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:10.547 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:10.547 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:10.548 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:10.548 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:10.548 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:10.548 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:10.548 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:10.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535590621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:10.633 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:33:10.635 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
18:33:10.737 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:10.795 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:10.796 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:10.796 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:10.797 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:10.797 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:10.797 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:10.797 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:10.797 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:10.797 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:10.798 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:10.798 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:10.798 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:10.798 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:10.855 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:10.905 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:10.985 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:10.986 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:10.986 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:10.987 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:10.987 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:10.987 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:10.987 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:10.987 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:10.987 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:10.988 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:10.988 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:10.988 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:10.988 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:10.989 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26841), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [72ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [84ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [165ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [165ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [217ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [218ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [223ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [278ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [311ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [311ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [312ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [312ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [323ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [343ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [362ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [443ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [483ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [483ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [742ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [743ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [743ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [743ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [844ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [902ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [903ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [903ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [903ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1403ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2201ms] refreshing cache from master, [2201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2203ms] too many traces: truncated at 100 traces, deferred=Deferred@1591951777(state=PENDING, result=null, callback=(continuation of Deferred@483618133 after retry RPC after error@46671092) -> (continuation of Deferred@948217887 after retry RPC after error@2083391719) -> (continuation of Deferred@2064677874 after retry RPC after error@951848928) -> (continuation of Deferred@627412152 after retry RPC after error@687915459) -> (continuation of Deferred@1371009274 after retry RPC after error@153888291) -> (continuation of Deferred@10845170 after retry RPC after error@788835580) -> (continuation of Deferred@1096460742 after retry RPC after error@699372272) -> (continuation of Deferred@50202332 after retry RPC after error@135735603) -> (continuation of Deferred@471315822 after retry RPC after error@1232768014) -> (continuation of Deferred@994097947 after retry RPC after error@170873841) -> (continuation of Deferred@733096735 after retry RPC after error@917883035) -> (continuation of Deferred@135476533 after retry RPC after error@2027118365) -> (continuation of Deferred@1115908555 after retry RPC after error@1525321744) -> (continuation of Deferred@1270988005 after retry RPC after error@688404791) -> (continuation of Deferred@1880932588 after retry RPC after error@2121835759) -> (continuation of Deferred@949487953 after retry RPC after error@1345408756) -> (continuation of Deferred@1178402750 after retry RPC after error@2102948938) -> (continuation of Deferred@91367473 after retry RPC after error@1609470085) -> (continuation of Deferred@2123257289 after retry RPC after error@1087018102) -> (continuation of Deferred@1424822270 after retry RPC after error@2142033758) -> (continuation of Deferred@1929438591 after retry RPC after error@1736291917) -> (continuation of Deferred@1540605859 after retry RPC after error@1121775008) -> (continuation of Deferred@906216345 after retry RPC after error@1019663562), errback=(continuation of Deferred@483618133 after retry RPC after error@46671092) -> (continuation of Deferred@948217887 after retry RPC after error@2083391719) -> (continuation of Deferred@2064677874 after retry RPC after error@951848928) -> (continuation of Deferred@627412152 after retry RPC after error@687915459) -> (continuation of Deferred@1371009274 after retry RPC after error@153888291) -> (continuation of Deferred@10845170 after retry RPC after error@788835580) -> (continuation of Deferred@1096460742 after retry RPC after error@699372272) -> (continuation of Deferred@50202332 after retry RPC after error@135735603) -> (continuation of Deferred@471315822 after retry RPC after error@1232768014) -> (continuation of Deferred@994097947 after retry RPC after error@170873841) -> (continuation of Deferred@733096735 after retry RPC after error@917883035) -> (continuation of Deferred@135476533 after retry RPC after error@2027118365) -> (continuation of Deferred@1115908555 after retry RPC after error@1525321744) -> (continuation of Deferred@1270988005 after retry RPC after error@688404791) -> (continuation of Deferred@1880932588 after retry RPC after error@2121835759) -> (continuation of Deferred@949487953 after retry RPC after error@1345408756) -> (continuation of Deferred@1178402750 after retry RPC after error@2102948938) -> (continuation of Deferred@91367473 after retry RPC after error@1609470085) -> (continuation of Deferred@2123257289 after retry RPC after error@1087018102) -> (continuation of Deferred@1424822270 after retry RPC after error@2142033758) -> (continuation of Deferred@1929438591 after retry RPC after error@1736291917) -> (continuation of Deferred@1540605859 after retry RPC after error@1121775008) -> (continuation of Deferred@906216345 after retry RPC after error@1019663562)))
18:33:10.990 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
18:33:10.991 [WARN - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26841), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [72ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [84ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [165ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [165ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [217ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [218ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [223ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [278ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [311ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [311ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [312ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [312ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [323ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [343ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [362ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [443ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [483ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [483ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [742ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [743ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [743ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [743ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [844ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [902ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [903ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [903ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [903ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1403ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2201ms] refreshing cache from master, [2201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2203ms] too many traces: truncated at 100 traces, deferred=Deferred@1591951777(state=PENDING, result=null, callback=(continuation of Deferred@483618133 after retry RPC after error@46671092) -> (continuation of Deferred@948217887 after retry RPC after error@2083391719) -> (continuation of Deferred@2064677874 after retry RPC after error@951848928) -> (continuation of Deferred@627412152 after retry RPC after error@687915459) -> (continuation of Deferred@1371009274 after retry RPC after error@153888291) -> (continuation of Deferred@10845170 after retry RPC after error@788835580) -> (continuation of Deferred@1096460742 after retry RPC after error@699372272) -> (continuation of Deferred@50202332 after retry RPC after error@135735603) -> (continuation of Deferred@471315822 after retry RPC after error@1232768014) -> (continuation of Deferred@994097947 after retry RPC after error@170873841) -> (continuation of Deferred@733096735 after retry RPC after error@917883035) -> (continuation of Deferred@135476533 after retry RPC after error@2027118365) -> (continuation of Deferred@1115908555 after retry RPC after error@1525321744) -> (continuation of Deferred@1270988005 after retry RPC after error@688404791) -> (continuation of Deferred@1880932588 after retry RPC after error@2121835759) -> (continuation of Deferred@949487953 after retry RPC after error@1345408756) -> (continuation of Deferred@1178402750 after retry RPC after error@2102948938) -> (continuation of Deferred@91367473 after retry RPC after error@1609470085) -> (continuation of Deferred@2123257289 after retry RPC after error@1087018102) -> (continuation of Deferred@1424822270 after retry RPC after error@2142033758) -> (continuation of Deferred@1929438591 after retry RPC after error@1736291917) -> (continuation of Deferred@1540605859 after retry RPC after error@1121775008) -> (continuation of Deferred@906216345 after retry RPC after error@1019663562), errback=(continuation of Deferred@483618133 after retry RPC after error@46671092) -> (continuation of Deferred@948217887 after retry RPC after error@2083391719) -> (continuation of Deferred@2064677874 after retry RPC after error@951848928) -> (continuation of Deferred@627412152 after retry RPC after error@687915459) -> (continuation of Deferred@1371009274 after retry RPC after error@153888291) -> (continuation of Deferred@10845170 after retry RPC after error@788835580) -> (continuation of Deferred@1096460742 after retry RPC after error@699372272) -> (continuation of Deferred@50202332 after retry RPC after error@135735603) -> (continuation of Deferred@471315822 after retry RPC after error@1232768014) -> (continuation of Deferred@994097947 after retry RPC after error@170873841) -> (continuation of Deferred@733096735 after retry RPC after error@917883035) -> (continuation of Deferred@135476533 after retry RPC after error@2027118365) -> (continuation of Deferred@1115908555 after retry RPC after error@1525321744) -> (continuation of Deferred@1270988005 after retry RPC after error@688404791) -> (continuation of Deferred@1880932588 after retry RPC after error@2121835759) -> (continuation of Deferred@949487953 after retry RPC after error@1345408756) -> (continuation of Deferred@1178402750 after retry RPC after error@2102948938) -> (continuation of Deferred@91367473 after retry RPC after error@1609470085) -> (continuation of Deferred@2123257289 after retry RPC after error@1087018102) -> (continuation of Deferred@1424822270 after retry RPC after error@2142033758) -> (continuation of Deferred@1929438591 after retry RPC after error@1736291917) -> (continuation of Deferred@1540605859 after retry RPC after error@1121775008) -> (continuation of Deferred@906216345 after retry RPC after error@1019663562)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.124:38627
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:10.991 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
18:33:10.994 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#3 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
18:33:10.998 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26841), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [72ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [84ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [165ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [165ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [217ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [218ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [223ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [278ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [311ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [311ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [312ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [312ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [323ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [323ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [343ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [362ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [443ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [483ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [483ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [742ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [743ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [743ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [743ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [844ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [902ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [903ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [903ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [903ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1403ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2201ms] refreshing cache from master, [2201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2203ms] too many traces: truncated at 100 traces, deferred=Deferred@1591951777(state=PENDING, result=null, callback=(continuation of Deferred@483618133 after retry RPC after error@46671092) -> (continuation of Deferred@948217887 after retry RPC after error@2083391719) -> (continuation of Deferred@2064677874 after retry RPC after error@951848928) -> (continuation of Deferred@627412152 after retry RPC after error@687915459) -> (continuation of Deferred@1371009274 after retry RPC after error@153888291) -> (continuation of Deferred@10845170 after retry RPC after error@788835580) -> (continuation of Deferred@1096460742 after retry RPC after error@699372272) -> (continuation of Deferred@50202332 after retry RPC after error@135735603) -> (continuation of Deferred@471315822 after retry RPC after error@1232768014) -> (continuation of Deferred@994097947 after retry RPC after error@170873841) -> (continuation of Deferred@733096735 after retry RPC after error@917883035) -> (continuation of Deferred@135476533 after retry RPC after error@2027118365) -> (continuation of Deferred@1115908555 after retry RPC after error@1525321744) -> (continuation of Deferred@1270988005 after retry RPC after error@688404791) -> (continuation of Deferred@1880932588 after retry RPC after error@2121835759) -> (continuation of Deferred@949487953 after retry RPC after error@1345408756) -> (continuation of Deferred@1178402750 after retry RPC after error@2102948938) -> (continuation of Deferred@91367473 after retry RPC after error@1609470085) -> (continuation of Deferred@2123257289 after retry RPC after error@1087018102) -> (continuation of Deferred@1424822270 after retry RPC after error@2142033758) -> (continuation of Deferred@1929438591 after retry RPC after error@1736291917) -> (continuation of Deferred@1540605859 after retry RPC after error@1121775008) -> (continuation of Deferred@906216345 after retry RPC after error@1019663562), errback=(continuation of Deferred@483618133 after retry RPC after error@46671092) -> (continuation of Deferred@948217887 after retry RPC after error@2083391719) -> (continuation of Deferred@2064677874 after retry RPC after error@951848928) -> (continuation of Deferred@627412152 after retry RPC after error@687915459) -> (continuation of Deferred@1371009274 after retry RPC after error@153888291) -> (continuation of Deferred@10845170 after retry RPC after error@788835580) -> (continuation of Deferred@1096460742 after retry RPC after error@699372272) -> (continuation of Deferred@50202332 after retry RPC after error@135735603) -> (continuation of Deferred@471315822 after retry RPC after error@1232768014) -> (continuation of Deferred@994097947 after retry RPC after error@170873841) -> (continuation of Deferred@733096735 after retry RPC after error@917883035) -> (continuation of Deferred@135476533 after retry RPC after error@2027118365) -> (continuation of Deferred@1115908555 after retry RPC after error@1525321744) -> (continuation of Deferred@1270988005 after retry RPC after error@688404791) -> (continuation of Deferred@1880932588 after retry RPC after error@2121835759) -> (continuation of Deferred@949487953 after retry RPC after error@1345408756) -> (continuation of Deferred@1178402750 after retry RPC after error@2102948938) -> (continuation of Deferred@91367473 after retry RPC after error@1609470085) -> (continuation of Deferred@2123257289 after retry RPC after error@1087018102) -> (continuation of Deferred@1424822270 after retry RPC after error@2142033758) -> (continuation of Deferred@1929438591 after retry RPC after error@1736291917) -> (continuation of Deferred@1540605859 after retry RPC after error@1121775008) -> (continuation of Deferred@906216345 after retry RPC after error@1019663562)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.124:38627
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:11.000 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
18:33:11.000 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state RUNNING to RESTARTING.
18:33:11.004 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:11.005 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#3) of source Source: KuduSource.
18:33:11.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:11.005327  5747 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } attempt: 6
18:33:11.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:11.045394  5747 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.136.61:43625: Network error: Client connection negotiation failed: client connection to 127.5.136.61:43625: connect: Connection refused (error 111)
18:33:11.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535591121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:11.135 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
18:33:11.138 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
18:33:11.287 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:11.288 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:11.288 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:11.289 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:11.289 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:11.289 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:11.290 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:11.290 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:11.290 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:11.291 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:11.291 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:11.291 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:11.291 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:11.323 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:11.324 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:11.324 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:11.324 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:11.324 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:11.324 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:11.324 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:11.324 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:11.324 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:11.325 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:11.325 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:11.325 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:11.325 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:11.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:11.357 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:11.357 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:11.357 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:11.358 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:11.358 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:11.358 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:11.359 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:11.359 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:11.359 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:11.359 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:11.359 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:11.360 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:11.360 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:11.406 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:11.577 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:11.577 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:11.578 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:11.578 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:11.578 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:11.578 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:11.580 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:11.581 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:11.581 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:11.581 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:11.581 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:11.581 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:11.581 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:11.618 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:11.618 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:11.618 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:11.619 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:11.619 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:11.619 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:11.619 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:11.619 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:11.619 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:11.619 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:11.619 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:11.619 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:11.619 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:11.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535591621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:11.645 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=24 ms, finalizationTime=0 ms).
18:33:11.647 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
18:33:11.708 [DEBUG - pool-208-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.2.96.188:32989, [12ms] received response from server master-127.2.96.188:32989: OK, deferred=null) with no deferred attached!
18:33:11.855 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:11.905 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:11.926 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:11.926 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:11.926 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:11.927 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:11.927 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:11.927 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:11.927 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:11.927 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:11.927 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:11.927 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:11.927 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:11.927 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:11.927 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:11.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:11.580929  5758 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 5750
18:33:11.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:11.969653  5758 kernel_stack_watchdog.cc:198] Thread 5750 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 402ms:
18:33:11.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:33:11.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:33:11.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:33:11.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:33:11.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:10.176760  5760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:11.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:11.970928  5750 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.795s	user 0.561s	sys 1.104s
18:33:11.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:11.971253  5761 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1794 milliseconds
18:33:11.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:11.971370  5750 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.796s	user 0.561s	sys 1.104s
18:33:11.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:11.972307  5750 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:33:11.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:11.972361  5762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:11.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:11.976807  5750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:33:11.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:11.979630  5750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:33:11.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:11.980976  5750 hybrid_clock.cc:648] HybridClock initialized: now 1783535591980944 us; error 44 us; skew 500 ppm
18:33:11.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:11.982088  5750 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:33:11.985 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:11.985 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:11.986 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:11.986 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:11.986 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:11.986 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:11.986 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:11.986 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:11.986 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:11.986 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:11.986 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:11.986 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:11.987 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:11.987 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27823), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [8ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [15ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [22ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [22ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [138ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [144ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [164ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [265ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [266ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [283ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [290ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [290ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [301ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [303ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [363ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [364ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [364ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [442ms] refreshing cache from master, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [444ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [444ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [445ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [445ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [542ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [702ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [703ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [763ms] refreshing cache from master, [763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [765ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [765ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [765ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [766ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1562ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2163ms] refreshing cache from master, [2163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2164ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2165ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [5721ms] refreshing cache from master, [5721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [5721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [5721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [5722ms] too many traces: truncated at 100 traces, deferred=Deferred@1746724503(state=PENDING, result=null, callback=(continuation of Deferred@1629790053 after retry RPC after error@762519282) -> (continuation of Deferred@1577302923 after retry RPC after error@1361368706) -> (continuation of Deferred@339649652 after retry RPC after error@554675343) -> (continuation of Deferred@1645446342 after retry RPC after error@359980736) -> (continuation of Deferred@1955124510 after retry RPC after error@675243220) -> (continuation of Deferred@1458892961 after retry RPC after error@1699063393) -> (continuation of Deferred@1465364466 after retry RPC after error@69040136) -> (continuation of Deferred@1973285330 after retry RPC after error@1034106798) -> (continuation of Deferred@1465989079 after retry RPC after error@945018891) -> (continuation of Deferred@576372146 after retry RPC after error@115404816) -> (continuation of Deferred@1482793108 after retry RPC after error@2127869971) -> (continuation of Deferred@152317270 after retry RPC after error@141900820) -> (continuation of Deferred@1564825742 after retry RPC after error@109733653) -> (continuation of Deferred@777819151 after retry RPC after error@258512972) -> (continuation of Deferred@2023628807 after retry RPC after error@771310286) -> (continuation of Deferred@1741641618 after retry RPC after error@749607391) -> (continuation of Deferred@624532053 after retry RPC after error@1110524686) -> (continuation of Deferred@1608511261 after retry RPC after error@65234392) -> (continuation of Deferred@1793178819 after retry RPC after error@578861986) -> (continuation of Deferred@42405864 after retry RPC after error@441608133), errback=(continuation of Deferred@1629790053 after retry RPC after error@762519282) -> (continuation of Deferred@1577302923 after retry RPC after error@1361368706) -> (continuation of Deferred@339649652 after retry RPC after error@554675343) -> (continuation of Deferred@1645446342 after retry RPC after error@359980736) -> (continuation of Deferred@1955124510 after retry RPC after error@675243220) -> (continuation of Deferred@1458892961 after retry RPC after error@1699063393) -> (continuation of Deferred@1465364466 after retry RPC after error@69040136) -> (continuation of Deferred@1973285330 after retry RPC after error@1034106798) -> (continuation of Deferred@1465989079 after retry RPC after error@945018891) -> (continuation of Deferred@576372146 after retry RPC after error@115404816) -> (continuation of Deferred@1482793108 after retry RPC after error@2127869971) -> (continuation of Deferred@152317270 after retry RPC after error@141900820) -> (continuation of Deferred@1564825742 after retry RPC after error@109733653) -> (continuation of Deferred@777819151 after retry RPC after error@258512972) -> (continuation of Deferred@2023628807 after retry RPC after error@771310286) -> (continuation of Deferred@1741641618 after retry RPC after error@749607391) -> (continuation of Deferred@624532053 after retry RPC after error@1110524686) -> (continuation of Deferred@1608511261 after retry RPC after error@65234392) -> (continuation of Deferred@1793178819 after retry RPC after error@578861986) -> (continuation of Deferred@42405864 after retry RPC after error@441608133)))
18:33:11.988 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
18:33:11.988 [WARN - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27823), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [8ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [15ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [22ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [22ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [138ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [144ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [164ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [265ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [266ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [283ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [290ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [290ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [301ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [303ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [363ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [364ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [364ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [442ms] refreshing cache from master, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [444ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [444ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [445ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [445ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [542ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [702ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [703ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [763ms] refreshing cache from master, [763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [765ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [765ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [765ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [766ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1562ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2163ms] refreshing cache from master, [2163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2164ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2165ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [5721ms] refreshing cache from master, [5721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [5721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [5721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [5722ms] too many traces: truncated at 100 traces, deferred=Deferred@1746724503(state=PENDING, result=null, callback=(continuation of Deferred@1629790053 after retry RPC after error@762519282) -> (continuation of Deferred@1577302923 after retry RPC after error@1361368706) -> (continuation of Deferred@339649652 after retry RPC after error@554675343) -> (continuation of Deferred@1645446342 after retry RPC after error@359980736) -> (continuation of Deferred@1955124510 after retry RPC after error@675243220) -> (continuation of Deferred@1458892961 after retry RPC after error@1699063393) -> (continuation of Deferred@1465364466 after retry RPC after error@69040136) -> (continuation of Deferred@1973285330 after retry RPC after error@1034106798) -> (continuation of Deferred@1465989079 after retry RPC after error@945018891) -> (continuation of Deferred@576372146 after retry RPC after error@115404816) -> (continuation of Deferred@1482793108 after retry RPC after error@2127869971) -> (continuation of Deferred@152317270 after retry RPC after error@141900820) -> (continuation of Deferred@1564825742 after retry RPC after error@109733653) -> (continuation of Deferred@777819151 after retry RPC after error@258512972) -> (continuation of Deferred@2023628807 after retry RPC after error@771310286) -> (continuation of Deferred@1741641618 after retry RPC after error@749607391) -> (continuation of Deferred@624532053 after retry RPC after error@1110524686) -> (continuation of Deferred@1608511261 after retry RPC after error@65234392) -> (continuation of Deferred@1793178819 after retry RPC after error@578861986) -> (continuation of Deferred@42405864 after retry RPC after error@441608133), errback=(continuation of Deferred@1629790053 after retry RPC after error@762519282) -> (continuation of Deferred@1577302923 after retry RPC after error@1361368706) -> (continuation of Deferred@339649652 after retry RPC after error@554675343) -> (continuation of Deferred@1645446342 after retry RPC after error@359980736) -> (continuation of Deferred@1955124510 after retry RPC after error@675243220) -> (continuation of Deferred@1458892961 after retry RPC after error@1699063393) -> (continuation of Deferred@1465364466 after retry RPC after error@69040136) -> (continuation of Deferred@1973285330 after retry RPC after error@1034106798) -> (continuation of Deferred@1465989079 after retry RPC after error@945018891) -> (continuation of Deferred@576372146 after retry RPC after error@115404816) -> (continuation of Deferred@1482793108 after retry RPC after error@2127869971) -> (continuation of Deferred@152317270 after retry RPC after error@141900820) -> (continuation of Deferred@1564825742 after retry RPC after error@109733653) -> (continuation of Deferred@777819151 after retry RPC after error@258512972) -> (continuation of Deferred@2023628807 after retry RPC after error@771310286) -> (continuation of Deferred@1741641618 after retry RPC after error@749607391) -> (continuation of Deferred@624532053 after retry RPC after error@1110524686) -> (continuation of Deferred@1608511261 after retry RPC after error@65234392) -> (continuation of Deferred@1793178819 after retry RPC after error@578861986) -> (continuation of Deferred@42405864 after retry RPC after error@441608133)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.125:40423
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:11.988 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
18:33:11.990 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#4 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
18:33:11.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:11.990414  5750 webserver.cc:534] Webserver started at http://127.5.136.61:44879/ using document root <none> and password file <none>
18:33:11.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:11.991875  5750 fs_manager.cc:362] Metadata directory not provided
18:33:11.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:11.992200  5750 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:33:11.992 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27823), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [8ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [15ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [22ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [22ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [138ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [144ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [164ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [265ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [266ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [283ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [290ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [290ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [301ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [303ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [363ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [364ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [364ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [442ms] refreshing cache from master, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [444ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [444ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [445ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [445ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [542ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [702ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [703ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [763ms] refreshing cache from master, [763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [765ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [765ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [765ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [766ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1562ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1562ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2163ms] refreshing cache from master, [2163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2164ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2165ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2165ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [5721ms] refreshing cache from master, [5721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [5721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [5721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [5722ms] too many traces: truncated at 100 traces, deferred=Deferred@1746724503(state=PENDING, result=null, callback=(continuation of Deferred@1629790053 after retry RPC after error@762519282) -> (continuation of Deferred@1577302923 after retry RPC after error@1361368706) -> (continuation of Deferred@339649652 after retry RPC after error@554675343) -> (continuation of Deferred@1645446342 after retry RPC after error@359980736) -> (continuation of Deferred@1955124510 after retry RPC after error@675243220) -> (continuation of Deferred@1458892961 after retry RPC after error@1699063393) -> (continuation of Deferred@1465364466 after retry RPC after error@69040136) -> (continuation of Deferred@1973285330 after retry RPC after error@1034106798) -> (continuation of Deferred@1465989079 after retry RPC after error@945018891) -> (continuation of Deferred@576372146 after retry RPC after error@115404816) -> (continuation of Deferred@1482793108 after retry RPC after error@2127869971) -> (continuation of Deferred@152317270 after retry RPC after error@141900820) -> (continuation of Deferred@1564825742 after retry RPC after error@109733653) -> (continuation of Deferred@777819151 after retry RPC after error@258512972) -> (continuation of Deferred@2023628807 after retry RPC after error@771310286) -> (continuation of Deferred@1741641618 after retry RPC after error@749607391) -> (continuation of Deferred@624532053 after retry RPC after error@1110524686) -> (continuation of Deferred@1608511261 after retry RPC after error@65234392) -> (continuation of Deferred@1793178819 after retry RPC after error@578861986) -> (continuation of Deferred@42405864 after retry RPC after error@441608133), errback=(continuation of Deferred@1629790053 after retry RPC after error@762519282) -> (continuation of Deferred@1577302923 after retry RPC after error@1361368706) -> (continuation of Deferred@339649652 after retry RPC after error@554675343) -> (continuation of Deferred@1645446342 after retry RPC after error@359980736) -> (continuation of Deferred@1955124510 after retry RPC after error@675243220) -> (continuation of Deferred@1458892961 after retry RPC after error@1699063393) -> (continuation of Deferred@1465364466 after retry RPC after error@69040136) -> (continuation of Deferred@1973285330 after retry RPC after error@1034106798) -> (continuation of Deferred@1465989079 after retry RPC after error@945018891) -> (continuation of Deferred@576372146 after retry RPC after error@115404816) -> (continuation of Deferred@1482793108 after retry RPC after error@2127869971) -> (continuation of Deferred@152317270 after retry RPC after error@141900820) -> (continuation of Deferred@1564825742 after retry RPC after error@109733653) -> (continuation of Deferred@777819151 after retry RPC after error@258512972) -> (continuation of Deferred@2023628807 after retry RPC after error@771310286) -> (continuation of Deferred@1741641618 after retry RPC after error@749607391) -> (continuation of Deferred@624532053 after retry RPC after error@1110524686) -> (continuation of Deferred@1608511261 after retry RPC after error@65234392) -> (continuation of Deferred@1793178819 after retry RPC after error@578861986) -> (continuation of Deferred@42405864 after retry RPC after error@441608133)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.125:40423
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:11.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:11.992820  5750 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:33:11.993 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:33:11.993 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#4) of source Source: KuduSource.
18:33:11.993 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
18:33:11.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:11.998349  5750 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/data/instance:
18:33:11.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c4e6b4438bb445d2b7bcf658725bf782"
18:33:11.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:11 on dist-test-slave-dxnw"
18:33:12.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:11.999744  5750 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/wal/instance:
18:33:12.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c4e6b4438bb445d2b7bcf658725bf782"
18:33:12.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:11 on dist-test-slave-dxnw"
18:33:12.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.008389  5750 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.004s
18:33:12.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.014595  5773 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:33:12.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.015873  5750 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
18:33:12.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.016223  5750 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/wal
18:33:12.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c4e6b4438bb445d2b7bcf658725bf782"
18:33:12.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:11 on dist-test-slave-dxnw"
18:33:12.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.016569  5750 fs_report.cc:389] FS layout report
18:33:12.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:33:12.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/wal
18:33:12.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/wal
18:33:12.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/data/data
18:33:12.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:33:12.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:33:12.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:33:12.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:33:12.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:33:12.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:33:12.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:33:12.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:33:12.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:33:12.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:33:12.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:33:12.048 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:12.049 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:12.049 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:12.049 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:12.049 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:12.049 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:12.049 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:12.049 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:12.049 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:12.049 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:12.049 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:12.049 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:12.050 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:12.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.072659  5750 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:33:12.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.074172  5750 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:33:12.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.074642  5750 kserver.cc:163] Server-wide thread pool size limit: 3276
18:33:12.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.106068  5747 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } attempt: 7
18:33:12.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.115398  5747 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.136.61:43625: Network error: Client connection negotiation failed: client connection to 127.5.136.61:43625: connect: Connection refused (error 111)
18:33:12.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535592121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:12.131 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:33:12.132 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
18:33:12.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.165616  5750 rpc_server.cc:307] RPC server started. Bound to: 127.5.136.61:43625
18:33:12.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.165755  5827 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.136.61:43625 every 8 connection(s)
18:33:12.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.168726  5750 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/data/info.pb
18:33:12.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.175829  5828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:12.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.176653  5664 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 5750
18:33:12.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.177199  5664 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-1/wal/instance
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.180240  5664 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/wal
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/data
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/logs
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/data/info.pb
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:33:12.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.136.60:39171
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.136.60
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.136.20:33349
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.5.136.62:42905,127.5.136.61:43625,127.5.136.60:39171
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:33:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46535/jwks.json with env {}
18:33:12.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.191005  5828 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } has no permanent_uuid. Determining permanent_uuid...
18:33:12.215 [DEBUG - pool-212-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30021), Traces: [0ms] sending RPC to server master-127.3.43.188:36795, [27ms] received response from server master-127.3.43.188:36795: OK, deferred=null) with no deferred attached!
18:33:12.215 [DEBUG - pool-212-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30021), Traces: [0ms] sending RPC to server master-127.3.43.188:36795, [27ms] received response from server master-127.3.43.188:36795: OK, deferred=null) with no deferred attached!
18:33:12.215 [DEBUG - pool-212-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30021), Traces: [0ms] sending RPC to server master-127.3.43.188:36795, [28ms] received response from server master-127.3.43.188:36795: OK, deferred=null) with no deferred attached!
18:33:12.215 [DEBUG - pool-212-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30020), Traces: [0ms] sending RPC to server master-127.3.43.188:36795, [31ms] received response from server master-127.3.43.188:36795: OK, deferred=null) with no deferred attached!
18:33:12.215 [DEBUG - pool-212-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30020), Traces: [0ms] sending RPC to server master-127.3.43.188:36795, [33ms] received response from server master-127.3.43.188:36795: OK, deferred=null) with no deferred attached!
18:33:12.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.224059  5828 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } has no permanent_uuid. Determining permanent_uuid...
18:33:12.233 [DEBUG - pool-212-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30039), Traces: [0ms] sending RPC to server master-127.3.43.188:36795, [4ms] received response from server master-127.3.43.188:36795: OK, deferred=null) with no deferred attached!
18:33:12.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.241899  5828 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } has no permanent_uuid. Determining permanent_uuid...
18:33:12.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.244714  5775 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.136.60:39171: connect: Connection refused (error 111)
18:33:12.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.249647  5828 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.136.60:39171: Network error: Client connection negotiation failed: client connection to 127.5.136.60:39171: connect: Connection refused (error 111)
18:33:12.259 [DEBUG - pool-216-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30008), Traces: [0ms] sending RPC to server master-127.3.43.188:36795, [19ms] received response from server master-127.3.43.188:36795: OK, deferred=null) with no deferred attached!
18:33:12.259 [DEBUG - pool-216-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30008), Traces: [0ms] sending RPC to server master-127.3.43.188:36795, [14ms] received response from server master-127.3.43.188:36795: OK, deferred=null) with no deferred attached!
18:33:12.259 [DEBUG - pool-216-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30007), Traces: [0ms] sending RPC to server master-127.3.43.188:36795, [16ms] received response from server master-127.3.43.188:36795: OK, deferred=null) with no deferred attached!
18:33:12.259 [DEBUG - pool-216-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30007), Traces: [0ms] sending RPC to server master-127.3.43.188:36795, [16ms] received response from server master-127.3.43.188:36795: OK, deferred=null) with no deferred attached!
18:33:12.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.299181  5828 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } attempt: 1
18:33:12.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.304672  5828 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.136.60:39171: Network error: Client connection negotiation failed: client connection to 127.5.136.60:39171: connect: Connection refused (error 111)
18:33:12.354 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:12.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.373188  5828 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } attempt: 2
18:33:12.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.379180  5828 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.136.60:39171: Network error: Client connection negotiation failed: client connection to 127.5.136.60:39171: connect: Connection refused (error 111)
18:33:12.405 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:12.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.470636  5828 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } attempt: 3
18:33:12.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.475574  5828 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.136.60:39171: Network error: Client connection negotiation failed: client connection to 127.5.136.60:39171: connect: Connection refused (error 111)
18:33:12.547 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:12.547 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:12.548 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:12.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.547806  5830 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:33:12.548 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:12.548 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:12.548 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:12.548 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:12.548 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:12.548 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:12.548 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:12.548 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:12.548 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:12.548 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:12.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.548672  5830 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:33:12.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.549378  5830 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:33:12.555 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:12.556 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:12.556 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:12.556 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:12.556 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:12.556 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:12.556 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:12.556 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:12.556 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:12.556 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:12.556 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:12.556 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:12.556 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:12.556 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:12.557 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:12.557 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:12.557 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:12.557 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:12.557 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:12.557 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:12.557 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:12.557 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:12.557 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:12.557 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:12.557 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:12.557 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:12.564 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:12.564 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:12.564 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:12.564 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:12.564 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:12.564 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:12.565 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:12.565 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:12.565 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:12.565 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:12.565 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:12.565 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:12.565 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:12.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.601884  5830 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:33:12.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.602286  5830 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:33:12.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.602602  5830 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:33:12.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.602959  5830 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:33:12.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.603291  5830 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:33:12.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.603533  5830 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46535/jwks.json
18:33:12.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.619001  5828 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } attempt: 4
18:33:12.621 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535592621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:12.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.626665  5828 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.136.60:39171: Network error: Client connection negotiation failed: client connection to 127.5.136.60:39171: connect: Connection refused (error 111)
18:33:12.629 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:33:12.630 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.648731  5830 master_runner.cc:387] Master server non-default flags:
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.136.20:33349
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/data
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/wal
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.5.136.62:42905,127.5.136.61:43625,127.5.136.60:39171
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.136.60:39171
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46535/jwks.json
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/data/info.pb
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.136.60
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/logs
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:33:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:33:12.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.650125  5830 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:33:12.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.651937  5830 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:33:12.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.664366  5841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:12.696 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:12.696 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:12.697 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:12.697 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:12.697 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:12.697 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:12.697 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:12.697 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:12.697 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:12.697 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:12.697 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:12.697 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:12.698 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:12.701 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:12.701 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:12.701 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:12.701 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:12.701 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:12.701 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:12.701 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:12.701 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:12.702 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:12.701 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:12.702 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:12.702 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:12.702 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:12.772 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:12.773 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:12.773 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:12.773 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:12.773 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:12.773 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:12.773 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:12.773 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:12.774 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:12.774 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:12.774 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:12.774 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:12.774 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:12.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:12.876 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:12.876 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:12.877 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:12.877 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:12.877 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:12.877 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:12.877 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:12.877 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:12.877 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:12.878 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:12.878 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:12.878 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:12.878 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:12.906 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:12.920 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:12.920 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:12.920 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:12.920 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:12.920 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:12.920 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:12.920 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:12.921 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:12.920 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:12.921 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:12.921 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:12.921 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:12.921 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:12.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.926189  5828 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } attempt: 5
18:33:12.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.932780  5828 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.136.60:39171: Network error: Client connection negotiation failed: client connection to 127.5.136.60:39171: connect: Connection refused (error 111)
18:33:13.066 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:13.067 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:13.067 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:13.067 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.067 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.067 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.067 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.067 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.067 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.067 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.067 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.067 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.068 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:13.068 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28910), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [90ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [93ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [259ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [276ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [276ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [344ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [347ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [348ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [349ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [350ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [362ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [383ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [421ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [422ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [462ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [465ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [521ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [522ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [643ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [643ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [680ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [683ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [683ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [863ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [863ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [864ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [864ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2401ms] refreshing cache from master, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2403ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2404ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2404ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2404ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3181ms] refreshing cache from master, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3182ms] too many traces: truncated at 100 traces, deferred=Deferred@1620910737(state=PENDING, result=null, callback=(continuation of Deferred@762028256 after retry RPC after error@1325931324) -> (continuation of Deferred@382451778 after retry RPC after error@533459360) -> (continuation of Deferred@1876377113 after retry RPC after error@1619597604) -> (continuation of Deferred@680008871 after retry RPC after error@1754181351) -> (continuation of Deferred@1048539673 after retry RPC after error@379002059) -> (continuation of Deferred@2123519898 after retry RPC after error@1668691769) -> (continuation of Deferred@651980532 after retry RPC after error@134438816) -> (continuation of Deferred@1690429373 after retry RPC after error@920443875) -> (continuation of Deferred@1941088258 after retry RPC after error@1641940875) -> (continuation of Deferred@172615682 after retry RPC after error@1511668075) -> (continuation of Deferred@1007577234 after retry RPC after error@771609287) -> (continuation of Deferred@1748051586 after retry RPC after error@1676381070) -> (continuation of Deferred@753804697 after retry RPC after error@1866903849) -> (continuation of Deferred@237145973 after retry RPC after error@824885956) -> (continuation of Deferred@1815477141 after retry RPC after error@916504771) -> (continuation of Deferred@753121349 after retry RPC after error@1261986815) -> (continuation of Deferred@135446622 after retry RPC after error@948223815) -> (continuation of Deferred@160696706 after retry RPC after error@29078740) -> (continuation of Deferred@523605133 after retry RPC after error@39222955) -> (continuation of Deferred@724021114 after retry RPC after error@2011603934) -> (continuation of Deferred@1145360467 after retry RPC after error@1976978774) -> (continuation of Deferred@1671196905 after retry RPC after error@564578071) -> (continuation of Deferred@1132612920 after retry RPC after error@75044067) -> (continuation of Deferred@73541565 after retry RPC after error@334222937) -> (continuation of Deferred@1121034897 after retry RPC after error@239302692), errback=(continuation of Deferred@762028256 after retry RPC after error@1325931324) -> (continuation of Deferred@382451778 after retry RPC after error@533459360) -> (continuation of Deferred@1876377113 after retry RPC after error@1619597604) -> (continuation of Deferred@680008871 after retry RPC after error@1754181351) -> (continuation of Deferred@1048539673 after retry RPC after error@379002059) -> (continuation of Deferred@2123519898 after retry RPC after error@1668691769) -> (continuation of Deferred@651980532 after retry RPC after error@134438816) -> (continuation of Deferred@1690429373 after retry RPC after error@920443875) -> (continuation of Deferred@1941088258 after retry RPC after error@1641940875) -> (continuation of Deferred@172615682 after retry RPC after error@1511668075) -> (continuation of Deferred@1007577234 after retry RPC after error@771609287) -> (continuation of Deferred@1748051586 after retry RPC after error@1676381070) -> (continuation of Deferred@753804697 after retry RPC after error@1866903849) -> (continuation of Deferred@237145973 after retry RPC after error@824885956) -> (continuation of Deferred@1815477141 after retry RPC after error@916504771) -> (continuation of Deferred@753121349 after retry RPC after error@1261986815) -> (continuation of Deferred@135446622 after retry RPC after error@948223815) -> (continuation of Deferred@160696706 after retry RPC after error@29078740) -> (continuation of Deferred@523605133 after retry RPC after error@39222955) -> (continuation of Deferred@724021114 after retry RPC after error@2011603934) -> (continuation of Deferred@1145360467 after retry RPC after error@1976978774) -> (continuation of Deferred@1671196905 after retry RPC after error@564578071) -> (continuation of Deferred@1132612920 after retry RPC after error@75044067) -> (continuation of Deferred@73541565 after retry RPC after error@334222937) -> (continuation of Deferred@1121034897 after retry RPC after error@239302692)))
18:33:13.069 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:13.070 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:13.070 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:13.070 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.070 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.071 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.071 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.071 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.071 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.071 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.071 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.071 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.071 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:13.070 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28910), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [90ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [93ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [259ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [276ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [276ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [344ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [347ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [348ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [349ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [350ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [362ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [383ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [421ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [422ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [462ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [465ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [521ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [522ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [643ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [643ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [680ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [683ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [683ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [863ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [863ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [864ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [864ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2401ms] refreshing cache from master, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2403ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2404ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2404ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2404ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3181ms] refreshing cache from master, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3182ms] too many traces: truncated at 100 traces, deferred=Deferred@1620910737(state=PENDING, result=null, callback=(continuation of Deferred@762028256 after retry RPC after error@1325931324) -> (continuation of Deferred@382451778 after retry RPC after error@533459360) -> (continuation of Deferred@1876377113 after retry RPC after error@1619597604) -> (continuation of Deferred@680008871 after retry RPC after error@1754181351) -> (continuation of Deferred@1048539673 after retry RPC after error@379002059) -> (continuation of Deferred@2123519898 after retry RPC after error@1668691769) -> (continuation of Deferred@651980532 after retry RPC after error@134438816) -> (continuation of Deferred@1690429373 after retry RPC after error@920443875) -> (continuation of Deferred@1941088258 after retry RPC after error@1641940875) -> (continuation of Deferred@172615682 after retry RPC after error@1511668075) -> (continuation of Deferred@1007577234 after retry RPC after error@771609287) -> (continuation of Deferred@1748051586 after retry RPC after error@1676381070) -> (continuation of Deferred@753804697 after retry RPC after error@1866903849) -> (continuation of Deferred@237145973 after retry RPC after error@824885956) -> (continuation of Deferred@1815477141 after retry RPC after error@916504771) -> (continuation of Deferred@753121349 after retry RPC after error@1261986815) -> (continuation of Deferred@135446622 after retry RPC after error@948223815) -> (continuation of Deferred@160696706 after retry RPC after error@29078740) -> (continuation of Deferred@523605133 after retry RPC after error@39222955) -> (continuation of Deferred@724021114 after retry RPC after error@2011603934) -> (continuation of Deferred@1145360467 after retry RPC after error@1976978774) -> (continuation of Deferred@1671196905 after retry RPC after error@564578071) -> (continuation of Deferred@1132612920 after retry RPC after error@75044067) -> (continuation of Deferred@73541565 after retry RPC after error@334222937) -> (continuation of Deferred@1121034897 after retry RPC after error@239302692), errback=(continuation of Deferred@762028256 after retry RPC after error@1325931324) -> (continuation of Deferred@382451778 after retry RPC after error@533459360) -> (continuation of Deferred@1876377113 after retry RPC after error@1619597604) -> (continuation of Deferred@680008871 after retry RPC after error@1754181351) -> (continuation of Deferred@1048539673 after retry RPC after error@379002059) -> (continuation of Deferred@2123519898 after retry RPC after error@1668691769) -> (continuation of Deferred@651980532 after retry RPC after error@134438816) -> (continuation of Deferred@1690429373 after retry RPC after error@920443875) -> (continuation of Deferred@1941088258 after retry RPC after error@1641940875) -> (continuation of Deferred@172615682 after retry RPC after error@1511668075) -> (continuation of Deferred@1007577234 after retry RPC after error@771609287) -> (continuation of Deferred@1748051586 after retry RPC after error@1676381070) -> (continuation of Deferred@753804697 after retry RPC after error@1866903849) -> (continuation of Deferred@237145973 after retry RPC after error@824885956) -> (continuation of Deferred@1815477141 after retry RPC after error@916504771) -> (continuation of Deferred@753121349 after retry RPC after error@1261986815) -> (continuation of Deferred@135446622 after retry RPC after error@948223815) -> (continuation of Deferred@160696706 after retry RPC after error@29078740) -> (continuation of Deferred@523605133 after retry RPC after error@39222955) -> (continuation of Deferred@724021114 after retry RPC after error@2011603934) -> (continuation of Deferred@1145360467 after retry RPC after error@1976978774) -> (continuation of Deferred@1671196905 after retry RPC after error@564578071) -> (continuation of Deferred@1132612920 after retry RPC after error@75044067) -> (continuation of Deferred@73541565 after retry RPC after error@334222937) -> (continuation of Deferred@1121034897 after retry RPC after error@239302692)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28910), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [90ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [93ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [259ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [276ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [276ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [344ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [347ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [348ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [349ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [350ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [362ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [383ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [421ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [422ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [462ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [465ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [521ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [522ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [643ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [643ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [680ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [683ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [683ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [863ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [863ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [864ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [864ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2401ms] refreshing cache from master, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2403ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2404ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2404ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2404ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3181ms] refreshing cache from master, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3182ms] too many traces: truncated at 100 traces, deferred=Deferred@1620910737(state=PENDING, result=null, callback=(continuation of Deferred@762028256 after retry RPC after error@1325931324) -> (continuation of Deferred@382451778 after retry RPC after error@533459360) -> (continuation of Deferred@1876377113 after retry RPC after error@1619597604) -> (continuation of Deferred@680008871 after retry RPC after error@1754181351) -> (continuation of Deferred@1048539673 after retry RPC after error@379002059) -> (continuation of Deferred@2123519898 after retry RPC after error@1668691769) -> (continuation of Deferred@651980532 after retry RPC after error@134438816) -> (continuation of Deferred@1690429373 after retry RPC after error@920443875) -> (continuation of Deferred@1941088258 after retry RPC after error@1641940875) -> (continuation of Deferred@172615682 after retry RPC after error@1511668075) -> (continuation of Deferred@1007577234 after retry RPC after error@771609287) -> (continuation of Deferred@1748051586 after retry RPC after error@1676381070) -> (continuation of Deferred@753804697 after retry RPC after error@1866903849) -> (continuation of Deferred@237145973 after retry RPC after error@824885956) -> (continuation of Deferred@1815477141 after retry RPC after error@916504771) -> (continuation of Deferred@753121349 after retry RPC after error@1261986815) -> (continuation of Deferred@135446622 after retry RPC after error@948223815) -> (continuation of Deferred@160696706 after retry RPC after error@29078740) -> (continuation of Deferred@523605133 after retry RPC after error@39222955) -> (continuation of Deferred@724021114 after retry RPC after error@2011603934) -> (continuation of Deferred@1145360467 after retry RPC after error@1976978774) -> (continuation of Deferred@1671196905 after retry RPC after error@564578071) -> (continuation of Deferred@1132612920 after retry RPC after error@75044067) -> (continuation of Deferred@73541565 after retry RPC after error@334222937) -> (continuation of Deferred@1121034897 after retry RPC after error@239302692), errback=(continuation of Deferred@762028256 after retry RPC after error@1325931324) -> (continuation of Deferred@382451778 after retry RPC after error@533459360) -> (continuation of Deferred@1876377113 after retry RPC after error@1619597604) -> (continuation of Deferred@680008871 after retry RPC after error@1754181351) -> (continuation of Deferred@1048539673 after retry RPC after error@379002059) -> (continuation of Deferred@2123519898 after retry RPC after error@1668691769) -> (continuation of Deferred@651980532 after retry RPC after error@134438816) -> (continuation of Deferred@1690429373 after retry RPC after error@920443875) -> (continuation of Deferred@1941088258 after retry RPC after error@1641940875) -> (continuation of Deferred@172615682 after retry RPC after error@1511668075) -> (continuation of Deferred@1007577234 after retry RPC after error@771609287) -> (continuation of Deferred@1748051586 after retry RPC after error@1676381070) -> (continuation of Deferred@753804697 after retry RPC after error@1866903849) -> (continuation of Deferred@237145973 after retry RPC after error@824885956) -> (continuation of Deferred@1815477141 after retry RPC after error@916504771) -> (continuation of Deferred@753121349 after retry RPC after error@1261986815) -> (continuation of Deferred@135446622 after retry RPC after error@948223815) -> (continuation of Deferred@160696706 after retry RPC after error@29078740) -> (continuation of Deferred@523605133 after retry RPC after error@39222955) -> (continuation of Deferred@724021114 after retry RPC after error@2011603934) -> (continuation of Deferred@1145360467 after retry RPC after error@1976978774) -> (continuation of Deferred@1671196905 after retry RPC after error@564578071) -> (continuation of Deferred@1132612920 after retry RPC after error@75044067) -> (continuation of Deferred@73541565 after retry RPC after error@334222937) -> (continuation of Deferred@1121034897 after retry RPC after error@239302692)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.11.253:35677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:13.075 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28910), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [90ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [93ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [259ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [276ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [276ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [344ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [347ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [348ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [349ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [350ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [362ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [383ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [421ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [422ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [462ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [465ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [521ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [522ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [643ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [643ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [680ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [683ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [683ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [863ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [863ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [864ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [864ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2401ms] refreshing cache from master, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2403ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2404ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2404ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2404ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3181ms] refreshing cache from master, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3182ms] too many traces: truncated at 100 traces, deferred=Deferred@1620910737(state=PENDING, result=null, callback=(continuation of Deferred@762028256 after retry RPC after error@1325931324) -> (continuation of Deferred@382451778 after retry RPC after error@533459360) -> (continuation of Deferred@1876377113 after retry RPC after error@1619597604) -> (continuation of Deferred@680008871 after retry RPC after error@1754181351) -> (continuation of Deferred@1048539673 after retry RPC after error@379002059) -> (continuation of Deferred@2123519898 after retry RPC after error@1668691769) -> (continuation of Deferred@651980532 after retry RPC after error@134438816) -> (continuation of Deferred@1690429373 after retry RPC after error@920443875) -> (continuation of Deferred@1941088258 after retry RPC after error@1641940875) -> (continuation of Deferred@172615682 after retry RPC after error@1511668075) -> (continuation of Deferred@1007577234 after retry RPC after error@771609287) -> (continuation of Deferred@1748051586 after retry RPC after error@1676381070) -> (continuation of Deferred@753804697 after retry RPC after error@1866903849) -> (continuation of Deferred@237145973 after retry RPC after error@824885956) -> (continuation of Deferred@1815477141 after retry RPC after error@916504771) -> (continuation of Deferred@753121349 after retry RPC after error@1261986815) -> (continuation of Deferred@135446622 after retry RPC after error@948223815) -> (continuation of Deferred@160696706 after retry RPC after error@29078740) -> (continuation of Deferred@523605133 after retry RPC after error@39222955) -> (continuation of Deferred@724021114 after retry RPC after error@2011603934) -> (continuation of Deferred@1145360467 after retry RPC after error@1976978774) -> (continuation of Deferred@1671196905 after retry RPC after error@564578071) -> (continuation of Deferred@1132612920 after retry RPC after error@75044067) -> (continuation of Deferred@73541565 after retry RPC after error@334222937) -> (continuation of Deferred@1121034897 after retry RPC after error@239302692), errback=(continuation of Deferred@762028256 after retry RPC after error@1325931324) -> (continuation of Deferred@382451778 after retry RPC after error@533459360) -> (continuation of Deferred@1876377113 after retry RPC after error@1619597604) -> (continuation of Deferred@680008871 after retry RPC after error@1754181351) -> (continuation of Deferred@1048539673 after retry RPC after error@379002059) -> (continuation of Deferred@2123519898 after retry RPC after error@1668691769) -> (continuation of Deferred@651980532 after retry RPC after error@134438816) -> (continuation of Deferred@1690429373 after retry RPC after error@920443875) -> (continuation of Deferred@1941088258 after retry RPC after error@1641940875) -> (continuation of Deferred@172615682 after retry RPC after error@1511668075) -> (continuation of Deferred@1007577234 after retry RPC after error@771609287) -> (continuation of Deferred@1748051586 after retry RPC after error@1676381070) -> (continuation of Deferred@753804697 after retry RPC after error@1866903849) -> (continuation of Deferred@237145973 after retry RPC after error@824885956) -> (continuation of Deferred@1815477141 after retry RPC after error@916504771) -> (continuation of Deferred@753121349 after retry RPC after error@1261986815) -> (continuation of Deferred@135446622 after retry RPC after error@948223815) -> (continuation of Deferred@160696706 after retry RPC after error@29078740) -> (continuation of Deferred@523605133 after retry RPC after error@39222955) -> (continuation of Deferred@724021114 after retry RPC after error@2011603934) -> (continuation of Deferred@1145360467 after retry RPC after error@1976978774) -> (continuation of Deferred@1671196905 after retry RPC after error@564578071) -> (continuation of Deferred@1132612920 after retry RPC after error@75044067) -> (continuation of Deferred@73541565 after retry RPC after error@334222937) -> (continuation of Deferred@1121034897 after retry RPC after error@239302692)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28910), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [90ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [93ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [259ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [276ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [276ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [344ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [347ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [348ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [349ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [350ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [362ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [382ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [383ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [383ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [421ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [422ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [422ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [462ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [465ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [521ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [522ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [522ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [643ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [643ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [680ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [683ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [683ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [863ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [863ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [864ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [864ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2401ms] refreshing cache from master, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2403ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2404ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2404ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2404ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3181ms] refreshing cache from master, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3182ms] too many traces: truncated at 100 traces, deferred=Deferred@1620910737(state=PENDING, result=null, callback=(continuation of Deferred@762028256 after retry RPC after error@1325931324) -> (continuation of Deferred@382451778 after retry RPC after error@533459360) -> (continuation of Deferred@1876377113 after retry RPC after error@1619597604) -> (continuation of Deferred@680008871 after retry RPC after error@1754181351) -> (continuation of Deferred@1048539673 after retry RPC after error@379002059) -> (continuation of Deferred@2123519898 after retry RPC after error@1668691769) -> (continuation of Deferred@651980532 after retry RPC after error@134438816) -> (continuation of Deferred@1690429373 after retry RPC after error@920443875) -> (continuation of Deferred@1941088258 after retry RPC after error@1641940875) -> (continuation of Deferred@172615682 after retry RPC after error@1511668075) -> (continuation of Deferred@1007577234 after retry RPC after error@771609287) -> (continuation of Deferred@1748051586 after retry RPC after error@1676381070) -> (continuation of Deferred@753804697 after retry RPC after error@1866903849) -> (continuation of Deferred@237145973 after retry RPC after error@824885956) -> (continuation of Deferred@1815477141 after retry RPC after error@916504771) -> (continuation of Deferred@753121349 after retry RPC after error@1261986815) -> (continuation of Deferred@135446622 after retry RPC after error@948223815) -> (continuation of Deferred@160696706 after retry RPC after error@29078740) -> (continuation of Deferred@523605133 after retry RPC after error@39222955) -> (continuation of Deferred@724021114 after retry RPC after error@2011603934) -> (continuation of Deferred@1145360467 after retry RPC after error@1976978774) -> (continuation of Deferred@1671196905 after retry RPC after error@564578071) -> (continuation of Deferred@1132612920 after retry RPC after error@75044067) -> (continuation of Deferred@73541565 after retry RPC after error@334222937) -> (continuation of Deferred@1121034897 after retry RPC after error@239302692), errback=(continuation of Deferred@762028256 after retry RPC after error@1325931324) -> (continuation of Deferred@382451778 after retry RPC after error@533459360) -> (continuation of Deferred@1876377113 after retry RPC after error@1619597604) -> (continuation of Deferred@680008871 after retry RPC after error@1754181351) -> (continuation of Deferred@1048539673 after retry RPC after error@379002059) -> (continuation of Deferred@2123519898 after retry RPC after error@1668691769) -> (continuation of Deferred@651980532 after retry RPC after error@134438816) -> (continuation of Deferred@1690429373 after retry RPC after error@920443875) -> (continuation of Deferred@1941088258 after retry RPC after error@1641940875) -> (continuation of Deferred@172615682 after retry RPC after error@1511668075) -> (continuation of Deferred@1007577234 after retry RPC after error@771609287) -> (continuation of Deferred@1748051586 after retry RPC after error@1676381070) -> (continuation of Deferred@753804697 after retry RPC after error@1866903849) -> (continuation of Deferred@237145973 after retry RPC after error@824885956) -> (continuation of Deferred@1815477141 after retry RPC after error@916504771) -> (continuation of Deferred@753121349 after retry RPC after error@1261986815) -> (continuation of Deferred@135446622 after retry RPC after error@948223815) -> (continuation of Deferred@160696706 after retry RPC after error@29078740) -> (continuation of Deferred@523605133 after retry RPC after error@39222955) -> (continuation of Deferred@724021114 after retry RPC after error@2011603934) -> (continuation of Deferred@1145360467 after retry RPC after error@1976978774) -> (continuation of Deferred@1671196905 after retry RPC after error@564578071) -> (continuation of Deferred@1132612920 after retry RPC after error@75044067) -> (continuation of Deferred@73541565 after retry RPC after error@334222937) -> (continuation of Deferred@1121034897 after retry RPC after error@239302692)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.11.253:35677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:13.076 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:33:13.076 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#3) of source Source: KuduSource.
18:33:13.076 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to CANCELING.
18:33:13.077 [INFO - flink-pekko.actor.default-dispatcher-10] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
18:33:13.077 [INFO - flink-pekko.actor.default-dispatcher-10] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to CANCELING.
18:33:13.077 [INFO - flink-pekko.actor.default-dispatcher-10] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
18:33:13.077 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to CANCELING.
18:33:13.077 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#4) of source Source: KuduSource.
18:33:13.078 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
18:33:13.078 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CANCELING to CANCELED.
18:33:13.078 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#3 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
18:33:13.078 [INFO - flink-pekko.actor.default-dispatcher-10] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
18:33:13.078 [INFO - flink-pekko.actor.default-dispatcher-10] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to CANCELING.
18:33:13.078 [INFO - flink-pekko.actor.default-dispatcher-10] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
18:33:13.083 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
18:33:13.083 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CANCELING to CANCELED.
18:33:13.083 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
18:33:13.084 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#3 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
18:33:13.084 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#4 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
18:33:13.085 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CANCELING to CANCELED.
18:33:13.085 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:33:13.086 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CANCELING to CANCELED.
18:33:13.086 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job f6e63683f34d031c5da392b08baea20c
18:33:13.086 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:13.086 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:13.087 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:13.087 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.087 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.087 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.087 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.087 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.088 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.088 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.088 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.088 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.088 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:13.106 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:13.106 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:13.107 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:13.107 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.107 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.107 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.107 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.107 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.107 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.107 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.107 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.107 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.107 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:13.121 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535593121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:13.126 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:13.126 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:13.127 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:13.127 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.127 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.127 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.127 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.127 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.127 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.127 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.127 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.127 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.127 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:13.132 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:33:13.133 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
18:33:13.146 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:13.146 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:13.146 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:13.147 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.147 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.147 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.147 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.147 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.147 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.147 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.147 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.147 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.147 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:13.166 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:13.166 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:13.166 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:13.167 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.167 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.167 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.167 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.167 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.167 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.167 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.167 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.168 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.168 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:13.226 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:13.226 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:13.227 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:13.227 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.227 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.227 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.227 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.227 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.227 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.227 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.227 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.227 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.227 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:13.346 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:13.347 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:13.347 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:13.347 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.347 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.347 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.347 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.347 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.347 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.347 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.347 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.348 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.348 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:13.348 [DEBUG - pool-208-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30006), Traces: [0ms] sending RPC to server master-127.2.96.188:32989, [9ms] received response from server master-127.2.96.188:32989: OK, deferred=null) with no deferred attached!
18:33:13.354 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:13.406 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:13.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:13.480254  5828 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } attempt: 6
18:33:13.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:13.489212  5828 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.136.60:39171: Network error: Client connection negotiation failed: client connection to 127.5.136.60:39171: connect: Connection refused (error 111)
18:33:13.501 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:13.501 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:13.501 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:13.501 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:13.501 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:13.501 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:13.502 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:13.502 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:13.502 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:13.502 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:13.502 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:13.502 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:13.502 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:13.503 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29268), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [110ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [110ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [129ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [129ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [198ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [225ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [242ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [280ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [296ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [297ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [297ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [301ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [302ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [343ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [343ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [402ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [462ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [462ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [462ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [462ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [702ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [703ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [703ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [841ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [843ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1180ms] refreshing cache from master, [1180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1183ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1183ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1820ms] refreshing cache from master, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1822ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1823ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2021ms] refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2022ms] too many traces: truncated at 100 traces, deferred=Deferred@2082135642(state=PENDING, result=null, callback=(continuation of Deferred@1052204468 after retry RPC after error@798001098) -> (continuation of Deferred@1097485270 after retry RPC after error@1806218671) -> (continuation of Deferred@1870008211 after retry RPC after error@1156807520) -> (continuation of Deferred@1465171155 after retry RPC after error@2046783067) -> (continuation of Deferred@640351328 after retry RPC after error@2044574654) -> (continuation of Deferred@186458738 after retry RPC after error@152180988) -> (continuation of Deferred@2016033858 after retry RPC after error@1824422066) -> (continuation of Deferred@240310757 after retry RPC after error@396293419) -> (continuation of Deferred@1048515510 after retry RPC after error@555452195) -> (continuation of Deferred@958328596 after retry RPC after error@1506370225) -> (continuation of Deferred@535636125 after retry RPC after error@1647478492) -> (continuation of Deferred@739943361 after retry RPC after error@1054117913) -> (continuation of Deferred@1217134238 after retry RPC after error@1048151349) -> (continuation of Deferred@1199844752 after retry RPC after error@1565145377) -> (continuation of Deferred@1252147992 after retry RPC after error@939534164) -> (continuation of Deferred@1578001769 after retry RPC after error@1384238264) -> (continuation of Deferred@182710131 after retry RPC after error@870339580) -> (continuation of Deferred@510156228 after retry RPC after error@1112581821) -> (continuation of Deferred@1474118131 after retry RPC after error@1720944455) -> (continuation of Deferred@986279980 after retry RPC after error@2104183942) -> (continuation of Deferred@1074022401 after retry RPC after error@978798329) -> (continuation of Deferred@1273895311 after retry RPC after error@1824944904) -> (continuation of Deferred@241199825 after retry RPC after error@243303786) -> (continuation of Deferred@890885972 after retry RPC after error@1788394700) -> (continuation of Deferred@1738765740 after retry RPC after error@1837242343) -> (continuation of Deferred@383438452 after retry RPC after error@965443263) -> (continuation of Deferred@1165586999 after retry RPC after error@943286352), errback=(continuation of Deferred@1052204468 after retry RPC after error@798001098) -> (continuation of Deferred@1097485270 after retry RPC after error@1806218671) -> (continuation of Deferred@1870008211 after retry RPC after error@1156807520) -> (continuation of Deferred@1465171155 after retry RPC after error@2046783067) -> (continuation of Deferred@640351328 after retry RPC after error@2044574654) -> (continuation of Deferred@186458738 after retry RPC after error@152180988) -> (continuation of Deferred@2016033858 after retry RPC after error@1824422066) -> (continuation of Deferred@240310757 after retry RPC after error@396293419) -> (continuation of Deferred@1048515510 after retry RPC after error@555452195) -> (continuation of Deferred@958328596 after retry RPC after error@1506370225) -> (continuation of Deferred@535636125 after retry RPC after error@1647478492) -> (continuation of Deferred@739943361 after retry RPC after error@1054117913) -> (continuation of Deferred@1217134238 after retry RPC after error@1048151349) -> (continuation of Deferred@1199844752 after retry RPC after error@1565145377) -> (continuation of Deferred@1252147992 after retry RPC after error@939534164) -> (continuation of Deferred@1578001769 after retry RPC after error@1384238264) -> (continuation of Deferred@182710131 after retry RPC after error@870339580) -> (continuation of Deferred@510156228 after retry RPC after error@1112581821) -> (continuation of Deferred@1474118131 after retry RPC after error@1720944455) -> (continuation of Deferred@986279980 after retry RPC after error@2104183942) -> (continuation of Deferred@1074022401 after retry RPC after error@978798329) -> (continuation of Deferred@1273895311 after retry RPC after error@1824944904) -> (continuation of Deferred@241199825 after retry RPC after error@243303786) -> (continuation of Deferred@890885972 after retry RPC after error@1788394700) -> (continuation of Deferred@1738765740 after retry RPC after error@1837242343) -> (continuation of Deferred@383438452 after retry RPC after error@965443263) -> (continuation of Deferred@1165586999 after retry RPC after error@943286352)))
18:33:13.586 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:13.587 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:13.587 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:13.587 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.587 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.588 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.588 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.588 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.588 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.588 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.588 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.588 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.588 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:13.597 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:13.597 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:13.597 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:13.598 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:13.598 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:13.598 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:13.597 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:13.598 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:13.598 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:13.598 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:13.598 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:13.598 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:13.598 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:13.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535593621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:13.631 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:33:13.632 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
18:33:13.664 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:13.665 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:13.665 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:13.665 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:13.665 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:13.665 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:13.665 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:13.665 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:13.665 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:13.665 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:13.666 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:13.666 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:13.666 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:13.666 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29487), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [153ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [166ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [168ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [168ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [225ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [225ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [228ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [229ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [229ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [229ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [293ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [294ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [294ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [295ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [295ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [297ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [301ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [301ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [302ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [326ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [326ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [344ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [344ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [363ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [400ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [404ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [404ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [483ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [483ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [740ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [742ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [742ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [742ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [743ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1480ms] refreshing cache from master, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1483ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1483ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2160ms] refreshing cache from master, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2162ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3640ms] refreshing cache from master, [3640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3641ms] too many traces: truncated at 100 traces, deferred=Deferred@1789516933(state=PENDING, result=null, callback=(continuation of Deferred@261027353 after retry RPC after error@1457220418) -> (continuation of Deferred@653657801 after retry RPC after error@35629926) -> (continuation of Deferred@2052696834 after retry RPC after error@2002083440) -> (continuation of Deferred@1636027933 after retry RPC after error@506990032) -> (continuation of Deferred@697218222 after retry RPC after error@1953880369) -> (continuation of Deferred@192483972 after retry RPC after error@1441908918) -> (continuation of Deferred@151403874 after retry RPC after error@1407242530) -> (continuation of Deferred@281937128 after retry RPC after error@1260509759) -> (continuation of Deferred@1945371412 after retry RPC after error@650687881) -> (continuation of Deferred@1187056892 after retry RPC after error@66377273) -> (continuation of Deferred@1347127792 after retry RPC after error@869010061) -> (continuation of Deferred@2099529444 after retry RPC after error@1480856167) -> (continuation of Deferred@1422660758 after retry RPC after error@117961952) -> (continuation of Deferred@1481347458 after retry RPC after error@551843782) -> (continuation of Deferred@339259368 after retry RPC after error@740358523) -> (continuation of Deferred@677620476 after retry RPC after error@733655665) -> (continuation of Deferred@2049707777 after retry RPC after error@1366084126) -> (continuation of Deferred@1684909701 after retry RPC after error@440049987) -> (continuation of Deferred@7659778 after retry RPC after error@939521832) -> (continuation of Deferred@1047490260 after retry RPC after error@1896935651) -> (continuation of Deferred@1447781170 after retry RPC after error@516261988) -> (continuation of Deferred@1528388774 after retry RPC after error@771242190) -> (continuation of Deferred@539462832 after retry RPC after error@311666296) -> (continuation of Deferred@58602720 after retry RPC after error@1865171465) -> (continuation of Deferred@1936851280 after retry RPC after error@2086521120) -> (continuation of Deferred@242629503 after retry RPC after error@54987954) -> (continuation of Deferred@1625093387 after retry RPC after error@1926903033) -> (continuation of Deferred@1304970270 after retry RPC after error@1993470857), errback=(continuation of Deferred@261027353 after retry RPC after error@1457220418) -> (continuation of Deferred@653657801 after retry RPC after error@35629926) -> (continuation of Deferred@2052696834 after retry RPC after error@2002083440) -> (continuation of Deferred@1636027933 after retry RPC after error@506990032) -> (continuation of Deferred@697218222 after retry RPC after error@1953880369) -> (continuation of Deferred@192483972 after retry RPC after error@1441908918) -> (continuation of Deferred@151403874 after retry RPC after error@1407242530) -> (continuation of Deferred@281937128 after retry RPC after error@1260509759) -> (continuation of Deferred@1945371412 after retry RPC after error@650687881) -> (continuation of Deferred@1187056892 after retry RPC after error@66377273) -> (continuation of Deferred@1347127792 after retry RPC after error@869010061) -> (continuation of Deferred@2099529444 after retry RPC after error@1480856167) -> (continuation of Deferred@1422660758 after retry RPC after error@117961952) -> (continuation of Deferred@1481347458 after retry RPC after error@551843782) -> (continuation of Deferred@339259368 after retry RPC after error@740358523) -> (continuation of Deferred@677620476 after retry RPC after error@733655665) -> (continuation of Deferred@2049707777 after retry RPC after error@1366084126) -> (continuation of Deferred@1684909701 after retry RPC after error@440049987) -> (continuation of Deferred@7659778 after retry RPC after error@939521832) -> (continuation of Deferred@1047490260 after retry RPC after error@1896935651) -> (continuation of Deferred@1447781170 after retry RPC after error@516261988) -> (continuation of Deferred@1528388774 after retry RPC after error@771242190) -> (continuation of Deferred@539462832 after retry RPC after error@311666296) -> (continuation of Deferred@58602720 after retry RPC after error@1865171465) -> (continuation of Deferred@1936851280 after retry RPC after error@2086521120) -> (continuation of Deferred@242629503 after retry RPC after error@54987954) -> (continuation of Deferred@1625093387 after retry RPC after error@1926903033) -> (continuation of Deferred@1304970270 after retry RPC after error@1993470857)))
18:33:13.786 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:13.787 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:13.787 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:13.787 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.787 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.787 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.787 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:13.787 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.787 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.787 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.787 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:13.787 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:13.787 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:13.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:13.906 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:14.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.666000  5842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:14.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:12.676446  5844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:14.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:12.676779  5830 server_base.cc:1061] running on GCE node
18:33:14.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.010650  5830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:33:14.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.013664  5830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:33:14.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.015033  5830 hybrid_clock.cc:648] HybridClock initialized: now 1783535594014978 us; error 60 us; skew 500 ppm
18:33:14.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.016060  5830 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:33:14.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.025033  5830 webserver.cc:534] Webserver started at http://127.5.136.60:35441/ using document root <none> and password file <none>
18:33:14.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.026166  5830 fs_manager.cc:362] Metadata directory not provided
18:33:14.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.026423  5830 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:33:14.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.027086  5830 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:33:14.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.032274  5830 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/data/instance:
18:33:14.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1258f432032b44f3a27e1087c7e24377"
18:33:14.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:14 on dist-test-slave-dxnw"
18:33:14.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.033565  5830 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/wal/instance:
18:33:14.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1258f432032b44f3a27e1087c7e24377"
18:33:14.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:14 on dist-test-slave-dxnw"
18:33:14.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.044827  5830 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.010s	sys 0.001s
18:33:14.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.053953  5860 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:33:14.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.055336  5830 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
18:33:14.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.055987  5830 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/wal
18:33:14.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1258f432032b44f3a27e1087c7e24377"
18:33:14.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:14 on dist-test-slave-dxnw"
18:33:14.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.056393  5830 fs_report.cc:389] FS layout report
18:33:14.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:33:14.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/wal
18:33:14.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/wal
18:33:14.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/data/data
18:33:14.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:33:14.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:33:14.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:33:14.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:33:14.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:33:14.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:33:14.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:33:14.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:33:14.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:33:14.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:33:14.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:33:14.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.116608  5830 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:33:14.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.118328  5830 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:33:14.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.118896  5830 kserver.cc:163] Server-wide thread pool size limit: 3276
18:33:14.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535594121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:14.131 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:33:14.132 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
18:33:14.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.205941  5747 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } attempt: 8
18:33:14.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.235618  5830 rpc_server.cc:307] RPC server started. Bound to: 127.5.136.60:39171
18:33:14.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.235702  5913 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.136.60:39171 every 8 connection(s)
18:33:14.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.238801  5747 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } has no permanent_uuid. Determining permanent_uuid...
18:33:14.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.239396  5830 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/data/info.pb
18:33:14.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.246660  5664 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 5830
18:33:14.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.247153  5664 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/master-2/wal/instance
18:33:14.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.260779  5914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:14.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.279492  5914 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } has no permanent_uuid. Determining permanent_uuid...
18:33:14.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.289165  5747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779: Bootstrap starting.
18:33:14.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.298056  5747 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779: Neither blocks nor log segments found. Creating new log.
18:33:14.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.300459  5747 log.cc:826] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779: Log is configured to *not* fsync() on all Append() calls
18:33:14.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.306185  5914 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } has no permanent_uuid. Determining permanent_uuid...
18:33:14.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.310719  5747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779: No bootstrap required, opened a new log
18:33:14.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.320087  5914 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } has no permanent_uuid. Determining permanent_uuid...
18:33:14.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.339218  5914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377: Bootstrap starting.
18:33:14.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.339061  5747 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } }
18:33:14.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.339983  5747 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:14.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.340286  5747 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9749d6e6ecd14ac2982f6cf232a3f779, State: Initialized, Role: FOLLOWER
18:33:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.341125  5747 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } }
18:33:14.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.344210  5923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } } }
18:33:14.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.345007  5923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [sys.catalog]: This master's current role is: FOLLOWER
18:33:14.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.345969  5747 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [sys.catalog]: configured and running, proceeding with master startup.
18:33:14.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.346050  5914 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377: Neither blocks nor log segments found. Creating new log.
18:33:14.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.348608  5914 log.cc:826] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377: Log is configured to *not* fsync() on all Append() calls
18:33:14.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.346342  5923 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:33:14.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.350139  5923 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } }
18:33:14.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:14.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.355438  5923 leader_election.cc:290] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4e6b4438bb445d2b7bcf658725bf782 (127.5.136.61:43625), 1258f432032b44f3a27e1087c7e24377 (127.5.136.60:39171)
18:33:14.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.360791  5914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377: No bootstrap required, opened a new log
18:33:14.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:14.377080  5701 tablet.cc:2406] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:33:14.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.389729  5914 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } }
18:33:14.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.390841  5914 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:14.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.391304  5914 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1258f432032b44f3a27e1087c7e24377, State: Initialized, Role: FOLLOWER
18:33:14.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.392771  5914 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } }
18:33:14.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:14.401316  5935 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:33:14.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:14.403515  5935 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:33:14.406 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:14.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.411875  5914 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377 [sys.catalog]: configured and running, proceeding with master startup.
18:33:14.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.412086  5887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1258f432032b44f3a27e1087c7e24377" is_pre_election: true
18:33:14.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.413018  5887 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9749d6e6ecd14ac2982f6cf232a3f779 in term 0.
18:33:14.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.414503  5697 leader_election.cc:304] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1258f432032b44f3a27e1087c7e24377, 9749d6e6ecd14ac2982f6cf232a3f779; no voters: 
18:33:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.415793  5923 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:33:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.416245  5923 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:33:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.416621  5923 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [term 0 FOLLOWER]: Advancing to term 1
18:33:14.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.410902  5937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } } }
18:33:14.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.427225  5937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377 [sys.catalog]: This master's current role is: FOLLOWER
18:33:14.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.426905  5923 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } }
18:33:14.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.439620  5887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1258f432032b44f3a27e1087c7e24377"
18:33:14.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.440441  5887 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377 [term 0 FOLLOWER]: Advancing to term 1
18:33:14.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.450448  5923 leader_election.cc:290] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [CANDIDATE]: Term 1 election: Requested vote from peers c4e6b4438bb445d2b7bcf658725bf782 (127.5.136.61:43625), 1258f432032b44f3a27e1087c7e24377 (127.5.136.60:39171)
18:33:14.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.456326  5887 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9749d6e6ecd14ac2982f6cf232a3f779 in term 1.
18:33:14.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.457805  5697 leader_election.cc:304] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1258f432032b44f3a27e1087c7e24377, 9749d6e6ecd14ac2982f6cf232a3f779; no voters: 
18:33:14.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.458643  5923 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [term 1 FOLLOWER]: Leader election won for term 1
18:33:14.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.461886  5923 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [term 1 LEADER]: Becoming Leader. State: Replica: 9749d6e6ecd14ac2982f6cf232a3f779, State: Running, Role: LEADER
18:33:14.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.463491  5923 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } }
18:33:14.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.397450  5676 master_runner.cc:187] Error getting master registration for 127.5.136.61:43625: OK, instance_id { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" instance_seqno: 1783535592141606 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:33:14.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.483395  5676 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:33:14.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.495738  5951 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
18:33:14.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.504104  5948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9749d6e6ecd14ac2982f6cf232a3f779. Latest consensus state: current_term: 1 leader_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } } }
18:33:14.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.504971  5948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [sys.catalog]: This master's current role is: LEADER
18:33:14.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.515798  5952 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:33:14.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.523263  5952 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:33:14.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.541706  5887 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377 [term 1 FOLLOWER]: Refusing update from remote peer 9749d6e6ecd14ac2982f6cf232a3f779: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:33:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.543371  5948 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:33:14.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.549803  5828 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } attempt: 7
18:33:14.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.518738  5830 master_runner.cc:187] Error getting master registration for 127.5.136.61:43625: OK, instance_id { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" instance_seqno: 1783535592141606 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:33:14.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.576848  5830 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:33:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.582145  5828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782: Bootstrap starting.
18:33:14.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.591903  5828 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782: Neither blocks nor log segments found. Creating new log.
18:33:14.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.594445  5828 log.cc:826] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782: Log is configured to *not* fsync() on all Append() calls
18:33:14.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.604346  5828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782: No bootstrap required, opened a new log
18:33:14.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.611266  5953 mvcc.cc:204] Tried to move back new op lower bound from 7305361795226226688 to 7305361794939588608. Current Snapshot: MvccSnapshot[applied={T|T < 7305361795226226688}]
18:33:14.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.609886  5937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9749d6e6ecd14ac2982f6cf232a3f779. Latest consensus state: current_term: 1 leader_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } } }
18:33:14.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.612421  5937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377 [sys.catalog]: This master's current role is: FOLLOWER
18:33:14.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.617563  5955 mvcc.cc:204] Tried to move back new op lower bound from 7305361795226226688 to 7305361794939588608. Current Snapshot: MvccSnapshot[applied={T|T < 7305361795226226688}]
18:33:14.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535594621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:14.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.621856  5937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } } }
18:33:14.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.622653  5937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377 [sys.catalog]: This master's current role is: FOLLOWER
18:33:14.628 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:14.628 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:14.629 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:14.629 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:14.630 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:14.630 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:14.630 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:14.631 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:14.631 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:14.629 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:14.631 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:14.631 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:14.631 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:14.631 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:33:14.633 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
18:33:14.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.643069  5923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } } }
18:33:14.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.643786  5923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [sys.catalog]: This master's current role is: LEADER
18:33:14.646 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:14.646 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:14.646 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:14.647 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:14.647 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:14.647 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:14.647 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:14.647 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:14.647 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:14.647 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:14.647 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:14.647 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:14.647 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:14.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.651018  5952 catalog_manager.cc:1382] Generated new cluster ID: 9c3e3f14a27d4fd08fa6e9d1aa64338c
18:33:14.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.651350  5952 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:33:14.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.671774  5828 raft_consensus.cc:359] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } }
18:33:14.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.672549  5828 raft_consensus.cc:385] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:14.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.672869  5828 raft_consensus.cc:740] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4e6b4438bb445d2b7bcf658725bf782, State: Initialized, Role: FOLLOWER
18:33:14.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.673862  5828 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } }
18:33:14.675 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:14.676 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:14.676 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:14.676 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:14.676 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:14.676 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:14.676 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:14.676 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:14.676 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:14.676 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:14.676 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:14.677 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:14.677 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:14.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.694671  5960 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } } }
18:33:14.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.696695  5828 sys_catalog.cc:565] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [sys.catalog]: configured and running, proceeding with master startup.
18:33:14.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.699438  5802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4e6b4438bb445d2b7bcf658725bf782" is_pre_election: true
18:33:14.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.700491  5960 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [sys.catalog]: This master's current role is: FOLLOWER
18:33:14.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.699101  5801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4e6b4438bb445d2b7bcf658725bf782"
18:33:14.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.700884  5800 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [term 0 FOLLOWER]: Advancing to term 1
18:33:14.737 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:14.737 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:14.737 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:14.738 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:14.738 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:14.738 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:14.739 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:14.739 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:14.739 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:14.740 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:14.740 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:14.740 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:14.740 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:14.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.742641  5800 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [term 1 FOLLOWER]: Refusing update from remote peer 9749d6e6ecd14ac2982f6cf232a3f779: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:33:14.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.743285  5960 raft_consensus.cc:493] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:33:14.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.743757  5960 raft_consensus.cc:515] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } }
18:33:14.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.744942  5952 catalog_manager.cc:1405] Generated new certificate authority record
18:33:14.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.747035  5952 catalog_manager.cc:1539] Loading token signing keys...
18:33:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.750511  5923 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:33:14.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.761221  5722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c4e6b4438bb445d2b7bcf658725bf782" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" is_pre_election: true
18:33:14.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.764252  5887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c4e6b4438bb445d2b7bcf658725bf782" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1258f432032b44f3a27e1087c7e24377" is_pre_election: true
18:33:14.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.759788  5960 leader_election.cc:290] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9749d6e6ecd14ac2982f6cf232a3f779 (127.5.136.62:42905), 1258f432032b44f3a27e1087c7e24377 (127.5.136.60:39171)
18:33:14.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.766000  5775 leader_election.cc:304] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4e6b4438bb445d2b7bcf658725bf782; no voters: 1258f432032b44f3a27e1087c7e24377, 9749d6e6ecd14ac2982f6cf232a3f779
18:33:14.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.775151  5952 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779: Generated new TSK 0
18:33:14.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.776430  5952 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:33:14.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.821332  5664 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:14.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:14.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/wal
18:33:14.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/data
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/logs
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/data/info.pb
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.136.1:0
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.5.136.1
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.136.1
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.5.136.62:42905,127.5.136.61:43625,127.5.136.60:39171
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.136.20:33349
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:33:14.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.827291  5964 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
18:33:14.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.828596  5960 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9749d6e6ecd14ac2982f6cf232a3f779. Latest consensus state: current_term: 1 leader_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } } }
18:33:14.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.829324  5960 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [sys.catalog]: This master's current role is: FOLLOWER
18:33:14.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.830127  5948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } } }
18:33:14.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.831023  5948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779 [sys.catalog]: This master's current role is: LEADER
18:33:14.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.846592  5974 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9749d6e6ecd14ac2982f6cf232a3f779" member_type: VOTER last_known_addr { host: "127.5.136.62" port: 42905 } } peers { permanent_uuid: "c4e6b4438bb445d2b7bcf658725bf782" member_type: VOTER last_known_addr { host: "127.5.136.61" port: 43625 } } peers { permanent_uuid: "1258f432032b44f3a27e1087c7e24377" member_type: VOTER last_known_addr { host: "127.5.136.60" port: 39171 } } }
18:33:14.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.849447  5974 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782 [sys.catalog]: This master's current role is: FOLLOWER
18:33:14.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:14.851274  5968 mvcc.cc:204] Tried to move back new op lower bound from 7305361796006985728 to 7305361794939588608. Current Snapshot: MvccSnapshot[applied={T|T < 7305361796006985728}]
18:33:14.855 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:14.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:14.859417  5976 catalog_manager.cc:1593] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:33:14.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:14.859858  5976 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:33:14.905 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:14.969 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:14.969 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:14.969 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:14.969 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:14.970 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:14.970 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:14.970 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:14.970 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:14.970 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:14.970 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:14.970 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:14.970 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:14.971 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:15.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535595121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:15.134 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:33:15.137 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
18:33:15.186 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:15.186 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:15.186 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:15.186 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:15.187 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:15.187 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:15.187 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:15.187 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:15.187 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:15.187 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:15.187 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:15.187 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:15.187 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:15.283 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:15.284 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:15.284 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:15.284 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:15.284 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:15.284 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:15.285 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:15.285 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:15.285 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:15.285 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:15.285 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:15.285 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:15.285 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:15.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:15.340354  5977 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:33:15.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:15.341197  5977 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:33:15.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:15.341995  5977 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:33:15.348 [DEBUG - pool-208-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30008), Traces: [0ms] sending RPC to server master-127.2.96.188:32989, [5ms] received response from server master-127.2.96.188:32989: OK, deferred=null) with no deferred attached!
18:33:15.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:15.388 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:15.388 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:15.388 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:15.389 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:15.389 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:15.389 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:15.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:15.388962  5977 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:33:15.389 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:15.389 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:15.389 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:15.389 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:15.389 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:15.389 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:15.390 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:15.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:15.390559  5977 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.136.1
18:33:15.395 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:15.396 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:15.396 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:15.396 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:15.396 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:15.396 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:15.396 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:15.396 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:15.396 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:15.396 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:15.396 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:15.396 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:15.396 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:15.405 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:15.496098  5977 tablet_server_runner.cc:78] Tablet server non-default flags:
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.136.20:33349
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/data
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/wal
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.136.1:0
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/data/info.pb
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.136.1
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.5.136.62:42905,127.5.136.61:43625,127.5.136.60:39171
18:33:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:33:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:33:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:33:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.5.136.1
18:33:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/logs
18:33:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:33:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:33:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:33:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:33:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:33:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:33:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:33:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:33:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:33:15.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:15.498051  5977 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:33:15.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:15.500379  5977 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:33:15.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:15.524519  5951 catalog_manager.cc:1294] Loaded cluster ID: 9c3e3f14a27d4fd08fa6e9d1aa64338c
18:33:15.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:15.525276  5951 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377: loading cluster ID for follower catalog manager: success
18:33:15.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:15.550448  5951 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377: acquiring CA information for follower catalog manager: success
18:33:15.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:15.570156  5989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:15.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:15.576373  5951 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 1258f432032b44f3a27e1087c7e24377: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:33:15.596 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:15.596 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:15.596 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:15.597 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:15.597 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:15.597 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:15.597 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:15.597 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:15.597 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:15.597 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:15.597 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:15.597 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:15.597 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:15.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535595621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:15.630 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:33:15.632 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
18:33:15.677 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:15.677 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:15.677 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:15.678 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:15.678 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:15.678 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:15.678 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:15.678 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:15.678 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:15.678 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:15.678 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:15.679 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:15.679 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:15.725 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state RESTARTING to RUNNING.
18:33:15.726 [INFO - flink-pekko.actor.default-dispatcher-6] (CheckpointCoordinator.java:1805) Restoring job f6e63683f34d031c5da392b08baea20c from Checkpoint 74 @ 1783535501335 for f6e63683f34d031c5da392b08baea20c located at file:/tmp/junit4154231101817438778/checkpoints/f6e63683f34d031c5da392b08baea20c/chk-74.
18:33:15.727 [INFO - flink-pekko.actor.default-dispatcher-6] (MasterHooks.java:201) No master state to restore
18:33:15.727 [INFO - flink-pekko.actor.default-dispatcher-6] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:33:15.728 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to SCHEDULED.
18:33:15.729 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from SCHEDULED to DEPLOYING.
18:33:15.729 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #4) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 13a0441c1420d35b57a28ebd584f9846
18:33:15.729 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 13a0441c1420d35b57a28ebd584f9846.
18:33:15.730 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_4), deploy into slot with allocation id 13a0441c1420d35b57a28ebd584f9846.
18:33:15.731 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:33:15.732 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to SCHEDULED.
18:33:15.732 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:33:15.733 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from SCHEDULED to DEPLOYING.
18:33:15.733 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #5) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id e5ed6e64fe4e0a504f52a2cb8573a359
18:33:15.734 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to SCHEDULED.
18:33:15.734 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:15.735 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from SCHEDULED to DEPLOYING.
18:33:15.735 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #5) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8c518d750e8767059e15b0e0577096dd
18:33:15.735 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to SCHEDULED.
18:33:15.736 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:33:15.737 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from SCHEDULED to DEPLOYING.
18:33:15.737 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #4) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8ff5a8fd5a1d7f8775f563b9a37bf60a
18:33:15.737 [INFO - Thread-44] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:33:15.738 [DEBUG - Thread-44] (Connection.java:575) [peer master-127.30.11.253:35677(127.30.11.253:35677)] disconnecting while in state TERMINATED
18:33:15.738 [DEBUG - Thread-44] (Connection.java:575) [peer master-127.30.11.252:39405(127.30.11.252:39405)] disconnecting while in state TERMINATED
18:33:15.738 [DEBUG - Thread-44] (Connection.java:575) [peer master-127.30.11.254:41811(127.30.11.254:41811)] disconnecting while in state TERMINATED
18:33:15.738 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:15.739 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot e5ed6e64fe4e0a504f52a2cb8573a359.
18:33:15.741 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_5), deploy into slot with allocation id e5ed6e64fe4e0a504f52a2cb8573a359.
18:33:15.741 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to DEPLOYING.
18:33:15.741 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_4) [DEPLOYING].
18:33:15.742 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@16f90b2b
18:33:15.742 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:15.742 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:33:15.743 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
18:33:15.743 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
18:33:15.746 [INFO - Thread-44] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:33:15.747 [INFO - Thread-44] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:33:15.747 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 8c518d750e8767059e15b0e0577096dd.
18:33:15.748 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:15.748 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:15.748 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:15.748 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_5), deploy into slot with allocation id 8c518d750e8767059e15b0e0577096dd.
18:33:15.748 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:15.748 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:15.748 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:15.748 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:15.748 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:15.748 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:15.749 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:15.749 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:15.749 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:15.749 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:15.749 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to DEPLOYING.
18:33:15.749 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:33:15.749 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_5) [DEPLOYING].
18:33:15.750 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_4), deploy into slot with allocation id 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:33:15.751 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to DEPLOYING.
18:33:15.751 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_4) [DEPLOYING].
18:33:15.751 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3e915b86
18:33:15.751 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:15.751 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:33:15.752 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
18:33:15.752 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
18:33:15.752 [DEBUG - Thread-44] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:15.752 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to DEPLOYING.
18:33:15.752 [INFO - Thread-44] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:33:15.752 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_5) [DEPLOYING].
18:33:15.753 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@42fefe
18:33:15.753 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:15.753 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:33:15.753 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4d1aa5e7
18:33:15.753 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:15.753 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
18:33:15.753 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:33:15.753 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
18:33:15.754 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
18:33:15.754 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
18:33:15.756 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:15.757 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:15.757 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:15.757 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:15.757 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:15.757 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:15.758 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:15.758 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:15.758 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:15.758 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:15.758 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:15.758 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:15.758 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:15.759 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4c490b8a
18:33:15.764 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:15.764 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@51f93e09
18:33:15.766 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:15.775 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3388b70f
18:33:15.778 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:15.780 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6ea0b076
18:33:15.782 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:15.782 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:15.783 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:15.783 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:15.785 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:15.790 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:15.793 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:15.822 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:15.825 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:15.825 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:15.832 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:15.833 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.833 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.833 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.835 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:15.841 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.841 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.841 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.841 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:15.842 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.842 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.842 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.843 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.843 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.843 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.843 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:15.853 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:15.855 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:15.857 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:15.857 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:15.857 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:15.857 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:15.857 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:15.858 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:15.858 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:15.858 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:15.858 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:15.858 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:15.858 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:15.858 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:15.858 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:15.858 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:15.859 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.859 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.859 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:15.865968  5976 catalog_manager.cc:1294] Loaded cluster ID: 9c3e3f14a27d4fd08fa6e9d1aa64338c
18:33:15.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:15.866412  5976 catalog_manager.cc:1587] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782: loading cluster ID for follower catalog manager: success
18:33:15.891 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:15.892 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.892 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.892 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.902 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.902 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.903 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.903 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:15.903755  5976 catalog_manager.cc:1609] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782: acquiring CA information for follower catalog manager: success
18:33:15.905 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:15.906 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:15.914 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:15.915 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.915 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:15.916 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.916 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.917 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.917 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.917 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.917 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:15.918 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.918 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.918 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.919 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.919 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.919 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.920 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:15.921 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:15.922 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.922 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.922 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.923 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:15.923 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.924 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.924 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.925 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.925 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.925 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.925 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:15.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:15.927696  5976 catalog_manager.cc:1637] T 00000000000000000000000000000000 P c4e6b4438bb445d2b7bcf658725bf782: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:33:15.928 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:15.930 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:15.930 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.930 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.930 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.932 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.932 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.932 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.932 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:15.933 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:15.934 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:15.935 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:15.935 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:15.935 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:15.935 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:15.937 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:15.937 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:15.937 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:15.938 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:15.938 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:15.938 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:15.938 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:15.940 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:15.941 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.941 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.941 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.942 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.942 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.942 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.942 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:15.944 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:15.945 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:15.945 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.945 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.945 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.946 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:15.947 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:15.947 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.947 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.947 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.948 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:15.948 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:15.949 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.949 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.949 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.949 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.952 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.952 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.952 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:15.951 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.951 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:15.950 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:15.950 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.950 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:15.953 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.953 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.953 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.953 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.953 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:15.954 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:15.954 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:15.954 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:15.955 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:15.955 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.956 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.956 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.961 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.961 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.961 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.961 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:15.963 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:15.964 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.964 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.964 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.965 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:15.965 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:15.966 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:15.966 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:15.966 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.966 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.966 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.966 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.966 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.966 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.966 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.966 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.966 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.966 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:15.967 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.967 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.967 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.967 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:15.968 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:15.969 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:15.970 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:15.970 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:15.969 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.971 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.971 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.970 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:15.971 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:15.971 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:15.971 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:15.969 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.971 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.971 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.971 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:15.973 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:15.973 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:15.974 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:15.974 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.974 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.974 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.974 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.974 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.974 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.975 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.975 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.975 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.975 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:15.985 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:15.986 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:15.986 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:15.987 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:15.987 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.987 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.987 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.988 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.988 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.988 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.988 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.988 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.988 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.989 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:15.989 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:15.991 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:15.993 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:15.994 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:15.994 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:15.994 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:15.994 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.994 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.994 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.995 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.995 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.995 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.995 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.995 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.995 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:15.995 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.995 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:15.995 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:15.995 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.996 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:15.996 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.996 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:15.996 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:15.996 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:15.996 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:15.996 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:15.996 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:15.996 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:15.996 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:15.997 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:15.997 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:15.997 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:15.997 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:15.997 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.997 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.997 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.997 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:15.998 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.998 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:15.998 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:15.999 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.000 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.000 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.000 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.001 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.001 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.001 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.001 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.002 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.002 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.002 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.002 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.003 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:16.003 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.003 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.003 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.005 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.005 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.005 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.005 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.005 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.005 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.005 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.006 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.006 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.006 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.006 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.006 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.006 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.007 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:16.007 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.007 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.007 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.008 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.008 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.008 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.008 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:16.010 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.010 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.010 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.011 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.011 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.011 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.011 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.011 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.011 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.011 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.011 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.011 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.011 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.013 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.013 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.014 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.014 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.014 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.014 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.014 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.014 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.015 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.015 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.015 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.015 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.015 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.025 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.025 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.026 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.026 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.026 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.026 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.027 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.027 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.027 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.027 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.027 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.027 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.028 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.028 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.028 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.028 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.028 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.028 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.028 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.029 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.029 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.029 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.029 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:16.029 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:16.029 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:16.030 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.030 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.030 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.030 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.030 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.030 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.030 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.030 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.030 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.031 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:16.031 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.031 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.031 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.031 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.031 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.031 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.032 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.032 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.032 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.032 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.032 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.032 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.032 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.033 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.033 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.033 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.033 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.034 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.034 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.034 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.034 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.034 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.035 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.035 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.035 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.035 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.035 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.035 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.036 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.036 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.045 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.046 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.046 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.046 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.046 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.046 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.046 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.047 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.047 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.047 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.047 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.047 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.047 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.049 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:16.049 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:16.049 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:16.049 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.049 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.049 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.050 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.050 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.050 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.050 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.050 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.050 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.050 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:16.051 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.051 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.051 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.051 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.051 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.051 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.052 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.052 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.052 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.052 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.052 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.052 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.053 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.065 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.065 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.065 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.066 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.066 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.066 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.066 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.066 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.067 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.067 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.067 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.067 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.067 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.068 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:16.068 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:16.068 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:16.069 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.069 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.069 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.069 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.069 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.069 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.069 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.070 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.070 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.070 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:16.070 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.070 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.070 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.071 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.071 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.071 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.071 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.071 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.071 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.072 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.072 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.072 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.072 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.085 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.086 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.086 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.087 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.087 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.087 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.087 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.087 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.087 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.088 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.088 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.088 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.088 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.105 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.106 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.106 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.107 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.107 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.107 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.107 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.107 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.108 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.108 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.108 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.108 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.108 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 69 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535596121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:16.130 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.130 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.131 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.131 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.132 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.132 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.132 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.132 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.132 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.132 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.132 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.132 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 69 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:33:16.134 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 69 as completed for source Source: KuduSource.
18:33:16.132 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.134 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.148 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:16.148 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:16.149 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:16.149 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.149 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.149 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.150 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.150 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.150 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.150 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.150 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.150 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.150 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:16.154 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.154 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.154 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.155 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.155 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.155 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.155 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.155 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.155 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.155 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.155 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.155 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.156 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.166 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.166 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.167 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.168 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.168 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.168 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.169 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.169 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.169 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.169 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.170 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.170 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.170 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.185 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.185 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.185 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.186 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.186 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.186 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.186 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.186 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.186 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.187 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.187 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.187 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.187 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.194 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.194 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.194 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.194 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.194 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.194 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.195 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.195 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.195 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.195 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.195 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.195 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.195 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.211 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.211 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.212 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.219 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.219 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.219 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.220 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.220 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.220 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.220 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.220 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.221 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.221 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.221 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.221 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.221 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.222 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.222 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.222 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.222 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.222 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.222 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.222 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.222 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.222 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.222 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.248 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:16.248 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:16.248 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:16.249 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.249 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.249 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.249 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.249 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.249 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.250 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.250 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.250 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.250 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:16.285 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.285 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.285 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.287 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.287 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.288 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.288 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.288 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.288 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.288 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.288 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.288 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.288 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.322 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:16.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:16.371 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.371 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.371 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.372 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.372 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.372 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.372 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.372 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.372 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.372 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.372 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.373 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.373 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.405 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:16.408 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:16.408 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:16.408 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:16.409 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.409 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.409 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.409 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.409 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.409 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.409 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.409 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.409 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.409 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:16.469 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:16.469 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:16.469 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:16.470 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.470 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.470 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.470 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.470 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.470 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.471 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.471 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.471 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.471 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:16.474 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.474 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.474 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.475 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.475 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.475 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.475 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.475 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.475 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.475 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.475 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.475 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.475 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.512 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:16.512 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:16.512 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:16.513 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:16.513 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:16.513 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:16.513 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:16.513 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:16.513 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:16.514 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:16.514 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:16.514 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:16.514 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:16.568 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:16.568 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:16.568 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:16.569 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.569 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.569 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:16.569 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.569 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.569 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:16.570 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.570 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.570 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:16.570 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:16.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 70 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535596621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:16.630 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.631 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.631 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.632 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.632 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.632 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.632 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.632 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.632 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.633 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.633 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.633 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.633 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.634 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 70 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:33:16.634 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 70 as completed for source Source: KuduSource.
18:33:16.779 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:16.780 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:16.780 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:16.780 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:16.780 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:16.781 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:16.781 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:16.781 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:16.781 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:16.781 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:16.781 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:16.781 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:16.781 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:16.822 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:16.825 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.826 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.826 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.826 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.826 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.826 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.827 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.827 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.827 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.827 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.827 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.827 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.827 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.855 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:16.863 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:16.864 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:16.864 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:16.864 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:16.864 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:16.864 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:16.864 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:16.864 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:16.865 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:16.865 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:16.865 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:16.865 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:16.865 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:16.906 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:16.946 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:16.946 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:16.946 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:16.947 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.947 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.947 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:16.947 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.947 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.947 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:16.948 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.948 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.948 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:16.948 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:16.948 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:16.948 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:16.949 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:16.949 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:16.949 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:16.949 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:16.949 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:16.949 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:16.949 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:16.950 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:16.950 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:16.950 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:16.950 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:16.999 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:16.999 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:17.000 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:17.000 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:17.000 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:17.000 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:17.000 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:17.000 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:17.000 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:17.000 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:17.000 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:17.000 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:17.001 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:17.068 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:17.069 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:17.069 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:17.069 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:17.069 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:17.070 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:17.070 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:17.070 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:17.070 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:17.070 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:17.070 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:17.070 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:17.070 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:17.121 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 71 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535597121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:17.131 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 71 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:33:17.131 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 71 as completed for source Source: KuduSource.
18:33:17.150 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:17.150 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:17.151 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:17.151 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:17.151 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:17.151 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:17.151 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:17.151 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:17.151 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:17.151 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:17.151 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:17.151 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:17.151 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:17.156 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:17.156 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:17.156 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:17.157 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:17.157 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:17.157 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:17.157 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:17.157 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:17.157 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:17.158 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:17.158 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:17.158 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:17.158 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:17.208 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:17.208 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:17.208 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:17.209 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:17.209 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:17.209 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:17.209 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:17.209 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:17.209 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:17.210 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:17.210 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:17.210 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:17.210 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:17.321 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:17.348 [DEBUG - pool-208-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30004), Traces: [0ms] sending RPC to server master-127.2.96.188:32989, [12ms] received response from server master-127.2.96.188:32989: OK, deferred=null) with no deferred attached!
18:33:17.354 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:17.406 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:17.437 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:17.437 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:17.437 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:17.438 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:17.438 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:17.438 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:17.439 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:17.439 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:17.439 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:17.440 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:17.440 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:17.440 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:17.440 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:17.454 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:17.454 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:17.454 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:17.454 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:17.454 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:17.454 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:17.455 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:17.455 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:17.455 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:17.455 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:17.455 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:17.455 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:17.455 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:17.578 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:17.578 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:17.578 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:17.579 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:17.579 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:17.579 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:17.579 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:17.579 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:17.579 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:17.579 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:17.579 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:17.579 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:17.579 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:17.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 72 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535597621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:17.630 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 72 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:33:17.631 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 72 as completed for source Source: KuduSource.
18:33:17.748 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:17.748 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:17.748 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:17.749 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:17.749 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:17.749 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:17.749 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:17.749 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:17.749 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:17.750 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:17.750 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:17.750 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:17.750 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:17.792 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:17.793 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:17.793 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:17.793 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:17.793 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:17.793 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:17.794 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:17.794 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:17.794 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:17.794 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:17.794 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:17.794 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:17.794 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:17.821 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:17.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:17.906 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:17.927 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:17.928 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:17.928 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:17.928 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:17.929 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:17.929 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:17.929 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:17.929 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:17.929 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:17.929 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:17.929 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:17.929 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:17.929 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:18.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:16.927166  5988 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 5977
18:33:18.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:18.019901  5977 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.452s	user 0.601s	sys 0.861s
18:33:18.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:18.024971  5977 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.458s	user 0.601s	sys 0.861s
18:33:18.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:15.570165  5990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:18.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.034057  5977 server_base.cc:1061] running on GCE node
18:33:18.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:18.035745  6051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:18.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.039997  5977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:33:18.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.050166  5977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:33:18.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.051855  5977 hybrid_clock.cc:648] HybridClock initialized: now 1783535598051800 us; error 45 us; skew 500 ppm
18:33:18.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.052942  5977 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:33:18.054 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:18.054 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:18.055 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:18.055 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:18.055 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:18.055 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:18.055 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:18.055 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:18.056 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:18.056 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:18.056 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:18.056 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:18.056 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:18.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.088887  5977 webserver.cc:534] Webserver started at http://127.5.136.1:38359/ using document root <none> and password file <none>
18:33:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.090148  5977 fs_manager.cc:362] Metadata directory not provided
18:33:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.090435  5977 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:33:18.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.091012  5977 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:33:18.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.107372  5977 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/data/instance:
18:33:18.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "422c1c063b1444b38bf3ee5a445401d1"
18:33:18.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:18 on dist-test-slave-dxnw"
18:33:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.109051  5977 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/wal/instance:
18:33:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "422c1c063b1444b38bf3ee5a445401d1"
18:33:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:18 on dist-test-slave-dxnw"
18:33:18.122 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 73 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535598121 for job 9de81db54be40687a2a82164db1dc50b.
18:33:18.130 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 73 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:33:18.131 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 73 as completed for source Source: KuduSource.
18:33:18.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.141366  5977 fs_manager.cc:696] Time spent creating directory manager: real 0.032s	user 0.010s	sys 0.000s
18:33:18.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.177693  6056 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.015s	user 0.000s	sys 0.000s
18:33:18.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.182451  5977 fs_manager.cc:730] Time spent opening block manager: real 0.034s	user 0.004s	sys 0.001s
18:33:18.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.182879  5977 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/wal
18:33:18.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "422c1c063b1444b38bf3ee5a445401d1"
18:33:18.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:18 on dist-test-slave-dxnw"
18:33:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.183355  5977 fs_report.cc:389] FS layout report
18:33:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:33:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/wal
18:33:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/wal
18:33:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/data/data
18:33:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:33:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:33:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:33:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:33:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:33:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:33:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:33:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:33:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:33:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:33:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:33:18.321 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:18.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.351954  5977 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:33:18.354 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:18.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.353989  5977 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:33:18.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.359783  5977 kserver.cc:163] Server-wide thread pool size limit: 3276
18:33:18.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.365643  5977 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:33:18.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.382120  5977 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:33:18.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.382581  5977 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
18:33:18.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.383013  5977 ts_tablet_manager.cc:616] Registered 0 tablets
18:33:18.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:18.384014  5977 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
18:33:18.406 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:18.436 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:18.436 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:18.436 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:18.437 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:18.437 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:18.437 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:18.438 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:18.438 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:18.438 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:18.438 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:18.438 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:18.438 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:18.438 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:18.485 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:18.485 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:18.485 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:18.486 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:18.486 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:18.486 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:18.487 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:18.487 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:18.487 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:18.487 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:18.487 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:18.487 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:18.487 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:18.622 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 74 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535598621 for job 9de81db54be40687a2a82164db1dc50b.
18:33:18.630 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 74 for job 9de81db54be40687a2a82164db1dc50b (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:33:18.631 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 74 as completed for source Source: KuduSource.
18:33:18.697 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:18.698 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:18.698 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:18.699 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:18.699 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:18.699 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:18.700 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:18.700 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:18.700 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:18.700 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:18.700 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:18.700 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:18.700 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:18.706 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:18.706 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:18.706 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:18.706 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:18.707 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:18.707 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:18.707 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:18.707 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:18.707 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:18.707 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:18.707 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:18.707 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:18.707 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:18.728 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:18.728 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:18.728 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:18.729 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:18.729 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:18.729 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:18.729 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:18.729 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:18.729 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:18.730 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:18.730 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:18.730 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:18.730 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:18.750 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:18.751 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:18.751 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:18.751 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:18.751 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:18.751 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:18.752 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:18.752 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:18.752 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:18.752 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:18.752 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:18.752 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:18.752 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:18.808 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:18.808 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:18.808 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:18.809 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.809 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.809 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.809 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.810 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.810 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.810 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.810 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.810 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.810 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:18.811 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=27, TimeoutTracker(timeout=30000, elapsed=29474), Traces: [0ms] sending RPC to server master-127.2.96.188:32989, [1ms] received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [12ms] refreshing cache from master, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [14ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [14ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [14ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [15ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [32ms] refreshing cache from master, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [34ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [34ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [34ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [34ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [51ms] refreshing cache from master, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [52ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [52ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [53ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [53ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [71ms] refreshing cache from master, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [72ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [72ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [72ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [73ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [92ms] refreshing cache from master, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [93ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [93ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [94ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [94ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [131ms] refreshing cache from master, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [132ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [132ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [132ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [133ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [252ms] refreshing cache from master, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [253ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [253ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [253ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [253ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [272ms] refreshing cache from master, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [273ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [273ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [273ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [273ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [572ms] refreshing cache from master, [572ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [572ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [573ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [573ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [573ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [573ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [573ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1491ms] refreshing cache from master, [1491ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1492ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1492ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1492ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1492ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [1493ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1493ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [2152ms] refreshing cache from master, [2152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [2152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [2152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [2153ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [2154ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [2155ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2155ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [5512ms] refreshing cache from master, [5512ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [5512ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [5513ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [5513ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [5514ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [5514ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [5515ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [7773ms] refreshing cache from master, [7773ms] too many traces: truncated at 100 traces, deferred=Deferred@1161325411(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@ef8bacb -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1912706406 after retry RPC after error@1050764743) -> (continuation of Deferred@952394243 after retry RPC after error@1931589938) -> (continuation of Deferred@234207381 after retry RPC after error@953117617) -> (continuation of Deferred@595645137 after retry RPC after error@1561728954) -> (continuation of Deferred@2106015133 after retry RPC after error@1054233471) -> (continuation of Deferred@467998766 after retry RPC after error@1990424367) -> (continuation of Deferred@839702451 after retry RPC after error@1053636390) -> (continuation of Deferred@232418489 after retry RPC after error@1613588514) -> (continuation of Deferred@885562075 after retry RPC after error@1668018019) -> (continuation of Deferred@1032513555 after retry RPC after error@921562104) -> (continuation of Deferred@1183031740 after retry RPC after error@2049924856) -> (continuation of Deferred@269478878 after retry RPC after error@1231314956) -> (continuation of Deferred@305243869 after retry RPC after error@317321981) -> (continuation of Deferred@2102897253 after retry RPC after error@391758275) -> (continuation of Deferred@138513083 after retry RPC after error@1440935764) -> (continuation of Deferred@354841359 after retry RPC after error@1286143921) -> (continuation of Deferred@1220059341 after retry RPC after error@182611649) -> (continuation of Deferred@746248857 after retry RPC after error@665124304) -> (continuation of Deferred@706191137 after retry RPC after error@865761476) -> (continuation of Deferred@1238291004 after retry RPC after error@1225059496) -> (continuation of Deferred@1610386494 after retry RPC after error@1069585245) -> (continuation of Deferred@10545579 after retry RPC after error@1848587451) -> (continuation of Deferred@1435097148 after retry RPC after error@1852371883) -> (continuation of Deferred@1761784444 after retry RPC after error@2124405003) -> (continuation of Deferred@1707910876 after retry RPC after error@1284568165), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1912706406 after retry RPC after error@1050764743) -> (continuation of Deferred@952394243 after retry RPC after error@1931589938) -> (continuation of Deferred@234207381 after retry RPC after error@953117617) -> (continuation of Deferred@595645137 after retry RPC after error@1561728954) -> (continuation of Deferred@2106015133 after retry RPC after error@1054233471) -> (continuation of Deferred@467998766 after retry RPC after error@1990424367) -> (continuation of Deferred@839702451 after retry RPC after error@1053636390) -> (continuation of Deferred@232418489 after retry RPC after error@1613588514) -> (continuation of Deferred@885562075 after retry RPC after error@1668018019) -> (continuation of Deferred@1032513555 after retry RPC after error@921562104) -> (continuation of Deferred@1183031740 after retry RPC after error@2049924856) -> (continuation of Deferred@269478878 after retry RPC after error@1231314956) -> (continuation of Deferred@305243869 after retry RPC after error@317321981) -> (continuation of Deferred@2102897253 after retry RPC after error@391758275) -> (continuation of Deferred@138513083 after retry RPC after error@1440935764) -> (continuation of Deferred@354841359 after retry RPC after error@1286143921) -> (continuation of Deferred@1220059341 after retry RPC after error@182611649) -> (continuation of Deferred@746248857 after retry RPC after error@665124304) -> (continuation of Deferred@706191137 after retry RPC after error@865761476) -> (continuation of Deferred@1238291004 after retry RPC after error@1225059496) -> (continuation of Deferred@1610386494 after retry RPC after error@1069585245) -> (continuation of Deferred@10545579 after retry RPC after error@1848587451) -> (continuation of Deferred@1435097148 after retry RPC after error@1852371883) -> (continuation of Deferred@1761784444 after retry RPC after error@2124405003) -> (continuation of Deferred@1707910876 after retry RPC after error@1284568165)))
18:33:18.811 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:18.812 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:18.812 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:18.812 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=27, TimeoutTracker(timeout=30000, elapsed=29474), Traces: [0ms] sending RPC to server master-127.2.96.188:32989, [1ms] received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [12ms] refreshing cache from master, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [14ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [14ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [14ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [15ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [32ms] refreshing cache from master, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [34ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [34ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [34ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [34ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [51ms] refreshing cache from master, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [52ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [52ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [53ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [53ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [71ms] refreshing cache from master, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [72ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [72ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [72ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [73ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [92ms] refreshing cache from master, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [93ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [93ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [94ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [94ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [131ms] refreshing cache from master, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [132ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [132ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [132ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [133ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [252ms] refreshing cache from master, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [253ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [253ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [253ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [253ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [272ms] refreshing cache from master, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [273ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [273ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [273ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [273ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [572ms] refreshing cache from master, [572ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [572ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [573ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [573ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [573ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [573ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [573ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1491ms] refreshing cache from master, [1491ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1492ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1492ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1492ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1492ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [1493ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1493ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [2152ms] refreshing cache from master, [2152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [2152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [2152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [2153ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [2154ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [2155ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2155ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [5512ms] refreshing cache from master, [5512ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [5512ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [5513ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [5513ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [5514ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [5514ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [5515ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [7773ms] refreshing cache from master, [7773ms] too many traces: truncated at 100 traces, deferred=Deferred@1161325411(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@ef8bacb -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1912706406 after retry RPC after error@1050764743) -> (continuation of Deferred@952394243 after retry RPC after error@1931589938) -> (continuation of Deferred@234207381 after retry RPC after error@953117617) -> (continuation of Deferred@595645137 after retry RPC after error@1561728954) -> (continuation of Deferred@2106015133 after retry RPC after error@1054233471) -> (continuation of Deferred@467998766 after retry RPC after error@1990424367) -> (continuation of Deferred@839702451 after retry RPC after error@1053636390) -> (continuation of Deferred@232418489 after retry RPC after error@1613588514) -> (continuation of Deferred@885562075 after retry RPC after error@1668018019) -> (continuation of Deferred@1032513555 after retry RPC after error@921562104) -> (continuation of Deferred@1183031740 after retry RPC after error@2049924856) -> (continuation of Deferred@269478878 after retry RPC after error@1231314956) -> (continuation of Deferred@305243869 after retry RPC after error@317321981) -> (continuation of Deferred@2102897253 after retry RPC after error@391758275) -> (continuation of Deferred@138513083 after retry RPC after error@1440935764) -> (continuation of Deferred@354841359 after retry RPC after error@1286143921) -> (continuation of Deferred@1220059341 after retry RPC after error@182611649) -> (continuation of Deferred@746248857 after retry RPC after error@665124304) -> (continuation of Deferred@706191137 after retry RPC after error@865761476) -> (continuation of Deferred@1238291004 after retry RPC after error@1225059496) -> (continuation of Deferred@1610386494 after retry RPC after error@1069585245) -> (continuation of Deferred@10545579 after retry RPC after error@1848587451) -> (continuation of Deferred@1435097148 after retry RPC after error@1852371883) -> (continuation of Deferred@1761784444 after retry RPC after error@2124405003) -> (continuation of Deferred@1707910876 after retry RPC after error@1284568165), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1912706406 after retry RPC after error@1050764743) -> (continuation of Deferred@952394243 after retry RPC after error@1931589938) -> (continuation of Deferred@234207381 after retry RPC after error@953117617) -> (continuation of Deferred@595645137 after retry RPC after error@1561728954) -> (continuation of Deferred@2106015133 after retry RPC after error@1054233471) -> (continuation of Deferred@467998766 after retry RPC after error@1990424367) -> (continuation of Deferred@839702451 after retry RPC after error@1053636390) -> (continuation of Deferred@232418489 after retry RPC after error@1613588514) -> (continuation of Deferred@885562075 after retry RPC after error@1668018019) -> (continuation of Deferred@1032513555 after retry RPC after error@921562104) -> (continuation of Deferred@1183031740 after retry RPC after error@2049924856) -> (continuation of Deferred@269478878 after retry RPC after error@1231314956) -> (continuation of Deferred@305243869 after retry RPC after error@317321981) -> (continuation of Deferred@2102897253 after retry RPC after error@391758275) -> (continuation of Deferred@138513083 after retry RPC after error@1440935764) -> (continuation of Deferred@354841359 after retry RPC after error@1286143921) -> (continuation of Deferred@1220059341 after retry RPC after error@182611649) -> (continuation of Deferred@746248857 after retry RPC after error@665124304) -> (continuation of Deferred@706191137 after retry RPC after error@865761476) -> (continuation of Deferred@1238291004 after retry RPC after error@1225059496) -> (continuation of Deferred@1610386494 after retry RPC after error@1069585245) -> (continuation of Deferred@10545579 after retry RPC after error@1848587451) -> (continuation of Deferred@1435097148 after retry RPC after error@1852371883) -> (continuation of Deferred@1761784444 after retry RPC after error@2124405003) -> (continuation of Deferred@1707910876 after retry RPC after error@1284568165)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=27, TimeoutTracker(timeout=30000, elapsed=29474), Traces: [0ms] sending RPC to server master-127.2.96.188:32989, [1ms] received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [12ms] refreshing cache from master, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [14ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [14ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [14ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [15ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [32ms] refreshing cache from master, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [34ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [34ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [34ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [34ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [51ms] refreshing cache from master, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [52ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [52ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [53ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [53ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [71ms] refreshing cache from master, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [72ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [72ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [72ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [73ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [92ms] refreshing cache from master, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [93ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [93ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [94ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [94ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [131ms] refreshing cache from master, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [132ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [132ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [132ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [133ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [252ms] refreshing cache from master, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [253ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [253ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [253ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [253ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [272ms] refreshing cache from master, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [273ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [273ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [273ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [273ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [572ms] refreshing cache from master, [572ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [572ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [573ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [573ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [573ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [573ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [573ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1491ms] refreshing cache from master, [1491ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1492ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1492ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1492ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1492ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [1493ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1493ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [2152ms] refreshing cache from master, [2152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [2152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [2152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [2153ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [2154ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [2155ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2155ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [5512ms] refreshing cache from master, [5512ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [5512ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [5513ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [5513ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [5514ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [5514ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [5515ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [7773ms] refreshing cache from master, [7773ms] too many traces: truncated at 100 traces, deferred=Deferred@1161325411(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@ef8bacb -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1912706406 after retry RPC after error@1050764743) -> (continuation of Deferred@952394243 after retry RPC after error@1931589938) -> (continuation of Deferred@234207381 after retry RPC after error@953117617) -> (continuation of Deferred@595645137 after retry RPC after error@1561728954) -> (continuation of Deferred@2106015133 after retry RPC after error@1054233471) -> (continuation of Deferred@467998766 after retry RPC after error@1990424367) -> (continuation of Deferred@839702451 after retry RPC after error@1053636390) -> (continuation of Deferred@232418489 after retry RPC after error@1613588514) -> (continuation of Deferred@885562075 after retry RPC after error@1668018019) -> (continuation of Deferred@1032513555 after retry RPC after error@921562104) -> (continuation of Deferred@1183031740 after retry RPC after error@2049924856) -> (continuation of Deferred@269478878 after retry RPC after error@1231314956) -> (continuation of Deferred@305243869 after retry RPC after error@317321981) -> (continuation of Deferred@2102897253 after retry RPC after error@391758275) -> (continuation of Deferred@138513083 after retry RPC after error@1440935764) -> (continuation of Deferred@354841359 after retry RPC after error@1286143921) -> (continuation of Deferred@1220059341 after retry RPC after error@182611649) -> (continuation of Deferred@746248857 after retry RPC after error@665124304) -> (continuation of Deferred@706191137 after retry RPC after error@865761476) -> (continuation of Deferred@1238291004 after retry RPC after error@1225059496) -> (continuation of Deferred@1610386494 after retry RPC after error@1069585245) -> (continuation of Deferred@10545579 after retry RPC after error@1848587451) -> (continuation of Deferred@1435097148 after retry RPC after error@1852371883) -> (continuation of Deferred@1761784444 after retry RPC after error@2124405003) -> (continuation of Deferred@1707910876 after retry RPC after error@1284568165), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1912706406 after retry RPC after error@1050764743) -> (continuation of Deferred@952394243 after retry RPC after error@1931589938) -> (continuation of Deferred@234207381 after retry RPC after error@953117617) -> (continuation of Deferred@595645137 after retry RPC after error@1561728954) -> (continuation of Deferred@2106015133 after retry RPC after error@1054233471) -> (continuation of Deferred@467998766 after retry RPC after error@1990424367) -> (continuation of Deferred@839702451 after retry RPC after error@1053636390) -> (continuation of Deferred@232418489 after retry RPC after error@1613588514) -> (continuation of Deferred@885562075 after retry RPC after error@1668018019) -> (continuation of Deferred@1032513555 after retry RPC after error@921562104) -> (continuation of Deferred@1183031740 after retry RPC after error@2049924856) -> (continuation of Deferred@269478878 after retry RPC after error@1231314956) -> (continuation of Deferred@305243869 after retry RPC after error@317321981) -> (continuation of Deferred@2102897253 after retry RPC after error@391758275) -> (continuation of Deferred@138513083 after retry RPC after error@1440935764) -> (continuation of Deferred@354841359 after retry RPC after error@1286143921) -> (continuation of Deferred@1220059341 after retry RPC after error@182611649) -> (continuation of Deferred@746248857 after retry RPC after error@665124304) -> (continuation of Deferred@706191137 after retry RPC after error@865761476) -> (continuation of Deferred@1238291004 after retry RPC after error@1225059496) -> (continuation of Deferred@1610386494 after retry RPC after error@1069585245) -> (continuation of Deferred@10545579 after retry RPC after error@1848587451) -> (continuation of Deferred@1435097148 after retry RPC after error@1852371883) -> (continuation of Deferred@1761784444 after retry RPC after error@2124405003) -> (continuation of Deferred@1707910876 after retry RPC after error@1284568165)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.96.188:32989
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:18.813 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.813 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.813 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.813 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.813 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.813 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.814 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.814 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.814 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.814 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:18.817 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=27, TimeoutTracker(timeout=30000, elapsed=29474), Traces: [0ms] sending RPC to server master-127.2.96.188:32989, [1ms] received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [12ms] refreshing cache from master, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [14ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [14ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [14ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [15ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [32ms] refreshing cache from master, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [34ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [34ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [34ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [34ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [51ms] refreshing cache from master, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [52ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [52ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [53ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [53ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [71ms] refreshing cache from master, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [72ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [72ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [72ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [73ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [92ms] refreshing cache from master, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [93ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [93ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [94ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [94ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [131ms] refreshing cache from master, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [132ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [132ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [132ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [133ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [252ms] refreshing cache from master, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [253ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [253ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [253ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [253ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [272ms] refreshing cache from master, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [273ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [273ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [273ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [273ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [572ms] refreshing cache from master, [572ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [572ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [573ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [573ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [573ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [573ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [573ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1491ms] refreshing cache from master, [1491ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1492ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1492ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1492ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1492ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [1493ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1493ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [2152ms] refreshing cache from master, [2152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [2152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [2152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [2153ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [2154ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [2155ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2155ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [5512ms] refreshing cache from master, [5512ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [5512ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [5513ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [5513ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [5514ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [5514ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [5515ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [7773ms] refreshing cache from master, [7773ms] too many traces: truncated at 100 traces, deferred=Deferred@1161325411(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@ef8bacb -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1912706406 after retry RPC after error@1050764743) -> (continuation of Deferred@952394243 after retry RPC after error@1931589938) -> (continuation of Deferred@234207381 after retry RPC after error@953117617) -> (continuation of Deferred@595645137 after retry RPC after error@1561728954) -> (continuation of Deferred@2106015133 after retry RPC after error@1054233471) -> (continuation of Deferred@467998766 after retry RPC after error@1990424367) -> (continuation of Deferred@839702451 after retry RPC after error@1053636390) -> (continuation of Deferred@232418489 after retry RPC after error@1613588514) -> (continuation of Deferred@885562075 after retry RPC after error@1668018019) -> (continuation of Deferred@1032513555 after retry RPC after error@921562104) -> (continuation of Deferred@1183031740 after retry RPC after error@2049924856) -> (continuation of Deferred@269478878 after retry RPC after error@1231314956) -> (continuation of Deferred@305243869 after retry RPC after error@317321981) -> (continuation of Deferred@2102897253 after retry RPC after error@391758275) -> (continuation of Deferred@138513083 after retry RPC after error@1440935764) -> (continuation of Deferred@354841359 after retry RPC after error@1286143921) -> (continuation of Deferred@1220059341 after retry RPC after error@182611649) -> (continuation of Deferred@746248857 after retry RPC after error@665124304) -> (continuation of Deferred@706191137 after retry RPC after error@865761476) -> (continuation of Deferred@1238291004 after retry RPC after error@1225059496) -> (continuation of Deferred@1610386494 after retry RPC after error@1069585245) -> (continuation of Deferred@10545579 after retry RPC after error@1848587451) -> (continuation of Deferred@1435097148 after retry RPC after error@1852371883) -> (continuation of Deferred@1761784444 after retry RPC after error@2124405003) -> (continuation of Deferred@1707910876 after retry RPC after error@1284568165), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1912706406 after retry RPC after error@1050764743) -> (continuation of Deferred@952394243 after retry RPC after error@1931589938) -> (continuation of Deferred@234207381 after retry RPC after error@953117617) -> (continuation of Deferred@595645137 after retry RPC after error@1561728954) -> (continuation of Deferred@2106015133 after retry RPC after error@1054233471) -> (continuation of Deferred@467998766 after retry RPC after error@1990424367) -> (continuation of Deferred@839702451 after retry RPC after error@1053636390) -> (continuation of Deferred@232418489 after retry RPC after error@1613588514) -> (continuation of Deferred@885562075 after retry RPC after error@1668018019) -> (continuation of Deferred@1032513555 after retry RPC after error@921562104) -> (continuation of Deferred@1183031740 after retry RPC after error@2049924856) -> (continuation of Deferred@269478878 after retry RPC after error@1231314956) -> (continuation of Deferred@305243869 after retry RPC after error@317321981) -> (continuation of Deferred@2102897253 after retry RPC after error@391758275) -> (continuation of Deferred@138513083 after retry RPC after error@1440935764) -> (continuation of Deferred@354841359 after retry RPC after error@1286143921) -> (continuation of Deferred@1220059341 after retry RPC after error@182611649) -> (continuation of Deferred@746248857 after retry RPC after error@665124304) -> (continuation of Deferred@706191137 after retry RPC after error@865761476) -> (continuation of Deferred@1238291004 after retry RPC after error@1225059496) -> (continuation of Deferred@1610386494 after retry RPC after error@1069585245) -> (continuation of Deferred@10545579 after retry RPC after error@1848587451) -> (continuation of Deferred@1435097148 after retry RPC after error@1852371883) -> (continuation of Deferred@1761784444 after retry RPC after error@2124405003) -> (continuation of Deferred@1707910876 after retry RPC after error@1284568165)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=27, TimeoutTracker(timeout=30000, elapsed=29474), Traces: [0ms] sending RPC to server master-127.2.96.188:32989, [1ms] received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [12ms] refreshing cache from master, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [14ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [14ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [14ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [15ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [32ms] refreshing cache from master, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [34ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [34ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [34ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [34ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [51ms] refreshing cache from master, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [52ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [52ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [53ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [53ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [71ms] refreshing cache from master, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [72ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [72ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [72ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [73ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [92ms] refreshing cache from master, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [93ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [93ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [94ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [94ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [131ms] refreshing cache from master, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [132ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [132ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [132ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [133ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [252ms] refreshing cache from master, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [253ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [253ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [253ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [253ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [272ms] refreshing cache from master, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [273ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [273ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [273ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [273ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [572ms] refreshing cache from master, [572ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [572ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [573ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [573ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [573ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [573ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [573ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1491ms] refreshing cache from master, [1491ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1492ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1492ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1492ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1492ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [1493ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1493ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [2152ms] refreshing cache from master, [2152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [2152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [2152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [2153ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [2154ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [2155ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2155ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [5512ms] refreshing cache from master, [5512ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [5512ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [5513ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [5513ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [5514ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [5514ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [5515ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [7773ms] refreshing cache from master, [7773ms] too many traces: truncated at 100 traces, deferred=Deferred@1161325411(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@ef8bacb -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1912706406 after retry RPC after error@1050764743) -> (continuation of Deferred@952394243 after retry RPC after error@1931589938) -> (continuation of Deferred@234207381 after retry RPC after error@953117617) -> (continuation of Deferred@595645137 after retry RPC after error@1561728954) -> (continuation of Deferred@2106015133 after retry RPC after error@1054233471) -> (continuation of Deferred@467998766 after retry RPC after error@1990424367) -> (continuation of Deferred@839702451 after retry RPC after error@1053636390) -> (continuation of Deferred@232418489 after retry RPC after error@1613588514) -> (continuation of Deferred@885562075 after retry RPC after error@1668018019) -> (continuation of Deferred@1032513555 after retry RPC after error@921562104) -> (continuation of Deferred@1183031740 after retry RPC after error@2049924856) -> (continuation of Deferred@269478878 after retry RPC after error@1231314956) -> (continuation of Deferred@305243869 after retry RPC after error@317321981) -> (continuation of Deferred@2102897253 after retry RPC after error@391758275) -> (continuation of Deferred@138513083 after retry RPC after error@1440935764) -> (continuation of Deferred@354841359 after retry RPC after error@1286143921) -> (continuation of Deferred@1220059341 after retry RPC after error@182611649) -> (continuation of Deferred@746248857 after retry RPC after error@665124304) -> (continuation of Deferred@706191137 after retry RPC after error@865761476) -> (continuation of Deferred@1238291004 after retry RPC after error@1225059496) -> (continuation of Deferred@1610386494 after retry RPC after error@1069585245) -> (continuation of Deferred@10545579 after retry RPC after error@1848587451) -> (continuation of Deferred@1435097148 after retry RPC after error@1852371883) -> (continuation of Deferred@1761784444 after retry RPC after error@2124405003) -> (continuation of Deferred@1707910876 after retry RPC after error@1284568165), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1912706406 after retry RPC after error@1050764743) -> (continuation of Deferred@952394243 after retry RPC after error@1931589938) -> (continuation of Deferred@234207381 after retry RPC after error@953117617) -> (continuation of Deferred@595645137 after retry RPC after error@1561728954) -> (continuation of Deferred@2106015133 after retry RPC after error@1054233471) -> (continuation of Deferred@467998766 after retry RPC after error@1990424367) -> (continuation of Deferred@839702451 after retry RPC after error@1053636390) -> (continuation of Deferred@232418489 after retry RPC after error@1613588514) -> (continuation of Deferred@885562075 after retry RPC after error@1668018019) -> (continuation of Deferred@1032513555 after retry RPC after error@921562104) -> (continuation of Deferred@1183031740 after retry RPC after error@2049924856) -> (continuation of Deferred@269478878 after retry RPC after error@1231314956) -> (continuation of Deferred@305243869 after retry RPC after error@317321981) -> (continuation of Deferred@2102897253 after retry RPC after error@391758275) -> (continuation of Deferred@138513083 after retry RPC after error@1440935764) -> (continuation of Deferred@354841359 after retry RPC after error@1286143921) -> (continuation of Deferred@1220059341 after retry RPC after error@182611649) -> (continuation of Deferred@746248857 after retry RPC after error@665124304) -> (continuation of Deferred@706191137 after retry RPC after error@865761476) -> (continuation of Deferred@1238291004 after retry RPC after error@1225059496) -> (continuation of Deferred@1610386494 after retry RPC after error@1069585245) -> (continuation of Deferred@10545579 after retry RPC after error@1848587451) -> (continuation of Deferred@1435097148 after retry RPC after error@1852371883) -> (continuation of Deferred@1761784444 after retry RPC after error@2124405003) -> (continuation of Deferred@1707910876 after retry RPC after error@1284568165)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.96.188:32989
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:18.818 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:33:18.818 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (9de81db54be40687a2a82164db1dc50b) switched from state RUNNING to RESTARTING.
18:33:18.818 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
18:33:18.818 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
18:33:18.819 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
18:33:18.819 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
18:33:18.819 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
18:33:18.819 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
18:33:18.819 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
18:33:18.820 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
18:33:18.820 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
18:33:18.820 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
18:33:18.820 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
18:33:18.821 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:18.828 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:18.828 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:18.828 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:18.830 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.830 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.830 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.830 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.3.43.190:40613(127.3.43.190:40613)] disconnecting while in state TERMINATED
18:33:18.830 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.3.43.188:36795(127.3.43.188:36795)] disconnecting while in state TERMINATED
18:33:18.830 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.3.43.189:32951(127.3.43.189:32951)] disconnecting while in state TERMINATED
18:33:18.830 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.830 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.830 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.831 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.831 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.831 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.831 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:18.830 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)] disconnecting while in state TERMINATED
18:33:18.831 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:18.832 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
18:33:18.832 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-0
18:33:18.832 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
18:33:18.848 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:18.848 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:18.848 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:18.849 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.849 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.849 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.849 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.849 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.849 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.850 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.850 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.850 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.850 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:18.855 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:18.866 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:18.866 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:18.867 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:18.867 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:18.867 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:18.867 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:18.867 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:18.867 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:18.867 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:18.867 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:18.867 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:18.868 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:18.868 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:18.868 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:18.868 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:18.868 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:18.868 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.868 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.868 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.869 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.869 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.869 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.869 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.869 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.869 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.869 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:18.873 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
18:33:18.873 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
18:33:18.873 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
18:33:18.888 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:18.889 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:18.889 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:18.889 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.889 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.889 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.890 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.890 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.890 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.890 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.890 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.890 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.890 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:18.896 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.3.43.190:40613(127.3.43.190:40613)] disconnecting while in state TERMINATED
18:33:18.896 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.3.43.188:36795(127.3.43.188:36795)] disconnecting while in state TERMINATED
18:33:18.896 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.3.43.189:32951(127.3.43.189:32951)] disconnecting while in state TERMINATED
18:33:18.897 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:18.897 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
18:33:18.897 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-0
18:33:18.905 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:18.908 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
18:33:18.908 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
18:33:18.908 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
18:33:18.908 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:18.909 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:18.909 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:18.909 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.909 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.909 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.910 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.910 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.910 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.910 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.910 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.910 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.910 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:18.923 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.3.43.190:40613(127.3.43.190:40613)] disconnecting while in state TERMINATED
18:33:18.923 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.3.43.188:36795(127.3.43.188:36795)] disconnecting while in state TERMINATED
18:33:18.923 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.3.43.189:32951(127.3.43.189:32951)] disconnecting while in state TERMINATED
18:33:18.923 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 7ecd1039231a404dbd66f834d9290a2d(127.3.43.131:38327)] disconnecting while in state TERMINATED
18:33:18.923 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:18.923 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-0
18:33:18.924 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
18:33:18.924 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
18:33:18.937 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
18:33:18.938 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
18:33:18.938 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
18:33:18.945 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.3.43.190:40613(127.3.43.190:40613)] disconnecting while in state TERMINATED
18:33:18.945 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.3.43.188:36795(127.3.43.188:36795)] disconnecting while in state TERMINATED
18:33:18.945 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.3.43.189:32951(127.3.43.189:32951)] disconnecting while in state TERMINATED
18:33:18.945 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:18.946 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
18:33:18.947 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
18:33:18.948 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:18.949 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:18.949 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:18.949 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.949 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.949 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:18.950 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.950 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.950 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:18.950 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.950 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.950 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:18.950 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:18.983 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
18:33:18.983 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:33:18.984 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
18:33:18.984 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
18:33:18.986 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
18:33:18.986 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
18:33:18.987 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:18.993 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-3
18:33:18.994 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:33:18.994 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
18:33:18.994 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
18:33:18.996 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
18:33:18.996 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
18:33:18.997 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:33:19.008 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:19.009 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:19.009 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:19.009 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:19.009 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:19.009 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:19.010 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:19.010 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:19.010 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:19.010 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:19.010 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:19.010 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:19.010 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:19.015 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
18:33:19.015 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:33:19.018 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
18:33:19.018 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
18:33:19.019 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
18:33:19.019 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
18:33:19.020 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:33:19.035 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
18:33:19.036 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:33:19.039 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
18:33:19.039 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
18:33:19.041 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
18:33:19.041 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
18:33:19.042 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 9de81db54be40687a2a82164db1dc50b
18:33:19.048 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:19.049 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:19.049 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:19.049 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:19.049 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:19.050 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:19.050 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:19.050 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:19.050 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:19.050 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:19.051 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:19.051 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:19.051 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:19.117 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:19.118 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:19.118 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:19.118 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:19.118 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:19.118 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:19.119 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:19.119 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:19.119 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:19.119 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:19.119 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:19.119 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:19.119 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:19.145 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:19.146 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:19.146 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:19.146 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:19.146 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:19.146 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:19.147 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:19.147 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:19.147 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:19.147 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:19.147 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:19.147 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:19.148 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:19.148 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:19.149 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:19.149 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:19.149 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:19.149 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:19.149 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:19.149 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:19.149 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:19.149 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:19.150 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:19.150 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:19.150 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:19.150 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:19.188 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:19.188 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:19.188 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:19.189 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:19.189 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:19.189 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:19.189 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:19.189 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:19.189 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:19.189 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:19.189 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:19.189 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:19.190 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:19.322 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:19.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:19.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.364931  5977 rpc_server.cc:307] RPC server started. Bound to: 127.5.136.1:34063
18:33:19.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.368886  6191 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.136.1:34063 every 8 connection(s)
18:33:19.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.369633  5977 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/data/info.pb
18:33:19.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.373539  5664 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 5977
18:33:19.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.374121  5664 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-0/wal/instance
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.386111  5664 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/wal
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/data
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/logs
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/data/info.pb
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:19.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:33:19.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:33:19.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.136.2:0
18:33:19.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.5.136.2
18:33:19.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.136.2
18:33:19.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:19.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.5.136.62:42905,127.5.136.61:43625,127.5.136.60:39171
18:33:19.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.136.20:33349
18:33:19.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:19.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:19.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:33:19.405 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:19.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.497619  6192 heartbeater.cc:344] Connected to a master server at 127.5.136.60:39171
18:33:19.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.498412  6192 heartbeater.cc:461] Registering TS with master...
18:33:19.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.499799  6192 heartbeater.cc:507] Master 127.5.136.60:39171 requested a full tablet report, sending...
18:33:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.503427  5877 ts_manager.cc:194] Registered new tserver with Master: 422c1c063b1444b38bf3ee5a445401d1 (127.5.136.1:34063)
18:33:19.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.509136  6193 heartbeater.cc:344] Connected to a master server at 127.5.136.61:43625
18:33:19.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.509490  6193 heartbeater.cc:461] Registering TS with master...
18:33:19.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.510366  6193 heartbeater.cc:507] Master 127.5.136.61:43625 requested a full tablet report, sending...
18:33:19.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.513279  5790 ts_manager.cc:194] Registered new tserver with Master: 422c1c063b1444b38bf3ee5a445401d1 (127.5.136.1:34063)
18:33:19.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.552416  6199 heartbeater.cc:344] Connected to a master server at 127.5.136.62:42905
18:33:19.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.552817  6199 heartbeater.cc:461] Registering TS with master...
18:33:19.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.553681  6199 heartbeater.cc:507] Master 127.5.136.62:42905 requested a full tablet report, sending...
18:33:19.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.556231  5712 ts_manager.cc:194] Registered new tserver with Master: 422c1c063b1444b38bf3ee5a445401d1 (127.5.136.1:34063)
18:33:19.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:19.559108  5712 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.5.136.1:60695
18:33:19.626 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:19.626 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:19.626 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:19.627 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:19.627 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:19.627 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:19.627 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:19.627 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:19.627 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:19.627 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:19.627 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:19.627 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:19.627 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:19.627 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:19.627 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:19.628 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:19.628 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:19.628 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:19.628 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:19.628 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:19.628 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:19.628 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:19.629 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:19.629 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:19.629 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:19.629 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:19.688 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:19.688 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:19.688 [DEBUG - pool-208-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:19.689 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:19.689 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:19.689 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:19.689 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:19.689 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:19.689 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:19.689 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:19.690 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:19.690 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:19.690 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:19.822 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:19.827 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (9de81db54be40687a2a82164db1dc50b) switched from state RESTARTING to RUNNING.
18:33:19.828 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 9de81db54be40687a2a82164db1dc50b from Checkpoint 74 @ 1783535598621 for 9de81db54be40687a2a82164db1dc50b located at file:/tmp/junit13379242205642315453/checkpoints/9de81db54be40687a2a82164db1dc50b/chk-74.
18:33:19.828 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
18:33:19.828 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:33:19.835 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
18:33:19.836 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:33:19.836 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
18:33:19.836 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id 30d104af07ed84a5695abb40e9c4cdae
18:33:19.836 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
18:33:19.837 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
18:33:19.837 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id e340c57f8743c3b4810a5f8fd9742fae
18:33:19.837 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
18:33:19.837 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:33:19.837 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:19.837 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
18:33:19.837 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id afa7c94bd89aa521f7cc788a9467b76f
18:33:19.838 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
18:33:19.838 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
18:33:19.838 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id 2d9055e68c7827d1c77d7c11ef4f5752
18:33:19.838 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:33:19.839 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 30d104af07ed84a5695abb40e9c4cdae.
18:33:19.840 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 30d104af07ed84a5695abb40e9c4cdae.
18:33:19.841 [INFO - Thread-45] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:33:19.841 [DEBUG - Thread-45] (Connection.java:575) [peer master-127.2.96.189:33339(127.2.96.189:33339)] disconnecting while in state TERMINATED
18:33:19.841 [DEBUG - Thread-45] (Connection.java:575) [peer master-127.2.96.188:32989(127.2.96.188:32989)] disconnecting while in state TERMINATED
18:33:19.841 [DEBUG - Thread-45] (Connection.java:575) [peer master-127.2.96.190:44161(127.2.96.190:44161)] disconnecting while in state TERMINATED
18:33:19.845 [DEBUG - Thread-45] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:19.846 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:33:19.846 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
18:33:19.847 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
18:33:19.850 [INFO - Thread-45] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:33:19.851 [INFO - Thread-45] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:33:19.854 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot e340c57f8743c3b4810a5f8fd9742fae.
18:33:19.855 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:19.855 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
18:33:19.855 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
18:33:19.856 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id e340c57f8743c3b4810a5f8fd9742fae.
18:33:19.856 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@f6d1739
18:33:19.856 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:19.856 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:33:19.857 [DEBUG - Thread-45] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:19.857 [INFO - Thread-45] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:33:19.857 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
18:33:19.858 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
18:33:19.860 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot afa7c94bd89aa521f7cc788a9467b76f.
18:33:19.861 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id afa7c94bd89aa521f7cc788a9467b76f.
18:33:19.861 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1ff473ce
18:33:19.861 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
18:33:19.861 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
18:33:19.863 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6245d1b4
18:33:19.863 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:19.864 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:33:19.864 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
18:33:19.864 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
18:33:19.867 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 2d9055e68c7827d1c77d7c11ef4f5752.
18:33:19.868 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id 2d9055e68c7827d1c77d7c11ef4f5752.
18:33:19.869 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
18:33:19.869 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
18:33:19.869 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7e522566
18:33:19.869 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:19.869 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:33:19.870 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
18:33:19.870 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
18:33:19.876 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3e53b804
18:33:19.881 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4002be9
18:33:19.885 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:19.887 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:19.888 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:19.894 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
18:33:19.894 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
18:33:19.895 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@63fd6dde
18:33:19.895 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:19.895 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:33:19.895 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
18:33:19.895 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
18:33:19.898 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@18cd3503
18:33:19.900 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:19.903 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:19.903 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:19.903 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:19.903 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:19.905 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:19.905 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:19.905 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:19.905 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:19.905 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:19.906 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:19.906 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:19.906 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:19.906 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:19.906 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:19.906 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:19.906 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:19.908 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:19.911 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:19.916 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:19.923 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:19.928 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:19.935 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:19.942 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:19.943 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.943 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.943 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.948 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:19.948 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.949 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.949 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.950 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:19.950 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.951 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.951 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.952 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:19.952 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.952 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.953 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.953 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:19.953 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.953 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.953 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.954 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.954 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.954 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.954 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:19.955 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:19.955 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.955 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.955 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.956 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:19.956 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:19.956 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:19.957 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.957 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.957 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.957 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:19.958 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.958 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.958 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.958 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.958 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.959 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.959 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:19.959 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:19.959 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:19.959 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:19.960 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:19.960 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:19.960 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:19.960 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:19.960 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:19.961 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:19.961 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.961 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.961 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.962 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:19.962 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.962 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.962 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.963 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.963 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.963 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.963 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:19.964 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:19.964 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:19.964 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:19.964 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:19.964 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:19.964 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.965 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.965 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.965 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:19.965 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.965 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.965 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.965 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:19.966 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:19.966 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:19.966 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.966 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.967 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.968 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.968 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.968 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.968 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:19.975 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.975 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.975 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.975 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:19.975 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:19.976 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:19.976 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.976 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:19.977 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:19.977 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.977 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.979 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:19.979 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.979 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.979 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.983 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.983 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.983 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.983 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:19.983 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:19.984 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:19.984 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:19.984 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:19.984 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:19.989 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:19.993 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:19.993 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:19.993 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:19.993 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.993 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:19.994 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:19.994 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.994 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.994 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:19.994 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:19.994 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:19.994 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:19.995 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:19.995 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:19.995 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.995 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.995 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.996 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.996 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.996 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.996 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:19.996 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:19.996 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.996 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.997 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.997 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.997 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:19.997 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.997 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.997 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:19.997 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.997 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.997 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:19.997 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:19.998 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.998 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.998 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.998 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.998 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.998 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.998 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:19.999 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:19.999 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.999 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.999 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:19.999 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:19.999 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.000 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.000 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.000 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.000 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:20.001 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.001 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.001 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.001 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.001 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.001 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.001 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.001 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.002 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.002 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.003 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:20.003 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.003 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.003 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.003 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.004 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.004 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.004 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:20.004 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.004 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.005 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.005 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.005 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.005 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.005 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.005 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.005 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.005 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.005 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.005 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.005 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.008 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.008 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.009 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.009 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.009 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.009 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.009 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.009 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.009 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.010 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.010 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.010 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.010 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:20.009853  6196 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:33:20.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:20.010491  6196 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:33:20.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:20.011233  6196 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:33:20.016 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:20.016 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:20.016 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:20.016 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.017 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.017 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.017 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.017 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.017 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.017 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.018 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.018 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.018 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.018 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:20.018 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.018 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.018 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.019 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.019 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.019 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.019 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.019 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.019 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.020 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.020 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.020 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.020 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.023 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.023 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.023 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.023 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.023 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.023 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.023 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.023 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.024 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.024 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.024 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.024 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.024 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.024 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.025 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.025 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.025 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.025 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.025 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.025 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.025 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.025 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.025 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.026 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.026 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.029 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.029 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.029 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.029 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.029 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.029 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.029 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.029 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.030 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.030 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.030 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.030 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.030 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.035 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.036 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.036 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.036 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.036 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.036 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.036 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.036 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.036 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.037 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.037 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.037 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.037 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.037 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:20.037 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:20.037 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:20.038 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.038 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.038 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.038 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.038 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.038 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.038 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.038 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.039 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.039 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.039 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.039 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.039 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:20.039 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.039 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.039 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.039 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.040 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.040 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.040 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.040 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.040 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.040 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.043 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.044 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.044 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.044 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.044 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.044 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.044 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.044 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.045 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.045 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.045 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.045 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.045 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.056 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.056 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.056 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.056 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.057 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.057 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.057 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.057 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.057 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.057 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.057 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.057 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.057 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.057 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.057 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.057 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:20.057 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.057 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:20.057 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:20.057 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.058 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.058 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.058 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.058 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.058 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.058 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.058 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.058 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.058 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.058 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.059 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.059 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.059 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.059 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.059 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.059 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.059 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.059 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.059 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:20.068 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.069 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.069 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.069 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.069 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.069 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.069 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.069 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.069 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.070 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.070 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.070 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.070 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.076 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.076 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.076 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.076 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.076 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.076 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.077 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.077 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.077 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.077 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.077 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.077 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.077 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.089 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.089 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.089 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.090 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.090 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.090 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.090 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.090 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.090 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.090 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.090 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.091 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.091 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:20.092624  6196 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:33:20.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:20.094075  6196 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.136.2
18:33:20.096 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.097 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:20.097 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.097 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:20.097 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:20.097 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.097 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.097 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.097 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.097 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.097 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.097 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.097 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.097 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.098 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.097 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.098 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.098 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.098 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.098 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.098 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.098 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:20.098 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.098 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.098 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.098 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.115 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.116 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.116 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.116 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.116 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.116 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.116 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.116 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.117 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.117 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.117 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.117 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.117 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.124 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.124 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.124 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.124 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.124 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.124 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.125 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.125 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.124 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.125 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.125 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.125 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.125 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.129 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.129 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.129 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.129 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.129 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.129 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.130 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.130 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.130 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.130 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.130 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.130 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.130 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.136 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.136 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.136 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.136 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.137 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.137 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.137 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.137 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.137 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.137 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.137 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.137 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.137 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.157 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.157 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.157 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.158 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.158 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.158 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.158 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.158 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.158 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.158 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.158 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.159 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.159 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:20.166440  6196 tablet_server_runner.cc:78] Tablet server non-default flags:
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.136.20:33349
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/data
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/wal
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.136.2:0
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/data/info.pb
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.136.2
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.5.136.62:42905,127.5.136.61:43625,127.5.136.60:39171
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.5.136.2
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/logs
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:33:20.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:33:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:33:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:20.168509  6196 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:33:20.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:20.170996  6196 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:33:20.176 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:20.176 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:20.176 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:20.177 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.177 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.177 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.177 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.177 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.177 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.177 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.178 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.178 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.178 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:20.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:20.198274  6261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:20.214 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:20.215 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:20.215 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:20.215 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:20.215 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:20.216 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:20.216 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:20.216 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:20.216 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:20.217 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:20.217 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:20.217 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:20.217 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:20.217 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:20.217 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:20.217 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:20.218 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.218 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.218 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.218 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.218 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.218 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.218 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.218 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.218 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.218 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:20.223 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.224 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.224 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.224 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.224 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.224 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.224 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.225 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.225 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.225 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.225 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.225 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.225 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.227 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:20.236 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.237 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.237 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.237 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.237 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.237 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.238 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.238 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.238 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.238 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.238 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.238 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.238 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.255 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.256 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.256 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.257 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.257 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.257 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.257 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.257 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.257 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.258 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.258 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.258 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.258 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.322 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:20.329 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.329 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.329 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.330 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.330 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.330 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.331 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.331 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.331 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.331 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.331 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.331 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.331 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:20.363 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:20.363 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:20.363 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:20.364 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:20.364 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:20.364 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:20.364 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:20.364 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:20.365 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:20.365 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:20.365 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:20.365 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:20.365 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:20.376 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:20.377 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:20.377 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:20.377 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.378 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.378 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.378 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.378 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.378 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.378 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.378 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.378 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.379 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:20.384 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.384 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.384 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.385 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.385 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.385 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.385 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.385 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.385 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.386 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.386 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.386 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.386 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:20.410 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:20.411 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:20.411 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:20.412 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:20.412 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:20.412 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:20.412 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:20.412 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:20.412 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:20.413 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:20.413 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:20.413 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:20.413 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:20.437 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:20.438 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:20.438 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:20.438 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.438 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.438 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.441 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.441 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.441 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.442 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.442 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.442 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.442 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.442 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.443 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.443 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:20.443 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.443 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.443 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.444 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.444 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.444 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.444 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.444 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.444 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.444 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.518 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:20.518 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:20.518 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:20.519 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:20.519 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:20.519 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:20.519 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:20.519 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:20.520 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:20.520 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:20.520 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:20.521 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:20.521 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:20.537 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:20.537 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:20.537 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:20.538 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:20.538 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:20.538 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:20.538 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:20.538 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:20.538 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:20.538 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:20.538 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:20.538 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:20.539 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:20.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:20.563129  6199 heartbeater.cc:499] Master 127.5.136.62:42905 was elected leader, sending a full tablet report...
18:33:20.649 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.649 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.649 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.650 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.650 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.650 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.651 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.651 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.651 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.652 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.652 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.652 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.652 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.715 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.716 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.716 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.716 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.717 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.717 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.717 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.717 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.717 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.718 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.718 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.718 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.718 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.728 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:20.736 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:20.737 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:20.737 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:20.738 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:20.738 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:20.738 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:20.738 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:20.738 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:20.738 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:20.739 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:20.739 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:20.739 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:20.739 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:20.744 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.744 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.744 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.745 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.745 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.745 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.745 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.745 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.745 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.746 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.746 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.746 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.746 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.791 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:20.791 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:20.792 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:20.792 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:20.792 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:20.792 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:20.793 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:20.793 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:20.793 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:20.793 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:20.793 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:20.793 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:20.793 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:20.822 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:20.849 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.849 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.849 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.850 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.850 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.850 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.851 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.851 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.851 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.899 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.899 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.900 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.900 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:20.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:20.906 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:20.937 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:20.937 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:20.937 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:20.937 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.937 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.937 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:20.937 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.937 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.938 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.938 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.938 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:20.938 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:20.938 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:20.944 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:20.944 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:20.944 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:20.944 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.944 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.944 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:20.944 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.944 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.944 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:20.945 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.945 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.945 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:20.945 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:21.016 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:21.016 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:21.016 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:21.017 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:21.017 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:21.017 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:21.017 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:21.017 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:21.017 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:21.018 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:21.018 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:21.018 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:21.018 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:21.056 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:21.056 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:21.056 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:21.057 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:21.057 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:21.057 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:21.057 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:21.057 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:21.057 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:21.058 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:21.058 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:21.058 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:21.058 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:21.099 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:21.100 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:21.100 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:21.101 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:21.101 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:21.101 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:21.102 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:21.102 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:21.102 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:21.102 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:21.102 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:21.102 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:21.103 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:21.169 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:21.169 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:21.169 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:21.170 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:21.170 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:21.170 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:21.171 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:21.171 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:21.171 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:21.171 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:21.171 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:21.171 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:21.171 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:21.203 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:21.203 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:21.203 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:21.204 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:21.204 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:21.204 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:21.205 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:21.205 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:21.205 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:21.206 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:21.206 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:21.206 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:21.206 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:21.226 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:21.257 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:21.257 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:21.257 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:21.258 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:21.258 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:21.258 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:21.258 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:21.258 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:21.258 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:21.259 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:21.259 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:21.259 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:21.259 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:21.291 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:21.291 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:21.291 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:21.292 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:21.292 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:21.292 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:21.292 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:21.293 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:21.293 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:21.293 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:21.293 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:21.293 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:21.293 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:21.322 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:21.354 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:21.406 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:21.416 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:21.417 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:21.417 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:21.417 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:21.417 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:21.417 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:21.418 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:21.418 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:21.418 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:21.418 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:21.418 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:21.418 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:21.418 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:21.456 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:21.456 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:21.456 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:21.457 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:21.457 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:21.457 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:21.458 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:21.458 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:21.458 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:21.458 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:21.458 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:21.458 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:21.458 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:21.538 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:21.538 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:21.538 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:21.539 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:21.539 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:21.539 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:21.539 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:21.539 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:21.539 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:21.541 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:21.542 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:21.542 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:21.542 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:21.549 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:21.549 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:21.549 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:21.549 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:21.549 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:21.549 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:21.550 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:21.550 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:21.550 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:21.550 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:21.551 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:21.551 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:21.551 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:21.672 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:21.672 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:21.672 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:21.673 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:21.673 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:21.673 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:21.673 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:21.673 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:21.673 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:21.674 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:21.674 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:21.674 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:21.674 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:21.726 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:21.803 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:21.804 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:21.804 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:21.804 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:21.804 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:21.805 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:21.805 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:21.805 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:21.805 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:21.805 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:21.806 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:21.806 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:21.806 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:21.821 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:21.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:21.906 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:21.931 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:21.931 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:21.931 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:21.932 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:21.932 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:21.932 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:21.932 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:21.932 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:21.932 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:21.933 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:21.933 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:21.933 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:21.933 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:21.957 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:21.957 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:21.957 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:21.958 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:21.958 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:21.958 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:21.958 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:21.958 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:21.958 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:21.959 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:21.959 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:21.959 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:21.959 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:22.028 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:22.029 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:22.029 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:22.029 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:22.029 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:22.029 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:22.030 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:22.030 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:22.030 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:22.030 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:22.030 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:22.030 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:22.030 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:22.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:21.599498  6260 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 6196
18:33:22.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:22.126305  6260 kernel_stack_watchdog.cc:198] Thread 6196 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 395ms:
18:33:22.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:33:22.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:33:22.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:33:22.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:33:22.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:20.201964  6262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:22.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:22.126866  6196 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.925s	user 0.634s	sys 1.029s
18:33:22.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:22.127488  6196 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.926s	user 0.634s	sys 1.029s
18:33:22.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:22.129396  6264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:22.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:22.131608  6263 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1925 milliseconds
18:33:22.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.131613  6196 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:33:22.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.132992  6196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:33:22.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.135589  6196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:33:22.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.136931  6196 hybrid_clock.cc:648] HybridClock initialized: now 1783535602136912 us; error 59 us; skew 500 ppm
18:33:22.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.137919  6196 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:33:22.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.144737  6196 webserver.cc:534] Webserver started at http://127.5.136.2:40849/ using document root <none> and password file <none>
18:33:22.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.145915  6196 fs_manager.cc:362] Metadata directory not provided
18:33:22.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.146102  6196 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:33:22.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.146548  6196 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:33:22.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.151930  6196 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/data/instance:
18:33:22.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9ea5388f32294500b5ec5ef882b64ee6"
18:33:22.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:22 on dist-test-slave-dxnw"
18:33:22.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.153134  6196 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/wal/instance:
18:33:22.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9ea5388f32294500b5ec5ef882b64ee6"
18:33:22.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:22 on dist-test-slave-dxnw"
18:33:22.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.161975  6196 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.005s
18:33:22.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.171630  6273 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:33:22.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.173063  6196 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.004s	sys 0.000s
18:33:22.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.173516  6196 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/wal
18:33:22.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9ea5388f32294500b5ec5ef882b64ee6"
18:33:22.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:22 on dist-test-slave-dxnw"
18:33:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.173916  6196 fs_report.cc:389] FS layout report
18:33:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:33:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/wal
18:33:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/wal
18:33:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/data/data
18:33:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:33:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:33:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:33:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:33:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:33:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:33:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:33:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:33:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:33:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:33:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:33:22.227 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:22.236 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:22.236 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:22.236 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:22.236 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:22.236 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:22.236 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:22.236 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:22.236 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:22.236 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:22.237 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:22.237 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:22.237 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:22.237 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:22.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.243259  6196 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:33:22.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.245227  6196 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:33:22.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.245770  6196 kserver.cc:163] Server-wide thread pool size limit: 3276
18:33:22.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.249948  6196 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:33:22.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.255934  6196 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:33:22.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.256201  6196 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:33:22.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.256498  6196 ts_tablet_manager.cc:616] Registered 0 tablets
18:33:22.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.256698  6196 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:33:22.321 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:22.328 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:22.328 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:22.328 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:22.328 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:22.328 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:22.329 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:22.329 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:22.329 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:22.329 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:22.329 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:22.329 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:22.329 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:22.330 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:22.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:22.405 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.432803  6196 rpc_server.cc:307] RPC server started. Bound to: 127.5.136.2:43565
18:33:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.432956  6385 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.136.2:43565 every 8 connection(s)
18:33:22.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.436146  6196 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/data/info.pb
18:33:22.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.445506  5664 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 6196
18:33:22.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.446135  5664 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-1/wal/instance
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.473783  5664 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/wal
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/data
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/logs
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/data/info.pb
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:33:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:33:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.136.3:0
18:33:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.5.136.3
18:33:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.136.3
18:33:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.5.136.62:42905,127.5.136.61:43625,127.5.136.60:39171
18:33:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.136.20:33349
18:33:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:33:22.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.509723  6386 heartbeater.cc:344] Connected to a master server at 127.5.136.60:39171
18:33:22.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.510268  6386 heartbeater.cc:461] Registering TS with master...
18:33:22.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.511639  6386 heartbeater.cc:507] Master 127.5.136.60:39171 requested a full tablet report, sending...
18:33:22.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.515066  5877 ts_manager.cc:194] Registered new tserver with Master: 9ea5388f32294500b5ec5ef882b64ee6 (127.5.136.2:43565)
18:33:22.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.525007  6388 heartbeater.cc:344] Connected to a master server at 127.5.136.62:42905
18:33:22.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.525415  6388 heartbeater.cc:461] Registering TS with master...
18:33:22.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.526434  6388 heartbeater.cc:507] Master 127.5.136.62:42905 requested a full tablet report, sending...
18:33:22.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.530756  5712 ts_manager.cc:194] Registered new tserver with Master: 9ea5388f32294500b5ec5ef882b64ee6 (127.5.136.2:43565)
18:33:22.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.533241  5712 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.5.136.2:41989
18:33:22.536 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:22.536 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:22.536 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:22.537 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:22.537 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:22.537 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:22.537 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:22.537 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:22.537 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:22.537 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:22.537 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:22.538 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:22.538 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:22.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.537050  6387 heartbeater.cc:344] Connected to a master server at 127.5.136.61:43625
18:33:22.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.537447  6387 heartbeater.cc:461] Registering TS with master...
18:33:22.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.538131  6387 heartbeater.cc:507] Master 127.5.136.61:43625 requested a full tablet report, sending...
18:33:22.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.541159  5790 ts_manager.cc:194] Registered new tserver with Master: 9ea5388f32294500b5ec5ef882b64ee6 (127.5.136.2:43565)
18:33:22.576 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:22.577 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:22.577 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:22.577 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:22.577 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:22.577 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:22.577 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:22.577 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:22.578 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:22.578 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:22.578 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:22.578 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:22.578 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:22.597 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:22.598 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:22.598 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:22.599 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:22.599 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:22.599 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:22.599 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:22.599 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:22.599 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:22.599 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:22.599 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:22.599 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:22.599 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:22.617 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:22.617 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:22.617 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:22.617 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:22.617 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:22.617 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:22.617 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:22.617 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:22.617 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:22.617 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:22.617 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:22.617 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:22.618 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:22.618 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26506), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [39ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [40ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [72ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [72ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [81ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [100ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [100ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [100ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [100ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [121ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [127ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [130ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [130ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [141ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [143ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [143ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [184ms] refreshing cache from master, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [186ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [190ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [191ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [191ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [362ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [362ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [561ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [562ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1062ms] refreshing cache from master, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1063ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1800ms] refreshing cache from master, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1802ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2160ms] refreshing cache from master, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2163ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2163ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [3820ms] refreshing cache from master, [3820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [3820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [3821ms] too many traces: truncated at 100 traces, deferred=Deferred@1262999283(state=PENDING, result=null, callback=(continuation of Deferred@1713895644 after retry RPC after error@1433697874) -> (continuation of Deferred@1059328893 after retry RPC after error@1252108836) -> (continuation of Deferred@320428724 after retry RPC after error@1709781099) -> (continuation of Deferred@2051635280 after retry RPC after error@1040059831) -> (continuation of Deferred@1693137990 after retry RPC after error@1219306200) -> (continuation of Deferred@2031568997 after retry RPC after error@877228357) -> (continuation of Deferred@167604870 after retry RPC after error@686242435) -> (continuation of Deferred@1810893722 after retry RPC after error@340565240) -> (continuation of Deferred@1984411061 after retry RPC after error@1734716124) -> (continuation of Deferred@203608433 after retry RPC after error@2096707409) -> (continuation of Deferred@928571238 after retry RPC after error@2099359771) -> (continuation of Deferred@1729257367 after retry RPC after error@1382330267) -> (continuation of Deferred@599189854 after retry RPC after error@1407657051) -> (continuation of Deferred@654063447 after retry RPC after error@1368611940) -> (continuation of Deferred@1174123281 after retry RPC after error@802460169) -> (continuation of Deferred@1750425131 after retry RPC after error@602820409) -> (continuation of Deferred@999625582 after retry RPC after error@811240143) -> (continuation of Deferred@1924939497 after retry RPC after error@595210240) -> (continuation of Deferred@820463970 after retry RPC after error@1418703171) -> (continuation of Deferred@1205306957 after retry RPC after error@895435911) -> (continuation of Deferred@1073329943 after retry RPC after error@383065090) -> (continuation of Deferred@1842025851 after retry RPC after error@578752313) -> (continuation of Deferred@1355564398 after retry RPC after error@1850173049) -> (continuation of Deferred@1536345607 after retry RPC after error@21896331), errback=(continuation of Deferred@1713895644 after retry RPC after error@1433697874) -> (continuation of Deferred@1059328893 after retry RPC after error@1252108836) -> (continuation of Deferred@320428724 after retry RPC after error@1709781099) -> (continuation of Deferred@2051635280 after retry RPC after error@1040059831) -> (continuation of Deferred@1693137990 after retry RPC after error@1219306200) -> (continuation of Deferred@2031568997 after retry RPC after error@877228357) -> (continuation of Deferred@167604870 after retry RPC after error@686242435) -> (continuation of Deferred@1810893722 after retry RPC after error@340565240) -> (continuation of Deferred@1984411061 after retry RPC after error@1734716124) -> (continuation of Deferred@203608433 after retry RPC after error@2096707409) -> (continuation of Deferred@928571238 after retry RPC after error@2099359771) -> (continuation of Deferred@1729257367 after retry RPC after error@1382330267) -> (continuation of Deferred@599189854 after retry RPC after error@1407657051) -> (continuation of Deferred@654063447 after retry RPC after error@1368611940) -> (continuation of Deferred@1174123281 after retry RPC after error@802460169) -> (continuation of Deferred@1750425131 after retry RPC after error@602820409) -> (continuation of Deferred@999625582 after retry RPC after error@811240143) -> (continuation of Deferred@1924939497 after retry RPC after error@595210240) -> (continuation of Deferred@820463970 after retry RPC after error@1418703171) -> (continuation of Deferred@1205306957 after retry RPC after error@895435911) -> (continuation of Deferred@1073329943 after retry RPC after error@383065090) -> (continuation of Deferred@1842025851 after retry RPC after error@578752313) -> (continuation of Deferred@1355564398 after retry RPC after error@1850173049) -> (continuation of Deferred@1536345607 after retry RPC after error@21896331)))
18:33:22.620 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:33:22.620 [WARN - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26506), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [39ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [40ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [72ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [72ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [81ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [100ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [100ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [100ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [100ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [121ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [127ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [130ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [130ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [141ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [143ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [143ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [184ms] refreshing cache from master, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [186ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [190ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [191ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [191ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [362ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [362ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [561ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [562ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1062ms] refreshing cache from master, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1063ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1800ms] refreshing cache from master, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1802ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2160ms] refreshing cache from master, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2163ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2163ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [3820ms] refreshing cache from master, [3820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [3820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [3821ms] too many traces: truncated at 100 traces, deferred=Deferred@1262999283(state=PENDING, result=null, callback=(continuation of Deferred@1713895644 after retry RPC after error@1433697874) -> (continuation of Deferred@1059328893 after retry RPC after error@1252108836) -> (continuation of Deferred@320428724 after retry RPC after error@1709781099) -> (continuation of Deferred@2051635280 after retry RPC after error@1040059831) -> (continuation of Deferred@1693137990 after retry RPC after error@1219306200) -> (continuation of Deferred@2031568997 after retry RPC after error@877228357) -> (continuation of Deferred@167604870 after retry RPC after error@686242435) -> (continuation of Deferred@1810893722 after retry RPC after error@340565240) -> (continuation of Deferred@1984411061 after retry RPC after error@1734716124) -> (continuation of Deferred@203608433 after retry RPC after error@2096707409) -> (continuation of Deferred@928571238 after retry RPC after error@2099359771) -> (continuation of Deferred@1729257367 after retry RPC after error@1382330267) -> (continuation of Deferred@599189854 after retry RPC after error@1407657051) -> (continuation of Deferred@654063447 after retry RPC after error@1368611940) -> (continuation of Deferred@1174123281 after retry RPC after error@802460169) -> (continuation of Deferred@1750425131 after retry RPC after error@602820409) -> (continuation of Deferred@999625582 after retry RPC after error@811240143) -> (continuation of Deferred@1924939497 after retry RPC after error@595210240) -> (continuation of Deferred@820463970 after retry RPC after error@1418703171) -> (continuation of Deferred@1205306957 after retry RPC after error@895435911) -> (continuation of Deferred@1073329943 after retry RPC after error@383065090) -> (continuation of Deferred@1842025851 after retry RPC after error@578752313) -> (continuation of Deferred@1355564398 after retry RPC after error@1850173049) -> (continuation of Deferred@1536345607 after retry RPC after error@21896331), errback=(continuation of Deferred@1713895644 after retry RPC after error@1433697874) -> (continuation of Deferred@1059328893 after retry RPC after error@1252108836) -> (continuation of Deferred@320428724 after retry RPC after error@1709781099) -> (continuation of Deferred@2051635280 after retry RPC after error@1040059831) -> (continuation of Deferred@1693137990 after retry RPC after error@1219306200) -> (continuation of Deferred@2031568997 after retry RPC after error@877228357) -> (continuation of Deferred@167604870 after retry RPC after error@686242435) -> (continuation of Deferred@1810893722 after retry RPC after error@340565240) -> (continuation of Deferred@1984411061 after retry RPC after error@1734716124) -> (continuation of Deferred@203608433 after retry RPC after error@2096707409) -> (continuation of Deferred@928571238 after retry RPC after error@2099359771) -> (continuation of Deferred@1729257367 after retry RPC after error@1382330267) -> (continuation of Deferred@599189854 after retry RPC after error@1407657051) -> (continuation of Deferred@654063447 after retry RPC after error@1368611940) -> (continuation of Deferred@1174123281 after retry RPC after error@802460169) -> (continuation of Deferred@1750425131 after retry RPC after error@602820409) -> (continuation of Deferred@999625582 after retry RPC after error@811240143) -> (continuation of Deferred@1924939497 after retry RPC after error@595210240) -> (continuation of Deferred@820463970 after retry RPC after error@1418703171) -> (continuation of Deferred@1205306957 after retry RPC after error@895435911) -> (continuation of Deferred@1073329943 after retry RPC after error@383065090) -> (continuation of Deferred@1842025851 after retry RPC after error@578752313) -> (continuation of Deferred@1355564398 after retry RPC after error@1850173049) -> (continuation of Deferred@1536345607 after retry RPC after error@21896331)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:22.620 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
18:33:22.622 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
18:33:22.625 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED on 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26506), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [39ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [40ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [72ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [72ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [81ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [100ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [100ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [100ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [100ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [121ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [127ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [130ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [130ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [141ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [143ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [143ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [184ms] refreshing cache from master, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [186ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [190ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [191ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [191ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [362ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [362ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [561ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [562ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1062ms] refreshing cache from master, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1063ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1800ms] refreshing cache from master, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1802ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2160ms] refreshing cache from master, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2163ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2163ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [3820ms] refreshing cache from master, [3820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [3820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [3821ms] too many traces: truncated at 100 traces, deferred=Deferred@1262999283(state=PENDING, result=null, callback=(continuation of Deferred@1713895644 after retry RPC after error@1433697874) -> (continuation of Deferred@1059328893 after retry RPC after error@1252108836) -> (continuation of Deferred@320428724 after retry RPC after error@1709781099) -> (continuation of Deferred@2051635280 after retry RPC after error@1040059831) -> (continuation of Deferred@1693137990 after retry RPC after error@1219306200) -> (continuation of Deferred@2031568997 after retry RPC after error@877228357) -> (continuation of Deferred@167604870 after retry RPC after error@686242435) -> (continuation of Deferred@1810893722 after retry RPC after error@340565240) -> (continuation of Deferred@1984411061 after retry RPC after error@1734716124) -> (continuation of Deferred@203608433 after retry RPC after error@2096707409) -> (continuation of Deferred@928571238 after retry RPC after error@2099359771) -> (continuation of Deferred@1729257367 after retry RPC after error@1382330267) -> (continuation of Deferred@599189854 after retry RPC after error@1407657051) -> (continuation of Deferred@654063447 after retry RPC after error@1368611940) -> (continuation of Deferred@1174123281 after retry RPC after error@802460169) -> (continuation of Deferred@1750425131 after retry RPC after error@602820409) -> (continuation of Deferred@999625582 after retry RPC after error@811240143) -> (continuation of Deferred@1924939497 after retry RPC after error@595210240) -> (continuation of Deferred@820463970 after retry RPC after error@1418703171) -> (continuation of Deferred@1205306957 after retry RPC after error@895435911) -> (continuation of Deferred@1073329943 after retry RPC after error@383065090) -> (continuation of Deferred@1842025851 after retry RPC after error@578752313) -> (continuation of Deferred@1355564398 after retry RPC after error@1850173049) -> (continuation of Deferred@1536345607 after retry RPC after error@21896331), errback=(continuation of Deferred@1713895644 after retry RPC after error@1433697874) -> (continuation of Deferred@1059328893 after retry RPC after error@1252108836) -> (continuation of Deferred@320428724 after retry RPC after error@1709781099) -> (continuation of Deferred@2051635280 after retry RPC after error@1040059831) -> (continuation of Deferred@1693137990 after retry RPC after error@1219306200) -> (continuation of Deferred@2031568997 after retry RPC after error@877228357) -> (continuation of Deferred@167604870 after retry RPC after error@686242435) -> (continuation of Deferred@1810893722 after retry RPC after error@340565240) -> (continuation of Deferred@1984411061 after retry RPC after error@1734716124) -> (continuation of Deferred@203608433 after retry RPC after error@2096707409) -> (continuation of Deferred@928571238 after retry RPC after error@2099359771) -> (continuation of Deferred@1729257367 after retry RPC after error@1382330267) -> (continuation of Deferred@599189854 after retry RPC after error@1407657051) -> (continuation of Deferred@654063447 after retry RPC after error@1368611940) -> (continuation of Deferred@1174123281 after retry RPC after error@802460169) -> (continuation of Deferred@1750425131 after retry RPC after error@602820409) -> (continuation of Deferred@999625582 after retry RPC after error@811240143) -> (continuation of Deferred@1924939497 after retry RPC after error@595210240) -> (continuation of Deferred@820463970 after retry RPC after error@1418703171) -> (continuation of Deferred@1205306957 after retry RPC after error@895435911) -> (continuation of Deferred@1073329943 after retry RPC after error@383065090) -> (continuation of Deferred@1842025851 after retry RPC after error@578752313) -> (continuation of Deferred@1355564398 after retry RPC after error@1850173049) -> (continuation of Deferred@1536345607 after retry RPC after error@21896331)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:22.627 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
18:33:22.627 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
18:33:22.627 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9) switched from state RUNNING to RESTARTING.
18:33:22.627 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:22.727 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:22.756 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:22.756 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:22.757 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:22.757 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:22.757 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:22.757 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:22.757 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:22.757 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:22.757 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:22.757 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:22.757 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:22.757 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:22.757 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:22.763 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:22.763 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:22.764 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:22.764 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:22.764 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:22.764 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:22.764 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:22.764 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:22.764 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:22.764 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:22.764 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:22.764 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:22.764 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:22.821 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:22.829 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:22.829 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:22.829 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:22.829 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:22.829 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:22.829 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:22.829 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:22.829 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:22.829 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:22.829 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:22.829 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:22.830 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:22.830 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:22.831 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:22.831 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:22.831 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:22.831 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:22.831 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:22.831 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:22.831 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:22.831 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:22.831 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:22.832 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:22.832 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:22.832 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:22.832 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:22.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:22.902058  6396 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:33:22.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:22.902748  6396 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:33:22.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:22.903558  6396 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:33:22.905 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:22.934 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:22.934 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:22.934 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:22.935 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:22.935 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:22.935 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:22.935 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:22.935 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:22.935 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:22.935 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:22.935 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:22.935 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:22.935 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:22.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:22.944887  6396 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:33:22.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:22.945837  6396 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.136.3
18:33:22.946 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:22.946 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:22.947 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:22.947 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:22.947 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:22.947 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:22.947 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:22.947 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:22.947 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:22.947 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:22.947 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:22.947 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:22.947 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:22.965 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:22.965 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:22.966 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:22.966 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:22.966 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:22.966 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:22.966 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:22.966 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:22.966 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:22.966 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:22.966 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:22.966 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:22.966 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.989056  6396 tablet_server_runner.cc:78] Tablet server non-default flags:
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.5.136.20:33349
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/data
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/wal
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.5.136.3:0
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/data/info.pb
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.5.136.3
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.5.136.62:42905,127.5.136.61:43625,127.5.136.60:39171
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.5.136.3
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/logs
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:33:22.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:33:22.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:33:22.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:33:22.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:33:22.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:33:22.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:33:22.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.990473  6396 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:33:22.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:22.992228  6396 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:33:23.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:23.009411  6404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:23.016 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:23.016 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:23.016 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:23.017 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:23.017 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:23.017 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:23.017 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:23.017 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:23.017 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:23.017 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:23.017 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:23.017 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:23.017 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:23.017 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26902), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [23ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [57ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [65ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [65ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [88ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [89ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [90ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [91ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [105ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [106ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [106ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [106ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [123ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [142ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [185ms] refreshing cache from master, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [190ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [191ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [192ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [192ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [323ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [330ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [330ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [481ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [482ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [482ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [482ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [962ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [962ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [962ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [962ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1062ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2340ms] refreshing cache from master, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2342ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2960ms] refreshing cache from master, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2962ms] too many traces: truncated at 100 traces, deferred=Deferred@1990600750(state=PENDING, result=null, callback=(continuation of Deferred@1933726097 after retry RPC after error@132462169) -> (continuation of Deferred@654193719 after retry RPC after error@1633587102) -> (continuation of Deferred@15832317 after retry RPC after error@772291908) -> (continuation of Deferred@2038496062 after retry RPC after error@1815587311) -> (continuation of Deferred@1626185448 after retry RPC after error@266366380) -> (continuation of Deferred@1908878949 after retry RPC after error@552507747) -> (continuation of Deferred@754469192 after retry RPC after error@553245814) -> (continuation of Deferred@1753573898 after retry RPC after error@1014289400) -> (continuation of Deferred@1386770231 after retry RPC after error@1012667256) -> (continuation of Deferred@2135616451 after retry RPC after error@1698372801) -> (continuation of Deferred@1962608262 after retry RPC after error@677383346) -> (continuation of Deferred@6094478 after retry RPC after error@1035741008) -> (continuation of Deferred@291490135 after retry RPC after error@972178002) -> (continuation of Deferred@1581081452 after retry RPC after error@48712028) -> (continuation of Deferred@1839017254 after retry RPC after error@1188434453) -> (continuation of Deferred@1933914016 after retry RPC after error@1271932221) -> (continuation of Deferred@1335936380 after retry RPC after error@965746727) -> (continuation of Deferred@1676812442 after retry RPC after error@700516372) -> (continuation of Deferred@1619239797 after retry RPC after error@1479161434) -> (continuation of Deferred@716057397 after retry RPC after error@185472988) -> (continuation of Deferred@1986762179 after retry RPC after error@2138760626) -> (continuation of Deferred@609652459 after retry RPC after error@1595788618) -> (continuation of Deferred@1978834663 after retry RPC after error@1569563294) -> (continuation of Deferred@1295797778 after retry RPC after error@2088414562), errback=(continuation of Deferred@1933726097 after retry RPC after error@132462169) -> (continuation of Deferred@654193719 after retry RPC after error@1633587102) -> (continuation of Deferred@15832317 after retry RPC after error@772291908) -> (continuation of Deferred@2038496062 after retry RPC after error@1815587311) -> (continuation of Deferred@1626185448 after retry RPC after error@266366380) -> (continuation of Deferred@1908878949 after retry RPC after error@552507747) -> (continuation of Deferred@754469192 after retry RPC after error@553245814) -> (continuation of Deferred@1753573898 after retry RPC after error@1014289400) -> (continuation of Deferred@1386770231 after retry RPC after error@1012667256) -> (continuation of Deferred@2135616451 after retry RPC after error@1698372801) -> (continuation of Deferred@1962608262 after retry RPC after error@677383346) -> (continuation of Deferred@6094478 after retry RPC after error@1035741008) -> (continuation of Deferred@291490135 after retry RPC after error@972178002) -> (continuation of Deferred@1581081452 after retry RPC after error@48712028) -> (continuation of Deferred@1839017254 after retry RPC after error@1188434453) -> (continuation of Deferred@1933914016 after retry RPC after error@1271932221) -> (continuation of Deferred@1335936380 after retry RPC after error@965746727) -> (continuation of Deferred@1676812442 after retry RPC after error@700516372) -> (continuation of Deferred@1619239797 after retry RPC after error@1479161434) -> (continuation of Deferred@716057397 after retry RPC after error@185472988) -> (continuation of Deferred@1986762179 after retry RPC after error@2138760626) -> (continuation of Deferred@609652459 after retry RPC after error@1595788618) -> (continuation of Deferred@1978834663 after retry RPC after error@1569563294) -> (continuation of Deferred@1295797778 after retry RPC after error@2088414562)))
18:33:23.018 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:33:23.019 [WARN - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26902), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [23ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [57ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [65ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [65ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [88ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [89ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [90ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [91ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [105ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [106ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [106ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [106ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [123ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [142ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [185ms] refreshing cache from master, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [190ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [191ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [192ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [192ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [323ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [330ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [330ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [481ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [482ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [482ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [482ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [962ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [962ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [962ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [962ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1062ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2340ms] refreshing cache from master, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2342ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2960ms] refreshing cache from master, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2962ms] too many traces: truncated at 100 traces, deferred=Deferred@1990600750(state=PENDING, result=null, callback=(continuation of Deferred@1933726097 after retry RPC after error@132462169) -> (continuation of Deferred@654193719 after retry RPC after error@1633587102) -> (continuation of Deferred@15832317 after retry RPC after error@772291908) -> (continuation of Deferred@2038496062 after retry RPC after error@1815587311) -> (continuation of Deferred@1626185448 after retry RPC after error@266366380) -> (continuation of Deferred@1908878949 after retry RPC after error@552507747) -> (continuation of Deferred@754469192 after retry RPC after error@553245814) -> (continuation of Deferred@1753573898 after retry RPC after error@1014289400) -> (continuation of Deferred@1386770231 after retry RPC after error@1012667256) -> (continuation of Deferred@2135616451 after retry RPC after error@1698372801) -> (continuation of Deferred@1962608262 after retry RPC after error@677383346) -> (continuation of Deferred@6094478 after retry RPC after error@1035741008) -> (continuation of Deferred@291490135 after retry RPC after error@972178002) -> (continuation of Deferred@1581081452 after retry RPC after error@48712028) -> (continuation of Deferred@1839017254 after retry RPC after error@1188434453) -> (continuation of Deferred@1933914016 after retry RPC after error@1271932221) -> (continuation of Deferred@1335936380 after retry RPC after error@965746727) -> (continuation of Deferred@1676812442 after retry RPC after error@700516372) -> (continuation of Deferred@1619239797 after retry RPC after error@1479161434) -> (continuation of Deferred@716057397 after retry RPC after error@185472988) -> (continuation of Deferred@1986762179 after retry RPC after error@2138760626) -> (continuation of Deferred@609652459 after retry RPC after error@1595788618) -> (continuation of Deferred@1978834663 after retry RPC after error@1569563294) -> (continuation of Deferred@1295797778 after retry RPC after error@2088414562), errback=(continuation of Deferred@1933726097 after retry RPC after error@132462169) -> (continuation of Deferred@654193719 after retry RPC after error@1633587102) -> (continuation of Deferred@15832317 after retry RPC after error@772291908) -> (continuation of Deferred@2038496062 after retry RPC after error@1815587311) -> (continuation of Deferred@1626185448 after retry RPC after error@266366380) -> (continuation of Deferred@1908878949 after retry RPC after error@552507747) -> (continuation of Deferred@754469192 after retry RPC after error@553245814) -> (continuation of Deferred@1753573898 after retry RPC after error@1014289400) -> (continuation of Deferred@1386770231 after retry RPC after error@1012667256) -> (continuation of Deferred@2135616451 after retry RPC after error@1698372801) -> (continuation of Deferred@1962608262 after retry RPC after error@677383346) -> (continuation of Deferred@6094478 after retry RPC after error@1035741008) -> (continuation of Deferred@291490135 after retry RPC after error@972178002) -> (continuation of Deferred@1581081452 after retry RPC after error@48712028) -> (continuation of Deferred@1839017254 after retry RPC after error@1188434453) -> (continuation of Deferred@1933914016 after retry RPC after error@1271932221) -> (continuation of Deferred@1335936380 after retry RPC after error@965746727) -> (continuation of Deferred@1676812442 after retry RPC after error@700516372) -> (continuation of Deferred@1619239797 after retry RPC after error@1479161434) -> (continuation of Deferred@716057397 after retry RPC after error@185472988) -> (continuation of Deferred@1986762179 after retry RPC after error@2138760626) -> (continuation of Deferred@609652459 after retry RPC after error@1595788618) -> (continuation of Deferred@1978834663 after retry RPC after error@1569563294) -> (continuation of Deferred@1295797778 after retry RPC after error@2088414562)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:23.019 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
18:33:23.021 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
18:33:23.023 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to FAILED on 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26902), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [23ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [57ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [65ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [65ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [88ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [89ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [90ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [91ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [105ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [106ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [106ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [106ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [123ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [142ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [185ms] refreshing cache from master, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [190ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [191ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [192ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [192ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [323ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [330ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [330ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [481ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [482ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [482ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [482ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [962ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [962ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [962ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [962ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1062ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2340ms] refreshing cache from master, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2342ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2342ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2960ms] refreshing cache from master, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2962ms] too many traces: truncated at 100 traces, deferred=Deferred@1990600750(state=PENDING, result=null, callback=(continuation of Deferred@1933726097 after retry RPC after error@132462169) -> (continuation of Deferred@654193719 after retry RPC after error@1633587102) -> (continuation of Deferred@15832317 after retry RPC after error@772291908) -> (continuation of Deferred@2038496062 after retry RPC after error@1815587311) -> (continuation of Deferred@1626185448 after retry RPC after error@266366380) -> (continuation of Deferred@1908878949 after retry RPC after error@552507747) -> (continuation of Deferred@754469192 after retry RPC after error@553245814) -> (continuation of Deferred@1753573898 after retry RPC after error@1014289400) -> (continuation of Deferred@1386770231 after retry RPC after error@1012667256) -> (continuation of Deferred@2135616451 after retry RPC after error@1698372801) -> (continuation of Deferred@1962608262 after retry RPC after error@677383346) -> (continuation of Deferred@6094478 after retry RPC after error@1035741008) -> (continuation of Deferred@291490135 after retry RPC after error@972178002) -> (continuation of Deferred@1581081452 after retry RPC after error@48712028) -> (continuation of Deferred@1839017254 after retry RPC after error@1188434453) -> (continuation of Deferred@1933914016 after retry RPC after error@1271932221) -> (continuation of Deferred@1335936380 after retry RPC after error@965746727) -> (continuation of Deferred@1676812442 after retry RPC after error@700516372) -> (continuation of Deferred@1619239797 after retry RPC after error@1479161434) -> (continuation of Deferred@716057397 after retry RPC after error@185472988) -> (continuation of Deferred@1986762179 after retry RPC after error@2138760626) -> (continuation of Deferred@609652459 after retry RPC after error@1595788618) -> (continuation of Deferred@1978834663 after retry RPC after error@1569563294) -> (continuation of Deferred@1295797778 after retry RPC after error@2088414562), errback=(continuation of Deferred@1933726097 after retry RPC after error@132462169) -> (continuation of Deferred@654193719 after retry RPC after error@1633587102) -> (continuation of Deferred@15832317 after retry RPC after error@772291908) -> (continuation of Deferred@2038496062 after retry RPC after error@1815587311) -> (continuation of Deferred@1626185448 after retry RPC after error@266366380) -> (continuation of Deferred@1908878949 after retry RPC after error@552507747) -> (continuation of Deferred@754469192 after retry RPC after error@553245814) -> (continuation of Deferred@1753573898 after retry RPC after error@1014289400) -> (continuation of Deferred@1386770231 after retry RPC after error@1012667256) -> (continuation of Deferred@2135616451 after retry RPC after error@1698372801) -> (continuation of Deferred@1962608262 after retry RPC after error@677383346) -> (continuation of Deferred@6094478 after retry RPC after error@1035741008) -> (continuation of Deferred@291490135 after retry RPC after error@972178002) -> (continuation of Deferred@1581081452 after retry RPC after error@48712028) -> (continuation of Deferred@1839017254 after retry RPC after error@1188434453) -> (continuation of Deferred@1933914016 after retry RPC after error@1271932221) -> (continuation of Deferred@1335936380 after retry RPC after error@965746727) -> (continuation of Deferred@1676812442 after retry RPC after error@700516372) -> (continuation of Deferred@1619239797 after retry RPC after error@1479161434) -> (continuation of Deferred@716057397 after retry RPC after error@185472988) -> (continuation of Deferred@1986762179 after retry RPC after error@2138760626) -> (continuation of Deferred@609652459 after retry RPC after error@1595788618) -> (continuation of Deferred@1978834663 after retry RPC after error@1569563294) -> (continuation of Deferred@1295797778 after retry RPC after error@2088414562)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:23.024 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
18:33:23.024 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:33:23.026 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
18:33:23.227 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:23.317 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:23.317 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:23.317 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:23.318 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:23.318 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:23.318 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:23.318 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:23.318 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:23.318 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:23.319 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:23.319 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:23.319 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:23.319 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:23.322 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:23.377 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:23.377 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:23.377 [DEBUG - pool-284-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:23.378 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:23.378 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:23.378 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:23.378 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:23.378 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:23.378 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:23.378 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:23.378 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:23.378 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:23.379 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:23.379 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27250), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [22ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [24ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [25ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [25ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [61ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [63ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [63ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [95ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [98ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [98ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [99ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [103ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [103ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [104ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [104ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [121ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [123ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [165ms] refreshing cache from master, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [166ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [169ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [169ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [170ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [243ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [302ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [307ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [308ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [314ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [314ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [443ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [443ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [443ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [444ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [881ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [882ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [882ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [883ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1080ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1082ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1163ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2340ms] refreshing cache from master, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2342ms] too many traces: truncated at 100 traces, deferred=Deferred@910347910(state=PENDING, result=null, callback=(continuation of Deferred@740283481 after retry RPC after error@641214818) -> (continuation of Deferred@1430530402 after retry RPC after error@1968372658) -> (continuation of Deferred@658326621 after retry RPC after error@1076431585) -> (continuation of Deferred@886191295 after retry RPC after error@1447020284) -> (continuation of Deferred@468545482 after retry RPC after error@328929364) -> (continuation of Deferred@919185748 after retry RPC after error@518619479) -> (continuation of Deferred@1846161023 after retry RPC after error@634948186) -> (continuation of Deferred@1579160764 after retry RPC after error@210883862) -> (continuation of Deferred@869755693 after retry RPC after error@1379708247) -> (continuation of Deferred@208127576 after retry RPC after error@240950183) -> (continuation of Deferred@114956098 after retry RPC after error@834360539) -> (continuation of Deferred@64750002 after retry RPC after error@1773609933) -> (continuation of Deferred@1057053118 after retry RPC after error@1425526537) -> (continuation of Deferred@935695796 after retry RPC after error@1732014538) -> (continuation of Deferred@1388648506 after retry RPC after error@941628140) -> (continuation of Deferred@592658537 after retry RPC after error@660985832) -> (continuation of Deferred@1562054646 after retry RPC after error@1708431811) -> (continuation of Deferred@1547558168 after retry RPC after error@1433312224) -> (continuation of Deferred@1343183364 after retry RPC after error@290773831) -> (continuation of Deferred@590545256 after retry RPC after error@35860341) -> (continuation of Deferred@676764239 after retry RPC after error@535818977) -> (continuation of Deferred@611092533 after retry RPC after error@1068450634) -> (continuation of Deferred@599204370 after retry RPC after error@1135588479) -> (continuation of Deferred@54698271 after retry RPC after error@1186072366), errback=(continuation of Deferred@740283481 after retry RPC after error@641214818) -> (continuation of Deferred@1430530402 after retry RPC after error@1968372658) -> (continuation of Deferred@658326621 after retry RPC after error@1076431585) -> (continuation of Deferred@886191295 after retry RPC after error@1447020284) -> (continuation of Deferred@468545482 after retry RPC after error@328929364) -> (continuation of Deferred@919185748 after retry RPC after error@518619479) -> (continuation of Deferred@1846161023 after retry RPC after error@634948186) -> (continuation of Deferred@1579160764 after retry RPC after error@210883862) -> (continuation of Deferred@869755693 after retry RPC after error@1379708247) -> (continuation of Deferred@208127576 after retry RPC after error@240950183) -> (continuation of Deferred@114956098 after retry RPC after error@834360539) -> (continuation of Deferred@64750002 after retry RPC after error@1773609933) -> (continuation of Deferred@1057053118 after retry RPC after error@1425526537) -> (continuation of Deferred@935695796 after retry RPC after error@1732014538) -> (continuation of Deferred@1388648506 after retry RPC after error@941628140) -> (continuation of Deferred@592658537 after retry RPC after error@660985832) -> (continuation of Deferred@1562054646 after retry RPC after error@1708431811) -> (continuation of Deferred@1547558168 after retry RPC after error@1433312224) -> (continuation of Deferred@1343183364 after retry RPC after error@290773831) -> (continuation of Deferred@590545256 after retry RPC after error@35860341) -> (continuation of Deferred@676764239 after retry RPC after error@535818977) -> (continuation of Deferred@611092533 after retry RPC after error@1068450634) -> (continuation of Deferred@599204370 after retry RPC after error@1135588479) -> (continuation of Deferred@54698271 after retry RPC after error@1186072366)))
18:33:23.380 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:33:23.381 [WARN - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27250), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [22ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [24ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [25ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [25ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [61ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [63ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [63ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [95ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [98ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [98ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [99ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [103ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [103ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [104ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [104ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [121ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [123ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [165ms] refreshing cache from master, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [166ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [169ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [169ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [170ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [243ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [302ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [307ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [308ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [314ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [314ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [443ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [443ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [443ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [444ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [881ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [882ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [882ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [883ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1080ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1082ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1163ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2340ms] refreshing cache from master, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2342ms] too many traces: truncated at 100 traces, deferred=Deferred@910347910(state=PENDING, result=null, callback=(continuation of Deferred@740283481 after retry RPC after error@641214818) -> (continuation of Deferred@1430530402 after retry RPC after error@1968372658) -> (continuation of Deferred@658326621 after retry RPC after error@1076431585) -> (continuation of Deferred@886191295 after retry RPC after error@1447020284) -> (continuation of Deferred@468545482 after retry RPC after error@328929364) -> (continuation of Deferred@919185748 after retry RPC after error@518619479) -> (continuation of Deferred@1846161023 after retry RPC after error@634948186) -> (continuation of Deferred@1579160764 after retry RPC after error@210883862) -> (continuation of Deferred@869755693 after retry RPC after error@1379708247) -> (continuation of Deferred@208127576 after retry RPC after error@240950183) -> (continuation of Deferred@114956098 after retry RPC after error@834360539) -> (continuation of Deferred@64750002 after retry RPC after error@1773609933) -> (continuation of Deferred@1057053118 after retry RPC after error@1425526537) -> (continuation of Deferred@935695796 after retry RPC after error@1732014538) -> (continuation of Deferred@1388648506 after retry RPC after error@941628140) -> (continuation of Deferred@592658537 after retry RPC after error@660985832) -> (continuation of Deferred@1562054646 after retry RPC after error@1708431811) -> (continuation of Deferred@1547558168 after retry RPC after error@1433312224) -> (continuation of Deferred@1343183364 after retry RPC after error@290773831) -> (continuation of Deferred@590545256 after retry RPC after error@35860341) -> (continuation of Deferred@676764239 after retry RPC after error@535818977) -> (continuation of Deferred@611092533 after retry RPC after error@1068450634) -> (continuation of Deferred@599204370 after retry RPC after error@1135588479) -> (continuation of Deferred@54698271 after retry RPC after error@1186072366), errback=(continuation of Deferred@740283481 after retry RPC after error@641214818) -> (continuation of Deferred@1430530402 after retry RPC after error@1968372658) -> (continuation of Deferred@658326621 after retry RPC after error@1076431585) -> (continuation of Deferred@886191295 after retry RPC after error@1447020284) -> (continuation of Deferred@468545482 after retry RPC after error@328929364) -> (continuation of Deferred@919185748 after retry RPC after error@518619479) -> (continuation of Deferred@1846161023 after retry RPC after error@634948186) -> (continuation of Deferred@1579160764 after retry RPC after error@210883862) -> (continuation of Deferred@869755693 after retry RPC after error@1379708247) -> (continuation of Deferred@208127576 after retry RPC after error@240950183) -> (continuation of Deferred@114956098 after retry RPC after error@834360539) -> (continuation of Deferred@64750002 after retry RPC after error@1773609933) -> (continuation of Deferred@1057053118 after retry RPC after error@1425526537) -> (continuation of Deferred@935695796 after retry RPC after error@1732014538) -> (continuation of Deferred@1388648506 after retry RPC after error@941628140) -> (continuation of Deferred@592658537 after retry RPC after error@660985832) -> (continuation of Deferred@1562054646 after retry RPC after error@1708431811) -> (continuation of Deferred@1547558168 after retry RPC after error@1433312224) -> (continuation of Deferred@1343183364 after retry RPC after error@290773831) -> (continuation of Deferred@590545256 after retry RPC after error@35860341) -> (continuation of Deferred@676764239 after retry RPC after error@535818977) -> (continuation of Deferred@611092533 after retry RPC after error@1068450634) -> (continuation of Deferred@599204370 after retry RPC after error@1135588479) -> (continuation of Deferred@54698271 after retry RPC after error@1186072366)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:23.381 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
18:33:23.383 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#2 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
18:33:23.388 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to FAILED on 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27250), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [22ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [24ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [25ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [25ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [61ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [63ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [63ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [95ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [98ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [98ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [99ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [103ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [103ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [104ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [104ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [121ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [123ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [165ms] refreshing cache from master, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [166ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [169ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [169ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [170ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [243ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [302ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [307ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [308ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [314ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [314ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [443ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [443ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [443ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [444ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [881ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [882ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [882ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [883ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1080ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1082ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1163ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2340ms] refreshing cache from master, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2342ms] too many traces: truncated at 100 traces, deferred=Deferred@910347910(state=PENDING, result=null, callback=(continuation of Deferred@740283481 after retry RPC after error@641214818) -> (continuation of Deferred@1430530402 after retry RPC after error@1968372658) -> (continuation of Deferred@658326621 after retry RPC after error@1076431585) -> (continuation of Deferred@886191295 after retry RPC after error@1447020284) -> (continuation of Deferred@468545482 after retry RPC after error@328929364) -> (continuation of Deferred@919185748 after retry RPC after error@518619479) -> (continuation of Deferred@1846161023 after retry RPC after error@634948186) -> (continuation of Deferred@1579160764 after retry RPC after error@210883862) -> (continuation of Deferred@869755693 after retry RPC after error@1379708247) -> (continuation of Deferred@208127576 after retry RPC after error@240950183) -> (continuation of Deferred@114956098 after retry RPC after error@834360539) -> (continuation of Deferred@64750002 after retry RPC after error@1773609933) -> (continuation of Deferred@1057053118 after retry RPC after error@1425526537) -> (continuation of Deferred@935695796 after retry RPC after error@1732014538) -> (continuation of Deferred@1388648506 after retry RPC after error@941628140) -> (continuation of Deferred@592658537 after retry RPC after error@660985832) -> (continuation of Deferred@1562054646 after retry RPC after error@1708431811) -> (continuation of Deferred@1547558168 after retry RPC after error@1433312224) -> (continuation of Deferred@1343183364 after retry RPC after error@290773831) -> (continuation of Deferred@590545256 after retry RPC after error@35860341) -> (continuation of Deferred@676764239 after retry RPC after error@535818977) -> (continuation of Deferred@611092533 after retry RPC after error@1068450634) -> (continuation of Deferred@599204370 after retry RPC after error@1135588479) -> (continuation of Deferred@54698271 after retry RPC after error@1186072366), errback=(continuation of Deferred@740283481 after retry RPC after error@641214818) -> (continuation of Deferred@1430530402 after retry RPC after error@1968372658) -> (continuation of Deferred@658326621 after retry RPC after error@1076431585) -> (continuation of Deferred@886191295 after retry RPC after error@1447020284) -> (continuation of Deferred@468545482 after retry RPC after error@328929364) -> (continuation of Deferred@919185748 after retry RPC after error@518619479) -> (continuation of Deferred@1846161023 after retry RPC after error@634948186) -> (continuation of Deferred@1579160764 after retry RPC after error@210883862) -> (continuation of Deferred@869755693 after retry RPC after error@1379708247) -> (continuation of Deferred@208127576 after retry RPC after error@240950183) -> (continuation of Deferred@114956098 after retry RPC after error@834360539) -> (continuation of Deferred@64750002 after retry RPC after error@1773609933) -> (continuation of Deferred@1057053118 after retry RPC after error@1425526537) -> (continuation of Deferred@935695796 after retry RPC after error@1732014538) -> (continuation of Deferred@1388648506 after retry RPC after error@941628140) -> (continuation of Deferred@592658537 after retry RPC after error@660985832) -> (continuation of Deferred@1562054646 after retry RPC after error@1708431811) -> (continuation of Deferred@1547558168 after retry RPC after error@1433312224) -> (continuation of Deferred@1343183364 after retry RPC after error@290773831) -> (continuation of Deferred@590545256 after retry RPC after error@35860341) -> (continuation of Deferred@676764239 after retry RPC after error@535818977) -> (continuation of Deferred@611092533 after retry RPC after error@1068450634) -> (continuation of Deferred@599204370 after retry RPC after error@1135588479) -> (continuation of Deferred@54698271 after retry RPC after error@1186072366)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:23.389 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:33:23.389 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
18:33:23.389 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#2) of source Source: KuduSource.
18:33:23.408 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:23.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:23.537101  6388 heartbeater.cc:499] Master 127.5.136.62:42905 was elected leader, sending a full tablet report...
18:33:23.569 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:23.569 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:23.569 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:23.570 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:23.570 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:23.570 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:23.570 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:23.570 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:23.570 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:23.571 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:23.571 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:23.571 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:23.571 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:23.572 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:23.572 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:23.572 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:23.572 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:23.573 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:23.573 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:23.573 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:23.573 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:23.573 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:23.574 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:23.574 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:23.574 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:23.574 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:23.727 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:23.756 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:23.757 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:23.757 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:23.758 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:23.758 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:23.758 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:23.758 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:23.758 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:23.758 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:23.759 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:23.759 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:23.759 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:23.759 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:23.822 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:23.906 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:23.952 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:23.953 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:23.953 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:23.953 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:23.954 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:23.954 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:23.954 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:23.954 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:23.954 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:23.955 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:23.955 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:23.955 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:23.955 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:24.100 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:24.100 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:24.100 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:24.101 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.101 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.101 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.101 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.101 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.102 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.102 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.102 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.102 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.102 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:24.103 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27978), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [51ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [53ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [54ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [54ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [73ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [73ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [75ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [75ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [85ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [93ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [94ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [94ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [166ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [167ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [167ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [182ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [182ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [201ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [202ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [263ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [264ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [264ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [321ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [323ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [323ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [541ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [541ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [542ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [542ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [861ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [862ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [863ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [863ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1060ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1062ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2560ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2562ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [5660ms] refreshing cache from master, [5660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [5661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [5662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [5663ms] too many traces: truncated at 100 traces, deferred=Deferred@1982390489(state=PENDING, result=null, callback=(continuation of Deferred@1194747440 after retry RPC after error@1578442203) -> (continuation of Deferred@647488508 after retry RPC after error@394846687) -> (continuation of Deferred@1669006072 after retry RPC after error@368451721) -> (continuation of Deferred@216512968 after retry RPC after error@1546725266) -> (continuation of Deferred@1734771246 after retry RPC after error@1135612963) -> (continuation of Deferred@1923664996 after retry RPC after error@661682196) -> (continuation of Deferred@1951721766 after retry RPC after error@931588739) -> (continuation of Deferred@58313723 after retry RPC after error@669885272) -> (continuation of Deferred@1956864858 after retry RPC after error@1953582527) -> (continuation of Deferred@966424281 after retry RPC after error@1931998673) -> (continuation of Deferred@485613916 after retry RPC after error@1645435848) -> (continuation of Deferred@139838957 after retry RPC after error@1141911627) -> (continuation of Deferred@1475924628 after retry RPC after error@801971896) -> (continuation of Deferred@152161281 after retry RPC after error@1288054528) -> (continuation of Deferred@1572544638 after retry RPC after error@449109423) -> (continuation of Deferred@498236210 after retry RPC after error@1622258083) -> (continuation of Deferred@1678628123 after retry RPC after error@1486378384) -> (continuation of Deferred@1459474010 after retry RPC after error@992756111) -> (continuation of Deferred@830729980 after retry RPC after error@732760457) -> (continuation of Deferred@320511416 after retry RPC after error@1248036461) -> (continuation of Deferred@1689875923 after retry RPC after error@656136588), errback=(continuation of Deferred@1194747440 after retry RPC after error@1578442203) -> (continuation of Deferred@647488508 after retry RPC after error@394846687) -> (continuation of Deferred@1669006072 after retry RPC after error@368451721) -> (continuation of Deferred@216512968 after retry RPC after error@1546725266) -> (continuation of Deferred@1734771246 after retry RPC after error@1135612963) -> (continuation of Deferred@1923664996 after retry RPC after error@661682196) -> (continuation of Deferred@1951721766 after retry RPC after error@931588739) -> (continuation of Deferred@58313723 after retry RPC after error@669885272) -> (continuation of Deferred@1956864858 after retry RPC after error@1953582527) -> (continuation of Deferred@966424281 after retry RPC after error@1931998673) -> (continuation of Deferred@485613916 after retry RPC after error@1645435848) -> (continuation of Deferred@139838957 after retry RPC after error@1141911627) -> (continuation of Deferred@1475924628 after retry RPC after error@801971896) -> (continuation of Deferred@152161281 after retry RPC after error@1288054528) -> (continuation of Deferred@1572544638 after retry RPC after error@449109423) -> (continuation of Deferred@498236210 after retry RPC after error@1622258083) -> (continuation of Deferred@1678628123 after retry RPC after error@1486378384) -> (continuation of Deferred@1459474010 after retry RPC after error@992756111) -> (continuation of Deferred@830729980 after retry RPC after error@732760457) -> (continuation of Deferred@320511416 after retry RPC after error@1248036461) -> (continuation of Deferred@1689875923 after retry RPC after error@656136588)))
18:33:24.104 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:33:24.104 [WARN - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27978), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [51ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [53ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [54ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [54ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [73ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [73ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [75ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [75ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [85ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [93ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [94ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [94ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [166ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [167ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [167ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [182ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [182ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [201ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [202ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [263ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [264ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [264ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [321ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [323ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [323ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [541ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [541ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [542ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [542ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [861ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [862ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [863ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [863ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1060ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1062ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2560ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2562ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [5660ms] refreshing cache from master, [5660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [5661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [5662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [5663ms] too many traces: truncated at 100 traces, deferred=Deferred@1982390489(state=PENDING, result=null, callback=(continuation of Deferred@1194747440 after retry RPC after error@1578442203) -> (continuation of Deferred@647488508 after retry RPC after error@394846687) -> (continuation of Deferred@1669006072 after retry RPC after error@368451721) -> (continuation of Deferred@216512968 after retry RPC after error@1546725266) -> (continuation of Deferred@1734771246 after retry RPC after error@1135612963) -> (continuation of Deferred@1923664996 after retry RPC after error@661682196) -> (continuation of Deferred@1951721766 after retry RPC after error@931588739) -> (continuation of Deferred@58313723 after retry RPC after error@669885272) -> (continuation of Deferred@1956864858 after retry RPC after error@1953582527) -> (continuation of Deferred@966424281 after retry RPC after error@1931998673) -> (continuation of Deferred@485613916 after retry RPC after error@1645435848) -> (continuation of Deferred@139838957 after retry RPC after error@1141911627) -> (continuation of Deferred@1475924628 after retry RPC after error@801971896) -> (continuation of Deferred@152161281 after retry RPC after error@1288054528) -> (continuation of Deferred@1572544638 after retry RPC after error@449109423) -> (continuation of Deferred@498236210 after retry RPC after error@1622258083) -> (continuation of Deferred@1678628123 after retry RPC after error@1486378384) -> (continuation of Deferred@1459474010 after retry RPC after error@992756111) -> (continuation of Deferred@830729980 after retry RPC after error@732760457) -> (continuation of Deferred@320511416 after retry RPC after error@1248036461) -> (continuation of Deferred@1689875923 after retry RPC after error@656136588), errback=(continuation of Deferred@1194747440 after retry RPC after error@1578442203) -> (continuation of Deferred@647488508 after retry RPC after error@394846687) -> (continuation of Deferred@1669006072 after retry RPC after error@368451721) -> (continuation of Deferred@216512968 after retry RPC after error@1546725266) -> (continuation of Deferred@1734771246 after retry RPC after error@1135612963) -> (continuation of Deferred@1923664996 after retry RPC after error@661682196) -> (continuation of Deferred@1951721766 after retry RPC after error@931588739) -> (continuation of Deferred@58313723 after retry RPC after error@669885272) -> (continuation of Deferred@1956864858 after retry RPC after error@1953582527) -> (continuation of Deferred@966424281 after retry RPC after error@1931998673) -> (continuation of Deferred@485613916 after retry RPC after error@1645435848) -> (continuation of Deferred@139838957 after retry RPC after error@1141911627) -> (continuation of Deferred@1475924628 after retry RPC after error@801971896) -> (continuation of Deferred@152161281 after retry RPC after error@1288054528) -> (continuation of Deferred@1572544638 after retry RPC after error@449109423) -> (continuation of Deferred@498236210 after retry RPC after error@1622258083) -> (continuation of Deferred@1678628123 after retry RPC after error@1486378384) -> (continuation of Deferred@1459474010 after retry RPC after error@992756111) -> (continuation of Deferred@830729980 after retry RPC after error@732760457) -> (continuation of Deferred@320511416 after retry RPC after error@1248036461) -> (continuation of Deferred@1689875923 after retry RPC after error@656136588)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:24.105 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
18:33:24.108 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
18:33:24.111 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to FAILED on 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27978), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [51ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [53ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [54ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [54ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [73ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [73ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [75ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [75ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [85ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [93ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [94ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [94ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [166ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [167ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [167ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [182ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [182ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [201ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [202ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [263ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [264ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [264ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [321ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [323ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [323ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [541ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [541ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [542ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [542ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [861ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [862ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [863ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [863ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1060ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1062ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2560ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2562ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [5660ms] refreshing cache from master, [5660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [5661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [5662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [5663ms] too many traces: truncated at 100 traces, deferred=Deferred@1982390489(state=PENDING, result=null, callback=(continuation of Deferred@1194747440 after retry RPC after error@1578442203) -> (continuation of Deferred@647488508 after retry RPC after error@394846687) -> (continuation of Deferred@1669006072 after retry RPC after error@368451721) -> (continuation of Deferred@216512968 after retry RPC after error@1546725266) -> (continuation of Deferred@1734771246 after retry RPC after error@1135612963) -> (continuation of Deferred@1923664996 after retry RPC after error@661682196) -> (continuation of Deferred@1951721766 after retry RPC after error@931588739) -> (continuation of Deferred@58313723 after retry RPC after error@669885272) -> (continuation of Deferred@1956864858 after retry RPC after error@1953582527) -> (continuation of Deferred@966424281 after retry RPC after error@1931998673) -> (continuation of Deferred@485613916 after retry RPC after error@1645435848) -> (continuation of Deferred@139838957 after retry RPC after error@1141911627) -> (continuation of Deferred@1475924628 after retry RPC after error@801971896) -> (continuation of Deferred@152161281 after retry RPC after error@1288054528) -> (continuation of Deferred@1572544638 after retry RPC after error@449109423) -> (continuation of Deferred@498236210 after retry RPC after error@1622258083) -> (continuation of Deferred@1678628123 after retry RPC after error@1486378384) -> (continuation of Deferred@1459474010 after retry RPC after error@992756111) -> (continuation of Deferred@830729980 after retry RPC after error@732760457) -> (continuation of Deferred@320511416 after retry RPC after error@1248036461) -> (continuation of Deferred@1689875923 after retry RPC after error@656136588), errback=(continuation of Deferred@1194747440 after retry RPC after error@1578442203) -> (continuation of Deferred@647488508 after retry RPC after error@394846687) -> (continuation of Deferred@1669006072 after retry RPC after error@368451721) -> (continuation of Deferred@216512968 after retry RPC after error@1546725266) -> (continuation of Deferred@1734771246 after retry RPC after error@1135612963) -> (continuation of Deferred@1923664996 after retry RPC after error@661682196) -> (continuation of Deferred@1951721766 after retry RPC after error@931588739) -> (continuation of Deferred@58313723 after retry RPC after error@669885272) -> (continuation of Deferred@1956864858 after retry RPC after error@1953582527) -> (continuation of Deferred@966424281 after retry RPC after error@1931998673) -> (continuation of Deferred@485613916 after retry RPC after error@1645435848) -> (continuation of Deferred@139838957 after retry RPC after error@1141911627) -> (continuation of Deferred@1475924628 after retry RPC after error@801971896) -> (continuation of Deferred@152161281 after retry RPC after error@1288054528) -> (continuation of Deferred@1572544638 after retry RPC after error@449109423) -> (continuation of Deferred@498236210 after retry RPC after error@1622258083) -> (continuation of Deferred@1678628123 after retry RPC after error@1486378384) -> (continuation of Deferred@1459474010 after retry RPC after error@992756111) -> (continuation of Deferred@830729980 after retry RPC after error@732760457) -> (continuation of Deferred@320511416 after retry RPC after error@1248036461) -> (continuation of Deferred@1689875923 after retry RPC after error@656136588)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:24.113 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
18:33:24.113 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 4cd649562a0f5305571102b5c888c5a9
18:33:24.116 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
18:33:24.227 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:24.314 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:24.315 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:24.315 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:24.315 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:24.315 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:24.315 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:24.315 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:24.315 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:24.315 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:24.315 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:24.315 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:24.316 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:24.316 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:24.322 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:24.369 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:24.369 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:24.369 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:24.369 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:24.369 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:24.369 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:24.369 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:24.369 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:24.369 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:24.370 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:24.370 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:24.370 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:24.370 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:24.388 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:24.389 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:24.389 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:24.389 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:24.389 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:24.389 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:24.390 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:24.390 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:24.390 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:24.390 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:24.390 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:24.390 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:24.390 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:24.405 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:23.010507  6405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:24.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:23.014343  6407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:24.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:24.490252  6406 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1477 milliseconds
18:33:24.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.490388  6396 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:33:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.491902  6396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:33:24.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.494722  6396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:33:24.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.496258  6396 hybrid_clock.cc:648] HybridClock initialized: now 1783535604496221 us; error 47 us; skew 500 ppm
18:33:24.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.497298  6396 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:33:24.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.504706  6396 webserver.cc:534] Webserver started at http://127.5.136.3:35111/ using document root <none> and password file <none>
18:33:24.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.505721  6396 fs_manager.cc:362] Metadata directory not provided
18:33:24.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.505908  6396 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:33:24.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.506400  6396 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:33:24.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.512034  6396 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/data/instance:
18:33:24.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bca326a30e144d5080c5b2dd919d9c4b"
18:33:24.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:24 on dist-test-slave-dxnw"
18:33:24.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.513152  6396 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/wal/instance:
18:33:24.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bca326a30e144d5080c5b2dd919d9c4b"
18:33:24.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:24 on dist-test-slave-dxnw"
18:33:24.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.521278  6396 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.000s
18:33:24.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.529338  6415 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:33:24.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.530673  6396 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
18:33:24.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.531054  6396 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/wal
18:33:24.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bca326a30e144d5080c5b2dd919d9c4b"
18:33:24.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:24 on dist-test-slave-dxnw"
18:33:24.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.531423  6396 fs_report.cc:389] FS layout report
18:33:24.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:33:24.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/wal
18:33:24.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/wal
18:33:24.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/data/data
18:33:24.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:33:24.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:33:24.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:33:24.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:33:24.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:33:24.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:33:24.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:33:24.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:33:24.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:33:24.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:33:24.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:33:24.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.621428  6396 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:33:24.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.623039  6396 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:33:24.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.623564  6396 kserver.cc:163] Server-wide thread pool size limit: 3276
18:33:24.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.626583  6396 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:33:24.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.631211  6396 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:33:24.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.631441  6396 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:33:24.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.631760  6396 ts_tablet_manager.cc:616] Registered 0 tablets
18:33:24.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.631963  6396 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:33:24.726 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:24.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.809993  6396 rpc_server.cc:307] RPC server started. Bound to: 127.5.136.3:39901
18:33:24.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.810088  6527 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.136.3:39901 every 8 connection(s)
18:33:24.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.813061  6396 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/data/info.pb
18:33:24.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.822530  5664 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 6396
18:33:24.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.823105  5664 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster2065910138852108455/ts-2/wal/instance
18:33:24.826 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:24.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.865247  6528 heartbeater.cc:344] Connected to a master server at 127.5.136.60:39171
18:33:24.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.865866  6528 heartbeater.cc:461] Registering TS with master...
18:33:24.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.867470  6528 heartbeater.cc:507] Master 127.5.136.60:39171 requested a full tablet report, sending...
18:33:24.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.870966  5877 ts_manager.cc:194] Registered new tserver with Master: bca326a30e144d5080c5b2dd919d9c4b (127.5.136.3:39901)
18:33:24.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.873181  6529 heartbeater.cc:344] Connected to a master server at 127.5.136.61:43625
18:33:24.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.873558  6529 heartbeater.cc:461] Registering TS with master...
18:33:24.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.874383  6529 heartbeater.cc:507] Master 127.5.136.61:43625 requested a full tablet report, sending...
18:33:24.877 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:24.877 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:24.877 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:24.877 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:24.877 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:24.877 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:24.878 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:24.878 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:24.880 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:24.881 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:24.881 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:24.881 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:24.881 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:24.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.879541  5790 ts_manager.cc:194] Registered new tserver with Master: bca326a30e144d5080c5b2dd919d9c4b (127.5.136.3:39901)
18:33:24.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.891234  6530 heartbeater.cc:344] Connected to a master server at 127.5.136.62:42905
18:33:24.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.891604  6530 heartbeater.cc:461] Registering TS with master...
18:33:24.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.892596  6530 heartbeater.cc:507] Master 127.5.136.62:42905 requested a full tablet report, sending...
18:33:24.893 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 4cd649562a0f5305571102b5c888c5a9 from Checkpoint 65 @ 1783535546001 for 4cd649562a0f5305571102b5c888c5a9 located at file:/tmp/junit5514029058471043739/checkpoints/4cd649562a0f5305571102b5c888c5a9/chk-65.
18:33:24.894 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
18:33:24.894 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 3 to checkpoint 65 for source Source: KuduSource to checkpoint.
18:33:24.894 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to SCHEDULED.
18:33:24.895 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from SCHEDULED to DEPLOYING.
18:33:24.895 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #3) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id d0320e7b86362daa97e494337af6f333
18:33:24.896 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:33:24.896 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot d0320e7b86362daa97e494337af6f333.
18:33:24.897 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_3), deploy into slot with allocation id d0320e7b86362daa97e494337af6f333.
18:33:24.898 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to DEPLOYING.
18:33:24.898 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 4cd649562a0f5305571102b5c888c5a9 from Checkpoint 65 @ 1783535546001 for 4cd649562a0f5305571102b5c888c5a9 located at file:/tmp/junit5514029058471043739/checkpoints/4cd649562a0f5305571102b5c888c5a9/chk-65.
18:33:24.898 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_3) [DEPLOYING].
18:33:24.899 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
18:33:24.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.895732  5711 ts_manager.cc:194] Registered new tserver with Master: bca326a30e144d5080c5b2dd919d9c4b (127.5.136.3:39901)
18:33:24.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.897768  5711 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.5.136.3:54733
18:33:24.900 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@679ee45e
18:33:24.900 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:24.901 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 65 for source Source: KuduSource to checkpoint.
18:33:24.901 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:33:24.901 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED.
18:33:24.901 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
18:33:24.902 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:33:24.903 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING.
18:33:24.903 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #3) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id 0abd8d1f15ad274a5029e6ed83960f8c
18:33:24.904 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 0abd8d1f15ad274a5029e6ed83960f8c.
18:33:24.905 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@737cd95c
18:33:24.905 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id 0abd8d1f15ad274a5029e6ed83960f8c.
18:33:24.905 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:24.906 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 4cd649562a0f5305571102b5c888c5a9 from Checkpoint 65 @ 1783535546001 for 4cd649562a0f5305571102b5c888c5a9 located at file:/tmp/junit5514029058471043739/checkpoints/4cd649562a0f5305571102b5c888c5a9/chk-65.
18:33:24.906 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
18:33:24.906 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:24.906 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 2 to checkpoint 65 for source Source: KuduSource to checkpoint.
18:33:24.906 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:24.906 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to SCHEDULED.
18:33:24.907 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:24.907 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:24.907 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:24.907 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:24.907 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:24.907 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:24.907 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:24.907 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:24.907 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:24.907 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:24.907 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:24.908 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:24.908 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from SCHEDULED to DEPLOYING.
18:33:24.908 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #3) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id c230971fad26d6cfa2b63ff44e7a1af5
18:33:24.909 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9) switched from state RESTARTING to RUNNING.
18:33:24.909 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 4cd649562a0f5305571102b5c888c5a9 from Checkpoint 65 @ 1783535546001 for 4cd649562a0f5305571102b5c888c5a9 located at file:/tmp/junit5514029058471043739/checkpoints/4cd649562a0f5305571102b5c888c5a9/chk-65.
18:33:24.909 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
18:33:24.909 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 65 for source Source: KuduSource to checkpoint.
18:33:24.910 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
18:33:24.910 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:33:24.910 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
18:33:24.910 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id 163e6d56962e3a45c0e4353eb3be3a9b
18:33:24.911 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
18:33:24.911 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot c230971fad26d6cfa2b63ff44e7a1af5.
18:33:24.913 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:24.914 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_3), deploy into slot with allocation id c230971fad26d6cfa2b63ff44e7a1af5.
18:33:24.914 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
18:33:24.914 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
18:33:24.914 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@585cbe71
18:33:24.914 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:24.915 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:33:24.915 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
18:33:24.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.916244  5664 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
18:33:24.916 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
18:33:24.918 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@55c7603f
18:33:24.919 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:24.920 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:24.927 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 163e6d56962e3a45c0e4353eb3be3a9b.
18:33:24.928 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id 163e6d56962e3a45c0e4353eb3be3a9b.
18:33:24.928 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to DEPLOYING.
18:33:24.928 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_3) [DEPLOYING].
18:33:24.929 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@41e8f495
18:33:24.929 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:24.929 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:33:24.929 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
18:33:24.930 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
18:33:24.932 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@698b42e1
18:33:24.934 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:24.935 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:33:24.935 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

18:33:24.935 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:24.936 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.5.136.62"
      port: 42905
    }
    bound_http_address {
      host: "127.5.136.62"
      port: 44661
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.5.136.61"
      port: 43625
    }
    bound_http_address {
      host: "127.5.136.61"
      port: 44879
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.5.136.60"
      port: 39171
    }
    bound_http_address {
      host: "127.5.136.60"
      port: 35441
    }
  }
}

18:33:24.936 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

18:33:24.937 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.5.136.1"
      port: 34063
    }
    bound_http_address {
      host: "127.5.136.1"
      port: 38359
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.5.136.2"
      port: 43565
    }
    bound_http_address {
      host: "127.5.136.2"
      port: 40849
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.5.136.3"
      port: 39901
    }
    bound_http_address {
      host: "127.5.136.3"
      port: 35111
    }
  }
}

18:33:24.937 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
18:33:24.938 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:24.946 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:24.947 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
18:33:24.947 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
18:33:24.947 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.947 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.947 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.948 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:24.948 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@73622aa9
18:33:24.948 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:24.948 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.948 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.948 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.948 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:33:24.949 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
18:33:24.949 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:24.949 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
18:33:24.949 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.949 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.949 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.950 [DEBUG - main] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:24.951 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:24.952 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@68269420
18:33:24.953 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:24.954 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:24.954 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.954 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.954 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.954 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.954 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.954 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:24.954 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.955 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:24.955 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.955 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.955 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.955 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:24.955 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.955 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.955 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.956 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:24.956 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.956 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.956 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.956 [DEBUG - main] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:24.957 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:24.957 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.179.62:35121(127.4.179.62:35121)] Successfully connected to peer
18:33:24.959 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.959 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.959 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.959 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:24.959 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:24.963 [DEBUG - main] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:24.963 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.179.60:34679(127.4.179.60:34679)] Successfully connected to peer
18:33:24.966 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.62
18:33:24.968 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.60
18:33:24.972 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:24.973 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.179.61:44733(127.4.179.61:44733)] Successfully connected to peer
18:33:24.975 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:24.977 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.61
18:33:24.979 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:24.980 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:24.982 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:24.983 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.983 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.983 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.984 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:24.985 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x313c10e6, L:/127.0.0.1:35448 - R:/127.4.179.60:34679] using SASL/PLAIN
18:33:24.985 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6cbc46bf, L:/127.0.0.1:55570 - R:/127.4.179.62:35121] using SASL/PLAIN
18:33:24.987 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:24.989 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:33:24.989 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=50), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: OK, deferred=null) after lookup
18:33:24.990 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.990 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.990 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.992 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xbe598f15, L:/127.0.0.1:43986 - R:/127.4.179.61:44733] using SASL/PLAIN
18:33:24.992 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.992 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.992 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.992 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:24.993 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:24.991588  4857 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55570:
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\004\001d\000\000\000\004\001\310\000\000\000"
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
18:33:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
18:33:24.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:33:24.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
18:33:24.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:33:24.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:33:24.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:33:24.995 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.995 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.995 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.995 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:24.996 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.996 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.996 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.996 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:24.997 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.997 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.997 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:24.997 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:24.997 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.997 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.997 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.998 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:24.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:24.997927  4857 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
18:33:24.998 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.998 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.998 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:24.998 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:24.999 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.999 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.999 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.999 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:24.999 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.999 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:24.999 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.000 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.000 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.000 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.000 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.000 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.001 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.001 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.002 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.002 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.002 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.002 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.002 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.002 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.002 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.002 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.002 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.003 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.003 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.003 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.003 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.003 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.012 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.012 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.013 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.013 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.013 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.017 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.017 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.020 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.020 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.020 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.020 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.020 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.020 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.021 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.021 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.021 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.020 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.021 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.021 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.021 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.023 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.023 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.023 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.023 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.024 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.024 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.024 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.024 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.030 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.030 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.031 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.031 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.031 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.031 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.031 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.031 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.031 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.031 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.031 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.031 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.031 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.032 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.032 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.032 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.032 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.032 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.032 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.032 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.032 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.032 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.032 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.032 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.032 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.032 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.032 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.032 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.032 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.033 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.033 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.033 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.033 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.033 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.033 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.033 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.033 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.038 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.039 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.039 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.040 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.040 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.040 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.040 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.040 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.040 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.040 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.040 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.040 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.040 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.040 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.042 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.042 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.043 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.043 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.043 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.043 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.043 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.043 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.044 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.044 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.044 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.044 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.054 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.054 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.054 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.055 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.055 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.055 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.055 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.055 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.055 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.055 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.055 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.055 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.055 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.056 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.056 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.056 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.056 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.056 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.056 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.057 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.057 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.057 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.057 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.057 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.057 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.057 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.057 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.057 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.057 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.058 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.058 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.058 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.058 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.058 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.058 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.058 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.059 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.059 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.059 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.059 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.059 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.059 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.060 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.060 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.060 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.060 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.060 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.060 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.061 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.061 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.061 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.061 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.061 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table fab365c4f81c4747993e0603891a5ae6
18:33:25.069 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:25.069 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:25.069 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:25.070 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:25.070 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:25.070 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:25.070 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:25.070 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:25.070 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:25.071 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:25.071 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:25.071 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:25.071 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:25.072 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.072 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.072 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.072 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.072 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.072 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.073 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.073 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.073 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.073 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.073 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.073 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.074 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.076 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.076 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.076 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.077 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.077 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.077 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.077 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.077 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.077 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.077 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.077 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.077 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.077 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.078 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.078 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.078 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:25.078 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.078 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:25.078 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:25.078 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.078 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.078 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.078 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:25.079 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:25.079 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:25.079 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.078 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:25.079 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.079 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:25.079 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.079 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:25.079 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.079 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.079 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.079 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.080 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:25.080 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:25.080 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:25.080 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:25.097 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.098 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.098 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.098 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.098 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.098 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.099 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.099 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.099 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.099 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.099 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.099 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.099 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.111 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.112 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.112 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.112 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.112 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.112 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.112 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.112 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.112 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.113 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.113 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.113 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.113 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.115 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.116 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.116 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.116 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.116 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.116 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.116 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.116 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.116 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.116 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.117 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.117 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.117 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.117 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.117 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.117 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.117 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.118 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.118 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.118 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.118 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.118 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.118 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.118 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.118 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.118 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.119 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.120 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.120 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.120 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.120 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.120 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.120 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.120 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.120 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.121 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.121 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.121 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.121 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.134197  5305 tablet_service.cc:1511] Processing CreateTablet for tablet bf4e623aabd94032905e80f9a4dbc79e (DEFAULT_TABLE table=replication_test_table [id=fab365c4f81c4747993e0603891a5ae6]), partition=RANGE (key1) PARTITION VALUES < 100
18:33:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.135874  5304 tablet_service.cc:1511] Processing CreateTablet for tablet 7f92012997064cd8962f208efb8dce40 (DEFAULT_TABLE table=replication_test_table [id=fab365c4f81c4747993e0603891a5ae6]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
18:33:25.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.137710  5304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f92012997064cd8962f208efb8dce40. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:25.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.138456  5305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4e623aabd94032905e80f9a4dbc79e. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:25.139 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.139 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.139 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.139 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.140 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.140 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.140 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.140 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.140 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.140 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.140 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.140 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.140 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.133378  5303 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee352da413147d39a7f82bb88ff1dda (DEFAULT_TABLE table=replication_test_table [id=fab365c4f81c4747993e0603891a5ae6]), partition=RANGE (key1) PARTITION 200 <= VALUES
18:33:25.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.141605  5303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee352da413147d39a7f82bb88ff1dda. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:25.155 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.156 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.156 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.156 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.156 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.156 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.156 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.156 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.156 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.157 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.157 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.157 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.157 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.170449  5586 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee352da413147d39a7f82bb88ff1dda (DEFAULT_TABLE table=replication_test_table [id=fab365c4f81c4747993e0603891a5ae6]), partition=RANGE (key1) PARTITION 200 <= VALUES
18:33:25.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.174140  5586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee352da413147d39a7f82bb88ff1dda. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:25.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.171130  5588 tablet_service.cc:1511] Processing CreateTablet for tablet bf4e623aabd94032905e80f9a4dbc79e (DEFAULT_TABLE table=replication_test_table [id=fab365c4f81c4747993e0603891a5ae6]), partition=RANGE (key1) PARTITION VALUES < 100
18:33:25.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.172284  5587 tablet_service.cc:1511] Processing CreateTablet for tablet 7f92012997064cd8962f208efb8dce40 (DEFAULT_TABLE table=replication_test_table [id=fab365c4f81c4747993e0603891a5ae6]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
18:33:25.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.177377  5588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4e623aabd94032905e80f9a4dbc79e. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:25.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.179244  5587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f92012997064cd8962f208efb8dce40. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:25.187 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:25.188 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:25.188 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:25.188 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:25.188 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:25.188 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:25.188 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:25.188 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:25.188 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:25.189 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:25.189 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:25.189 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:25.189 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:25.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.204093  6602 tablet_bootstrap.cc:492] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61: Bootstrap starting.
18:33:25.215 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:25.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.218789  5445 tablet_service.cc:1511] Processing CreateTablet for tablet 7f92012997064cd8962f208efb8dce40 (DEFAULT_TABLE table=replication_test_table [id=fab365c4f81c4747993e0603891a5ae6]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
18:33:25.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.220896  5445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f92012997064cd8962f208efb8dce40. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:25.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.222047  6602 tablet_bootstrap.cc:654] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61: Neither blocks nor log segments found. Creating new log.
18:33:25.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.224802  6602 log.cc:826] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61: Log is configured to *not* fsync() on all Append() calls
18:33:25.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.214319  5444 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee352da413147d39a7f82bb88ff1dda (DEFAULT_TABLE table=replication_test_table [id=fab365c4f81c4747993e0603891a5ae6]), partition=RANGE (key1) PARTITION 200 <= VALUES
18:33:25.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.225921  5444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee352da413147d39a7f82bb88ff1dda. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:25.229 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:25.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.227589  5446 tablet_service.cc:1511] Processing CreateTablet for tablet bf4e623aabd94032905e80f9a4dbc79e (DEFAULT_TABLE table=replication_test_table [id=fab365c4f81c4747993e0603891a5ae6]), partition=RANGE (key1) PARTITION VALUES < 100
18:33:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.230235  5446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4e623aabd94032905e80f9a4dbc79e. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:25.251 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.252 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.252 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.253 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.253 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.253 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.253 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.253 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.253 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.253 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.253 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.253 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.254 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.257 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.257 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.257 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.258 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.258 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.258 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.258 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.258 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.258 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.258 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.258 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.258 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.259 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.281729  6602 tablet_bootstrap.cc:492] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61: No bootstrap required, opened a new log
18:33:25.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.282307  6602 ts_tablet_manager.cc:1403] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.006s
18:33:25.283 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:25.283 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:25.283 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:25.283 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.283 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.283 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.284 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.284 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.284 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.284 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.284 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.284 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.284 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:25.285 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29165), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [18ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [61ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [66ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [66ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [99ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [105ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [108ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [133ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [133ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [134ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [134ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [143ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [196ms] refreshing cache from master, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [199ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [203ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [205ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [205ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [241ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [242ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [242ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [302ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [442ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [443ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [443ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [443ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [542ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [542ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [543ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [543ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [843ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [843ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [843ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [843ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1781ms] refreshing cache from master, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1783ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1783ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1783ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2561ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2563ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2563ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2565ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2565ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2565ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [5261ms] refreshing cache from master, [5261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [5261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [5261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [5262ms] too many traces: truncated at 100 traces, deferred=Deferred@141055789(state=PENDING, result=null, callback=(continuation of Deferred@1747771452 after retry RPC after error@654568990) -> (continuation of Deferred@1913593916 after retry RPC after error@949276783) -> (continuation of Deferred@926345793 after retry RPC after error@259883431) -> (continuation of Deferred@83381940 after retry RPC after error@452059628) -> (continuation of Deferred@437613585 after retry RPC after error@2038873677) -> (continuation of Deferred@1062060583 after retry RPC after error@715565731) -> (continuation of Deferred@463664666 after retry RPC after error@1461344245) -> (continuation of Deferred@110619595 after retry RPC after error@435923464) -> (continuation of Deferred@367365387 after retry RPC after error@273008061) -> (continuation of Deferred@691383757 after retry RPC after error@1843063049) -> (continuation of Deferred@1424931948 after retry RPC after error@1782113121) -> (continuation of Deferred@1860661294 after retry RPC after error@1422876250) -> (continuation of Deferred@1969456499 after retry RPC after error@1491948373) -> (continuation of Deferred@224280166 after retry RPC after error@592288793) -> (continuation of Deferred@1257037086 after retry RPC after error@2024364269) -> (continuation of Deferred@75035792 after retry RPC after error@1259998546) -> (continuation of Deferred@1731345666 after retry RPC after error@1433304889) -> (continuation of Deferred@376556912 after retry RPC after error@219816561) -> (continuation of Deferred@2075579645 after retry RPC after error@1569192709) -> (continuation of Deferred@1158002568 after retry RPC after error@433069299) -> (continuation of Deferred@1410081288 after retry RPC after error@917611615) -> (continuation of Deferred@1583414518 after retry RPC after error@1196315725), errback=(continuation of Deferred@1747771452 after retry RPC after error@654568990) -> (continuation of Deferred@1913593916 after retry RPC after error@949276783) -> (continuation of Deferred@926345793 after retry RPC after error@259883431) -> (continuation of Deferred@83381940 after retry RPC after error@452059628) -> (continuation of Deferred@437613585 after retry RPC after error@2038873677) -> (continuation of Deferred@1062060583 after retry RPC after error@715565731) -> (continuation of Deferred@463664666 after retry RPC after error@1461344245) -> (continuation of Deferred@110619595 after retry RPC after error@435923464) -> (continuation of Deferred@367365387 after retry RPC after error@273008061) -> (continuation of Deferred@691383757 after retry RPC after error@1843063049) -> (continuation of Deferred@1424931948 after retry RPC after error@1782113121) -> (continuation of Deferred@1860661294 after retry RPC after error@1422876250) -> (continuation of Deferred@1969456499 after retry RPC after error@1491948373) -> (continuation of Deferred@224280166 after retry RPC after error@592288793) -> (continuation of Deferred@1257037086 after retry RPC after error@2024364269) -> (continuation of Deferred@75035792 after retry RPC after error@1259998546) -> (continuation of Deferred@1731345666 after retry RPC after error@1433304889) -> (continuation of Deferred@376556912 after retry RPC after error@219816561) -> (continuation of Deferred@2075579645 after retry RPC after error@1569192709) -> (continuation of Deferred@1158002568 after retry RPC after error@433069299) -> (continuation of Deferred@1410081288 after retry RPC after error@917611615) -> (continuation of Deferred@1583414518 after retry RPC after error@1196315725)))
18:33:25.285 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:25.285 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:25.285 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:25.286 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.286 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.286 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.286 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29165), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [18ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [61ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [66ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [66ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [99ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [105ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [108ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [133ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [133ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [134ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [134ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [143ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [196ms] refreshing cache from master, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [199ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [203ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [205ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [205ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [241ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [242ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [242ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [302ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [442ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [443ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [443ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [443ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [542ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [542ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [543ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [543ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [843ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [843ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [843ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [843ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1781ms] refreshing cache from master, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1783ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1783ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1783ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2561ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2563ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2563ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2565ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2565ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2565ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [5261ms] refreshing cache from master, [5261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [5261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [5261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [5262ms] too many traces: truncated at 100 traces, deferred=Deferred@141055789(state=PENDING, result=null, callback=(continuation of Deferred@1747771452 after retry RPC after error@654568990) -> (continuation of Deferred@1913593916 after retry RPC after error@949276783) -> (continuation of Deferred@926345793 after retry RPC after error@259883431) -> (continuation of Deferred@83381940 after retry RPC after error@452059628) -> (continuation of Deferred@437613585 after retry RPC after error@2038873677) -> (continuation of Deferred@1062060583 after retry RPC after error@715565731) -> (continuation of Deferred@463664666 after retry RPC after error@1461344245) -> (continuation of Deferred@110619595 after retry RPC after error@435923464) -> (continuation of Deferred@367365387 after retry RPC after error@273008061) -> (continuation of Deferred@691383757 after retry RPC after error@1843063049) -> (continuation of Deferred@1424931948 after retry RPC after error@1782113121) -> (continuation of Deferred@1860661294 after retry RPC after error@1422876250) -> (continuation of Deferred@1969456499 after retry RPC after error@1491948373) -> (continuation of Deferred@224280166 after retry RPC after error@592288793) -> (continuation of Deferred@1257037086 after retry RPC after error@2024364269) -> (continuation of Deferred@75035792 after retry RPC after error@1259998546) -> (continuation of Deferred@1731345666 after retry RPC after error@1433304889) -> (continuation of Deferred@376556912 after retry RPC after error@219816561) -> (continuation of Deferred@2075579645 after retry RPC after error@1569192709) -> (continuation of Deferred@1158002568 after retry RPC after error@433069299) -> (continuation of Deferred@1410081288 after retry RPC after error@917611615) -> (continuation of Deferred@1583414518 after retry RPC after error@1196315725), errback=(continuation of Deferred@1747771452 after retry RPC after error@654568990) -> (continuation of Deferred@1913593916 after retry RPC after error@949276783) -> (continuation of Deferred@926345793 after retry RPC after error@259883431) -> (continuation of Deferred@83381940 after retry RPC after error@452059628) -> (continuation of Deferred@437613585 after retry RPC after error@2038873677) -> (continuation of Deferred@1062060583 after retry RPC after error@715565731) -> (continuation of Deferred@463664666 after retry RPC after error@1461344245) -> (continuation of Deferred@110619595 after retry RPC after error@435923464) -> (continuation of Deferred@367365387 after retry RPC after error@273008061) -> (continuation of Deferred@691383757 after retry RPC after error@1843063049) -> (continuation of Deferred@1424931948 after retry RPC after error@1782113121) -> (continuation of Deferred@1860661294 after retry RPC after error@1422876250) -> (continuation of Deferred@1969456499 after retry RPC after error@1491948373) -> (continuation of Deferred@224280166 after retry RPC after error@592288793) -> (continuation of Deferred@1257037086 after retry RPC after error@2024364269) -> (continuation of Deferred@75035792 after retry RPC after error@1259998546) -> (continuation of Deferred@1731345666 after retry RPC after error@1433304889) -> (continuation of Deferred@376556912 after retry RPC after error@219816561) -> (continuation of Deferred@2075579645 after retry RPC after error@1569192709) -> (continuation of Deferred@1158002568 after retry RPC after error@433069299) -> (continuation of Deferred@1410081288 after retry RPC after error@917611615) -> (continuation of Deferred@1583414518 after retry RPC after error@1196315725)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29165), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [18ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [61ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [66ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [66ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [99ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [105ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [108ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [133ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [133ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [134ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [134ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [143ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [196ms] refreshing cache from master, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [199ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [203ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [205ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [205ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [241ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [242ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [242ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [302ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [442ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [443ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [443ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [443ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [542ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [542ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [543ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [543ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [843ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [843ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [843ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [843ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1781ms] refreshing cache from master, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1783ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1783ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1783ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2561ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2563ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2563ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2565ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2565ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2565ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [5261ms] refreshing cache from master, [5261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [5261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [5261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [5262ms] too many traces: truncated at 100 traces, deferred=Deferred@141055789(state=PENDING, result=null, callback=(continuation of Deferred@1747771452 after retry RPC after error@654568990) -> (continuation of Deferred@1913593916 after retry RPC after error@949276783) -> (continuation of Deferred@926345793 after retry RPC after error@259883431) -> (continuation of Deferred@83381940 after retry RPC after error@452059628) -> (continuation of Deferred@437613585 after retry RPC after error@2038873677) -> (continuation of Deferred@1062060583 after retry RPC after error@715565731) -> (continuation of Deferred@463664666 after retry RPC after error@1461344245) -> (continuation of Deferred@110619595 after retry RPC after error@435923464) -> (continuation of Deferred@367365387 after retry RPC after error@273008061) -> (continuation of Deferred@691383757 after retry RPC after error@1843063049) -> (continuation of Deferred@1424931948 after retry RPC after error@1782113121) -> (continuation of Deferred@1860661294 after retry RPC after error@1422876250) -> (continuation of Deferred@1969456499 after retry RPC after error@1491948373) -> (continuation of Deferred@224280166 after retry RPC after error@592288793) -> (continuation of Deferred@1257037086 after retry RPC after error@2024364269) -> (continuation of Deferred@75035792 after retry RPC after error@1259998546) -> (continuation of Deferred@1731345666 after retry RPC after error@1433304889) -> (continuation of Deferred@376556912 after retry RPC after error@219816561) -> (continuation of Deferred@2075579645 after retry RPC after error@1569192709) -> (continuation of Deferred@1158002568 after retry RPC after error@433069299) -> (continuation of Deferred@1410081288 after retry RPC after error@917611615) -> (continuation of Deferred@1583414518 after retry RPC after error@1196315725), errback=(continuation of Deferred@1747771452 after retry RPC after error@654568990) -> (continuation of Deferred@1913593916 after retry RPC after error@949276783) -> (continuation of Deferred@926345793 after retry RPC after error@259883431) -> (continuation of Deferred@83381940 after retry RPC after error@452059628) -> (continuation of Deferred@437613585 after retry RPC after error@2038873677) -> (continuation of Deferred@1062060583 after retry RPC after error@715565731) -> (continuation of Deferred@463664666 after retry RPC after error@1461344245) -> (continuation of Deferred@110619595 after retry RPC after error@435923464) -> (continuation of Deferred@367365387 after retry RPC after error@273008061) -> (continuation of Deferred@691383757 after retry RPC after error@1843063049) -> (continuation of Deferred@1424931948 after retry RPC after error@1782113121) -> (continuation of Deferred@1860661294 after retry RPC after error@1422876250) -> (continuation of Deferred@1969456499 after retry RPC after error@1491948373) -> (continuation of Deferred@224280166 after retry RPC after error@592288793) -> (continuation of Deferred@1257037086 after retry RPC after error@2024364269) -> (continuation of Deferred@75035792 after retry RPC after error@1259998546) -> (continuation of Deferred@1731345666 after retry RPC after error@1433304889) -> (continuation of Deferred@376556912 after retry RPC after error@219816561) -> (continuation of Deferred@2075579645 after retry RPC after error@1569192709) -> (continuation of Deferred@1158002568 after retry RPC after error@433069299) -> (continuation of Deferred@1410081288 after retry RPC after error@917611615) -> (continuation of Deferred@1583414518 after retry RPC after error@1196315725)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.0.106.253:45189
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:25.286 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.286 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.286 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.286 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.287 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.287 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.287 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:25.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.292990  6604 tablet_bootstrap.cc:492] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581: Bootstrap starting.
18:33:25.293 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29165), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [18ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [61ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [66ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [66ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [99ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [105ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [108ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [133ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [133ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [134ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [134ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [143ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [196ms] refreshing cache from master, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [199ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [203ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [205ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [205ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [241ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [242ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [242ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [302ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [442ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [443ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [443ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [443ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [542ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [542ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [543ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [543ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [843ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [843ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [843ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [843ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1781ms] refreshing cache from master, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1783ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1783ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1783ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2561ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2563ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2563ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2565ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2565ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2565ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [5261ms] refreshing cache from master, [5261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [5261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [5261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [5262ms] too many traces: truncated at 100 traces, deferred=Deferred@141055789(state=PENDING, result=null, callback=(continuation of Deferred@1747771452 after retry RPC after error@654568990) -> (continuation of Deferred@1913593916 after retry RPC after error@949276783) -> (continuation of Deferred@926345793 after retry RPC after error@259883431) -> (continuation of Deferred@83381940 after retry RPC after error@452059628) -> (continuation of Deferred@437613585 after retry RPC after error@2038873677) -> (continuation of Deferred@1062060583 after retry RPC after error@715565731) -> (continuation of Deferred@463664666 after retry RPC after error@1461344245) -> (continuation of Deferred@110619595 after retry RPC after error@435923464) -> (continuation of Deferred@367365387 after retry RPC after error@273008061) -> (continuation of Deferred@691383757 after retry RPC after error@1843063049) -> (continuation of Deferred@1424931948 after retry RPC after error@1782113121) -> (continuation of Deferred@1860661294 after retry RPC after error@1422876250) -> (continuation of Deferred@1969456499 after retry RPC after error@1491948373) -> (continuation of Deferred@224280166 after retry RPC after error@592288793) -> (continuation of Deferred@1257037086 after retry RPC after error@2024364269) -> (continuation of Deferred@75035792 after retry RPC after error@1259998546) -> (continuation of Deferred@1731345666 after retry RPC after error@1433304889) -> (continuation of Deferred@376556912 after retry RPC after error@219816561) -> (continuation of Deferred@2075579645 after retry RPC after error@1569192709) -> (continuation of Deferred@1158002568 after retry RPC after error@433069299) -> (continuation of Deferred@1410081288 after retry RPC after error@917611615) -> (continuation of Deferred@1583414518 after retry RPC after error@1196315725), errback=(continuation of Deferred@1747771452 after retry RPC after error@654568990) -> (continuation of Deferred@1913593916 after retry RPC after error@949276783) -> (continuation of Deferred@926345793 after retry RPC after error@259883431) -> (continuation of Deferred@83381940 after retry RPC after error@452059628) -> (continuation of Deferred@437613585 after retry RPC after error@2038873677) -> (continuation of Deferred@1062060583 after retry RPC after error@715565731) -> (continuation of Deferred@463664666 after retry RPC after error@1461344245) -> (continuation of Deferred@110619595 after retry RPC after error@435923464) -> (continuation of Deferred@367365387 after retry RPC after error@273008061) -> (continuation of Deferred@691383757 after retry RPC after error@1843063049) -> (continuation of Deferred@1424931948 after retry RPC after error@1782113121) -> (continuation of Deferred@1860661294 after retry RPC after error@1422876250) -> (continuation of Deferred@1969456499 after retry RPC after error@1491948373) -> (continuation of Deferred@224280166 after retry RPC after error@592288793) -> (continuation of Deferred@1257037086 after retry RPC after error@2024364269) -> (continuation of Deferred@75035792 after retry RPC after error@1259998546) -> (continuation of Deferred@1731345666 after retry RPC after error@1433304889) -> (continuation of Deferred@376556912 after retry RPC after error@219816561) -> (continuation of Deferred@2075579645 after retry RPC after error@1569192709) -> (continuation of Deferred@1158002568 after retry RPC after error@433069299) -> (continuation of Deferred@1410081288 after retry RPC after error@917611615) -> (continuation of Deferred@1583414518 after retry RPC after error@1196315725)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29165), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [18ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [61ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [66ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [66ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [99ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [105ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [108ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [133ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [133ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [134ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [134ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [143ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [196ms] refreshing cache from master, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [199ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [203ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [205ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [205ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [241ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [242ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [242ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [302ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [442ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [443ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [443ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [443ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [542ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [542ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [543ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [543ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [842ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [843ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [843ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [843ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [843ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1781ms] refreshing cache from master, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1783ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1783ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1783ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2561ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2563ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2563ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2565ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2565ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2565ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [5261ms] refreshing cache from master, [5261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [5261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [5261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [5262ms] too many traces: truncated at 100 traces, deferred=Deferred@141055789(state=PENDING, result=null, callback=(continuation of Deferred@1747771452 after retry RPC after error@654568990) -> (continuation of Deferred@1913593916 after retry RPC after error@949276783) -> (continuation of Deferred@926345793 after retry RPC after error@259883431) -> (continuation of Deferred@83381940 after retry RPC after error@452059628) -> (continuation of Deferred@437613585 after retry RPC after error@2038873677) -> (continuation of Deferred@1062060583 after retry RPC after error@715565731) -> (continuation of Deferred@463664666 after retry RPC after error@1461344245) -> (continuation of Deferred@110619595 after retry RPC after error@435923464) -> (continuation of Deferred@367365387 after retry RPC after error@273008061) -> (continuation of Deferred@691383757 after retry RPC after error@1843063049) -> (continuation of Deferred@1424931948 after retry RPC after error@1782113121) -> (continuation of Deferred@1860661294 after retry RPC after error@1422876250) -> (continuation of Deferred@1969456499 after retry RPC after error@1491948373) -> (continuation of Deferred@224280166 after retry RPC after error@592288793) -> (continuation of Deferred@1257037086 after retry RPC after error@2024364269) -> (continuation of Deferred@75035792 after retry RPC after error@1259998546) -> (continuation of Deferred@1731345666 after retry RPC after error@1433304889) -> (continuation of Deferred@376556912 after retry RPC after error@219816561) -> (continuation of Deferred@2075579645 after retry RPC after error@1569192709) -> (continuation of Deferred@1158002568 after retry RPC after error@433069299) -> (continuation of Deferred@1410081288 after retry RPC after error@917611615) -> (continuation of Deferred@1583414518 after retry RPC after error@1196315725), errback=(continuation of Deferred@1747771452 after retry RPC after error@654568990) -> (continuation of Deferred@1913593916 after retry RPC after error@949276783) -> (continuation of Deferred@926345793 after retry RPC after error@259883431) -> (continuation of Deferred@83381940 after retry RPC after error@452059628) -> (continuation of Deferred@437613585 after retry RPC after error@2038873677) -> (continuation of Deferred@1062060583 after retry RPC after error@715565731) -> (continuation of Deferred@463664666 after retry RPC after error@1461344245) -> (continuation of Deferred@110619595 after retry RPC after error@435923464) -> (continuation of Deferred@367365387 after retry RPC after error@273008061) -> (continuation of Deferred@691383757 after retry RPC after error@1843063049) -> (continuation of Deferred@1424931948 after retry RPC after error@1782113121) -> (continuation of Deferred@1860661294 after retry RPC after error@1422876250) -> (continuation of Deferred@1969456499 after retry RPC after error@1491948373) -> (continuation of Deferred@224280166 after retry RPC after error@592288793) -> (continuation of Deferred@1257037086 after retry RPC after error@2024364269) -> (continuation of Deferred@75035792 after retry RPC after error@1259998546) -> (continuation of Deferred@1731345666 after retry RPC after error@1433304889) -> (continuation of Deferred@376556912 after retry RPC after error@219816561) -> (continuation of Deferred@2075579645 after retry RPC after error@1569192709) -> (continuation of Deferred@1158002568 after retry RPC after error@433069299) -> (continuation of Deferred@1410081288 after retry RPC after error@917611615) -> (continuation of Deferred@1583414518 after retry RPC after error@1196315725)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.0.106.253:45189
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:25.295 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:33:25.295 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9) switched from state RUNNING to RESTARTING.
18:33:25.295 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.296 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.296 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.296 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#3) of source Source: KuduSource.
18:33:25.296 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.296 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to CANCELING.
18:33:25.296 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.296 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.296 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.296 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.296 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.296 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.296 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.297 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.297 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.297 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
18:33:25.297 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to CANCELING.
18:33:25.297 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
18:33:25.297 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#3) of source Source: KuduSource.
18:33:25.297 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to CANCELING.
18:33:25.298 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#3) of source Source: KuduSource.
18:33:25.298 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
18:33:25.298 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#3) of source Source: KuduSource.
18:33:25.298 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to CANCELING.
18:33:25.303 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:25.303 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:25.303 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:25.303 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.303 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.303 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.303 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.303 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.303 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.304 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.304 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.304 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.304 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:25.317 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
18:33:25.317 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
18:33:25.317 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CANCELING to CANCELED.
18:33:25.317 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to CANCELING.
18:33:25.317 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
18:33:25.317 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
18:33:25.318 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
18:33:25.318 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CANCELING to CANCELED.
18:33:25.318 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
18:33:25.318 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
18:33:25.318 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
18:33:25.318 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
18:33:25.319 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
18:33:25.320 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
18:33:25.320 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
18:33:25.320 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
18:33:25.320 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to CANCELING.
18:33:25.320 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
18:33:25.322 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:25.322 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
18:33:25.323 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CANCELING to CANCELED.
18:33:25.323 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#3 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
18:33:25.323 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:25.323 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:25.324 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:25.324 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.324 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.324 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.324 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.324 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.324 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.324 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#3 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
18:33:25.324 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.324 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.324 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.324 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#3 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
18:33:25.325 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:25.325 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#3 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
18:33:25.325 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#3 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
18:33:25.325 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CANCELING to CANCELED.
18:33:25.326 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CANCELING to CANCELED.
18:33:25.327 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
18:33:25.327 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:25.327 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:33:25.327 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:33:25.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.327049  6602 raft_consensus.cc:359] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.328162  6602 raft_consensus.cc:385] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:25.328 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CANCELING to CANCELED.
18:33:25.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.328490  6602 raft_consensus.cc:740] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6008cdf76d9e456ca635ad5aeccc6c61, State: Initialized, Role: FOLLOWER
18:33:25.329 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 4cd649562a0f5305571102b5c888c5a9
18:33:25.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.329674  6602 consensus_queue.cc:260] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.335769  6604 tablet_bootstrap.cc:654] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581: Neither blocks nor log segments found. Creating new log.
18:33:25.336 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:25.337 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:25.337 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:25.338 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:25.338 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:25.338 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:25.338 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:25.338 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:25.338 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:25.338 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:25.338 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:25.339 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:25.339 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:25.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.341039  6602 ts_tablet_manager.cc:1434] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61: Time spent starting tablet: real 0.058s	user 0.042s	sys 0.004s
18:33:25.343 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:25.343 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:25.343 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:25.344 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.344 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.344 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.344 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.344 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.344 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.344 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.345 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.345 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.345 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:25.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.346138  6602 tablet_bootstrap.cc:492] T 7f92012997064cd8962f208efb8dce40 P 6008cdf76d9e456ca635ad5aeccc6c61: Bootstrap starting.
18:33:25.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.348205  6604 log.cc:826] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581: Log is configured to *not* fsync() on all Append() calls
18:33:25.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.354703  6618 raft_consensus.cc:493] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:33:25.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.355337  6618 raft_consensus.cc:515] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.363 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:25.363 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:25.363 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:25.364 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.364 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.364 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.365 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.365 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.365 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.365 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.365 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.365 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.365 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:25.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.368552  6618 leader_election.cc:290] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5454fd94967f4e178a493e84ecdce8e2 (127.4.179.2:33745), 928ff5a5022c4c84be872c8cd7fd3581 (127.4.179.3:43889)
18:33:25.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.374961  6619 tablet_bootstrap.cc:492] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2: Bootstrap starting.
18:33:25.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.389027  6602 tablet_bootstrap.cc:654] T 7f92012997064cd8962f208efb8dce40 P 6008cdf76d9e456ca635ad5aeccc6c61: Neither blocks nor log segments found. Creating new log.
18:33:25.398 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.398 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.398335  6619 tablet_bootstrap.cc:654] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2: Neither blocks nor log segments found. Creating new log.
18:33:25.399 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.399 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.399 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.399 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.399 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.399 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.400 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.400 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.400 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.400 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.400 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.400 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.400 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.400 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.400 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.400 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.401 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.401 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.401 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.401 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.401029  6619 log.cc:826] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2: Log is configured to *not* fsync() on all Append() calls
18:33:25.401 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.401 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.401 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.401 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.402405  6604 tablet_bootstrap.cc:492] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581: No bootstrap required, opened a new log
18:33:25.403 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:25.403 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:25.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.402964  6604 ts_tablet_manager.cc:1403] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581: Time spent bootstrapping tablet: real 0.111s	user 0.008s	sys 0.012s
18:33:25.403 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:25.403 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.403 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.403 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.404 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.404 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.404 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.404 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.404 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.404 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.404 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:25.406 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:25.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:25.406647  5379 tablet.cc:2406] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:33:25.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.393683  5608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee352da413147d39a7f82bb88ff1dda" candidate_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "928ff5a5022c4c84be872c8cd7fd3581" is_pre_election: true
18:33:25.412 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.412 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.412 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.412 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.412 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.412 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.413 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.413 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.413 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.413 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.413 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.413 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.413 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:25.413794  5259 leader_election.cc:343] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 928ff5a5022c4c84be872c8cd7fd3581 (127.4.179.3:43889): Illegal state: must be running to vote when last-logged opid is not known
18:33:25.417 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.417 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.417 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.418 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.418 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.418 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.418 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.418 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.418 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.418 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.419 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.419 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.419 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.419 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.419 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.420 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.420 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.420 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.420 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.420 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.420 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.420 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.420 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.420 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.420 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.420 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.426723  6602 tablet_bootstrap.cc:492] T 7f92012997064cd8962f208efb8dce40 P 6008cdf76d9e456ca635ad5aeccc6c61: No bootstrap required, opened a new log
18:33:25.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.427310  6602 ts_tablet_manager.cc:1403] T 7f92012997064cd8962f208efb8dce40 P 6008cdf76d9e456ca635ad5aeccc6c61: Time spent bootstrapping tablet: real 0.081s	user 0.004s	sys 0.009s
18:33:25.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.431052  6602 raft_consensus.cc:359] T 7f92012997064cd8962f208efb8dce40 P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.432153  6602 raft_consensus.cc:385] T 7f92012997064cd8962f208efb8dce40 P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:25.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.432524  6602 raft_consensus.cc:740] T 7f92012997064cd8962f208efb8dce40 P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6008cdf76d9e456ca635ad5aeccc6c61, State: Initialized, Role: FOLLOWER
18:33:25.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.433583  6602 consensus_queue.cc:260] T 7f92012997064cd8962f208efb8dce40 P 6008cdf76d9e456ca635ad5aeccc6c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.443 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:25.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.395870  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee352da413147d39a7f82bb88ff1dda" candidate_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5454fd94967f4e178a493e84ecdce8e2" is_pre_election: true
18:33:25.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:25.441664  5260 leader_election.cc:343] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5454fd94967f4e178a493e84ecdce8e2 (127.4.179.2:33745): Illegal state: must be running to vote when last-logged opid is not known
18:33:25.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.442059  5260 leader_election.cc:304] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6008cdf76d9e456ca635ad5aeccc6c61; no voters: 5454fd94967f4e178a493e84ecdce8e2, 928ff5a5022c4c84be872c8cd7fd3581
18:33:25.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.442312  6602 ts_tablet_manager.cc:1434] T 7f92012997064cd8962f208efb8dce40 P 6008cdf76d9e456ca635ad5aeccc6c61: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
18:33:25.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.442948  6618 raft_consensus.cc:2749] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:33:25.444 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:25.444 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:25.444 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.444 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.444 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.444 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.444 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.444 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.445 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.445 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.445 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.445 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:25.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.445999  6602 tablet_bootstrap.cc:492] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61: Bootstrap starting.
18:33:25.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.450059  6604 raft_consensus.cc:359] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.451145  6604 raft_consensus.cc:385] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:25.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.451472  6604 raft_consensus.cc:740] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 928ff5a5022c4c84be872c8cd7fd3581, State: Initialized, Role: FOLLOWER
18:33:25.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.452467  6604 consensus_queue.cc:260] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.454087  6602 tablet_bootstrap.cc:654] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61: Neither blocks nor log segments found. Creating new log.
18:33:25.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.456193  6619 tablet_bootstrap.cc:492] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2: No bootstrap required, opened a new log
18:33:25.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.456910  6619 ts_tablet_manager.cc:1403] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.028s
18:33:25.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.462414  6604 ts_tablet_manager.cc:1434] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581: Time spent starting tablet: real 0.059s	user 0.018s	sys 0.010s
18:33:25.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.464813  6604 tablet_bootstrap.cc:492] T bf4e623aabd94032905e80f9a4dbc79e P 928ff5a5022c4c84be872c8cd7fd3581: Bootstrap starting.
18:33:25.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.471259  6604 tablet_bootstrap.cc:654] T bf4e623aabd94032905e80f9a4dbc79e P 928ff5a5022c4c84be872c8cd7fd3581: Neither blocks nor log segments found. Creating new log.
18:33:25.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.483178  6604 tablet_bootstrap.cc:492] T bf4e623aabd94032905e80f9a4dbc79e P 928ff5a5022c4c84be872c8cd7fd3581: No bootstrap required, opened a new log
18:33:25.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.483611  6604 ts_tablet_manager.cc:1403] T bf4e623aabd94032905e80f9a4dbc79e P 928ff5a5022c4c84be872c8cd7fd3581: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
18:33:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.486289  6604 raft_consensus.cc:359] T bf4e623aabd94032905e80f9a4dbc79e P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } }
18:33:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.487035  6604 raft_consensus.cc:385] T bf4e623aabd94032905e80f9a4dbc79e P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:25.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.487353  6604 raft_consensus.cc:740] T bf4e623aabd94032905e80f9a4dbc79e P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 928ff5a5022c4c84be872c8cd7fd3581, State: Initialized, Role: FOLLOWER
18:33:25.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.488015  6604 consensus_queue.cc:260] T bf4e623aabd94032905e80f9a4dbc79e P 928ff5a5022c4c84be872c8cd7fd3581 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } }
18:33:25.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.499997  6604 ts_tablet_manager.cc:1434] T bf4e623aabd94032905e80f9a4dbc79e P 928ff5a5022c4c84be872c8cd7fd3581: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
18:33:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:25.502959  5661 tablet.cc:2406] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:33:25.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.521828  6619 raft_consensus.cc:359] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.522828  6619 raft_consensus.cc:385] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:25.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.524339  6619 raft_consensus.cc:740] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5454fd94967f4e178a493e84ecdce8e2, State: Initialized, Role: FOLLOWER
18:33:25.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.527612  6619 consensus_queue.cc:260] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.535195  6628 raft_consensus.cc:493] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:33:25.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.535815  6628 raft_consensus.cc:515] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.539341  6628 leader_election.cc:290] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6008cdf76d9e456ca635ad5aeccc6c61 (127.4.179.1:45253), 5454fd94967f4e178a493e84ecdce8e2 (127.4.179.2:33745)
18:33:25.543 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:25.543 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:25.544 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:25.544 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.544 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.544 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.544 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.544 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.544 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.545 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.545 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.545 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.545 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:25.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.550896  6619 ts_tablet_manager.cc:1434] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2: Time spent starting tablet: real 0.094s	user 0.015s	sys 0.012s
18:33:25.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.553006  6604 tablet_bootstrap.cc:492] T 5ee352da413147d39a7f82bb88ff1dda P 928ff5a5022c4c84be872c8cd7fd3581: Bootstrap starting.
18:33:25.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.556190  6619 tablet_bootstrap.cc:492] T bf4e623aabd94032905e80f9a4dbc79e P 5454fd94967f4e178a493e84ecdce8e2: Bootstrap starting.
18:33:25.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:25.558203  5520 tablet.cc:2406] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:33:25.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.563088  6629 raft_consensus.cc:493] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:33:25.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.563704  6629 raft_consensus.cc:515] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.569437  6629 leader_election.cc:290] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6008cdf76d9e456ca635ad5aeccc6c61 (127.4.179.1:45253), 928ff5a5022c4c84be872c8cd7fd3581 (127.4.179.3:43889)
18:33:25.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.575594  6619 tablet_bootstrap.cc:654] T bf4e623aabd94032905e80f9a4dbc79e P 5454fd94967f4e178a493e84ecdce8e2: Neither blocks nor log segments found. Creating new log.
18:33:25.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.584353  6602 tablet_bootstrap.cc:492] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61: No bootstrap required, opened a new log
18:33:25.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.584810  6602 ts_tablet_manager.cc:1403] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61: Time spent bootstrapping tablet: real 0.139s	user 0.007s	sys 0.012s
18:33:25.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.600485  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f92012997064cd8962f208efb8dce40" candidate_uuid: "928ff5a5022c4c84be872c8cd7fd3581" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5454fd94967f4e178a493e84ecdce8e2" is_pre_election: true
18:33:25.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:25.602154  5543 leader_election.cc:343] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5454fd94967f4e178a493e84ecdce8e2 (127.4.179.2:33745): Illegal state: must be running to vote when last-logged opid is not known
18:33:25.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.608352  6604 tablet_bootstrap.cc:654] T 5ee352da413147d39a7f82bb88ff1dda P 928ff5a5022c4c84be872c8cd7fd3581: Neither blocks nor log segments found. Creating new log.
18:33:25.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.608929  5325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f92012997064cd8962f208efb8dce40" candidate_uuid: "928ff5a5022c4c84be872c8cd7fd3581" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" is_pre_election: true
18:33:25.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.609411  6619 tablet_bootstrap.cc:492] T bf4e623aabd94032905e80f9a4dbc79e P 5454fd94967f4e178a493e84ecdce8e2: No bootstrap required, opened a new log
18:33:25.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.609815  6619 ts_tablet_manager.cc:1403] T bf4e623aabd94032905e80f9a4dbc79e P 5454fd94967f4e178a493e84ecdce8e2: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.004s
18:33:25.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.609707  5325 raft_consensus.cc:2468] T 7f92012997064cd8962f208efb8dce40 P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 928ff5a5022c4c84be872c8cd7fd3581 in term 0.
18:33:25.612 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.612 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.612 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.612 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.612 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.613 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.613 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.613 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.613 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.613 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.613 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.613 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.613 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.611505  5544 leader_election.cc:304] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6008cdf76d9e456ca635ad5aeccc6c61, 928ff5a5022c4c84be872c8cd7fd3581; no voters: 5454fd94967f4e178a493e84ecdce8e2
18:33:25.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.612975  6625 raft_consensus.cc:2804] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:33:25.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.613322  6625 raft_consensus.cc:493] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:33:25.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.613668  6625 raft_consensus.cc:3060] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Advancing to term 1
18:33:25.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.614379  6602 raft_consensus.cc:359] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } }
18:33:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.615141  6602 raft_consensus.cc:385] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.615401  6602 raft_consensus.cc:740] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6008cdf76d9e456ca635ad5aeccc6c61, State: Initialized, Role: FOLLOWER
18:33:25.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.617331  6602 consensus_queue.cc:260] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } }
18:33:25.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.620220  6602 ts_tablet_manager.cc:1434] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
18:33:25.624 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:25.624 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:25.624 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:25.625 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:25.625 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:25.625 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:25.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.625322  6625 raft_consensus.cc:515] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.626 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:25.627 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:25.627 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:25.627 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:25.627 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:25.627 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:25.627 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:25.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.628182  6625 leader_election.cc:290] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [CANDIDATE]: Term 1 election: Requested vote from peers 6008cdf76d9e456ca635ad5aeccc6c61 (127.4.179.1:45253), 5454fd94967f4e178a493e84ecdce8e2 (127.4.179.2:33745)
18:33:25.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.629637  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f92012997064cd8962f208efb8dce40" candidate_uuid: "928ff5a5022c4c84be872c8cd7fd3581" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5454fd94967f4e178a493e84ecdce8e2"
18:33:25.633 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.633 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.633 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.634 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.634 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.634 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.634 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.634 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.634 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.634 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.634 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.634 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.631335  5325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f92012997064cd8962f208efb8dce40" candidate_uuid: "928ff5a5022c4c84be872c8cd7fd3581" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6008cdf76d9e456ca635ad5aeccc6c61"
18:33:25.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.631882  5325 raft_consensus.cc:3060] T 7f92012997064cd8962f208efb8dce40 P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Advancing to term 1
18:33:25.634 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.636 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.636 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.636 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.636 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.636 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.636 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.637 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.637 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.637 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.637 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.637 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.637 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.637 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.629420  6604 tablet_bootstrap.cc:492] T 5ee352da413147d39a7f82bb88ff1dda P 928ff5a5022c4c84be872c8cd7fd3581: No bootstrap required, opened a new log
18:33:25.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.640374  6604 ts_tablet_manager.cc:1403] T 5ee352da413147d39a7f82bb88ff1dda P 928ff5a5022c4c84be872c8cd7fd3581: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.006s
18:33:25.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.641688  5325 raft_consensus.cc:2468] T 7f92012997064cd8962f208efb8dce40 P 6008cdf76d9e456ca635ad5aeccc6c61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 928ff5a5022c4c84be872c8cd7fd3581 in term 1.
18:33:25.643 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:25.644 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:25.644 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:25.644 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.644 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.644 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.644 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.645 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.645 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.645 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.645 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.645 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.645 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:25.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.643510  6604 raft_consensus.cc:359] T 5ee352da413147d39a7f82bb88ff1dda P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.646262  6604 raft_consensus.cc:385] T 5ee352da413147d39a7f82bb88ff1dda P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:25.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.646560  6604 raft_consensus.cc:740] T 5ee352da413147d39a7f82bb88ff1dda P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 928ff5a5022c4c84be872c8cd7fd3581, State: Initialized, Role: FOLLOWER
18:33:25.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:25.639858  5543 leader_election.cc:343] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5454fd94967f4e178a493e84ecdce8e2 (127.4.179.2:33745): Illegal state: must be running to vote when last-logged opid is not known
18:33:25.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.648849  6604 consensus_queue.cc:260] T 5ee352da413147d39a7f82bb88ff1dda P 928ff5a5022c4c84be872c8cd7fd3581 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.650606  5544 leader_election.cc:304] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6008cdf76d9e456ca635ad5aeccc6c61, 928ff5a5022c4c84be872c8cd7fd3581; no voters: 5454fd94967f4e178a493e84ecdce8e2
18:33:25.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.651626  6628 raft_consensus.cc:2804] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [term 1 FOLLOWER]: Leader election won for term 1
18:33:25.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.651147  6619 raft_consensus.cc:359] T bf4e623aabd94032905e80f9a4dbc79e P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } }
18:33:25.657 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:25.657 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:25.657 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:25.658 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:25.658 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:25.658 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:25.658 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:25.658 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:25.658 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:25.659 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:25.659 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:25.659 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:25.659 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:25.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.665567  6604 ts_tablet_manager.cc:1434] T 5ee352da413147d39a7f82bb88ff1dda P 928ff5a5022c4c84be872c8cd7fd3581: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.004s
18:33:25.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.654691  6619 raft_consensus.cc:385] T bf4e623aabd94032905e80f9a4dbc79e P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:25.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.666466  6619 raft_consensus.cc:740] T bf4e623aabd94032905e80f9a4dbc79e P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5454fd94967f4e178a493e84ecdce8e2, State: Initialized, Role: FOLLOWER
18:33:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.669718  6619 consensus_queue.cc:260] T bf4e623aabd94032905e80f9a4dbc79e P 5454fd94967f4e178a493e84ecdce8e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } }
18:33:25.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.671363  5608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee352da413147d39a7f82bb88ff1dda" candidate_uuid: "5454fd94967f4e178a493e84ecdce8e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "928ff5a5022c4c84be872c8cd7fd3581" is_pre_election: true
18:33:25.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.674880  5608 raft_consensus.cc:2468] T 5ee352da413147d39a7f82bb88ff1dda P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5454fd94967f4e178a493e84ecdce8e2 in term 0.
18:33:25.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.677805  5400 leader_election.cc:304] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5454fd94967f4e178a493e84ecdce8e2, 928ff5a5022c4c84be872c8cd7fd3581; no voters: 
18:33:25.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.678874  6629 raft_consensus.cc:2804] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:33:25.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.679224  6629 raft_consensus.cc:493] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:33:25.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.679525  6629 raft_consensus.cc:3060] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Advancing to term 1
18:33:25.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.688488  6629 raft_consensus.cc:515] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.690565  6619 ts_tablet_manager.cc:1434] T bf4e623aabd94032905e80f9a4dbc79e P 5454fd94967f4e178a493e84ecdce8e2: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.000s
18:33:25.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.704854  6619 tablet_bootstrap.cc:492] T 7f92012997064cd8962f208efb8dce40 P 5454fd94967f4e178a493e84ecdce8e2: Bootstrap starting.
18:33:25.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.711663  5608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee352da413147d39a7f82bb88ff1dda" candidate_uuid: "5454fd94967f4e178a493e84ecdce8e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "928ff5a5022c4c84be872c8cd7fd3581"
18:33:25.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.712189  5608 raft_consensus.cc:3060] T 5ee352da413147d39a7f82bb88ff1dda P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Advancing to term 1
18:33:25.718 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.718 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.718 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.718 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.718 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.719 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.719 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.719 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.719 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.719 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.719 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.719 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.719 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.706363  6629 leader_election.cc:290] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [CANDIDATE]: Term 1 election: Requested vote from peers 6008cdf76d9e456ca635ad5aeccc6c61 (127.4.179.1:45253), 928ff5a5022c4c84be872c8cd7fd3581 (127.4.179.3:43889)
18:33:25.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.718590  5608 raft_consensus.cc:2468] T 5ee352da413147d39a7f82bb88ff1dda P 928ff5a5022c4c84be872c8cd7fd3581 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5454fd94967f4e178a493e84ecdce8e2 in term 1.
18:33:25.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.719127  6628 raft_consensus.cc:697] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [term 1 LEADER]: Becoming Leader. State: Replica: 928ff5a5022c4c84be872c8cd7fd3581, State: Running, Role: LEADER
18:33:25.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.719712  5400 leader_election.cc:304] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5454fd94967f4e178a493e84ecdce8e2, 928ff5a5022c4c84be872c8cd7fd3581; no voters: 
18:33:25.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.720400  6628 consensus_queue.cc:237] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.722219  6629 raft_consensus.cc:2804] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [term 1 FOLLOWER]: Leader election won for term 1
18:33:25.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.724028  5325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee352da413147d39a7f82bb88ff1dda" candidate_uuid: "5454fd94967f4e178a493e84ecdce8e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" is_pre_election: true
18:33:25.726 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:25.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.724690  5325 raft_consensus.cc:2468] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5454fd94967f4e178a493e84ecdce8e2 in term 0.
18:33:25.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.725941  5324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee352da413147d39a7f82bb88ff1dda" candidate_uuid: "5454fd94967f4e178a493e84ecdce8e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6008cdf76d9e456ca635ad5aeccc6c61"
18:33:25.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.726609  5324 raft_consensus.cc:3060] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Advancing to term 1
18:33:25.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.736038  5324 raft_consensus.cc:2468] T 5ee352da413147d39a7f82bb88ff1dda P 6008cdf76d9e456ca635ad5aeccc6c61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5454fd94967f4e178a493e84ecdce8e2 in term 1.
18:33:25.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.742734  6619 tablet_bootstrap.cc:654] T 7f92012997064cd8962f208efb8dce40 P 5454fd94967f4e178a493e84ecdce8e2: Neither blocks nor log segments found. Creating new log.
18:33:25.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.746966  6629 raft_consensus.cc:697] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [term 1 LEADER]: Becoming Leader. State: Replica: 5454fd94967f4e178a493e84ecdce8e2, State: Running, Role: LEADER
18:33:25.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.748126  6629 consensus_queue.cc:237] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.751356  4857 catalog_manager.cc:5696] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 reported cstate change: term changed from 0 to 1, leader changed from <none> to 928ff5a5022c4c84be872c8cd7fd3581 (127.4.179.3). New cstate: current_term: 1 leader_uuid: "928ff5a5022c4c84be872c8cd7fd3581" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } health_report { overall_health: HEALTHY } } }
18:33:25.759 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:25.759 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:25.759 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:25.759 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.760 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.760 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:25.760 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.760 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.760 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:25.760 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.760 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.760 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:25.761 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:25.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.772347  4856 catalog_manager.cc:5696] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5454fd94967f4e178a493e84ecdce8e2 (127.4.179.2). New cstate: current_term: 1 leader_uuid: "5454fd94967f4e178a493e84ecdce8e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } health_report { overall_health: UNKNOWN } } }
18:33:25.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.782229  6619 tablet_bootstrap.cc:492] T 7f92012997064cd8962f208efb8dce40 P 5454fd94967f4e178a493e84ecdce8e2: No bootstrap required, opened a new log
18:33:25.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.782652  6619 ts_tablet_manager.cc:1403] T 7f92012997064cd8962f208efb8dce40 P 5454fd94967f4e178a493e84ecdce8e2: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.010s
18:33:25.783 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:25.783 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:25.783 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:25.784 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.784 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.784 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.784 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.784 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.784 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.784 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.784 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.784 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.784 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:25.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.786916  6619 raft_consensus.cc:359] T 7f92012997064cd8962f208efb8dce40 P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.787611  6619 raft_consensus.cc:385] T 7f92012997064cd8962f208efb8dce40 P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:25.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.787999  6619 raft_consensus.cc:740] T 7f92012997064cd8962f208efb8dce40 P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5454fd94967f4e178a493e84ecdce8e2, State: Initialized, Role: FOLLOWER
18:33:25.796 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:25.797 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:25.797 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:25.797 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:25.797 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:25.797 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:25.798 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:25.798 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:25.798 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:25.798 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:25.798 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:25.798 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:25.798 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:25.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.788972  6619 consensus_queue.cc:260] T 7f92012997064cd8962f208efb8dce40 P 5454fd94967f4e178a493e84ecdce8e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:25.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.820616  6619 ts_tablet_manager.cc:1434] T 7f92012997064cd8962f208efb8dce40 P 5454fd94967f4e178a493e84ecdce8e2: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
18:33:25.821 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:25.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.837172  6618 raft_consensus.cc:493] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:33:25.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.837661  6618 raft_consensus.cc:515] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } }
18:33:25.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.839537  6618 leader_election.cc:290] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 928ff5a5022c4c84be872c8cd7fd3581 (127.4.179.3:43889), 5454fd94967f4e178a493e84ecdce8e2 (127.4.179.2:33745)
18:33:25.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.840541  5608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4e623aabd94032905e80f9a4dbc79e" candidate_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "928ff5a5022c4c84be872c8cd7fd3581" is_pre_election: true
18:33:25.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.841146  5608 raft_consensus.cc:2468] T bf4e623aabd94032905e80f9a4dbc79e P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6008cdf76d9e456ca635ad5aeccc6c61 in term 0.
18:33:25.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.840967  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4e623aabd94032905e80f9a4dbc79e" candidate_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5454fd94967f4e178a493e84ecdce8e2" is_pre_election: true
18:33:25.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.841867  5466 raft_consensus.cc:2468] T bf4e623aabd94032905e80f9a4dbc79e P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6008cdf76d9e456ca635ad5aeccc6c61 in term 0.
18:33:25.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.843468  5260 leader_election.cc:304] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5454fd94967f4e178a493e84ecdce8e2, 6008cdf76d9e456ca635ad5aeccc6c61; no voters: 
18:33:25.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.844446  6618 raft_consensus.cc:2804] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:33:25.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.844758  6618 raft_consensus.cc:493] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:33:25.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.845057  6618 raft_consensus.cc:3060] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [term 0 FOLLOWER]: Advancing to term 1
18:33:25.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.852238  6618 raft_consensus.cc:515] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } }
18:33:25.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.854154  6618 leader_election.cc:290] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [CANDIDATE]: Term 1 election: Requested vote from peers 928ff5a5022c4c84be872c8cd7fd3581 (127.4.179.3:43889), 5454fd94967f4e178a493e84ecdce8e2 (127.4.179.2:33745)
18:33:25.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.855008  5608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4e623aabd94032905e80f9a4dbc79e" candidate_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "928ff5a5022c4c84be872c8cd7fd3581"
18:33:25.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.855513  5608 raft_consensus.cc:3060] T bf4e623aabd94032905e80f9a4dbc79e P 928ff5a5022c4c84be872c8cd7fd3581 [term 0 FOLLOWER]: Advancing to term 1
18:33:25.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.855409  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4e623aabd94032905e80f9a4dbc79e" candidate_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5454fd94967f4e178a493e84ecdce8e2"
18:33:25.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.856019  5466 raft_consensus.cc:3060] T bf4e623aabd94032905e80f9a4dbc79e P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Advancing to term 1
18:33:25.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.861739  5608 raft_consensus.cc:2468] T bf4e623aabd94032905e80f9a4dbc79e P 928ff5a5022c4c84be872c8cd7fd3581 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6008cdf76d9e456ca635ad5aeccc6c61 in term 1.
18:33:25.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.862972  5259 leader_election.cc:304] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6008cdf76d9e456ca635ad5aeccc6c61, 928ff5a5022c4c84be872c8cd7fd3581; no voters: 
18:33:25.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.865713  6618 raft_consensus.cc:2804] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [term 1 FOLLOWER]: Leader election won for term 1
18:33:25.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.866999  5466 raft_consensus.cc:2468] T bf4e623aabd94032905e80f9a4dbc79e P 5454fd94967f4e178a493e84ecdce8e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6008cdf76d9e456ca635ad5aeccc6c61 in term 1.
18:33:25.883 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:25.883 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:25.884 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:25.884 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.884 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.884 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:25.885 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.885 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.885 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:25.885 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.885 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.885 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:25.885 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:25.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.892989  6618 raft_consensus.cc:697] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [term 1 LEADER]: Becoming Leader. State: Replica: 6008cdf76d9e456ca635ad5aeccc6c61, State: Running, Role: LEADER
18:33:25.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.894436  6618 consensus_queue.cc:237] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } }
18:33:25.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.901742  6530 heartbeater.cc:499] Master 127.5.136.62:42905 was elected leader, sending a full tablet report...
18:33:25.906 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:25.919 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:25.919 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:25.919 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:25.919 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:25.919 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:25.919 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:25.919 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:25.919 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:25.919 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:25.919 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:25.920 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:25.920 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:25.920 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:25.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:25.929404  4857 catalog_manager.cc:5696] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6008cdf76d9e456ca635ad5aeccc6c61 (127.4.179.1). New cstate: current_term: 1 leader_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } health_report { overall_health: UNKNOWN } } }
18:33:26.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.064802  6629 raft_consensus.cc:493] T 7f92012997064cd8962f208efb8dce40 P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:33:26.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.065274  6629 raft_consensus.cc:515] T 7f92012997064cd8962f208efb8dce40 P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 } } peers { permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 } } peers { permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 } }
18:33:26.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.067260  6629 leader_election.cc:290] T 7f92012997064cd8962f208efb8dce40 P 5454fd94967f4e178a493e84ecdce8e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6008cdf76d9e456ca635ad5aeccc6c61 (127.4.179.1:45253), 928ff5a5022c4c84be872c8cd7fd3581 (127.4.179.3:43889)
18:33:26.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.068058  5324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f92012997064cd8962f208efb8dce40" candidate_uuid: "5454fd94967f4e178a493e84ecdce8e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" is_pre_election: true
18:33:26.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.068833  5324 raft_consensus.cc:2393] T 7f92012997064cd8962f208efb8dce40 P 6008cdf76d9e456ca635ad5aeccc6c61 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5454fd94967f4e178a493e84ecdce8e2 in current term 1: Already voted for candidate 928ff5a5022c4c84be872c8cd7fd3581 in this term.
18:33:26.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.068794  5608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f92012997064cd8962f208efb8dce40" candidate_uuid: "5454fd94967f4e178a493e84ecdce8e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "928ff5a5022c4c84be872c8cd7fd3581" is_pre_election: true
18:33:26.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.070510  5402 leader_election.cc:304] T 7f92012997064cd8962f208efb8dce40 P 5454fd94967f4e178a493e84ecdce8e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5454fd94967f4e178a493e84ecdce8e2; no voters: 6008cdf76d9e456ca635ad5aeccc6c61, 928ff5a5022c4c84be872c8cd7fd3581
18:33:26.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.071920  6629 raft_consensus.cc:3060] T 7f92012997064cd8962f208efb8dce40 P 5454fd94967f4e178a493e84ecdce8e2 [term 0 FOLLOWER]: Advancing to term 1
18:33:26.076 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table fab365c4f81c4747993e0603891a5ae6
18:33:26.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.077984  6629 raft_consensus.cc:2749] T 7f92012997064cd8962f208efb8dce40 P 5454fd94967f4e178a493e84ecdce8e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:33:26.080 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet bf4e623aabd94032905e80f9a4dbc79e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:26.080 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 7f92012997064cd8962f208efb8dce40 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:26.080 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 5ee352da413147d39a7f82bb88ff1dda for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:26.081 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=bf4e623aabd94032905e80f9a4dbc79e@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745),6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)[L],928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=7f92012997064cd8962f208efb8dce40@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745),6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253),928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=5ee352da413147d39a7f82bb88ff1dda@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)[L],6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253),928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)]}]
18:33:26.081 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.179.62:35121, [4ms] Sub RPC GetTableLocations: received response from server master-127.4.179.62:35121: OK, deferred=null) after lookup
18:33:26.081 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)] connecting to peer
18:33:26.082 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)] Successfully connected to peer
18:33:26.092 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:26.095 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x0335d1c9, L:/127.0.0.1:54582 - R:/127.4.179.1:45253] using TOKEN/null
18:33:26.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.109438  5608 raft_consensus.cc:1275] T bf4e623aabd94032905e80f9a4dbc79e P 928ff5a5022c4c84be872c8cd7fd3581 [term 1 FOLLOWER]: Refusing update from remote peer 6008cdf76d9e456ca635ad5aeccc6c61: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:33:26.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.109429  5466 raft_consensus.cc:1275] T bf4e623aabd94032905e80f9a4dbc79e P 5454fd94967f4e178a493e84ecdce8e2 [term 1 FOLLOWER]: Refusing update from remote peer 6008cdf76d9e456ca635ad5aeccc6c61: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:33:26.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.110984  6618 consensus_queue.cc:1048] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:33:26.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.112003  6652 consensus_queue.cc:1048] T bf4e623aabd94032905e80f9a4dbc79e P 6008cdf76d9e456ca635ad5aeccc6c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:33:26.129 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:26.129 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:26.129 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:26.130 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:26.130 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:26.130 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:26.130 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:26.130 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:26.130 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:26.131 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:26.131 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:26.131 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:26.131 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:26.135 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:26.135 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:26.136 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:26.136 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.136 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.136 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.136 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.136 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.136 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.139 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.139 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.139 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.139 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:26.153 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:26.153 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:26.153 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:26.154 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.154 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.154 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.154 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.154 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.154 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.158 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.158 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.158 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.158 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.164618  6625 consensus_queue.cc:1048] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5454fd94967f4e178a493e84ecdce8e2" member_type: VOTER last_known_addr { host: "127.4.179.2" port: 33745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:33:26.196 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:26.196 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:26.196 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:26.198 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.198 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.198 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.198 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.198 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.198 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.199 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.199 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.199 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.199 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:26.220 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:26.220 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:26.220 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:26.220 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.220 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.220 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.221 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.221 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.221 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.221 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.221 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.221 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.221 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.222258  6625 consensus_queue.cc:1048] T 7f92012997064cd8962f208efb8dce40 P 928ff5a5022c4c84be872c8cd7fd3581 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:33:26.227 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:26.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.234428  6629 consensus_queue.cc:1048] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "928ff5a5022c4c84be872c8cd7fd3581" member_type: VOTER last_known_addr { host: "127.4.179.3" port: 43889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:33:26.245 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:26.245 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:26.246 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:26.246 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:26.246 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:26.246 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:26.246 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:26.246 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:26.246 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:26.246 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:26.246 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:26.246 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:26.246 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:26.260 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:26.260 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:26.260 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:26.261 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.261 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.261 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.261 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.261 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.261 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.262 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.262 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.262 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.262 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:26.270 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:26.270 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:26.270 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:26.271 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:26.271 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:26.271 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:26.271 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:26.271 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:26.271 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:26.273 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:26.273 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:26.273 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:26.273 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:26.287 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:26.288 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:26.288 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:26.288 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:26.288 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:26.288 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:26.288 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:26.289 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:26.289 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:26.289 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:26.289 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:26.289 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:26.289 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:26.300 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:26.301 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:26.301 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:26.302 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.302 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.302 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.302 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.302 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.302 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.303 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.303 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.303 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.303 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:26.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.312868  6668 consensus_queue.cc:1048] T 5ee352da413147d39a7f82bb88ff1dda P 5454fd94967f4e178a493e84ecdce8e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6008cdf76d9e456ca635ad5aeccc6c61" member_type: VOTER last_known_addr { host: "127.4.179.1" port: 45253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
18:33:26.321 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:26.339 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:26.339 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:26.340 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:26.340 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.340 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.340 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:26.341 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.341 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.341 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:26.341 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.341 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.341 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:26.341 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:26.406 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:26.443 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:26.443 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:26.443 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:26.443 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:26.444 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:26.444 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:26.444 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:26.444 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:26.444 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:26.444 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:26.444 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:26.445 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:26.445 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:26.561 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:26.562 [ERROR - main] (HashedWheelTimer.java:470) You are creating too many HashedWheelTimer instances. HashedWheelTimer is a shared resource that must be reused across the JVM, so that only a few instances are created.
18:33:26.563 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:26.565 [DEBUG - main] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:33:26.566 [DEBUG - main] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:33:26.567 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.5.136.60:39171(127.5.136.60:39171)] Successfully connected to peer
18:33:26.570 [DEBUG - main] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:33:26.571 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.5.136.62:42905(127.5.136.62:42905)] Successfully connected to peer
18:33:26.578 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.62
18:33:26.585 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.5.136.61:43625(127.5.136.61:43625)] Successfully connected to peer
18:33:26.588 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:26.591 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.60
18:33:26.599 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.61
18:33:26.600 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:26.602 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x2123a23a, L:/127.0.0.1:41622 - R:/127.5.136.62:42905] using SASL/PLAIN
18:33:26.605 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:33:26.605 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=41), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [40ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: OK, deferred=null) after lookup
18:33:26.611 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:26.612 [DEBUG - main] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:26.613 [DEBUG - main] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:26.615 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:26.615 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:26.615 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:26.615 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:26.615 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:26.615 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:26.615 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:26.615 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:26.615 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:26.615 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.179.62:35121(127.4.179.62:35121)] Successfully connected to peer
18:33:26.615 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:26.615 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:26.616 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:26.616 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:26.616 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:26.616 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:26.616 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:26.616 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:26.616 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:26.616 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:26.616 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:26.616 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:26.616 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:26.617 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:26.617 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:26.616 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:26.617 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:26.617 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2c75d0c9, L:/127.0.0.1:40272 - R:/127.5.136.60:39171] using SASL/PLAIN
18:33:26.618 [DEBUG - main] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:26.619 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x3a2c29f4, L:/127.0.0.1:38212 - R:/127.5.136.61:43625] using SASL/PLAIN
18:33:26.621 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.179.60:34679(127.4.179.60:34679)] Successfully connected to peer
18:33:26.624 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.62
18:33:26.625 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:26.625 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:26.625 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:26.625 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:26.626 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:26.626 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:26.626 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:26.626 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:26.626 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:26.626 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:26.626 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:26.626 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:26.626 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:26.628 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:26.629 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:26.629 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:26.629 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:26.629 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:26.629 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:26.629 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:26.629 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:26.629 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:26.629 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:26.629 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:26.629 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:26.629 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:26.630 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.60
18:33:26.638 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.179.61:44733(127.4.179.61:44733)] Successfully connected to peer
18:33:26.640 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:26.644 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x12fc4453, L:/127.0.0.1:55580 - R:/127.4.179.62:35121] using SASL/PLAIN
18:33:26.651 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:33:26.651 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=42), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [39ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: OK, deferred=null) after lookup
18:33:26.657 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table fab365c4f81c4747993e0603891a5ae6
18:33:26.661 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:26.662 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet bf4e623aabd94032905e80f9a4dbc79e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:26.662 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 7f92012997064cd8962f208efb8dce40 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:26.662 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 5ee352da413147d39a7f82bb88ff1dda for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:26.663 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=bf4e623aabd94032905e80f9a4dbc79e@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745),6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)[L],928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=7f92012997064cd8962f208efb8dce40@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745),6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253),928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=5ee352da413147d39a7f82bb88ff1dda@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)[L],6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253),928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)]}]
18:33:26.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.665932  5711 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41622:
18:33:26.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
18:33:26.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
18:33:26.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:33:26.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
18:33:26.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:33:26.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:33:26.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:33:26.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:33:26.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:33:26.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\001d\000\000\000"
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
18:33:26.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:33:26.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
18:33:26.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:33:26.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:33:26.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:33:26.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
18:33:26.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:26.671977  5711 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
18:33:26.677 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x6232077b, L:/127.0.0.1:35464 - R:/127.4.179.60:34679] using SASL/PLAIN
18:33:26.688 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:26.688 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:26.688 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:26.689 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:26.689 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:26.689 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:26.689 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:26.689 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:26.689 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:26.690 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:26.690 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.61
18:33:26.690 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:26.690 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:26.690 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:26.699 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:26.704 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xcee42551, L:/127.0.0.1:44000 - R:/127.4.179.61:44733] using SASL/PLAIN
18:33:26.727 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:26.818 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 616ea92ec0b3496fb52deb2da91bd772
18:33:26.821 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:26.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.873703  6104 tablet_service.cc:1511] Processing CreateTablet for tablet eae68b231bec4d52a4b3372911249c5e (DEFAULT_TABLE table=replication_test_table [id=616ea92ec0b3496fb52deb2da91bd772]), partition=RANGE (key1) PARTITION VALUES < 100
18:33:26.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.882069  6104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae68b231bec4d52a4b3372911249c5e. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:26.905 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:26.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.905622  6463 tablet_service.cc:1511] Processing CreateTablet for tablet eae68b231bec4d52a4b3372911249c5e (DEFAULT_TABLE table=replication_test_table [id=616ea92ec0b3496fb52deb2da91bd772]), partition=RANGE (key1) PARTITION VALUES < 100
18:33:26.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.907910  6463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae68b231bec4d52a4b3372911249c5e. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:26.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.914819  6321 tablet_service.cc:1511] Processing CreateTablet for tablet eae68b231bec4d52a4b3372911249c5e (DEFAULT_TABLE table=replication_test_table [id=616ea92ec0b3496fb52deb2da91bd772]), partition=RANGE (key1) PARTITION VALUES < 100
18:33:26.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.920426  6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae68b231bec4d52a4b3372911249c5e. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:26.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.932444  6705 tablet_bootstrap.cc:492] T eae68b231bec4d52a4b3372911249c5e P 422c1c063b1444b38bf3ee5a445401d1: Bootstrap starting.
18:33:26.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.942008  6705 tablet_bootstrap.cc:654] T eae68b231bec4d52a4b3372911249c5e P 422c1c063b1444b38bf3ee5a445401d1: Neither blocks nor log segments found. Creating new log.
18:33:26.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.944623  6705 log.cc:826] T eae68b231bec4d52a4b3372911249c5e P 422c1c063b1444b38bf3ee5a445401d1: Log is configured to *not* fsync() on all Append() calls
18:33:26.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.945338  6706 tablet_bootstrap.cc:492] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b: Bootstrap starting.
18:33:26.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.955741  6706 tablet_bootstrap.cc:654] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b: Neither blocks nor log segments found. Creating new log.
18:33:26.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.957957  6706 log.cc:826] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b: Log is configured to *not* fsync() on all Append() calls
18:33:26.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.967571  6705 tablet_bootstrap.cc:492] T eae68b231bec4d52a4b3372911249c5e P 422c1c063b1444b38bf3ee5a445401d1: No bootstrap required, opened a new log
18:33:26.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.968137  6705 ts_tablet_manager.cc:1403] T eae68b231bec4d52a4b3372911249c5e P 422c1c063b1444b38bf3ee5a445401d1: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.007s
18:33:26.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.973110  6706 tablet_bootstrap.cc:492] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b: No bootstrap required, opened a new log
18:33:26.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.973753  6706 ts_tablet_manager.cc:1403] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.008s
18:33:26.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.983597  6709 tablet_bootstrap.cc:492] T eae68b231bec4d52a4b3372911249c5e P 9ea5388f32294500b5ec5ef882b64ee6: Bootstrap starting.
18:33:26.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.997192  6709 tablet_bootstrap.cc:654] T eae68b231bec4d52a4b3372911249c5e P 9ea5388f32294500b5ec5ef882b64ee6: Neither blocks nor log segments found. Creating new log.
18:33:27.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:26.999804  6709 log.cc:826] T eae68b231bec4d52a4b3372911249c5e P 9ea5388f32294500b5ec5ef882b64ee6: Log is configured to *not* fsync() on all Append() calls
18:33:27.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.003906  6706 raft_consensus.cc:359] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } }
18:33:27.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.004912  6706 raft_consensus.cc:385] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:27.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.005216  6706 raft_consensus.cc:740] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bca326a30e144d5080c5b2dd919d9c4b, State: Initialized, Role: FOLLOWER
18:33:27.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.006204  6709 tablet_bootstrap.cc:492] T eae68b231bec4d52a4b3372911249c5e P 9ea5388f32294500b5ec5ef882b64ee6: No bootstrap required, opened a new log
18:33:27.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.006763  6709 ts_tablet_manager.cc:1403] T eae68b231bec4d52a4b3372911249c5e P 9ea5388f32294500b5ec5ef882b64ee6: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
18:33:27.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.006251  6706 consensus_queue.cc:260] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } }
18:33:27.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.007524  6705 raft_consensus.cc:359] T eae68b231bec4d52a4b3372911249c5e P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } }
18:33:27.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.008574  6705 raft_consensus.cc:385] T eae68b231bec4d52a4b3372911249c5e P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:27.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.008956  6705 raft_consensus.cc:740] T eae68b231bec4d52a4b3372911249c5e P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 422c1c063b1444b38bf3ee5a445401d1, State: Initialized, Role: FOLLOWER
18:33:27.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.009918  6705 consensus_queue.cc:260] T eae68b231bec4d52a4b3372911249c5e P 422c1c063b1444b38bf3ee5a445401d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } }
18:33:27.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.020243  6705 ts_tablet_manager.cc:1434] T eae68b231bec4d52a4b3372911249c5e P 422c1c063b1444b38bf3ee5a445401d1: Time spent starting tablet: real 0.052s	user 0.034s	sys 0.007s
18:33:27.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.026603  6706 ts_tablet_manager.cc:1434] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b: Time spent starting tablet: real 0.052s	user 0.034s	sys 0.000s
18:33:27.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.042415  6709 raft_consensus.cc:359] T eae68b231bec4d52a4b3372911249c5e P 9ea5388f32294500b5ec5ef882b64ee6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } }
18:33:27.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.043479  6709 raft_consensus.cc:385] T eae68b231bec4d52a4b3372911249c5e P 9ea5388f32294500b5ec5ef882b64ee6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:27.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.043807  6709 raft_consensus.cc:740] T eae68b231bec4d52a4b3372911249c5e P 9ea5388f32294500b5ec5ef882b64ee6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ea5388f32294500b5ec5ef882b64ee6, State: Initialized, Role: FOLLOWER
18:33:27.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.044591  6709 consensus_queue.cc:260] T eae68b231bec4d52a4b3372911249c5e P 9ea5388f32294500b5ec5ef882b64ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } }
18:33:27.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.053107  6709 ts_tablet_manager.cc:1434] T eae68b231bec4d52a4b3372911249c5e P 9ea5388f32294500b5ec5ef882b64ee6: Time spent starting tablet: real 0.046s	user 0.030s	sys 0.005s
18:33:27.076 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:27.076 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:27.076 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:27.077 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:27.077 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:27.077 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:27.077 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:27.077 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:27.077 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:27.078 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:27.078 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:27.078 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:27.078 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:27.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:27.116353  6535 tablet.cc:2406] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:33:27.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.122313  6711 raft_consensus.cc:493] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:33:27.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.123154  6711 raft_consensus.cc:515] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } }
18:33:27.129 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:27.129 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:27.129 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:27.130 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:27.130 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:27.130 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:27.130 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:27.130 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:27.130 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:27.130 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:27.130 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:27.130 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:27.130 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:27.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.127084  6711 leader_election.cc:290] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 422c1c063b1444b38bf3ee5a445401d1 (127.5.136.1:34063), 9ea5388f32294500b5ec5ef882b64ee6 (127.5.136.2:43565)
18:33:27.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.141484  6140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae68b231bec4d52a4b3372911249c5e" candidate_uuid: "bca326a30e144d5080c5b2dd919d9c4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "422c1c063b1444b38bf3ee5a445401d1" is_pre_election: true
18:33:27.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.142644  6140 raft_consensus.cc:2468] T eae68b231bec4d52a4b3372911249c5e P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bca326a30e144d5080c5b2dd919d9c4b in term 0.
18:33:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.144439  6418 leader_election.cc:304] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 422c1c063b1444b38bf3ee5a445401d1, bca326a30e144d5080c5b2dd919d9c4b; no voters: 
18:33:27.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.145435  6711 raft_consensus.cc:2804] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Leader pre-election won for term 1
18:33:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.145881  6711 raft_consensus.cc:493] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:33:27.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.146232  6711 raft_consensus.cc:3060] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Advancing to term 1
18:33:27.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.147280  6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae68b231bec4d52a4b3372911249c5e" candidate_uuid: "bca326a30e144d5080c5b2dd919d9c4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ea5388f32294500b5ec5ef882b64ee6" is_pre_election: true
18:33:27.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.148231  6341 raft_consensus.cc:2468] T eae68b231bec4d52a4b3372911249c5e P 9ea5388f32294500b5ec5ef882b64ee6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bca326a30e144d5080c5b2dd919d9c4b in term 0.
18:33:27.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.152151  6711 raft_consensus.cc:515] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } }
18:33:27.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.153561  6711 leader_election.cc:290] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [CANDIDATE]: Term 1 election: Requested vote from peers 422c1c063b1444b38bf3ee5a445401d1 (127.5.136.1:34063), 9ea5388f32294500b5ec5ef882b64ee6 (127.5.136.2:43565)
18:33:27.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.154347  6140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae68b231bec4d52a4b3372911249c5e" candidate_uuid: "bca326a30e144d5080c5b2dd919d9c4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "422c1c063b1444b38bf3ee5a445401d1"
18:33:27.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.154526  6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae68b231bec4d52a4b3372911249c5e" candidate_uuid: "bca326a30e144d5080c5b2dd919d9c4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ea5388f32294500b5ec5ef882b64ee6"
18:33:27.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.155053  6140 raft_consensus.cc:3060] T eae68b231bec4d52a4b3372911249c5e P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Advancing to term 1
18:33:27.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.155140  6341 raft_consensus.cc:3060] T eae68b231bec4d52a4b3372911249c5e P 9ea5388f32294500b5ec5ef882b64ee6 [term 0 FOLLOWER]: Advancing to term 1
18:33:27.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.160270  6341 raft_consensus.cc:2468] T eae68b231bec4d52a4b3372911249c5e P 9ea5388f32294500b5ec5ef882b64ee6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bca326a30e144d5080c5b2dd919d9c4b in term 1.
18:33:27.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.160446  6140 raft_consensus.cc:2468] T eae68b231bec4d52a4b3372911249c5e P 422c1c063b1444b38bf3ee5a445401d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bca326a30e144d5080c5b2dd919d9c4b in term 1.
18:33:27.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.161402  6417 leader_election.cc:304] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ea5388f32294500b5ec5ef882b64ee6, bca326a30e144d5080c5b2dd919d9c4b; no voters: 
18:33:27.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.162129  6711 raft_consensus.cc:2804] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [term 1 FOLLOWER]: Leader election won for term 1
18:33:27.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.164477  6711 raft_consensus.cc:697] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [term 1 LEADER]: Becoming Leader. State: Replica: bca326a30e144d5080c5b2dd919d9c4b, State: Running, Role: LEADER
18:33:27.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.166076  6711 consensus_queue.cc:237] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } }
18:33:27.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.182984  5712 catalog_manager.cc:5696] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b reported cstate change: term changed from 0 to 1, leader changed from <none> to bca326a30e144d5080c5b2dd919d9c4b (127.5.136.3). New cstate: current_term: 1 leader_uuid: "bca326a30e144d5080c5b2dd919d9c4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } health_report { overall_health: UNKNOWN } } }
18:33:27.208 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:27.208 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:27.209 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:27.209 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:27.209 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:27.209 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:27.209 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:27.209 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:27.209 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:27.209 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:27.209 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:27.209 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:27.209 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.210289  5712 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41622:
18:33:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
18:33:27.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:27.222667  6200 tablet.cc:2406] T eae68b231bec4d52a4b3372911249c5e P 422c1c063b1444b38bf3ee5a445401d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:33:27.227 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:27.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:27.235922  5712 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0ca41259ca7743c99aac8ead8fb35574 has no consensus state
18:33:27.258 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:27.258 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:27.258 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:27.259 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:27.259 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:27.259 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:27.259 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:27.259 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:27.259 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:27.259 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:27.259 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:27.259 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:27.259 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:27.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:27.260298  6393 tablet.cc:2406] T eae68b231bec4d52a4b3372911249c5e P 9ea5388f32294500b5ec5ef882b64ee6: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:33:27.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.263170  6104 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca41259ca7743c99aac8ead8fb35574 (DEFAULT_TABLE table=replication_test_table [id=616ea92ec0b3496fb52deb2da91bd772]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
18:33:27.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.264410  6104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca41259ca7743c99aac8ead8fb35574. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:27.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.270007  6463 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca41259ca7743c99aac8ead8fb35574 (DEFAULT_TABLE table=replication_test_table [id=616ea92ec0b3496fb52deb2da91bd772]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
18:33:27.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.271198  6463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca41259ca7743c99aac8ead8fb35574. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:27.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.274893  6321 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca41259ca7743c99aac8ead8fb35574 (DEFAULT_TABLE table=replication_test_table [id=616ea92ec0b3496fb52deb2da91bd772]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
18:33:27.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.276032  6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca41259ca7743c99aac8ead8fb35574. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:27.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:27.283005  5698 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 0ca41259ca7743c99aac8ead8fb35574 (table replication_test_table [id=616ea92ec0b3496fb52deb2da91bd772], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0ca41259ca7743c99aac8ead8fb35574 consensus state has no leader
18:33:27.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.285674  6705 tablet_bootstrap.cc:492] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1: Bootstrap starting.
18:33:27.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.290635  6706 tablet_bootstrap.cc:492] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b: Bootstrap starting.
18:33:27.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.290683  6709 tablet_bootstrap.cc:492] T 0ca41259ca7743c99aac8ead8fb35574 P 9ea5388f32294500b5ec5ef882b64ee6: Bootstrap starting.
18:33:27.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.293651  6705 tablet_bootstrap.cc:654] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1: Neither blocks nor log segments found. Creating new log.
18:33:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.297672  6709 tablet_bootstrap.cc:654] T 0ca41259ca7743c99aac8ead8fb35574 P 9ea5388f32294500b5ec5ef882b64ee6: Neither blocks nor log segments found. Creating new log.
18:33:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.298121  6706 tablet_bootstrap.cc:654] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b: Neither blocks nor log segments found. Creating new log.
18:33:27.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.310562  6706 tablet_bootstrap.cc:492] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b: No bootstrap required, opened a new log
18:33:27.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.311056  6706 ts_tablet_manager.cc:1403] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
18:33:27.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.311244  6705 tablet_bootstrap.cc:492] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1: No bootstrap required, opened a new log
18:33:27.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.311666  6705 ts_tablet_manager.cc:1403] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
18:33:27.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.314320  6705 raft_consensus.cc:359] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.314445  6706 raft_consensus.cc:359] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.314985  6705 raft_consensus.cc:385] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:27.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.315203  6706 raft_consensus.cc:385] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:27.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.315281  6705 raft_consensus.cc:740] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 422c1c063b1444b38bf3ee5a445401d1, State: Initialized, Role: FOLLOWER
18:33:27.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.315502  6706 raft_consensus.cc:740] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bca326a30e144d5080c5b2dd919d9c4b, State: Initialized, Role: FOLLOWER
18:33:27.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.316042  6705 consensus_queue.cc:260] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.316569  6706 consensus_queue.cc:260] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.319540  6705 ts_tablet_manager.cc:1434] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
18:33:27.323 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:27.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.329268  6709 tablet_bootstrap.cc:492] T 0ca41259ca7743c99aac8ead8fb35574 P 9ea5388f32294500b5ec5ef882b64ee6: No bootstrap required, opened a new log
18:33:27.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.329839  6709 ts_tablet_manager.cc:1403] T 0ca41259ca7743c99aac8ead8fb35574 P 9ea5388f32294500b5ec5ef882b64ee6: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.009s
18:33:27.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.333259  6709 raft_consensus.cc:359] T 0ca41259ca7743c99aac8ead8fb35574 P 9ea5388f32294500b5ec5ef882b64ee6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.334129  6709 raft_consensus.cc:385] T 0ca41259ca7743c99aac8ead8fb35574 P 9ea5388f32294500b5ec5ef882b64ee6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:27.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.334630  6709 raft_consensus.cc:740] T 0ca41259ca7743c99aac8ead8fb35574 P 9ea5388f32294500b5ec5ef882b64ee6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ea5388f32294500b5ec5ef882b64ee6, State: Initialized, Role: FOLLOWER
18:33:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.335551  6709 consensus_queue.cc:260] T 0ca41259ca7743c99aac8ead8fb35574 P 9ea5388f32294500b5ec5ef882b64ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.338210  6709 ts_tablet_manager.cc:1434] T 0ca41259ca7743c99aac8ead8fb35574 P 9ea5388f32294500b5ec5ef882b64ee6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
18:33:27.341 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:27.341 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:27.342 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:27.343 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:27.343 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:27.343 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:27.348 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:27.348 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:27.348 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:27.349 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:27.349 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:27.349 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:27.349 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:27.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.349231  5712 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779: replication_test_table [id=616ea92ec0b3496fb52deb2da91bd772] alter complete (version 0)
18:33:27.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.359509  5711 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41622:
18:33:27.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001\310\000\000\000\007\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
18:33:27.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.362630  6706 ts_tablet_manager.cc:1434] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.001s
18:33:27.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:27.404222  5711 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0ca41259ca7743c99aac8ead8fb35574 consensus state has no leader
18:33:27.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:27.404762  5711 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8ba55a97d55047f096401a4685d6b07e has no consensus state
18:33:27.411 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:27.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.432183  6463 tablet_service.cc:1511] Processing CreateTablet for tablet 8ba55a97d55047f096401a4685d6b07e (DEFAULT_TABLE table=replication_test_table [id=616ea92ec0b3496fb52deb2da91bd772]), partition=RANGE (key1) PARTITION 200 <= VALUES
18:33:27.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.433467  6463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ba55a97d55047f096401a4685d6b07e. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:27.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.439713  6712 raft_consensus.cc:493] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:33:27.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.439864  6104 tablet_service.cc:1511] Processing CreateTablet for tablet 8ba55a97d55047f096401a4685d6b07e (DEFAULT_TABLE table=replication_test_table [id=616ea92ec0b3496fb52deb2da91bd772]), partition=RANGE (key1) PARTITION 200 <= VALUES
18:33:27.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.440222  6712 raft_consensus.cc:515] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.440999  6104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ba55a97d55047f096401a4685d6b07e. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:27.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.444119  6321 tablet_service.cc:1511] Processing CreateTablet for tablet 8ba55a97d55047f096401a4685d6b07e (DEFAULT_TABLE table=replication_test_table [id=616ea92ec0b3496fb52deb2da91bd772]), partition=RANGE (key1) PARTITION 200 <= VALUES
18:33:27.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.452332  6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ba55a97d55047f096401a4685d6b07e. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:27.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.457574  6712 leader_election.cc:290] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ea5388f32294500b5ec5ef882b64ee6 (127.5.136.2:43565), bca326a30e144d5080c5b2dd919d9c4b (127.5.136.3:39901)
18:33:27.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.464816  6705 tablet_bootstrap.cc:492] T 8ba55a97d55047f096401a4685d6b07e P 422c1c063b1444b38bf3ee5a445401d1: Bootstrap starting.
18:33:27.472 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:27.472 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:27.472 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:27.473 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:27.473 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:27.473 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:27.473 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:27.473 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:27.473 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:27.474 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:27.474 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:27.474 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:27.474 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:27.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.475493  6705 tablet_bootstrap.cc:654] T 8ba55a97d55047f096401a4685d6b07e P 422c1c063b1444b38bf3ee5a445401d1: Neither blocks nor log segments found. Creating new log.
18:33:27.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.504266  6711 raft_consensus.cc:493] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:33:27.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.504786  6711 raft_consensus.cc:515] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.507045  6711 leader_election.cc:290] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 422c1c063b1444b38bf3ee5a445401d1 (127.5.136.1:34063), 9ea5388f32294500b5ec5ef882b64ee6 (127.5.136.2:43565)
18:33:27.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.508248  6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca41259ca7743c99aac8ead8fb35574" candidate_uuid: "bca326a30e144d5080c5b2dd919d9c4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ea5388f32294500b5ec5ef882b64ee6" is_pre_election: true
18:33:27.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.508899  6341 raft_consensus.cc:2468] T 0ca41259ca7743c99aac8ead8fb35574 P 9ea5388f32294500b5ec5ef882b64ee6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bca326a30e144d5080c5b2dd919d9c4b in term 0.
18:33:27.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.510126  6140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca41259ca7743c99aac8ead8fb35574" candidate_uuid: "bca326a30e144d5080c5b2dd919d9c4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "422c1c063b1444b38bf3ee5a445401d1" is_pre_election: true
18:33:27.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.510138  6417 leader_election.cc:304] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ea5388f32294500b5ec5ef882b64ee6, bca326a30e144d5080c5b2dd919d9c4b; no voters: 
18:33:27.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.510989  6711 raft_consensus.cc:2804] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Leader pre-election won for term 1
18:33:27.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.511332  6711 raft_consensus.cc:493] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:33:27.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.511665  6711 raft_consensus.cc:3060] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Advancing to term 1
18:33:27.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.510753  6140 raft_consensus.cc:2468] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bca326a30e144d5080c5b2dd919d9c4b in term 0.
18:33:27.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.523571  6711 raft_consensus.cc:515] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.529603  6711 leader_election.cc:290] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [CANDIDATE]: Term 1 election: Requested vote from peers 422c1c063b1444b38bf3ee5a445401d1 (127.5.136.1:34063), 9ea5388f32294500b5ec5ef882b64ee6 (127.5.136.2:43565)
18:33:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.530792  6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca41259ca7743c99aac8ead8fb35574" candidate_uuid: "bca326a30e144d5080c5b2dd919d9c4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ea5388f32294500b5ec5ef882b64ee6"
18:33:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.531322  6706 tablet_bootstrap.cc:492] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b: Bootstrap starting.
18:33:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.531426  6341 raft_consensus.cc:3060] T 0ca41259ca7743c99aac8ead8fb35574 P 9ea5388f32294500b5ec5ef882b64ee6 [term 0 FOLLOWER]: Advancing to term 1
18:33:27.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.535411  6709 tablet_bootstrap.cc:492] T 8ba55a97d55047f096401a4685d6b07e P 9ea5388f32294500b5ec5ef882b64ee6: Bootstrap starting.
18:33:27.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.538417  6706 tablet_bootstrap.cc:654] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b: Neither blocks nor log segments found. Creating new log.
18:33:27.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.538609  6341 raft_consensus.cc:2468] T 0ca41259ca7743c99aac8ead8fb35574 P 9ea5388f32294500b5ec5ef882b64ee6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bca326a30e144d5080c5b2dd919d9c4b in term 1.
18:33:27.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.539948  6417 leader_election.cc:304] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ea5388f32294500b5ec5ef882b64ee6, bca326a30e144d5080c5b2dd919d9c4b; no voters: 
18:33:27.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.541231  6711 raft_consensus.cc:2804] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [term 1 FOLLOWER]: Leader election won for term 1
18:33:27.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.543357  6709 tablet_bootstrap.cc:654] T 8ba55a97d55047f096401a4685d6b07e P 9ea5388f32294500b5ec5ef882b64ee6: Neither blocks nor log segments found. Creating new log.
18:33:27.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.547781  6140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca41259ca7743c99aac8ead8fb35574" candidate_uuid: "bca326a30e144d5080c5b2dd919d9c4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "422c1c063b1444b38bf3ee5a445401d1"
18:33:27.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.548455  6140 raft_consensus.cc:3060] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Advancing to term 1
18:33:27.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.550923  6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca41259ca7743c99aac8ead8fb35574" candidate_uuid: "422c1c063b1444b38bf3ee5a445401d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ea5388f32294500b5ec5ef882b64ee6" is_pre_election: true
18:33:27.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.553514  6483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca41259ca7743c99aac8ead8fb35574" candidate_uuid: "422c1c063b1444b38bf3ee5a445401d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bca326a30e144d5080c5b2dd919d9c4b" is_pre_election: true
18:33:27.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.557595  6711 raft_consensus.cc:697] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [term 1 LEADER]: Becoming Leader. State: Replica: bca326a30e144d5080c5b2dd919d9c4b, State: Running, Role: LEADER
18:33:27.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.560679  6140 raft_consensus.cc:2468] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bca326a30e144d5080c5b2dd919d9c4b in term 1.
18:33:27.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.561094  6341 raft_consensus.cc:2393] T 0ca41259ca7743c99aac8ead8fb35574 P 9ea5388f32294500b5ec5ef882b64ee6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 422c1c063b1444b38bf3ee5a445401d1 in current term 1: Already voted for candidate bca326a30e144d5080c5b2dd919d9c4b in this term.
18:33:27.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.565692  6705 tablet_bootstrap.cc:492] T 8ba55a97d55047f096401a4685d6b07e P 422c1c063b1444b38bf3ee5a445401d1: No bootstrap required, opened a new log
18:33:27.568 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:27.568 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:27.568 [DEBUG - pool-288-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:27.569 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:27.569 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:27.569 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:27.571 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:27.571 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:27.571 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:27.571 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:27.571 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:27.572 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:27.572 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:27.572 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27277), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [9ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [79ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [87ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [95ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [180ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [185ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [195ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [196ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [353ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [357ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [358ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [359ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [359ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [402ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [422ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [459ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [462ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [482ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [663ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [761ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [761ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [762ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [801ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [801ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [803ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [803ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2480ms] refreshing cache from master, [2480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2481ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [6240ms] refreshing cache from master, [6240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [6241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [6241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [6241ms] too many traces: truncated at 100 traces, deferred=Deferred@816025557(state=PENDING, result=null, callback=(continuation of Deferred@447947143 after retry RPC after error@819041710) -> (continuation of Deferred@670362977 after retry RPC after error@193270637) -> (continuation of Deferred@137995395 after retry RPC after error@888745167) -> (continuation of Deferred@887509204 after retry RPC after error@391848798) -> (continuation of Deferred@1375961226 after retry RPC after error@794902865) -> (continuation of Deferred@696763545 after retry RPC after error@1728598820) -> (continuation of Deferred@692164767 after retry RPC after error@210710319) -> (continuation of Deferred@456884523 after retry RPC after error@1041195035) -> (continuation of Deferred@456102437 after retry RPC after error@1856778296) -> (continuation of Deferred@693753375 after retry RPC after error@1821602967) -> (continuation of Deferred@189431194 after retry RPC after error@73965883) -> (continuation of Deferred@1676043911 after retry RPC after error@338071968) -> (continuation of Deferred@1289259027 after retry RPC after error@234392010) -> (continuation of Deferred@1568281772 after retry RPC after error@2104571186) -> (continuation of Deferred@1977725599 after retry RPC after error@1008653104) -> (continuation of Deferred@835485547 after retry RPC after error@1172309189) -> (continuation of Deferred@1038951340 after retry RPC after error@2007031922) -> (continuation of Deferred@633732810 after retry RPC after error@1623593115) -> (continuation of Deferred@887275372 after retry RPC after error@1144089330) -> (continuation of Deferred@1309212432 after retry RPC after error@513440898) -> (continuation of Deferred@1067624930 after retry RPC after error@1879777822) -> (continuation of Deferred@2045944688 after retry RPC after error@885112480) -> (continuation of Deferred@512158819 after retry RPC after error@934557311) -> (continuation of Deferred@1538386650 after retry RPC after error@1656515506), errback=(continuation of Deferred@447947143 after retry RPC after error@819041710) -> (continuation of Deferred@670362977 after retry RPC after error@193270637) -> (continuation of Deferred@137995395 after retry RPC after error@888745167) -> (continuation of Deferred@887509204 after retry RPC after error@391848798) -> (continuation of Deferred@1375961226 after retry RPC after error@794902865) -> (continuation of Deferred@696763545 after retry RPC after error@1728598820) -> (continuation of Deferred@692164767 after retry RPC after error@210710319) -> (continuation of Deferred@456884523 after retry RPC after error@1041195035) -> (continuation of Deferred@456102437 after retry RPC after error@1856778296) -> (continuation of Deferred@693753375 after retry RPC after error@1821602967) -> (continuation of Deferred@189431194 after retry RPC after error@73965883) -> (continuation of Deferred@1676043911 after retry RPC after error@338071968) -> (continuation of Deferred@1289259027 after retry RPC after error@234392010) -> (continuation of Deferred@1568281772 after retry RPC after error@2104571186) -> (continuation of Deferred@1977725599 after retry RPC after error@1008653104) -> (continuation of Deferred@835485547 after retry RPC after error@1172309189) -> (continuation of Deferred@1038951340 after retry RPC after error@2007031922) -> (continuation of Deferred@633732810 after retry RPC after error@1623593115) -> (continuation of Deferred@887275372 after retry RPC after error@1144089330) -> (continuation of Deferred@1309212432 after retry RPC after error@513440898) -> (continuation of Deferred@1067624930 after retry RPC after error@1879777822) -> (continuation of Deferred@2045944688 after retry RPC after error@885112480) -> (continuation of Deferred@512158819 after retry RPC after error@934557311) -> (continuation of Deferred@1538386650 after retry RPC after error@1656515506)))
18:33:27.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.558838  6711 consensus_queue.cc:237] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.566128  6705 ts_tablet_manager.cc:1403] T 8ba55a97d55047f096401a4685d6b07e P 422c1c063b1444b38bf3ee5a445401d1: Time spent bootstrapping tablet: real 0.102s	user 0.022s	sys 0.004s
18:33:27.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.578142  6705 raft_consensus.cc:359] T 8ba55a97d55047f096401a4685d6b07e P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.578898  6705 raft_consensus.cc:385] T 8ba55a97d55047f096401a4685d6b07e P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:27.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.579185  6705 raft_consensus.cc:740] T 8ba55a97d55047f096401a4685d6b07e P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 422c1c063b1444b38bf3ee5a445401d1, State: Initialized, Role: FOLLOWER
18:33:27.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.579892  6705 consensus_queue.cc:260] T 8ba55a97d55047f096401a4685d6b07e P 422c1c063b1444b38bf3ee5a445401d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.580461  6716 consensus_queue.cc:1048] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:33:27.582 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
18:33:27.583 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:27.583 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:27.583 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:27.584 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:27.584 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:27.584 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:27.584 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:27.584 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:27.584 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:27.584 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:27.584 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:27.584 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:27.584 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:27.584 [WARN - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27277), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [9ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [79ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [87ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [95ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [180ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [185ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [195ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [196ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [353ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [357ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [358ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [359ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [359ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [402ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [422ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [459ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [462ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [482ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [663ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [761ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [761ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [762ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [801ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [801ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [803ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [803ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2480ms] refreshing cache from master, [2480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2481ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [6240ms] refreshing cache from master, [6240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [6241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [6241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [6241ms] too many traces: truncated at 100 traces, deferred=Deferred@816025557(state=PENDING, result=null, callback=(continuation of Deferred@447947143 after retry RPC after error@819041710) -> (continuation of Deferred@670362977 after retry RPC after error@193270637) -> (continuation of Deferred@137995395 after retry RPC after error@888745167) -> (continuation of Deferred@887509204 after retry RPC after error@391848798) -> (continuation of Deferred@1375961226 after retry RPC after error@794902865) -> (continuation of Deferred@696763545 after retry RPC after error@1728598820) -> (continuation of Deferred@692164767 after retry RPC after error@210710319) -> (continuation of Deferred@456884523 after retry RPC after error@1041195035) -> (continuation of Deferred@456102437 after retry RPC after error@1856778296) -> (continuation of Deferred@693753375 after retry RPC after error@1821602967) -> (continuation of Deferred@189431194 after retry RPC after error@73965883) -> (continuation of Deferred@1676043911 after retry RPC after error@338071968) -> (continuation of Deferred@1289259027 after retry RPC after error@234392010) -> (continuation of Deferred@1568281772 after retry RPC after error@2104571186) -> (continuation of Deferred@1977725599 after retry RPC after error@1008653104) -> (continuation of Deferred@835485547 after retry RPC after error@1172309189) -> (continuation of Deferred@1038951340 after retry RPC after error@2007031922) -> (continuation of Deferred@633732810 after retry RPC after error@1623593115) -> (continuation of Deferred@887275372 after retry RPC after error@1144089330) -> (continuation of Deferred@1309212432 after retry RPC after error@513440898) -> (continuation of Deferred@1067624930 after retry RPC after error@1879777822) -> (continuation of Deferred@2045944688 after retry RPC after error@885112480) -> (continuation of Deferred@512158819 after retry RPC after error@934557311) -> (continuation of Deferred@1538386650 after retry RPC after error@1656515506), errback=(continuation of Deferred@447947143 after retry RPC after error@819041710) -> (continuation of Deferred@670362977 after retry RPC after error@193270637) -> (continuation of Deferred@137995395 after retry RPC after error@888745167) -> (continuation of Deferred@887509204 after retry RPC after error@391848798) -> (continuation of Deferred@1375961226 after retry RPC after error@794902865) -> (continuation of Deferred@696763545 after retry RPC after error@1728598820) -> (continuation of Deferred@692164767 after retry RPC after error@210710319) -> (continuation of Deferred@456884523 after retry RPC after error@1041195035) -> (continuation of Deferred@456102437 after retry RPC after error@1856778296) -> (continuation of Deferred@693753375 after retry RPC after error@1821602967) -> (continuation of Deferred@189431194 after retry RPC after error@73965883) -> (continuation of Deferred@1676043911 after retry RPC after error@338071968) -> (continuation of Deferred@1289259027 after retry RPC after error@234392010) -> (continuation of Deferred@1568281772 after retry RPC after error@2104571186) -> (continuation of Deferred@1977725599 after retry RPC after error@1008653104) -> (continuation of Deferred@835485547 after retry RPC after error@1172309189) -> (continuation of Deferred@1038951340 after retry RPC after error@2007031922) -> (continuation of Deferred@633732810 after retry RPC after error@1623593115) -> (continuation of Deferred@887275372 after retry RPC after error@1144089330) -> (continuation of Deferred@1309212432 after retry RPC after error@513440898) -> (continuation of Deferred@1067624930 after retry RPC after error@1879777822) -> (continuation of Deferred@2045944688 after retry RPC after error@885112480) -> (continuation of Deferred@512158819 after retry RPC after error@934557311) -> (continuation of Deferred@1538386650 after retry RPC after error@1656515506)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.124:38123
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:27.585 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_6).
18:33:27.591 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#6 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_6.
18:33:27.594 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27277), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [9ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [79ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [87ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [95ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [180ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [185ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [195ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [196ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [353ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [357ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [358ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [359ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [359ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [402ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [422ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [459ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [462ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [482ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [662ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [663ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [761ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [761ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [762ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [801ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [801ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [803ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [803ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2480ms] refreshing cache from master, [2480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2481ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [6240ms] refreshing cache from master, [6240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [6241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [6241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [6241ms] too many traces: truncated at 100 traces, deferred=Deferred@816025557(state=PENDING, result=null, callback=(continuation of Deferred@447947143 after retry RPC after error@819041710) -> (continuation of Deferred@670362977 after retry RPC after error@193270637) -> (continuation of Deferred@137995395 after retry RPC after error@888745167) -> (continuation of Deferred@887509204 after retry RPC after error@391848798) -> (continuation of Deferred@1375961226 after retry RPC after error@794902865) -> (continuation of Deferred@696763545 after retry RPC after error@1728598820) -> (continuation of Deferred@692164767 after retry RPC after error@210710319) -> (continuation of Deferred@456884523 after retry RPC after error@1041195035) -> (continuation of Deferred@456102437 after retry RPC after error@1856778296) -> (continuation of Deferred@693753375 after retry RPC after error@1821602967) -> (continuation of Deferred@189431194 after retry RPC after error@73965883) -> (continuation of Deferred@1676043911 after retry RPC after error@338071968) -> (continuation of Deferred@1289259027 after retry RPC after error@234392010) -> (continuation of Deferred@1568281772 after retry RPC after error@2104571186) -> (continuation of Deferred@1977725599 after retry RPC after error@1008653104) -> (continuation of Deferred@835485547 after retry RPC after error@1172309189) -> (continuation of Deferred@1038951340 after retry RPC after error@2007031922) -> (continuation of Deferred@633732810 after retry RPC after error@1623593115) -> (continuation of Deferred@887275372 after retry RPC after error@1144089330) -> (continuation of Deferred@1309212432 after retry RPC after error@513440898) -> (continuation of Deferred@1067624930 after retry RPC after error@1879777822) -> (continuation of Deferred@2045944688 after retry RPC after error@885112480) -> (continuation of Deferred@512158819 after retry RPC after error@934557311) -> (continuation of Deferred@1538386650 after retry RPC after error@1656515506), errback=(continuation of Deferred@447947143 after retry RPC after error@819041710) -> (continuation of Deferred@670362977 after retry RPC after error@193270637) -> (continuation of Deferred@137995395 after retry RPC after error@888745167) -> (continuation of Deferred@887509204 after retry RPC after error@391848798) -> (continuation of Deferred@1375961226 after retry RPC after error@794902865) -> (continuation of Deferred@696763545 after retry RPC after error@1728598820) -> (continuation of Deferred@692164767 after retry RPC after error@210710319) -> (continuation of Deferred@456884523 after retry RPC after error@1041195035) -> (continuation of Deferred@456102437 after retry RPC after error@1856778296) -> (continuation of Deferred@693753375 after retry RPC after error@1821602967) -> (continuation of Deferred@189431194 after retry RPC after error@73965883) -> (continuation of Deferred@1676043911 after retry RPC after error@338071968) -> (continuation of Deferred@1289259027 after retry RPC after error@234392010) -> (continuation of Deferred@1568281772 after retry RPC after error@2104571186) -> (continuation of Deferred@1977725599 after retry RPC after error@1008653104) -> (continuation of Deferred@835485547 after retry RPC after error@1172309189) -> (continuation of Deferred@1038951340 after retry RPC after error@2007031922) -> (continuation of Deferred@633732810 after retry RPC after error@1623593115) -> (continuation of Deferred@887275372 after retry RPC after error@1144089330) -> (continuation of Deferred@1309212432 after retry RPC after error@513440898) -> (continuation of Deferred@1067624930 after retry RPC after error@1879777822) -> (continuation of Deferred@2045944688 after retry RPC after error@885112480) -> (continuation of Deferred@512158819 after retry RPC after error@934557311) -> (continuation of Deferred@1538386650 after retry RPC after error@1656515506)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.124:38123
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:27.632 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:27.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.595477  6705 ts_tablet_manager.cc:1434] T 8ba55a97d55047f096401a4685d6b07e P 422c1c063b1444b38bf3ee5a445401d1: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
18:33:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.602499  6706 tablet_bootstrap.cc:492] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b: No bootstrap required, opened a new log
18:33:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.602972  6706 ts_tablet_manager.cc:1403] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.018s
18:33:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.611889  6706 raft_consensus.cc:359] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.612665  6706 raft_consensus.cc:385] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.612955  6706 raft_consensus.cc:740] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bca326a30e144d5080c5b2dd919d9c4b, State: Initialized, Role: FOLLOWER
18:33:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.613759  6706 consensus_queue.cc:260] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.615260  6060 leader_election.cc:304] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 422c1c063b1444b38bf3ee5a445401d1; no voters: 9ea5388f32294500b5ec5ef882b64ee6, bca326a30e144d5080c5b2dd919d9c4b
18:33:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.616155  6712 raft_consensus.cc:2749] T 0ca41259ca7743c99aac8ead8fb35574 P 422c1c063b1444b38bf3ee5a445401d1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:33:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.610342  5710 catalog_manager.cc:5696] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b reported cstate change: term changed from 0 to 1, leader changed from <none> to bca326a30e144d5080c5b2dd919d9c4b (127.5.136.3). New cstate: current_term: 1 leader_uuid: "bca326a30e144d5080c5b2dd919d9c4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } health_report { overall_health: HEALTHY } } }
18:33:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.629953  6706 ts_tablet_manager.cc:1434] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
18:33:27.633 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_6.
18:33:27.633 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RUNNING to RESTARTING.
18:33:27.634 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#6) of source Source: KuduSource.
18:33:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.637269  6711 consensus_queue.cc:1048] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:33:27.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.722848  6711 raft_consensus.cc:493] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:33:27.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.723357  6711 raft_consensus.cc:515] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.725446  6711 leader_election.cc:290] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 422c1c063b1444b38bf3ee5a445401d1 (127.5.136.1:34063), 9ea5388f32294500b5ec5ef882b64ee6 (127.5.136.2:43565)
18:33:27.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.727970  6140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba55a97d55047f096401a4685d6b07e" candidate_uuid: "bca326a30e144d5080c5b2dd919d9c4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "422c1c063b1444b38bf3ee5a445401d1" is_pre_election: true
18:33:27.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.728590  6140 raft_consensus.cc:2468] T 8ba55a97d55047f096401a4685d6b07e P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bca326a30e144d5080c5b2dd919d9c4b in term 0.
18:33:27.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.729946  6418 leader_election.cc:304] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 422c1c063b1444b38bf3ee5a445401d1, bca326a30e144d5080c5b2dd919d9c4b; no voters: 
18:33:27.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.731040  6711 raft_consensus.cc:2804] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Leader pre-election won for term 1
18:33:27.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.731463  6711 raft_consensus.cc:493] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:33:27.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.731781  6711 raft_consensus.cc:3060] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [term 0 FOLLOWER]: Advancing to term 1
18:33:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.732918  6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba55a97d55047f096401a4685d6b07e" candidate_uuid: "bca326a30e144d5080c5b2dd919d9c4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ea5388f32294500b5ec5ef882b64ee6" is_pre_election: true
18:33:27.736 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:27.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:27.743883  6417 leader_election.cc:343] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ea5388f32294500b5ec5ef882b64ee6 (127.5.136.2:43565): Illegal state: must be running to vote when last-logged opid is not known
18:33:27.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.742722  6711 raft_consensus.cc:515] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.750216  6140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba55a97d55047f096401a4685d6b07e" candidate_uuid: "bca326a30e144d5080c5b2dd919d9c4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "422c1c063b1444b38bf3ee5a445401d1"
18:33:27.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.750758  6140 raft_consensus.cc:3060] T 8ba55a97d55047f096401a4685d6b07e P 422c1c063b1444b38bf3ee5a445401d1 [term 0 FOLLOWER]: Advancing to term 1
18:33:27.754 [DEBUG - main] (Connection.java:575) [peer master-127.4.179.60:34679(127.4.179.60:34679)] disconnecting while in state READY
18:33:27.755 [DEBUG - main] (Connection.java:575) [peer master-127.4.179.62:35121(127.4.179.62:35121)] disconnecting while in state READY
18:33:27.755 [DEBUG - main] (Connection.java:575) [peer master-127.4.179.61:44733(127.4.179.61:44733)] disconnecting while in state READY
18:33:27.755 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.179.61:44733(127.4.179.61:44733)] handling channelInactive
18:33:27.755 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.179.60:34679(127.4.179.60:34679)] handling channelInactive
18:33:27.755 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state READY due to: connection closed
18:33:27.755 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state READY due to: connection closed
18:33:27.756 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:27.757 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
18:33:27.758 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
18:33:27.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.757618  6140 raft_consensus.cc:2468] T 8ba55a97d55047f096401a4685d6b07e P 422c1c063b1444b38bf3ee5a445401d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bca326a30e144d5080c5b2dd919d9c4b in term 1.
18:33:27.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.758705  6418 leader_election.cc:304] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 422c1c063b1444b38bf3ee5a445401d1, bca326a30e144d5080c5b2dd919d9c4b; no voters: 
18:33:27.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.759519  6716 raft_consensus.cc:2804] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [term 1 FOLLOWER]: Leader election won for term 1
18:33:27.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.665091  5711 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 9749d6e6ecd14ac2982f6cf232a3f779: replication_test_table [id=616ea92ec0b3496fb52deb2da91bd772] alter complete (version 0)
18:33:27.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.774324  6716 raft_consensus.cc:697] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [term 1 LEADER]: Becoming Leader. State: Replica: bca326a30e144d5080c5b2dd919d9c4b, State: Running, Role: LEADER
18:33:27.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.775221  6716 consensus_queue.cc:237] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.781549  6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba55a97d55047f096401a4685d6b07e" candidate_uuid: "bca326a30e144d5080c5b2dd919d9c4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ea5388f32294500b5ec5ef882b64ee6"
18:33:27.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.781608  6711 leader_election.cc:290] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [CANDIDATE]: Term 1 election: Requested vote from peers 422c1c063b1444b38bf3ee5a445401d1 (127.5.136.1:34063), 9ea5388f32294500b5ec5ef882b64ee6 (127.5.136.2:43565)
18:33:27.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:27.784708  6417 leader_election.cc:343] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ea5388f32294500b5ec5ef882b64ee6 (127.5.136.2:43565): Illegal state: must be running to vote when last-logged opid is not known
18:33:27.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.808391  6709 tablet_bootstrap.cc:492] T 8ba55a97d55047f096401a4685d6b07e P 9ea5388f32294500b5ec5ef882b64ee6: No bootstrap required, opened a new log
18:33:27.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.808897  6709 ts_tablet_manager.cc:1403] T 8ba55a97d55047f096401a4685d6b07e P 9ea5388f32294500b5ec5ef882b64ee6: Time spent bootstrapping tablet: real 0.274s	user 0.007s	sys 0.009s
18:33:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.811829  6709 raft_consensus.cc:359] T 8ba55a97d55047f096401a4685d6b07e P 9ea5388f32294500b5ec5ef882b64ee6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.812577  6709 raft_consensus.cc:385] T 8ba55a97d55047f096401a4685d6b07e P 9ea5388f32294500b5ec5ef882b64ee6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:27.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.812924  6709 raft_consensus.cc:740] T 8ba55a97d55047f096401a4685d6b07e P 9ea5388f32294500b5ec5ef882b64ee6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ea5388f32294500b5ec5ef882b64ee6, State: Initialized, Role: FOLLOWER
18:33:27.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.813787  6709 consensus_queue.cc:260] T 8ba55a97d55047f096401a4685d6b07e P 9ea5388f32294500b5ec5ef882b64ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } }
18:33:27.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.823973  6709 ts_tablet_manager.cc:1434] T 8ba55a97d55047f096401a4685d6b07e P 9ea5388f32294500b5ec5ef882b64ee6: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
18:33:27.826 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:27.840 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.179.62:35121(127.4.179.62:35121)] handling channelInactive
18:33:27.840 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state READY due to: connection closed
18:33:27.840 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-0
18:33:27.840 [DEBUG - main] (Connection.java:575) [peer master-127.5.136.61:43625(127.5.136.61:43625)] disconnecting while in state READY
18:33:27.840 [DEBUG - main] (Connection.java:575) [peer master-127.5.136.62:42905(127.5.136.62:42905)] disconnecting while in state READY
18:33:27.840 [DEBUG - main] (Connection.java:575) [peer master-127.5.136.60:39171(127.5.136.60:39171)] disconnecting while in state READY
18:33:27.841 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.5.136.61:43625(127.5.136.61:43625)] handling channelInactive
18:33:27.841 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state READY due to: connection closed
18:33:27.841 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.5.136.62:42905(127.5.136.62:42905)] handling channelInactive
18:33:27.841 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state READY due to: connection closed
18:33:27.841 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:27.842 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-1
18:33:27.842 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
18:33:27.856 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.5.136.60:39171(127.5.136.60:39171)] handling channelInactive
18:33:27.856 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state READY due to: connection closed
18:33:27.867 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:33:27.868 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:33:27.869 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
18:33:27.869 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
18:33:27.869 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:33:27.869 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:33:27.869 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:33:27.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:27.880910  5710 catalog_manager.cc:5696] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b reported cstate change: term changed from 0 to 1, leader changed from <none> to bca326a30e144d5080c5b2dd919d9c4b (127.5.136.3). New cstate: current_term: 1 leader_uuid: "bca326a30e144d5080c5b2dd919d9c4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bca326a30e144d5080c5b2dd919d9c4b" member_type: VOTER last_known_addr { host: "127.5.136.3" port: 39901 } health_report { overall_health: HEALTHY } } }
18:33:27.912 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:27.912 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:27.912 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:27.912 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:27.912 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:27.912 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:27.912 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:27.912 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:27.912 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:27.912 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:27.913 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:27.913 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:27.913 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:27.940 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
18:33:27.940 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
18:33:27.940 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
18:33:27.940 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
18:33:27.940 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
18:33:27.940 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
18:33:27.940 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
18:33:28.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:28.031934  6716 consensus_queue.cc:1048] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:33:28.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:28.055553  6716 consensus_queue.cc:1048] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:33:28.056 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:28.056 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:28.056 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:28.057 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:28.057 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:28.057 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:28.057 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:28.057 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:28.058 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:28.058 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:28.058 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:28.058 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:28.058 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:28.166 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:28.166 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:28.166 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:28.167 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:28.167 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:28.167 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:28.167 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:28.167 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:28.167 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:28.167 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:28.167 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:28.167 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:28.167 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:28.220 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
18:33:28.228 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:28.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:28.227653  6716 consensus_queue.cc:1048] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "422c1c063b1444b38bf3ee5a445401d1" member_type: VOTER last_known_addr { host: "127.5.136.1" port: 34063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:33:28.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:28.264060  6340 raft_consensus.cc:3060] T 8ba55a97d55047f096401a4685d6b07e P 9ea5388f32294500b5ec5ef882b64ee6 [term 0 FOLLOWER]: Advancing to term 1
18:33:28.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:28.274398  6716 consensus_queue.cc:1048] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ea5388f32294500b5ec5ef882b64ee6" member_type: VOTER last_known_addr { host: "127.5.136.2" port: 43565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:33:28.317 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:28.317 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:28.317 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:28.318 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:28.318 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:28.318 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:28.321 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:28.332 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:28.332 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:28.332 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:28.332 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:28.332 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:28.333 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:28.333 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:28.341 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
18:33:28.341 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
18:33:28.341 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
18:33:28.361 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
18:33:28.471 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:28.471 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:28.471 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:28.471 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:28.471 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:28.472 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:28.472 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:28.472 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:28.472 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:28.472 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:28.473 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:28.473 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:28.473 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:28.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:28.558387  5910 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0160 after lost signal to thread 5836
18:33:28.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:28.559173  5910 debug-util.cc:398] Leaking SignalData structure 0x7b080009b7e0 after lost signal to thread 5913
18:33:28.678 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:28.680 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:28.680 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:28.681 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:28.681 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:28.681 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:28.681 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:28.681 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:28.681 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:28.681 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:28.681 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:28.681 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:28.681 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:28.685 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9) switched from state RESTARTING to RUNNING.
18:33:28.686 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job 4cd649562a0f5305571102b5c888c5a9 from Checkpoint 65 @ 1783535546001 for 4cd649562a0f5305571102b5c888c5a9 located at file:/tmp/junit5514029058471043739/checkpoints/4cd649562a0f5305571102b5c888c5a9/chk-65.
18:33:28.687 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
18:33:28.687 [INFO - flink-pekko.actor.default-dispatcher-9] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:33:28.699 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to SCHEDULED.
18:33:28.700 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:33:28.700 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from SCHEDULED to DEPLOYING.
18:33:28.701 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #4) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id d0320e7b86362daa97e494337af6f333
18:33:28.701 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot d0320e7b86362daa97e494337af6f333.
18:33:28.702 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_4), deploy into slot with allocation id d0320e7b86362daa97e494337af6f333.
18:33:28.703 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to SCHEDULED.
18:33:28.703 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:33:28.704 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from SCHEDULED to DEPLOYING.
18:33:28.704 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #4) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id c230971fad26d6cfa2b63ff44e7a1af5
18:33:28.704 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to SCHEDULED.
18:33:28.704 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:28.705 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from SCHEDULED to DEPLOYING.
18:33:28.705 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #4) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id 0abd8d1f15ad274a5029e6ed83960f8c
18:33:28.705 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to SCHEDULED.
18:33:28.706 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:33:28.706 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from SCHEDULED to DEPLOYING.
18:33:28.706 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #4) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id 163e6d56962e3a45c0e4353eb3be3a9b
18:33:28.707 [INFO - Thread-46] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:33:28.707 [DEBUG - Thread-46] (Connection.java:575) [peer master-127.0.106.253:45189(127.0.106.253:45189)] disconnecting while in state TERMINATED
18:33:28.707 [DEBUG - Thread-46] (Connection.java:575) [peer master-127.0.106.254:32967(127.0.106.254:32967)] disconnecting while in state TERMINATED
18:33:28.708 [DEBUG - Thread-46] (Connection.java:575) [peer master-127.0.106.252:46705(127.0.106.252:46705)] disconnecting while in state TERMINATED
18:33:28.708 [DEBUG - Thread-46] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:28.709 [INFO - Thread-46] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:33:28.709 [INFO - Thread-46] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:33:28.712 [DEBUG - Thread-46] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:28.713 [INFO - Thread-46] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:33:28.714 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot c230971fad26d6cfa2b63ff44e7a1af5.
18:33:28.716 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_4), deploy into slot with allocation id c230971fad26d6cfa2b63ff44e7a1af5.
18:33:28.724 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:28.724 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:28.724 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:28.724 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:28.724 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to DEPLOYING.
18:33:28.724 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_4) [DEPLOYING].
18:33:28.725 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@340df0d8
18:33:28.725 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:28.726 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:33:28.726 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
18:33:28.726 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
18:33:28.726 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:28.730 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 0abd8d1f15ad274a5029e6ed83960f8c.
18:33:28.731 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_4), deploy into slot with allocation id 0abd8d1f15ad274a5029e6ed83960f8c.
18:33:28.731 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to DEPLOYING.
18:33:28.731 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_4) [DEPLOYING].
18:33:28.732 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5e585783
18:33:28.732 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:28.735 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:33:28.735 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
18:33:28.735 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
18:33:28.737 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 163e6d56962e3a45c0e4353eb3be3a9b.
18:33:28.738 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_4), deploy into slot with allocation id 163e6d56962e3a45c0e4353eb3be3a9b.
18:33:28.738 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to DEPLOYING.
18:33:28.740 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_4) [DEPLOYING].
18:33:28.741 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@53b1ef26
18:33:28.742 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:28.739 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@246af8ce
18:33:28.745 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:28.742 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@37f1fd15
18:33:28.749 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:28.754 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:33:28.755 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
18:33:28.755 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
18:33:28.776 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2c9bf15c
18:33:28.780 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:28.783 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to DEPLOYING.
18:33:28.783 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_4) [DEPLOYING].
18:33:28.786 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4819a908
18:33:28.786 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:28.787 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:33:28.788 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
18:33:28.789 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
18:33:28.799 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:28.801 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@340ffee4
18:33:28.803 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:28.805 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:28.811 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:28.821 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:28.821 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:28.832 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:28.833 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.833 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.833 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.843 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:28.844 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.844 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.844 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.859 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:28.860 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:28.860 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:28.860 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:28.860 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:28.860 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:28.860 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:28.861 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:28.864 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:28.865 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:28.866 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.866 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.866 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.870 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:28.870 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:28.870 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:28.870 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:28.875 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:28.875 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:28.875 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:28.875 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:28.876 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:28.876 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:28.876 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:28.876 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:28.876 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:28.877 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:28.877 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:28.877 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:28.877 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:28.877 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:28.877 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:28.877 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:28.877 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:28.878 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28571), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [87ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [88ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [89ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [89ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [172ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [211ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [212ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [284ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [285ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [285ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [285ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [302ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [321ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [323ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [341ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [348ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [348ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [462ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [722ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [722ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [723ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [723ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [881ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [882ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [882ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [882ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [962ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [962ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [962ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [963ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2240ms] refreshing cache from master, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2244ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5520ms] refreshing cache from master, [5520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5522ms] too many traces: truncated at 100 traces, deferred=Deferred@1716240903(state=PENDING, result=null, callback=(continuation of Deferred@612965719 after retry RPC after error@615155757) -> (continuation of Deferred@1011107149 after retry RPC after error@69727032) -> (continuation of Deferred@1755850062 after retry RPC after error@414393238) -> (continuation of Deferred@105083872 after retry RPC after error@1028062755) -> (continuation of Deferred@351092368 after retry RPC after error@356716552) -> (continuation of Deferred@142781747 after retry RPC after error@46132710) -> (continuation of Deferred@2136689311 after retry RPC after error@1914029612) -> (continuation of Deferred@1868764776 after retry RPC after error@307103423) -> (continuation of Deferred@929348059 after retry RPC after error@1805401533) -> (continuation of Deferred@482060016 after retry RPC after error@2124554278) -> (continuation of Deferred@1813701704 after retry RPC after error@1717652899) -> (continuation of Deferred@657255353 after retry RPC after error@1222659178) -> (continuation of Deferred@1935919514 after retry RPC after error@520330752) -> (continuation of Deferred@1605554042 after retry RPC after error@368790522) -> (continuation of Deferred@2025422790 after retry RPC after error@2068389199) -> (continuation of Deferred@852083779 after retry RPC after error@2107833723) -> (continuation of Deferred@1314318918 after retry RPC after error@2110137766) -> (continuation of Deferred@22093185 after retry RPC after error@1811050997) -> (continuation of Deferred@303018519 after retry RPC after error@1588088549) -> (continuation of Deferred@1469902244 after retry RPC after error@798577531) -> (continuation of Deferred@1080677269 after retry RPC after error@1554674203) -> (continuation of Deferred@1818973671 after retry RPC after error@151830938) -> (continuation of Deferred@125263445 after retry RPC after error@146984458) -> (continuation of Deferred@1051752088 after retry RPC after error@1365205189), errback=(continuation of Deferred@612965719 after retry RPC after error@615155757) -> (continuation of Deferred@1011107149 after retry RPC after error@69727032) -> (continuation of Deferred@1755850062 after retry RPC after error@414393238) -> (continuation of Deferred@105083872 after retry RPC after error@1028062755) -> (continuation of Deferred@351092368 after retry RPC after error@356716552) -> (continuation of Deferred@142781747 after retry RPC after error@46132710) -> (continuation of Deferred@2136689311 after retry RPC after error@1914029612) -> (continuation of Deferred@1868764776 after retry RPC after error@307103423) -> (continuation of Deferred@929348059 after retry RPC after error@1805401533) -> (continuation of Deferred@482060016 after retry RPC after error@2124554278) -> (continuation of Deferred@1813701704 after retry RPC after error@1717652899) -> (continuation of Deferred@657255353 after retry RPC after error@1222659178) -> (continuation of Deferred@1935919514 after retry RPC after error@520330752) -> (continuation of Deferred@1605554042 after retry RPC after error@368790522) -> (continuation of Deferred@2025422790 after retry RPC after error@2068389199) -> (continuation of Deferred@852083779 after retry RPC after error@2107833723) -> (continuation of Deferred@1314318918 after retry RPC after error@2110137766) -> (continuation of Deferred@22093185 after retry RPC after error@1811050997) -> (continuation of Deferred@303018519 after retry RPC after error@1588088549) -> (continuation of Deferred@1469902244 after retry RPC after error@798577531) -> (continuation of Deferred@1080677269 after retry RPC after error@1554674203) -> (continuation of Deferred@1818973671 after retry RPC after error@151830938) -> (continuation of Deferred@125263445 after retry RPC after error@146984458) -> (continuation of Deferred@1051752088 after retry RPC after error@1365205189)))
18:33:28.880 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
18:33:28.880 [WARN - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28571), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [87ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [88ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [89ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [89ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [172ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [211ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [212ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [284ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [285ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [285ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [285ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [302ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [321ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [323ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [341ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [348ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [348ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [462ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [722ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [722ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [723ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [723ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [881ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [882ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [882ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [882ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [962ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [962ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [962ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [963ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2240ms] refreshing cache from master, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2244ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5520ms] refreshing cache from master, [5520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5522ms] too many traces: truncated at 100 traces, deferred=Deferred@1716240903(state=PENDING, result=null, callback=(continuation of Deferred@612965719 after retry RPC after error@615155757) -> (continuation of Deferred@1011107149 after retry RPC after error@69727032) -> (continuation of Deferred@1755850062 after retry RPC after error@414393238) -> (continuation of Deferred@105083872 after retry RPC after error@1028062755) -> (continuation of Deferred@351092368 after retry RPC after error@356716552) -> (continuation of Deferred@142781747 after retry RPC after error@46132710) -> (continuation of Deferred@2136689311 after retry RPC after error@1914029612) -> (continuation of Deferred@1868764776 after retry RPC after error@307103423) -> (continuation of Deferred@929348059 after retry RPC after error@1805401533) -> (continuation of Deferred@482060016 after retry RPC after error@2124554278) -> (continuation of Deferred@1813701704 after retry RPC after error@1717652899) -> (continuation of Deferred@657255353 after retry RPC after error@1222659178) -> (continuation of Deferred@1935919514 after retry RPC after error@520330752) -> (continuation of Deferred@1605554042 after retry RPC after error@368790522) -> (continuation of Deferred@2025422790 after retry RPC after error@2068389199) -> (continuation of Deferred@852083779 after retry RPC after error@2107833723) -> (continuation of Deferred@1314318918 after retry RPC after error@2110137766) -> (continuation of Deferred@22093185 after retry RPC after error@1811050997) -> (continuation of Deferred@303018519 after retry RPC after error@1588088549) -> (continuation of Deferred@1469902244 after retry RPC after error@798577531) -> (continuation of Deferred@1080677269 after retry RPC after error@1554674203) -> (continuation of Deferred@1818973671 after retry RPC after error@151830938) -> (continuation of Deferred@125263445 after retry RPC after error@146984458) -> (continuation of Deferred@1051752088 after retry RPC after error@1365205189), errback=(continuation of Deferred@612965719 after retry RPC after error@615155757) -> (continuation of Deferred@1011107149 after retry RPC after error@69727032) -> (continuation of Deferred@1755850062 after retry RPC after error@414393238) -> (continuation of Deferred@105083872 after retry RPC after error@1028062755) -> (continuation of Deferred@351092368 after retry RPC after error@356716552) -> (continuation of Deferred@142781747 after retry RPC after error@46132710) -> (continuation of Deferred@2136689311 after retry RPC after error@1914029612) -> (continuation of Deferred@1868764776 after retry RPC after error@307103423) -> (continuation of Deferred@929348059 after retry RPC after error@1805401533) -> (continuation of Deferred@482060016 after retry RPC after error@2124554278) -> (continuation of Deferred@1813701704 after retry RPC after error@1717652899) -> (continuation of Deferred@657255353 after retry RPC after error@1222659178) -> (continuation of Deferred@1935919514 after retry RPC after error@520330752) -> (continuation of Deferred@1605554042 after retry RPC after error@368790522) -> (continuation of Deferred@2025422790 after retry RPC after error@2068389199) -> (continuation of Deferred@852083779 after retry RPC after error@2107833723) -> (continuation of Deferred@1314318918 after retry RPC after error@2110137766) -> (continuation of Deferred@22093185 after retry RPC after error@1811050997) -> (continuation of Deferred@303018519 after retry RPC after error@1588088549) -> (continuation of Deferred@1469902244 after retry RPC after error@798577531) -> (continuation of Deferred@1080677269 after retry RPC after error@1554674203) -> (continuation of Deferred@1818973671 after retry RPC after error@151830938) -> (continuation of Deferred@125263445 after retry RPC after error@146984458) -> (continuation of Deferred@1051752088 after retry RPC after error@1365205189)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:28.880 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#5 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_5).
18:33:28.882 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#5 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_5.
18:33:28.882 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:28.885 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28571), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [87ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [88ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [89ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [89ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [172ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [211ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [212ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [223ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [284ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [285ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [285ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [285ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [302ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [321ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [323ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [341ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [348ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [348ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [462ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [722ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [722ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [723ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [723ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [881ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [882ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [882ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [882ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [962ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [962ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [962ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [963ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2240ms] refreshing cache from master, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2244ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5520ms] refreshing cache from master, [5520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5522ms] too many traces: truncated at 100 traces, deferred=Deferred@1716240903(state=PENDING, result=null, callback=(continuation of Deferred@612965719 after retry RPC after error@615155757) -> (continuation of Deferred@1011107149 after retry RPC after error@69727032) -> (continuation of Deferred@1755850062 after retry RPC after error@414393238) -> (continuation of Deferred@105083872 after retry RPC after error@1028062755) -> (continuation of Deferred@351092368 after retry RPC after error@356716552) -> (continuation of Deferred@142781747 after retry RPC after error@46132710) -> (continuation of Deferred@2136689311 after retry RPC after error@1914029612) -> (continuation of Deferred@1868764776 after retry RPC after error@307103423) -> (continuation of Deferred@929348059 after retry RPC after error@1805401533) -> (continuation of Deferred@482060016 after retry RPC after error@2124554278) -> (continuation of Deferred@1813701704 after retry RPC after error@1717652899) -> (continuation of Deferred@657255353 after retry RPC after error@1222659178) -> (continuation of Deferred@1935919514 after retry RPC after error@520330752) -> (continuation of Deferred@1605554042 after retry RPC after error@368790522) -> (continuation of Deferred@2025422790 after retry RPC after error@2068389199) -> (continuation of Deferred@852083779 after retry RPC after error@2107833723) -> (continuation of Deferred@1314318918 after retry RPC after error@2110137766) -> (continuation of Deferred@22093185 after retry RPC after error@1811050997) -> (continuation of Deferred@303018519 after retry RPC after error@1588088549) -> (continuation of Deferred@1469902244 after retry RPC after error@798577531) -> (continuation of Deferred@1080677269 after retry RPC after error@1554674203) -> (continuation of Deferred@1818973671 after retry RPC after error@151830938) -> (continuation of Deferred@125263445 after retry RPC after error@146984458) -> (continuation of Deferred@1051752088 after retry RPC after error@1365205189), errback=(continuation of Deferred@612965719 after retry RPC after error@615155757) -> (continuation of Deferred@1011107149 after retry RPC after error@69727032) -> (continuation of Deferred@1755850062 after retry RPC after error@414393238) -> (continuation of Deferred@105083872 after retry RPC after error@1028062755) -> (continuation of Deferred@351092368 after retry RPC after error@356716552) -> (continuation of Deferred@142781747 after retry RPC after error@46132710) -> (continuation of Deferred@2136689311 after retry RPC after error@1914029612) -> (continuation of Deferred@1868764776 after retry RPC after error@307103423) -> (continuation of Deferred@929348059 after retry RPC after error@1805401533) -> (continuation of Deferred@482060016 after retry RPC after error@2124554278) -> (continuation of Deferred@1813701704 after retry RPC after error@1717652899) -> (continuation of Deferred@657255353 after retry RPC after error@1222659178) -> (continuation of Deferred@1935919514 after retry RPC after error@520330752) -> (continuation of Deferred@1605554042 after retry RPC after error@368790522) -> (continuation of Deferred@2025422790 after retry RPC after error@2068389199) -> (continuation of Deferred@852083779 after retry RPC after error@2107833723) -> (continuation of Deferred@1314318918 after retry RPC after error@2110137766) -> (continuation of Deferred@22093185 after retry RPC after error@1811050997) -> (continuation of Deferred@303018519 after retry RPC after error@1588088549) -> (continuation of Deferred@1469902244 after retry RPC after error@798577531) -> (continuation of Deferred@1080677269 after retry RPC after error@1554674203) -> (continuation of Deferred@1818973671 after retry RPC after error@151830938) -> (continuation of Deferred@125263445 after retry RPC after error@146984458) -> (continuation of Deferred@1051752088 after retry RPC after error@1365205189)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:28.887 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:33:28.887 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#5) of source Source: KuduSource.
18:33:28.888 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_5.
18:33:28.895 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:28.902 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:28.903 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:28.903 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:28.904 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:28.910 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:28.911 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.911 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.911 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.916 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:28.917 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:28.917 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:28.917 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:28.920 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:28.920 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:28.920 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:28.920 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:28.924 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:28.925 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:28.925 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.925 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.925 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.931 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:28.932 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:28.932 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:28.932 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:28.940 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:28.942 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:28.942 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:28.943 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:28.964 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:28.964 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:28.964 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:28.964 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:28.971 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:28.975 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:28.979 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.980 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.980 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:28.983 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:28.984 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:28.984 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:28.984 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:28.984 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:28.984 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:28.984 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:28.985 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:28.987 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:28.987 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:28.987 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:28.987 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:28.997 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.000 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.001 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.001 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.002 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.003 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.004 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.004 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.004 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.004 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.004 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.004 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.005 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.005 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.005 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.005 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.005 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.005 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.008 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.008 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.008 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.008 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.018 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.019 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.019 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.019 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.020 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.024 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.025 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.025 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.025 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.025 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.025 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.025 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.025 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.025 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.025 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.025 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.025 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.025 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.027 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.029 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.029 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.029 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.045 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.045 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.045 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.045 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.045 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.045 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.046 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.046 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.046 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.046 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.046 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.046 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.046 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.048 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.048 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.049 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.049 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.056 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.056 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:29.057 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.057 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.057 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.071 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:29.072 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.072 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.072 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.080 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.081 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.081 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.081 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:29.083 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.084 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.084 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.084 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.084 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.084 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.084 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.084 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.084 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.084 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.084 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.084 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.084 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.091 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:29.094 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:29.096 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.097 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.097 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.097 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.099 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.100 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.100 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.100 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.109 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.110 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.110 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.110 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.114 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.114 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.114 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.114 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.117 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.117 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.117 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.117 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.122 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.122 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.122 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.122 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.123 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.123 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.123 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.123 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.123 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.123 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.123 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.123 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.123 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.142 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.142 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.142 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.142 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.142 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.142 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.143 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.143 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.143 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.143 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.143 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.143 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.143 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.147 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.149 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.149 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.149 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.152 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.152 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.152 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.152 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.157 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.157 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.157 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.157 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.163 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.163 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.165 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.165 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.169 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:29.169 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.170 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.170 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.176 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.176 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:29.177 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.177 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.177 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.177 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.177 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.178 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.178 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:29.179 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.181 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.181 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.181 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.182 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.182 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.182 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.182 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.182 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.182 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.182 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.182 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.182 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.182 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.183 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.184 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.184 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.184 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.189 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.189 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.189 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.189 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.190 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.190 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.190 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.190 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.190 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:29.191 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:29.191 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:29.191 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.191 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.191 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.191 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.191 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.191 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.191 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.191 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.191 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.191 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:29.195 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.195 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.195 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.195 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.199 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.199 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.199 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.199 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.200 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.200 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.200 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.200 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.202 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.202 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.202 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.202 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.202 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.202 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.203 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.203 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.203 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.203 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.203 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.203 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.203 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.211 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:29.211 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:29.211 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:29.211 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.212 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.212 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.212 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.212 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.212 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.212 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.212 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.212 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.212 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:29.216 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.216 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.217 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.217 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.217 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.217 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.217 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.217 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.217 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.217 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.217 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.217 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.217 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.219 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.220 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.220 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.220 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.220 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.220 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.221 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.221 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.221 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.221 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.221 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.222 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.222 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.223 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.224 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.224 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.224 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.224 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.224 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.224 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.224 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.224 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.224 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.224 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.224 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.224 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.227 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:29.230 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:29.231 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:29.231 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:29.231 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.231 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.231 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.231 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.231 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.231 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.232 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.232 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.232 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.232 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:29.236 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.236 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.236 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.236 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.236 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.236 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.237 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.237 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.237 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.237 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.237 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.237 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.237 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.240 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.240 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.240 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.240 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.240 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.240 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.241 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.241 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.241 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.241 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.241 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.241 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.241 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.256 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.257 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.257 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.257 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.257 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.257 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.257 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.257 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.257 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.257 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.257 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.257 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.257 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.260 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.260 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.260 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.260 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.260 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.260 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.260 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.260 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.260 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.260 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.260 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.260 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.260 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.271 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:29.272 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:29.272 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:29.272 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.272 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.272 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.273 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.273 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.273 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.273 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.273 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.273 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.273 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:29.279 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.279 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.279 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.280 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.280 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.280 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.280 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.280 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.280 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.280 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.280 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.280 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.280 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.282 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.282 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.282 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.282 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.282 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.282 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.282 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.282 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.282 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.283 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.283 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.283 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.283 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.284 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.284 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.284 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.285 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.285 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.285 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.285 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.285 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.285 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.286 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.286 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.286 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.286 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.296 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.296 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.297 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.297 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.297 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.297 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.297 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.297 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.297 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.297 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.297 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.297 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.297 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.300 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.300 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.300 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.300 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.300 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.300 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.301 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.301 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.300 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.301 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.301 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.301 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.301 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.321 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:29.359 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.360 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.360 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.362 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.362 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.362 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.362 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.362 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.363 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.363 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.363 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.363 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.363 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.363 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.363 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.363 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.364 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.364 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.364 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.365 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.365 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.365 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.365 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.365 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.365 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.365 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.371 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:29.371 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:29.371 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:29.371 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.371 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.371 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.371 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.371 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.371 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.371 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.371 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.372 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.372 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:29.384 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:29.384 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:29.384 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:29.385 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:29.385 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:29.385 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:29.385 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:29.385 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:29.385 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:29.385 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:29.385 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:29.385 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:29.385 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:29.411 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:29.411 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:29.412 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:29.412 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.412 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.412 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.412 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.412 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.412 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.413 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.413 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.413 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.413 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:29.416 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.416 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.416 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.417 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.417 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.417 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.417 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.417 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.417 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.417 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.417 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.417 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.417 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.440 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:29.440 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:29.440 [DEBUG - pool-290-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:29.441 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:29.441 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:29.441 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:29.442 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:29.442 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:29.442 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:29.442 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:29.442 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:29.442 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:29.442 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:29.443 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29148), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [145ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [145ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [240ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [251ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [255ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [261ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [315ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [316ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [329ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [330ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [331ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [331ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [342ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [362ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [403ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [521ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [522ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [743ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [822ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [822ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [823ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [823ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1701ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1702ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2583ms] refreshing cache from master, [2583ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2583ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2583ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2586ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2587ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2591ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2591ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [5881ms] refreshing cache from master, [5881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5882ms] too many traces: truncated at 100 traces, deferred=Deferred@422164430(state=PENDING, result=null, callback=(continuation of Deferred@645832905 after retry RPC after error@2050888458) -> (continuation of Deferred@208075920 after retry RPC after error@1478868245) -> (continuation of Deferred@185476656 after retry RPC after error@27443736) -> (continuation of Deferred@983252160 after retry RPC after error@1327756179) -> (continuation of Deferred@895906785 after retry RPC after error@583259479) -> (continuation of Deferred@1105035507 after retry RPC after error@296897584) -> (continuation of Deferred@399363228 after retry RPC after error@723049055) -> (continuation of Deferred@116334039 after retry RPC after error@96404214) -> (continuation of Deferred@2096076785 after retry RPC after error@298348561) -> (continuation of Deferred@1874314842 after retry RPC after error@308462056) -> (continuation of Deferred@305306698 after retry RPC after error@1084767973) -> (continuation of Deferred@293381564 after retry RPC after error@362105850) -> (continuation of Deferred@323175886 after retry RPC after error@303898197) -> (continuation of Deferred@1723341039 after retry RPC after error@1498236249) -> (continuation of Deferred@1353258635 after retry RPC after error@708597117) -> (continuation of Deferred@216358837 after retry RPC after error@1068610813) -> (continuation of Deferred@657776846 after retry RPC after error@1877729000) -> (continuation of Deferred@1238707287 after retry RPC after error@2071035852) -> (continuation of Deferred@2068042492 after retry RPC after error@1257136098) -> (continuation of Deferred@708404604 after retry RPC after error@1514594536) -> (continuation of Deferred@1073155438 after retry RPC after error@123622461) -> (continuation of Deferred@1714279215 after retry RPC after error@184626850) -> (continuation of Deferred@203087569 after retry RPC after error@2039520467), errback=(continuation of Deferred@645832905 after retry RPC after error@2050888458) -> (continuation of Deferred@208075920 after retry RPC after error@1478868245) -> (continuation of Deferred@185476656 after retry RPC after error@27443736) -> (continuation of Deferred@983252160 after retry RPC after error@1327756179) -> (continuation of Deferred@895906785 after retry RPC after error@583259479) -> (continuation of Deferred@1105035507 after retry RPC after error@296897584) -> (continuation of Deferred@399363228 after retry RPC after error@723049055) -> (continuation of Deferred@116334039 after retry RPC after error@96404214) -> (continuation of Deferred@2096076785 after retry RPC after error@298348561) -> (continuation of Deferred@1874314842 after retry RPC after error@308462056) -> (continuation of Deferred@305306698 after retry RPC after error@1084767973) -> (continuation of Deferred@293381564 after retry RPC after error@362105850) -> (continuation of Deferred@323175886 after retry RPC after error@303898197) -> (continuation of Deferred@1723341039 after retry RPC after error@1498236249) -> (continuation of Deferred@1353258635 after retry RPC after error@708597117) -> (continuation of Deferred@216358837 after retry RPC after error@1068610813) -> (continuation of Deferred@657776846 after retry RPC after error@1877729000) -> (continuation of Deferred@1238707287 after retry RPC after error@2071035852) -> (continuation of Deferred@2068042492 after retry RPC after error@1257136098) -> (continuation of Deferred@708404604 after retry RPC after error@1514594536) -> (continuation of Deferred@1073155438 after retry RPC after error@123622461) -> (continuation of Deferred@1714279215 after retry RPC after error@184626850) -> (continuation of Deferred@203087569 after retry RPC after error@2039520467)))
18:33:29.444 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
18:33:29.445 [WARN - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29148), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [145ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [145ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [240ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [251ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [255ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [261ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [315ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [316ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [329ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [330ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [331ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [331ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [342ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [362ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [403ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [521ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [522ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [743ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [822ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [822ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [823ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [823ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1701ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1702ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2583ms] refreshing cache from master, [2583ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2583ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2583ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2586ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2587ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2591ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2591ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [5881ms] refreshing cache from master, [5881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5882ms] too many traces: truncated at 100 traces, deferred=Deferred@422164430(state=PENDING, result=null, callback=(continuation of Deferred@645832905 after retry RPC after error@2050888458) -> (continuation of Deferred@208075920 after retry RPC after error@1478868245) -> (continuation of Deferred@185476656 after retry RPC after error@27443736) -> (continuation of Deferred@983252160 after retry RPC after error@1327756179) -> (continuation of Deferred@895906785 after retry RPC after error@583259479) -> (continuation of Deferred@1105035507 after retry RPC after error@296897584) -> (continuation of Deferred@399363228 after retry RPC after error@723049055) -> (continuation of Deferred@116334039 after retry RPC after error@96404214) -> (continuation of Deferred@2096076785 after retry RPC after error@298348561) -> (continuation of Deferred@1874314842 after retry RPC after error@308462056) -> (continuation of Deferred@305306698 after retry RPC after error@1084767973) -> (continuation of Deferred@293381564 after retry RPC after error@362105850) -> (continuation of Deferred@323175886 after retry RPC after error@303898197) -> (continuation of Deferred@1723341039 after retry RPC after error@1498236249) -> (continuation of Deferred@1353258635 after retry RPC after error@708597117) -> (continuation of Deferred@216358837 after retry RPC after error@1068610813) -> (continuation of Deferred@657776846 after retry RPC after error@1877729000) -> (continuation of Deferred@1238707287 after retry RPC after error@2071035852) -> (continuation of Deferred@2068042492 after retry RPC after error@1257136098) -> (continuation of Deferred@708404604 after retry RPC after error@1514594536) -> (continuation of Deferred@1073155438 after retry RPC after error@123622461) -> (continuation of Deferred@1714279215 after retry RPC after error@184626850) -> (continuation of Deferred@203087569 after retry RPC after error@2039520467), errback=(continuation of Deferred@645832905 after retry RPC after error@2050888458) -> (continuation of Deferred@208075920 after retry RPC after error@1478868245) -> (continuation of Deferred@185476656 after retry RPC after error@27443736) -> (continuation of Deferred@983252160 after retry RPC after error@1327756179) -> (continuation of Deferred@895906785 after retry RPC after error@583259479) -> (continuation of Deferred@1105035507 after retry RPC after error@296897584) -> (continuation of Deferred@399363228 after retry RPC after error@723049055) -> (continuation of Deferred@116334039 after retry RPC after error@96404214) -> (continuation of Deferred@2096076785 after retry RPC after error@298348561) -> (continuation of Deferred@1874314842 after retry RPC after error@308462056) -> (continuation of Deferred@305306698 after retry RPC after error@1084767973) -> (continuation of Deferred@293381564 after retry RPC after error@362105850) -> (continuation of Deferred@323175886 after retry RPC after error@303898197) -> (continuation of Deferred@1723341039 after retry RPC after error@1498236249) -> (continuation of Deferred@1353258635 after retry RPC after error@708597117) -> (continuation of Deferred@216358837 after retry RPC after error@1068610813) -> (continuation of Deferred@657776846 after retry RPC after error@1877729000) -> (continuation of Deferred@1238707287 after retry RPC after error@2071035852) -> (continuation of Deferred@2068042492 after retry RPC after error@1257136098) -> (continuation of Deferred@708404604 after retry RPC after error@1514594536) -> (continuation of Deferred@1073155438 after retry RPC after error@123622461) -> (continuation of Deferred@1714279215 after retry RPC after error@184626850) -> (continuation of Deferred@203087569 after retry RPC after error@2039520467)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:29.445 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
18:33:29.448 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#6 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_6.
18:33:29.450 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29148), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [145ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [145ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [240ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [251ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [255ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [261ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [315ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [316ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [329ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [330ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [331ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [331ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [342ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [342ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [362ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [403ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [403ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [521ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [522ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [743ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [822ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [822ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [823ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [823ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1701ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1702ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2583ms] refreshing cache from master, [2583ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2583ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2583ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2586ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2587ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2591ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2591ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [5881ms] refreshing cache from master, [5881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5882ms] too many traces: truncated at 100 traces, deferred=Deferred@422164430(state=PENDING, result=null, callback=(continuation of Deferred@645832905 after retry RPC after error@2050888458) -> (continuation of Deferred@208075920 after retry RPC after error@1478868245) -> (continuation of Deferred@185476656 after retry RPC after error@27443736) -> (continuation of Deferred@983252160 after retry RPC after error@1327756179) -> (continuation of Deferred@895906785 after retry RPC after error@583259479) -> (continuation of Deferred@1105035507 after retry RPC after error@296897584) -> (continuation of Deferred@399363228 after retry RPC after error@723049055) -> (continuation of Deferred@116334039 after retry RPC after error@96404214) -> (continuation of Deferred@2096076785 after retry RPC after error@298348561) -> (continuation of Deferred@1874314842 after retry RPC after error@308462056) -> (continuation of Deferred@305306698 after retry RPC after error@1084767973) -> (continuation of Deferred@293381564 after retry RPC after error@362105850) -> (continuation of Deferred@323175886 after retry RPC after error@303898197) -> (continuation of Deferred@1723341039 after retry RPC after error@1498236249) -> (continuation of Deferred@1353258635 after retry RPC after error@708597117) -> (continuation of Deferred@216358837 after retry RPC after error@1068610813) -> (continuation of Deferred@657776846 after retry RPC after error@1877729000) -> (continuation of Deferred@1238707287 after retry RPC after error@2071035852) -> (continuation of Deferred@2068042492 after retry RPC after error@1257136098) -> (continuation of Deferred@708404604 after retry RPC after error@1514594536) -> (continuation of Deferred@1073155438 after retry RPC after error@123622461) -> (continuation of Deferred@1714279215 after retry RPC after error@184626850) -> (continuation of Deferred@203087569 after retry RPC after error@2039520467), errback=(continuation of Deferred@645832905 after retry RPC after error@2050888458) -> (continuation of Deferred@208075920 after retry RPC after error@1478868245) -> (continuation of Deferred@185476656 after retry RPC after error@27443736) -> (continuation of Deferred@983252160 after retry RPC after error@1327756179) -> (continuation of Deferred@895906785 after retry RPC after error@583259479) -> (continuation of Deferred@1105035507 after retry RPC after error@296897584) -> (continuation of Deferred@399363228 after retry RPC after error@723049055) -> (continuation of Deferred@116334039 after retry RPC after error@96404214) -> (continuation of Deferred@2096076785 after retry RPC after error@298348561) -> (continuation of Deferred@1874314842 after retry RPC after error@308462056) -> (continuation of Deferred@305306698 after retry RPC after error@1084767973) -> (continuation of Deferred@293381564 after retry RPC after error@362105850) -> (continuation of Deferred@323175886 after retry RPC after error@303898197) -> (continuation of Deferred@1723341039 after retry RPC after error@1498236249) -> (continuation of Deferred@1353258635 after retry RPC after error@708597117) -> (continuation of Deferred@216358837 after retry RPC after error@1068610813) -> (continuation of Deferred@657776846 after retry RPC after error@1877729000) -> (continuation of Deferred@1238707287 after retry RPC after error@2071035852) -> (continuation of Deferred@2068042492 after retry RPC after error@1257136098) -> (continuation of Deferred@708404604 after retry RPC after error@1514594536) -> (continuation of Deferred@1073155438 after retry RPC after error@123622461) -> (continuation of Deferred@1714279215 after retry RPC after error@184626850) -> (continuation of Deferred@203087569 after retry RPC after error@2039520467)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:29.452 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_6.
18:33:29.453 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:33:29.453 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#6) of source Source: KuduSource.
18:33:29.460 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.460 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.460 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.461 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.461 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.461 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.461 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.461 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.461 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.461 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.461 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.461 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.461 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.477 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:29.477 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:29.477 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:29.477 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:29.477 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:29.477 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:29.478 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:29.478 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:29.478 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:29.478 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:29.478 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:29.478 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:29.478 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:29.520 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.520 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.520 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.521 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.521 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.521 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.521 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.521 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.521 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.521 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.521 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.521 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.521 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.568 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:29.569 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:29.569 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:29.569 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:29.569 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:29.569 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:29.569 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:29.570 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:29.570 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:29.569 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:29.570 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:29.570 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:29.570 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:29.594 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:29.616 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:29.616 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:29.616 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:29.617 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:29.617 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:29.617 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:29.617 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:29.617 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:29.617 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:29.619 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:29.619 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:29.619 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:29.619 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:29.630 [INFO - flink-pekko.actor.default-dispatcher-6] (Slf4jLogger.scala:117) Slf4jLogger started
18:33:29.636 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.636 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.636 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.636 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.637 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.637 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.637 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.637 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.637 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.637 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.637 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.637 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.637 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.644 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.644 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.644 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.644 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.644 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.644 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.645 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.645 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.645 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.645 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.645 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.645 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.645 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.685 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:29.685 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:29.685 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:29.685 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:29.685 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:29.685 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:29.685 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:29.685 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:29.685 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:29.685 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:29.685 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:29.685 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:29.686 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:29.721 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.721 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.722 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.722 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.722 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.722 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.722 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.722 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.722 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.722 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.722 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.722 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.722 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.727 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:29.731 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:29.731 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:29.731 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:29.732 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.732 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.732 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:29.732 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.732 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.732 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:29.732 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.732 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.733 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:29.733 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:29.800 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.800 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.800 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.800 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.800 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.800 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.801 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.801 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.801 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.801 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.801 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.801 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.801 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.809 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
18:33:29.815 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.816 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.816 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.816 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.816 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.816 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.816 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.816 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.816 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.816 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.816 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.816 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.816 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.822 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:29.836 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
18:33:29.877 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.878 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.878 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.878 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.878 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.878 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.879 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.879 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.879 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.879 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.879 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.879 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.879 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.901 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
18:33:29.936 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.937 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.937 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.937 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.937 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.937 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.937 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.938 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.938 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.938 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.938 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.938 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.938 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.939 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
18:33:29.942 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:29.942 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:29.942 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:29.942 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.942 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.942 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:29.942 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.942 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.943 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:29.943 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.943 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.943 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:29.943 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:29.988 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
18:33:29.992 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:29.992 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:29.992 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:29.993 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:29.993 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:29.993 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:29.993 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:29.993 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:29.993 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:29.993 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:29.993 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:29.993 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:29.994 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:29.994 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29617), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [22ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [43ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [156ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [166ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [176ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [176ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [285ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [286ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [286ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [286ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [303ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [321ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [322ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [362ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [383ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [523ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [743ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1243ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1561ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1564ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1564ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2760ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2763ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3261ms] refreshing cache from master, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3262ms] too many traces: truncated at 100 traces, deferred=Deferred@361514417(state=PENDING, result=null, callback=(continuation of Deferred@379854568 after retry RPC after error@1544904018) -> (continuation of Deferred@1818469448 after retry RPC after error@464901560) -> (continuation of Deferred@768658296 after retry RPC after error@1541008477) -> (continuation of Deferred@711541386 after retry RPC after error@524573290) -> (continuation of Deferred@887409137 after retry RPC after error@550199348) -> (continuation of Deferred@1079380917 after retry RPC after error@2105315039) -> (continuation of Deferred@1866820544 after retry RPC after error@351567068) -> (continuation of Deferred@1687144020 after retry RPC after error@2099029612) -> (continuation of Deferred@969136484 after retry RPC after error@249970716) -> (continuation of Deferred@348228338 after retry RPC after error@209084864) -> (continuation of Deferred@735674835 after retry RPC after error@394510868) -> (continuation of Deferred@252533772 after retry RPC after error@810177612) -> (continuation of Deferred@1467649167 after retry RPC after error@1583380246) -> (continuation of Deferred@996720106 after retry RPC after error@1499621119) -> (continuation of Deferred@1526699944 after retry RPC after error@133858086) -> (continuation of Deferred@2030303710 after retry RPC after error@865873311) -> (continuation of Deferred@360234643 after retry RPC after error@1187577001) -> (continuation of Deferred@551755943 after retry RPC after error@1925251569) -> (continuation of Deferred@572372252 after retry RPC after error@598816834) -> (continuation of Deferred@443466379 after retry RPC after error@1616545470) -> (continuation of Deferred@799046396 after retry RPC after error@91829346) -> (continuation of Deferred@1768936668 after retry RPC after error@1563738169) -> (continuation of Deferred@1911498489 after retry RPC after error@1039779458) -> (continuation of Deferred@707214549 after retry RPC after error@1374225568), errback=(continuation of Deferred@379854568 after retry RPC after error@1544904018) -> (continuation of Deferred@1818469448 after retry RPC after error@464901560) -> (continuation of Deferred@768658296 after retry RPC after error@1541008477) -> (continuation of Deferred@711541386 after retry RPC after error@524573290) -> (continuation of Deferred@887409137 after retry RPC after error@550199348) -> (continuation of Deferred@1079380917 after retry RPC after error@2105315039) -> (continuation of Deferred@1866820544 after retry RPC after error@351567068) -> (continuation of Deferred@1687144020 after retry RPC after error@2099029612) -> (continuation of Deferred@969136484 after retry RPC after error@249970716) -> (continuation of Deferred@348228338 after retry RPC after error@209084864) -> (continuation of Deferred@735674835 after retry RPC after error@394510868) -> (continuation of Deferred@252533772 after retry RPC after error@810177612) -> (continuation of Deferred@1467649167 after retry RPC after error@1583380246) -> (continuation of Deferred@996720106 after retry RPC after error@1499621119) -> (continuation of Deferred@1526699944 after retry RPC after error@133858086) -> (continuation of Deferred@2030303710 after retry RPC after error@865873311) -> (continuation of Deferred@360234643 after retry RPC after error@1187577001) -> (continuation of Deferred@551755943 after retry RPC after error@1925251569) -> (continuation of Deferred@572372252 after retry RPC after error@598816834) -> (continuation of Deferred@443466379 after retry RPC after error@1616545470) -> (continuation of Deferred@799046396 after retry RPC after error@91829346) -> (continuation of Deferred@1768936668 after retry RPC after error@1563738169) -> (continuation of Deferred@1911498489 after retry RPC after error@1039779458) -> (continuation of Deferred@707214549 after retry RPC after error@1374225568)))
18:33:29.996 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:29.996 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:29.996 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:29.997 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:29.997 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:29.997 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:29.997 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29617), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [22ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [43ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [156ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [166ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [176ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [176ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [285ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [286ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [286ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [286ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [303ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [321ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [322ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [362ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [383ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [523ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [743ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1243ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1561ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1564ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1564ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2760ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2763ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3261ms] refreshing cache from master, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3262ms] too many traces: truncated at 100 traces, deferred=Deferred@361514417(state=PENDING, result=null, callback=(continuation of Deferred@379854568 after retry RPC after error@1544904018) -> (continuation of Deferred@1818469448 after retry RPC after error@464901560) -> (continuation of Deferred@768658296 after retry RPC after error@1541008477) -> (continuation of Deferred@711541386 after retry RPC after error@524573290) -> (continuation of Deferred@887409137 after retry RPC after error@550199348) -> (continuation of Deferred@1079380917 after retry RPC after error@2105315039) -> (continuation of Deferred@1866820544 after retry RPC after error@351567068) -> (continuation of Deferred@1687144020 after retry RPC after error@2099029612) -> (continuation of Deferred@969136484 after retry RPC after error@249970716) -> (continuation of Deferred@348228338 after retry RPC after error@209084864) -> (continuation of Deferred@735674835 after retry RPC after error@394510868) -> (continuation of Deferred@252533772 after retry RPC after error@810177612) -> (continuation of Deferred@1467649167 after retry RPC after error@1583380246) -> (continuation of Deferred@996720106 after retry RPC after error@1499621119) -> (continuation of Deferred@1526699944 after retry RPC after error@133858086) -> (continuation of Deferred@2030303710 after retry RPC after error@865873311) -> (continuation of Deferred@360234643 after retry RPC after error@1187577001) -> (continuation of Deferred@551755943 after retry RPC after error@1925251569) -> (continuation of Deferred@572372252 after retry RPC after error@598816834) -> (continuation of Deferred@443466379 after retry RPC after error@1616545470) -> (continuation of Deferred@799046396 after retry RPC after error@91829346) -> (continuation of Deferred@1768936668 after retry RPC after error@1563738169) -> (continuation of Deferred@1911498489 after retry RPC after error@1039779458) -> (continuation of Deferred@707214549 after retry RPC after error@1374225568), errback=(continuation of Deferred@379854568 after retry RPC after error@1544904018) -> (continuation of Deferred@1818469448 after retry RPC after error@464901560) -> (continuation of Deferred@768658296 after retry RPC after error@1541008477) -> (continuation of Deferred@711541386 after retry RPC after error@524573290) -> (continuation of Deferred@887409137 after retry RPC after error@550199348) -> (continuation of Deferred@1079380917 after retry RPC after error@2105315039) -> (continuation of Deferred@1866820544 after retry RPC after error@351567068) -> (continuation of Deferred@1687144020 after retry RPC after error@2099029612) -> (continuation of Deferred@969136484 after retry RPC after error@249970716) -> (continuation of Deferred@348228338 after retry RPC after error@209084864) -> (continuation of Deferred@735674835 after retry RPC after error@394510868) -> (continuation of Deferred@252533772 after retry RPC after error@810177612) -> (continuation of Deferred@1467649167 after retry RPC after error@1583380246) -> (continuation of Deferred@996720106 after retry RPC after error@1499621119) -> (continuation of Deferred@1526699944 after retry RPC after error@133858086) -> (continuation of Deferred@2030303710 after retry RPC after error@865873311) -> (continuation of Deferred@360234643 after retry RPC after error@1187577001) -> (continuation of Deferred@551755943 after retry RPC after error@1925251569) -> (continuation of Deferred@572372252 after retry RPC after error@598816834) -> (continuation of Deferred@443466379 after retry RPC after error@1616545470) -> (continuation of Deferred@799046396 after retry RPC after error@91829346) -> (continuation of Deferred@1768936668 after retry RPC after error@1563738169) -> (continuation of Deferred@1911498489 after retry RPC after error@1039779458) -> (continuation of Deferred@707214549 after retry RPC after error@1374225568)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29617), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [22ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [43ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [156ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [166ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [176ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [176ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [285ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [286ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [286ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [286ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [303ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [321ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [322ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [362ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [383ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [523ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [743ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1243ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1561ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1564ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1564ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2760ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2763ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3261ms] refreshing cache from master, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3262ms] too many traces: truncated at 100 traces, deferred=Deferred@361514417(state=PENDING, result=null, callback=(continuation of Deferred@379854568 after retry RPC after error@1544904018) -> (continuation of Deferred@1818469448 after retry RPC after error@464901560) -> (continuation of Deferred@768658296 after retry RPC after error@1541008477) -> (continuation of Deferred@711541386 after retry RPC after error@524573290) -> (continuation of Deferred@887409137 after retry RPC after error@550199348) -> (continuation of Deferred@1079380917 after retry RPC after error@2105315039) -> (continuation of Deferred@1866820544 after retry RPC after error@351567068) -> (continuation of Deferred@1687144020 after retry RPC after error@2099029612) -> (continuation of Deferred@969136484 after retry RPC after error@249970716) -> (continuation of Deferred@348228338 after retry RPC after error@209084864) -> (continuation of Deferred@735674835 after retry RPC after error@394510868) -> (continuation of Deferred@252533772 after retry RPC after error@810177612) -> (continuation of Deferred@1467649167 after retry RPC after error@1583380246) -> (continuation of Deferred@996720106 after retry RPC after error@1499621119) -> (continuation of Deferred@1526699944 after retry RPC after error@133858086) -> (continuation of Deferred@2030303710 after retry RPC after error@865873311) -> (continuation of Deferred@360234643 after retry RPC after error@1187577001) -> (continuation of Deferred@551755943 after retry RPC after error@1925251569) -> (continuation of Deferred@572372252 after retry RPC after error@598816834) -> (continuation of Deferred@443466379 after retry RPC after error@1616545470) -> (continuation of Deferred@799046396 after retry RPC after error@91829346) -> (continuation of Deferred@1768936668 after retry RPC after error@1563738169) -> (continuation of Deferred@1911498489 after retry RPC after error@1039779458) -> (continuation of Deferred@707214549 after retry RPC after error@1374225568), errback=(continuation of Deferred@379854568 after retry RPC after error@1544904018) -> (continuation of Deferred@1818469448 after retry RPC after error@464901560) -> (continuation of Deferred@768658296 after retry RPC after error@1541008477) -> (continuation of Deferred@711541386 after retry RPC after error@524573290) -> (continuation of Deferred@887409137 after retry RPC after error@550199348) -> (continuation of Deferred@1079380917 after retry RPC after error@2105315039) -> (continuation of Deferred@1866820544 after retry RPC after error@351567068) -> (continuation of Deferred@1687144020 after retry RPC after error@2099029612) -> (continuation of Deferred@969136484 after retry RPC after error@249970716) -> (continuation of Deferred@348228338 after retry RPC after error@209084864) -> (continuation of Deferred@735674835 after retry RPC after error@394510868) -> (continuation of Deferred@252533772 after retry RPC after error@810177612) -> (continuation of Deferred@1467649167 after retry RPC after error@1583380246) -> (continuation of Deferred@996720106 after retry RPC after error@1499621119) -> (continuation of Deferred@1526699944 after retry RPC after error@133858086) -> (continuation of Deferred@2030303710 after retry RPC after error@865873311) -> (continuation of Deferred@360234643 after retry RPC after error@1187577001) -> (continuation of Deferred@551755943 after retry RPC after error@1925251569) -> (continuation of Deferred@572372252 after retry RPC after error@598816834) -> (continuation of Deferred@443466379 after retry RPC after error@1616545470) -> (continuation of Deferred@799046396 after retry RPC after error@91829346) -> (continuation of Deferred@1768936668 after retry RPC after error@1563738169) -> (continuation of Deferred@1911498489 after retry RPC after error@1039779458) -> (continuation of Deferred@707214549 after retry RPC after error@1374225568)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.68.188:38393
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:29.998 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:29.998 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:29.998 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:29.998 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:29.998 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:29.998 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:29.998 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:30.002 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29617), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [22ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [43ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [156ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [166ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [176ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [176ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [285ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [286ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [286ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [286ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [303ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [321ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [322ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [362ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [383ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [523ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [743ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1243ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1561ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1564ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1564ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2760ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2763ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3261ms] refreshing cache from master, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3262ms] too many traces: truncated at 100 traces, deferred=Deferred@361514417(state=PENDING, result=null, callback=(continuation of Deferred@379854568 after retry RPC after error@1544904018) -> (continuation of Deferred@1818469448 after retry RPC after error@464901560) -> (continuation of Deferred@768658296 after retry RPC after error@1541008477) -> (continuation of Deferred@711541386 after retry RPC after error@524573290) -> (continuation of Deferred@887409137 after retry RPC after error@550199348) -> (continuation of Deferred@1079380917 after retry RPC after error@2105315039) -> (continuation of Deferred@1866820544 after retry RPC after error@351567068) -> (continuation of Deferred@1687144020 after retry RPC after error@2099029612) -> (continuation of Deferred@969136484 after retry RPC after error@249970716) -> (continuation of Deferred@348228338 after retry RPC after error@209084864) -> (continuation of Deferred@735674835 after retry RPC after error@394510868) -> (continuation of Deferred@252533772 after retry RPC after error@810177612) -> (continuation of Deferred@1467649167 after retry RPC after error@1583380246) -> (continuation of Deferred@996720106 after retry RPC after error@1499621119) -> (continuation of Deferred@1526699944 after retry RPC after error@133858086) -> (continuation of Deferred@2030303710 after retry RPC after error@865873311) -> (continuation of Deferred@360234643 after retry RPC after error@1187577001) -> (continuation of Deferred@551755943 after retry RPC after error@1925251569) -> (continuation of Deferred@572372252 after retry RPC after error@598816834) -> (continuation of Deferred@443466379 after retry RPC after error@1616545470) -> (continuation of Deferred@799046396 after retry RPC after error@91829346) -> (continuation of Deferred@1768936668 after retry RPC after error@1563738169) -> (continuation of Deferred@1911498489 after retry RPC after error@1039779458) -> (continuation of Deferred@707214549 after retry RPC after error@1374225568), errback=(continuation of Deferred@379854568 after retry RPC after error@1544904018) -> (continuation of Deferred@1818469448 after retry RPC after error@464901560) -> (continuation of Deferred@768658296 after retry RPC after error@1541008477) -> (continuation of Deferred@711541386 after retry RPC after error@524573290) -> (continuation of Deferred@887409137 after retry RPC after error@550199348) -> (continuation of Deferred@1079380917 after retry RPC after error@2105315039) -> (continuation of Deferred@1866820544 after retry RPC after error@351567068) -> (continuation of Deferred@1687144020 after retry RPC after error@2099029612) -> (continuation of Deferred@969136484 after retry RPC after error@249970716) -> (continuation of Deferred@348228338 after retry RPC after error@209084864) -> (continuation of Deferred@735674835 after retry RPC after error@394510868) -> (continuation of Deferred@252533772 after retry RPC after error@810177612) -> (continuation of Deferred@1467649167 after retry RPC after error@1583380246) -> (continuation of Deferred@996720106 after retry RPC after error@1499621119) -> (continuation of Deferred@1526699944 after retry RPC after error@133858086) -> (continuation of Deferred@2030303710 after retry RPC after error@865873311) -> (continuation of Deferred@360234643 after retry RPC after error@1187577001) -> (continuation of Deferred@551755943 after retry RPC after error@1925251569) -> (continuation of Deferred@572372252 after retry RPC after error@598816834) -> (continuation of Deferred@443466379 after retry RPC after error@1616545470) -> (continuation of Deferred@799046396 after retry RPC after error@91829346) -> (continuation of Deferred@1768936668 after retry RPC after error@1563738169) -> (continuation of Deferred@1911498489 after retry RPC after error@1039779458) -> (continuation of Deferred@707214549 after retry RPC after error@1374225568)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29617), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [22ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [43ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [156ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [165ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [166ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [176ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [176ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [285ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [286ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [286ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [286ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [302ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [303ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [321ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [322ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [361ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [362ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [383ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [383ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [523ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [742ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [743ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [743ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1243ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1561ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1564ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1564ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2760ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2763ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [3261ms] refreshing cache from master, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [3262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [3262ms] too many traces: truncated at 100 traces, deferred=Deferred@361514417(state=PENDING, result=null, callback=(continuation of Deferred@379854568 after retry RPC after error@1544904018) -> (continuation of Deferred@1818469448 after retry RPC after error@464901560) -> (continuation of Deferred@768658296 after retry RPC after error@1541008477) -> (continuation of Deferred@711541386 after retry RPC after error@524573290) -> (continuation of Deferred@887409137 after retry RPC after error@550199348) -> (continuation of Deferred@1079380917 after retry RPC after error@2105315039) -> (continuation of Deferred@1866820544 after retry RPC after error@351567068) -> (continuation of Deferred@1687144020 after retry RPC after error@2099029612) -> (continuation of Deferred@969136484 after retry RPC after error@249970716) -> (continuation of Deferred@348228338 after retry RPC after error@209084864) -> (continuation of Deferred@735674835 after retry RPC after error@394510868) -> (continuation of Deferred@252533772 after retry RPC after error@810177612) -> (continuation of Deferred@1467649167 after retry RPC after error@1583380246) -> (continuation of Deferred@996720106 after retry RPC after error@1499621119) -> (continuation of Deferred@1526699944 after retry RPC after error@133858086) -> (continuation of Deferred@2030303710 after retry RPC after error@865873311) -> (continuation of Deferred@360234643 after retry RPC after error@1187577001) -> (continuation of Deferred@551755943 after retry RPC after error@1925251569) -> (continuation of Deferred@572372252 after retry RPC after error@598816834) -> (continuation of Deferred@443466379 after retry RPC after error@1616545470) -> (continuation of Deferred@799046396 after retry RPC after error@91829346) -> (continuation of Deferred@1768936668 after retry RPC after error@1563738169) -> (continuation of Deferred@1911498489 after retry RPC after error@1039779458) -> (continuation of Deferred@707214549 after retry RPC after error@1374225568), errback=(continuation of Deferred@379854568 after retry RPC after error@1544904018) -> (continuation of Deferred@1818469448 after retry RPC after error@464901560) -> (continuation of Deferred@768658296 after retry RPC after error@1541008477) -> (continuation of Deferred@711541386 after retry RPC after error@524573290) -> (continuation of Deferred@887409137 after retry RPC after error@550199348) -> (continuation of Deferred@1079380917 after retry RPC after error@2105315039) -> (continuation of Deferred@1866820544 after retry RPC after error@351567068) -> (continuation of Deferred@1687144020 after retry RPC after error@2099029612) -> (continuation of Deferred@969136484 after retry RPC after error@249970716) -> (continuation of Deferred@348228338 after retry RPC after error@209084864) -> (continuation of Deferred@735674835 after retry RPC after error@394510868) -> (continuation of Deferred@252533772 after retry RPC after error@810177612) -> (continuation of Deferred@1467649167 after retry RPC after error@1583380246) -> (continuation of Deferred@996720106 after retry RPC after error@1499621119) -> (continuation of Deferred@1526699944 after retry RPC after error@133858086) -> (continuation of Deferred@2030303710 after retry RPC after error@865873311) -> (continuation of Deferred@360234643 after retry RPC after error@1187577001) -> (continuation of Deferred@551755943 after retry RPC after error@1925251569) -> (continuation of Deferred@572372252 after retry RPC after error@598816834) -> (continuation of Deferred@443466379 after retry RPC after error@1616545470) -> (continuation of Deferred@799046396 after retry RPC after error@91829346) -> (continuation of Deferred@1768936668 after retry RPC after error@1563738169) -> (continuation of Deferred@1911498489 after retry RPC after error@1039779458) -> (continuation of Deferred@707214549 after retry RPC after error@1374225568)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.68.188:38393
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:30.004 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:33:30.004 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#6) of source Source: KuduSource.
18:33:30.004 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to CANCELING.
18:33:30.005 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_6).
18:33:30.005 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to CANCELING.
18:33:30.005 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_6).
18:33:30.012 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:30.012 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:30.012 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:30.012 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.012 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.012 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.013 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.013 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.013 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.013 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.013 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.013 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.013 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:30.015 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
18:33:30.015 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CANCELING to CANCELED.
18:33:30.015 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_6).
18:33:30.016 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#6 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_6.
18:33:30.017 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CANCELING to CANCELED.
18:33:30.018 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:318) Clearing resource requirements of job fa73e37017778341a79e5b3ef3d55eb9
18:33:30.020 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
18:33:30.021 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
18:33:30.021 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
18:33:30.021 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
18:33:30.021 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
18:33:30.022 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
18:33:30.022 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
18:33:30.022 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
18:33:30.024 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
18:33:30.024 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
18:33:30.025 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
18:33:30.025 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
18:33:30.025 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
18:33:30.025 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
18:33:30.025 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
18:33:30.025 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
18:33:30.025 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
18:33:30.025 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
18:33:30.025 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
18:33:30.026 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
18:33:30.031 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
18:33:30.031 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
18:33:30.031 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
18:33:30.031 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
18:33:30.031 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_91d164ed4bfb0693b632f97a4f3a9555/blobStorage
18:33:30.032 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:44115 - max concurrent requests: 50 - max backlog: 1000
18:33:30.033 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:30.033 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:30.033 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:30.033 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.033 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.033 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.033 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.034 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.034 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.034 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.034 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.034 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.034 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:30.035 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_91d164ed4bfb0693b632f97a4f3a9555/blobStorage
18:33:30.037 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_91d164ed4bfb0693b632f97a4f3a9555/blobStorage
18:33:30.038 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
18:33:30.038 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 1bed232f-62eb-42dc-858c-7139d8e062d6
18:33:30.040 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 32 GB (66.67% usable)
18:33:30.040 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-3c6a25f7-9284-48b3-8f19-e1c695f7770f
18:33:30.043 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-22963432-2c59-4026-bd85-ea5c7c444138
18:33:30.044 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:30.044 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:30.044 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:30.045 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.045 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.045 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.045 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.045 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.045 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.045 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.045 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.045 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.045 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:30.054 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:30.054 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:30.054 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:30.054 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.054 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.055 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.055 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.055 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.055 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.055 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.055 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.055 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.055 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:30.072 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:30.072 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:30.072 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:30.073 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.073 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.073 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.073 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.073 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.073 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.073 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.073 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.073 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.074 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:30.094 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:30.108 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:30.108 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:30.108 [DEBUG - pool-294-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:30.109 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:30.109 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:30.109 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:30.109 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:30.109 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:30.109 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:30.109 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:30.109 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:30.109 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:30.109 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:30.110 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29803), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [73ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [165ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [166ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [326ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [340ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [345ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [345ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [372ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [372ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [374ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [375ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [375ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [375ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [380ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [381ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [402ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [443ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [500ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [502ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [504ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [504ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [621ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [621ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [622ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [760ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [762ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [763ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [763ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [763ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1220ms] refreshing cache from master, [1220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1221ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1223ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1223ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1801ms] refreshing cache from master, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1803ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1803ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1803ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1803ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3360ms] refreshing cache from master, [3360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3363ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3363ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3364ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [4260ms] refreshing cache from master, [4260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [4260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [4261ms] too many traces: truncated at 100 traces, deferred=Deferred@1000634904(state=PENDING, result=null, callback=(continuation of Deferred@1578390325 after retry RPC after error@1922444037) -> (continuation of Deferred@731255958 after retry RPC after error@872075078) -> (continuation of Deferred@1334554615 after retry RPC after error@210135808) -> (continuation of Deferred@397405346 after retry RPC after error@1917485550) -> (continuation of Deferred@1621916743 after retry RPC after error@1607324985) -> (continuation of Deferred@938469534 after retry RPC after error@286018172) -> (continuation of Deferred@314655326 after retry RPC after error@596912418) -> (continuation of Deferred@1811386070 after retry RPC after error@417035902) -> (continuation of Deferred@9442441 after retry RPC after error@38789248) -> (continuation of Deferred@1427722017 after retry RPC after error@380808058) -> (continuation of Deferred@377934201 after retry RPC after error@1798334665) -> (continuation of Deferred@1959740105 after retry RPC after error@1998966353) -> (continuation of Deferred@1468581077 after retry RPC after error@1058445517) -> (continuation of Deferred@826367212 after retry RPC after error@1758415827) -> (continuation of Deferred@2037421171 after retry RPC after error@1923853152) -> (continuation of Deferred@1228287973 after retry RPC after error@1530229955) -> (continuation of Deferred@647733466 after retry RPC after error@163905474) -> (continuation of Deferred@1911922712 after retry RPC after error@26624393) -> (continuation of Deferred@2062593041 after retry RPC after error@1415865954) -> (continuation of Deferred@147716502 after retry RPC after error@1004825359) -> (continuation of Deferred@1141622854 after retry RPC after error@858517971) -> (continuation of Deferred@1414377321 after retry RPC after error@1281956604) -> (continuation of Deferred@1455071951 after retry RPC after error@989033634) -> (continuation of Deferred@58499698 after retry RPC after error@130479643), errback=(continuation of Deferred@1578390325 after retry RPC after error@1922444037) -> (continuation of Deferred@731255958 after retry RPC after error@872075078) -> (continuation of Deferred@1334554615 after retry RPC after error@210135808) -> (continuation of Deferred@397405346 after retry RPC after error@1917485550) -> (continuation of Deferred@1621916743 after retry RPC after error@1607324985) -> (continuation of Deferred@938469534 after retry RPC after error@286018172) -> (continuation of Deferred@314655326 after retry RPC after error@596912418) -> (continuation of Deferred@1811386070 after retry RPC after error@417035902) -> (continuation of Deferred@9442441 after retry RPC after error@38789248) -> (continuation of Deferred@1427722017 after retry RPC after error@380808058) -> (continuation of Deferred@377934201 after retry RPC after error@1798334665) -> (continuation of Deferred@1959740105 after retry RPC after error@1998966353) -> (continuation of Deferred@1468581077 after retry RPC after error@1058445517) -> (continuation of Deferred@826367212 after retry RPC after error@1758415827) -> (continuation of Deferred@2037421171 after retry RPC after error@1923853152) -> (continuation of Deferred@1228287973 after retry RPC after error@1530229955) -> (continuation of Deferred@647733466 after retry RPC after error@163905474) -> (continuation of Deferred@1911922712 after retry RPC after error@26624393) -> (continuation of Deferred@2062593041 after retry RPC after error@1415865954) -> (continuation of Deferred@147716502 after retry RPC after error@1004825359) -> (continuation of Deferred@1141622854 after retry RPC after error@858517971) -> (continuation of Deferred@1414377321 after retry RPC after error@1281956604) -> (continuation of Deferred@1455071951 after retry RPC after error@989033634) -> (continuation of Deferred@58499698 after retry RPC after error@130479643)))
18:33:30.111 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:30.112 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:30.112 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:30.112 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.112 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.112 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.112 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.112 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.113 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.113 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.113 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.113 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.113 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:30.172 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:30.172 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:30.172 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:30.172 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.172 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.172 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.173 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.173 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.173 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.173 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.173 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.173 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.173 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:30.197 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
18:33:30.216 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
18:33:30.216 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
18:33:30.216 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
18:33:30.217 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
18:33:30.219 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:30.219 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:30.219 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:30.220 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.220 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.220 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.220 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.220 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.220 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.221 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.221 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.221 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.221 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:30.224 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_16 .
18:33:30.227 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:30.232 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultJobLeaderService.java:127) Start job leader service.
18:33:30.232 [INFO - flink-pekko.actor.default-dispatcher-6] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-526621e6-142c-4a5f-83fd-17f8147e6893
18:33:30.233 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:30.233 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:30.233 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:30.233 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.233 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.233 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.233 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.233 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.233 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.234 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.234 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.234 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.234 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:30.235 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
18:33:30.235 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
18:33:30.252 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:30.252 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:30.252 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:30.253 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.253 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.253 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.253 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.253 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.253 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.253 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.253 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.253 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.253 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:30.259 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
18:33:30.259 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
18:33:30.267 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:33593
18:33:30.267 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
18:33:30.273 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:30.274 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:30.274 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:30.274 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:30.275 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:30.275 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:30.274 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:30.274 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:30.275 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:30.275 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:30.275 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:30.275 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:30.275 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:30.279 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
18:33:30.279 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:33593 was granted leadership with leaderSessionID=0ec9412a-94ce-4960-aaef-de3cc6e14a83
18:33:30.279 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:33593 , session=0ec9412a-94ce-4960-aaef-de3cc6e14a83
18:33:30.283 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
18:33:30.283 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
18:33:30.283 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 1415e9fa-fe56-4d49-9886-7e4f913eed46. Creating new DispatcherLeaderProcess.
18:33:30.284 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
18:33:30.291 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
18:33:30.298 [INFO - pool-343-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 940803f1-adfe-41cc-812e-ba2805f426ea.
18:33:30.301 [INFO - pool-343-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_17 .
18:33:30.303 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
18:33:30.303 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
18:33:30.307 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_18 .
18:33:30.314 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_18 , session=1415e9fa-fe56-4d49-9886-7e4f913eed46
18:33:30.318 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:253) Starting the resource manager.
18:33:30.323 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:30.336 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:30.336 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:30.336 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:30.337 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.337 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.337 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.337 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.337 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.337 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.337 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.337 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.337 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.337 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:30.338 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:212) Starting the slot manager.
18:33:30.339 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:308) Starting tokens update task
18:33:30.339 [WARN - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
18:33:30.339 [WARN - flink-pekko.actor.default-dispatcher-6] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
18:33:30.339 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_17 , session=940803f1-adfe-41cc-812e-ba2805f426ea
18:33:30.341 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_17(812eba2805f426ea940803f1adfe41cc).
18:33:30.364 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
18:33:30.376 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:1080) Registering TaskManager with ResourceID 1bed232f-62eb-42dc-858c-7139d8e062d6 (pekko://flink/user/rpc/taskmanager_16) at ResourceManager
18:33:30.387 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_17 under registration id 37f651ea80659481e59ba59ea5044501.
18:33:30.388 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:344) Registering task executor 1bed232f-62eb-42dc-858c-7139d8e062d6 under 37f651ea80659481e59ba59ea5044501 at the slot manager.
18:33:30.396 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:30.396 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:30.396 [INFO - flink-pekko.actor.default-dispatcher-8] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (2f0efe0c81addbcaea565a6248e4a915).
18:33:30.396 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:30.397 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:30.397 [INFO - flink-pekko.actor.default-dispatcher-8] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (2f0efe0c81addbcaea565a6248e4a915).
18:33:30.397 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:30.397 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:30.397 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:30.397 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:30.397 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:30.397 [INFO - flink-pekko.actor.default-dispatcher-8] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-2f0efe0c81addbcaea565a6248e4a915'.
18:33:30.397 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:30.397 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:30.398 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:30.398 [INFO - mini-cluster-io-thread-4] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 2f0efe0c81addbcaea565a6248e4a915 was granted leadership with leader id e97d0ecd-550f-4482-a4ac-9674997e9fb7. Creating new JobMasterServiceProcess.
18:33:30.398 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:30.402 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_19 .
18:33:30.408 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (2f0efe0c81addbcaea565a6248e4a915).
18:33:30.409 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (2f0efe0c81addbcaea565a6248e4a915).
18:33:30.410 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 64d733c18b826c46b5739fcbca8e3700 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:30.410 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (2f0efe0c81addbcaea565a6248e4a915).
18:33:30.410 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
18:33:30.412 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:30.412 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:30.412 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:30.413 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.413 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.413 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.413 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
18:33:30.414 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@77c9933b
18:33:30.414 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:30.414 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.414 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.414 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit6432019912241751994/checkpoints")
18:33:30.414 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.414 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.414 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.414 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.414 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:30.420 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
18:33:30.421 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@2a74e728 for Flink Streaming Job (2f0efe0c81addbcaea565a6248e4a915).
18:33:30.422 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_19 , session=e97d0ecd-550f-4482-a4ac-9674997e9fb7
18:33:30.422 [INFO - flink-pekko.actor.default-dispatcher-6] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (2f0efe0c81addbcaea565a6248e4a915) under job master id a4ac9674997e9fb7e97d0ecd550f4482.
18:33:30.423 [INFO - flink-pekko.actor.default-dispatcher-6] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:33:30.424 [DEBUG - flink-pekko.actor.default-dispatcher-6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:30.427 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
18:33:30.427 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2f0efe0c81addbcaea565a6248e4a915) switched from state CREATED to RUNNING.
18:33:30.429 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
18:33:30.429 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
18:33:30.429 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
18:33:30.430 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
18:33:30.430 [INFO - flink-pekko.actor.default-dispatcher-6] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_17(812eba2805f426ea940803f1adfe41cc)
18:33:30.434 [INFO - flink-pekko.actor.default-dispatcher-9] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
18:33:30.435 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:390) Registering job manager a4ac9674997e9fb7e97d0ecd550f4482@pekko://flink/user/rpc/jobmanager_19 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:30.447 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:1015) Registered job manager a4ac9674997e9fb7e97d0ecd550f4482@pekko://flink/user/rpc/jobmanager_19 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:30.450 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:30.451 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:30.451 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:30.451 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:30.451 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:30.451 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:30.452 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:30.452 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:30.452 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:30.452 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:30.452 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:30.452 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:30.452 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:30.456 [INFO - flink-pekko.actor.default-dispatcher-10] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: 812eba2805f426ea940803f1adfe41cc.
18:33:30.457 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job 2f0efe0c81addbcaea565a6248e4a915: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:33:30.458 [DEBUG - main] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:33:30.459 [DEBUG - main] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:33:30.459 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 2f0efe0c81addbcaea565a6248e4a915
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 1bed232f-62eb-42dc-858c-7139d8e062d6
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
18:33:30.460 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot b0e850dd626dd04ec9671c33d0683fa9 from 1bed232f-62eb-42dc-858c-7139d8e062d6 for job 2f0efe0c81addbcaea565a6248e4a915 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:33:30.460 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot cac6830ea48c76d0f02fea2daf2d606e from 1bed232f-62eb-42dc-858c-7139d8e062d6 for job 2f0efe0c81addbcaea565a6248e4a915 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:33:30.460 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request b0e850dd626dd04ec9671c33d0683fa9 for job 2f0efe0c81addbcaea565a6248e4a915 from resource manager with leader id 812eba2805f426ea940803f1adfe41cc.
18:33:30.461 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 421d6f04d5fc55b572cf4c1dc4e4d1e1 from 1bed232f-62eb-42dc-858c-7139d8e062d6 for job 2f0efe0c81addbcaea565a6248e4a915 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:33:30.461 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for b0e850dd626dd04ec9671c33d0683fa9 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:33:30.461 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 724a237c36a82d0d22572c72ade5813d from 1bed232f-62eb-42dc-858c-7139d8e062d6 for job 2f0efe0c81addbcaea565a6248e4a915 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:33:30.461 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.5.136.60:39171(127.5.136.60:39171)] Successfully connected to peer
18:33:30.462 [DEBUG - main] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:33:30.463 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.5.136.62:42905(127.5.136.62:42905)] Successfully connected to peer
18:33:30.465 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.5.136.61:43625(127.5.136.61:43625)] Successfully connected to peer
18:33:30.466 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:192) Add job 2f0efe0c81addbcaea565a6248e4a915 for job leader monitoring.
18:33:30.467 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request cac6830ea48c76d0f02fea2daf2d606e for job 2f0efe0c81addbcaea565a6248e4a915 from resource manager with leader id 812eba2805f426ea940803f1adfe41cc.
18:33:30.467 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for cac6830ea48c76d0f02fea2daf2d606e with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:33:30.467 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 421d6f04d5fc55b572cf4c1dc4e4d1e1 for job 2f0efe0c81addbcaea565a6248e4a915 from resource manager with leader id 812eba2805f426ea940803f1adfe41cc.
18:33:30.467 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 421d6f04d5fc55b572cf4c1dc4e4d1e1 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:33:30.467 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 724a237c36a82d0d22572c72ade5813d for job 2f0efe0c81addbcaea565a6248e4a915 from resource manager with leader id 812eba2805f426ea940803f1adfe41cc.
18:33:30.468 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 724a237c36a82d0d22572c72ade5813d with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:33:30.469 [INFO - mini-cluster-io-thread-4] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_19 with leader id e97d0ecd-550f-4482-a4ac-9674997e9fb7.
18:33:30.472 [INFO - flink-pekko.actor.default-dispatcher-9] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
18:33:30.474 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_19 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:30.474 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:1783) Establish JobManager connection for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:30.474 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 2f0efe0c81addbcaea565a6248e4a915.
18:33:30.475 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
18:33:30.475 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 1bed232f-62eb-42dc-858c-7139d8e062d6 @ 127.0.0.1 (dataPort=-1) with allocation id b0e850dd626dd04ec9671c33d0683fa9
18:33:30.477 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot b0e850dd626dd04ec9671c33d0683fa9.
18:33:30.478 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:30.478 [INFO - flink-pekko.actor.default-dispatcher-9] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
18:33:30.478 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 2f0efe0c81addbcaea565a6248e4a915
18:33:30.480 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id b0e850dd626dd04ec9671c33d0683fa9.
18:33:30.480 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:30.498 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.61
18:33:30.511 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:30.511 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:30.511 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:30.511 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:30.511 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:30.511 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:30.512 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:30.512 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:30.512 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:30.512 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:30.512 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:30.512 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:30.512 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:30.512 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.515 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.60
18:33:30.519 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.62
18:33:30.519 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
18:33:30.519 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 1bed232f-62eb-42dc-858c-7139d8e062d6 @ 127.0.0.1 (dataPort=-1) with allocation id cac6830ea48c76d0f02fea2daf2d606e
18:33:30.523 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
18:33:30.523 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 1bed232f-62eb-42dc-858c-7139d8e062d6 @ 127.0.0.1 (dataPort=-1) with allocation id 724a237c36a82d0d22572c72ade5813d
18:33:30.524 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x41fb8351, L:/127.0.0.1:38220 - R:/127.5.136.61:43625] using SASL/PLAIN
18:33:30.525 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:30.526 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.179.62:35121(127.4.179.62:35121)] Successfully connected to peer
18:33:30.527 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:30.535 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.179.60:34679(127.4.179.60:34679)] Successfully connected to peer
18:33:30.549 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.550 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.555 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xa989f6e2, L:/127.0.0.1:41632 - R:/127.5.136.62:42905] using SASL/PLAIN
18:33:30.555 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x754a4095, L:/127.0.0.1:40278 - R:/127.5.136.60:39171] using SASL/PLAIN
18:33:30.562 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot cac6830ea48c76d0f02fea2daf2d606e.
18:33:30.565 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id cac6830ea48c76d0f02fea2daf2d606e.
18:33:30.570 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.179.61:44733(127.4.179.61:44733)] Successfully connected to peer
18:33:30.571 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
18:33:30.571 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
18:33:30.578 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:33:30.578 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=123), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [72ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: OK, [100ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: OK, [112ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: OK, deferred=null) after lookup
18:33:30.579 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.61
18:33:30.583 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
18:33:30.583 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 616ea92ec0b3496fb52deb2da91bd772
18:33:30.583 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 1bed232f-62eb-42dc-858c-7139d8e062d6 @ 127.0.0.1 (dataPort=-1) with allocation id 421d6f04d5fc55b572cf4c1dc4e4d1e1
18:33:30.584 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 724a237c36a82d0d22572c72ade5813d.
18:33:30.587 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 724a237c36a82d0d22572c72ade5813d.
18:33:30.588 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot b0e850dd626dd04ec9671c33d0683fa9.
18:33:30.588 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot cac6830ea48c76d0f02fea2daf2d606e.
18:33:30.588 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 724a237c36a82d0d22572c72ade5813d.
18:33:30.588 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 421d6f04d5fc55b572cf4c1dc4e4d1e1.
18:33:30.588 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 421d6f04d5fc55b572cf4c1dc4e4d1e1.
18:33:30.589 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eae68b231bec4d52a4b3372911249c5e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:30.589 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ca41259ca7743c99aac8ead8fb35574 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:30.589 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8ba55a97d55047f096401a4685d6b07e for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:30.590 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=eae68b231bec4d52a4b3372911249c5e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=0ca41259ca7743c99aac8ead8fb35574@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=8ba55a97d55047f096401a4685d6b07e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}]
18:33:30.590 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=6), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.5.136.62:42905, [6ms] Sub RPC GetTableLocations: received response from server master-127.5.136.62:42905: OK, deferred=null)) after lookup
18:33:30.590 [DEBUG - kudu-nio-1] (Connection.java:748) [peer bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)] connecting to peer
18:33:30.592 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3a642f76
18:33:30.592 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:30.592 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id 421d6f04d5fc55b572cf4c1dc4e4d1e1.
18:33:30.592 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit6432019912241751994/checkpoints")
18:33:30.592 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
18:33:30.592 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
18:33:30.592 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
18:33:30.593 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
18:33:30.593 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7d011386
18:33:30.593 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:30.593 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit6432019912241751994/checkpoints")
18:33:30.593 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
18:33:30.593 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
18:33:30.595 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:30.595 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.62
18:33:30.606 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
18:33:30.606 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
18:33:30.607 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7fa14065
18:33:30.607 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:30.608 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.60
18:33:30.616 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit6432019912241751994/checkpoints")
18:33:30.617 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
18:33:30.617 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
18:33:30.618 [DEBUG - kudu-nio-3] (Connection.java:757) [peer bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)] Successfully connected to peer
18:33:30.625 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@c27251f
18:33:30.626 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7c7d29e6
18:33:30.646 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
18:33:30.646 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
18:33:30.647 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@16ff541
18:33:30.647 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:30.647 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:30.647 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit6432019912241751994/checkpoints")
18:33:30.647 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
18:33:30.648 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
18:33:30.654 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.657 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.660 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x8ef096a5, L:/127.0.0.1:35478 - R:/127.4.179.60:34679] using SASL/PLAIN
18:33:30.662 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x18dd4f1a, L:/127.0.0.1:55584 - R:/127.4.179.62:35121] using SASL/PLAIN
18:33:30.662 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@eb800a7
18:33:30.664 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.666 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.666 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:30.671 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:30.675 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:30.676 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:33:30.676 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=217), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [195ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: OK, [195ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: OK, deferred=null) after lookup
18:33:30.679 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:33:30.680 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table fab365c4f81c4747993e0603891a5ae6
18:33:30.681 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5b89da5f
18:33:30.685 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet bf4e623aabd94032905e80f9a4dbc79e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:30.685 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 7f92012997064cd8962f208efb8dce40 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:30.685 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 5ee352da413147d39a7f82bb88ff1dda for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:30.685 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=bf4e623aabd94032905e80f9a4dbc79e@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745),6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)[L],928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=7f92012997064cd8962f208efb8dce40@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745),6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253),928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=5ee352da413147d39a7f82bb88ff1dda@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)[L],6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253),928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)]}]
18:33:30.687 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5166ff11, L:/127.0.0.1:44012 - R:/127.4.179.61:44733] using SASL/PLAIN
18:33:30.691 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x23164dbf, L:/127.0.0.1:59368 - R:/127.5.136.3:39901] using TOKEN/null
18:33:30.695 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:30.696 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:33:30.713 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eae68b231bec4d52a4b3372911249c5e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:30.713 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eae68b231bec4d52a4b3372911249c5e for partition [<start>, 0x80000064) with scanner id null
18:33:30.719 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:33:30.720 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.5.136.60:39171(127.5.136.60:39171)] Successfully connected to peer
18:33:30.722 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.60
18:33:30.725 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0ca41259ca7743c99aac8ead8fb35574, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:30.726 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0ca41259ca7743c99aac8ead8fb35574 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:30.728 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:30.733 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8ba55a97d55047f096401a4685d6b07e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:30.735 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:33:30.736 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:33:30.740 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.741 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:30.741 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:30.741 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:30.742 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.742 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.742 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.742 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.742 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.742 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.742 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.742 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.742 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.742 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:30.746 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:33:30.747 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.5.136.60:39171(127.5.136.60:39171)] Successfully connected to peer
18:33:30.753 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:33:30.754 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.5.136.62:42905(127.5.136.62:42905)] Successfully connected to peer
18:33:30.754 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.60
18:33:30.756 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc7d5703a, L:/127.0.0.1:40294 - R:/127.5.136.60:39171] using SASL/PLAIN
18:33:30.768 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.62
18:33:30.773 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.774 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:30.774 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:30.774 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:30.774 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:30.775 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:30.775 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:30.775 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:30.775 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:30.775 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:30.775 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:30.775 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:30.775 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:30.775 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:30.777 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x73d38af4, L:/127.0.0.1:40308 - R:/127.5.136.60:39171] using SASL/PLAIN
18:33:30.777 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:33:30.778 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.5.136.60:39171(127.5.136.60:39171)] Successfully connected to peer
18:33:30.779 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:33:30.779 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.5.136.62:42905(127.5.136.62:42905)] Successfully connected to peer
18:33:30.778 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.787 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x460a030c, L:/127.0.0.1:41640 - R:/127.5.136.62:42905] using SASL/PLAIN
18:33:30.788 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.5.136.61:43625(127.5.136.61:43625)] Successfully connected to peer
18:33:30.790 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.61
18:33:30.795 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:33:30.796 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=129), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [82ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: OK, deferred=null) after lookup
18:33:30.810 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.813 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 616ea92ec0b3496fb52deb2da91bd772
18:33:30.813 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eae68b231bec4d52a4b3372911249c5e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:30.813 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eae68b231bec4d52a4b3372911249c5e for partition [<start>, 0x80000064) with scanner id null
18:33:30.819 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x62aa0fa5, L:/127.0.0.1:38236 - R:/127.5.136.61:43625] using SASL/PLAIN
18:33:30.820 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0ca41259ca7743c99aac8ead8fb35574, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:30.820 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0ca41259ca7743c99aac8ead8fb35574 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:30.821 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:30.825 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:33:30.826 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.60
18:33:30.832 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:30.832 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:30.833 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:30.833 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.833 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.833 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:30.833 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.833 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.833 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.833 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.833 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:30.833 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:30.833 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 616ea92ec0b3496fb52deb2da91bd772
18:33:30.833 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:30.834 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@36f979fd
18:33:30.834 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8ba55a97d55047f096401a4685d6b07e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:30.834 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.5.136.62:42905(127.5.136.62:42905)] Successfully connected to peer
18:33:30.835 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.62
18:33:30.836 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
18:33:30.836 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
18:33:30.837 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.5.136.61:43625(127.5.136.61:43625)] Successfully connected to peer
18:33:30.841 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.61
18:33:30.851 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.62
18:33:30.848 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.857 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.5.136.61:43625(127.5.136.61:43625)] Successfully connected to peer
18:33:30.861 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.861 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc02343e3, L:/127.0.0.1:40320 - R:/127.5.136.60:39171] using SASL/PLAIN
18:33:30.866 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.869 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x27acaec3, L:/127.0.0.1:41654 - R:/127.5.136.62:42905] using SASL/PLAIN
18:33:30.871 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:33:30.877 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.61
18:33:30.881 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:33:30.882 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=186), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [133ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: OK, deferred=null) after lookup
18:33:30.883 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.5.136.60:39171(127.5.136.60:39171)] Successfully connected to peer
18:33:30.884 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.887 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x2ab90daf, L:/127.0.0.1:41660 - R:/127.5.136.62:42905] using SASL/PLAIN
18:33:30.889 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 616ea92ec0b3496fb52deb2da91bd772
18:33:30.890 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.60
18:33:30.894 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xa7570882, L:/127.0.0.1:38238 - R:/127.5.136.61:43625] using SASL/PLAIN
18:33:30.894 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eae68b231bec4d52a4b3372911249c5e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:30.894 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eae68b231bec4d52a4b3372911249c5e for partition [<start>, 0x80000064) with scanner id null
18:33:30.894 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:33:30.895 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:33:30.895 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=224), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [84ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: OK, [129ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [199ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: OK, deferred=null) after lookup
18:33:30.900 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0ca41259ca7743c99aac8ead8fb35574, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:30.901 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0ca41259ca7743c99aac8ead8fb35574 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:30.906 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 616ea92ec0b3496fb52deb2da91bd772
18:33:30.907 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@56e395e1
18:33:30.907 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8ba55a97d55047f096401a4685d6b07e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:30.908 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
18:33:30.908 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
18:33:30.910 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 616ea92ec0b3496fb52deb2da91bd772
18:33:30.911 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.5.136.62:42905(127.5.136.62:42905)] Successfully connected to peer
18:33:30.917 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.5.136.61:43625(127.5.136.61:43625)] Successfully connected to peer
18:33:30.922 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 616ea92ec0b3496fb52deb2da91bd772
18:33:30.922 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@399d570
18:33:30.923 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:30.924 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:30.924 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:30.924 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
18:33:30.924 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
18:33:30.924 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.925 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.925 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:30.925 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.925 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.925 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:30.925 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.925 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.925 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:30.925 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:30.926 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.62
18:33:30.927 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.5.136.61
18:33:30.928 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.934 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xe16aa9e2, L:/127.0.0.1:38242 - R:/127.5.136.61:43625] using SASL/PLAIN
18:33:30.936 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.939 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
18:33:30.939 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='7d25205c9925764e3a7ae2cd89531be41e303208d89ecbb569b24225cc3c8d73'}]
18:33:30.941 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:30.944 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:30.943 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x906e2369, L:/127.0.0.1:40336 - R:/127.5.136.60:39171] using SASL/PLAIN
18:33:30.946 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x154a75d6, L:/127.0.0.1:41674 - R:/127.5.136.62:42905] using SASL/PLAIN
18:33:30.948 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:33:30.949 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
18:33:30.949 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299998, tablet=bf4e623aabd94032905e80f9a4dbc79e@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)[L],6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253),928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)]}]
18:33:30.949 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='ec95335cd4baccd6a2da2bdfe54c2b2464a866fb76fa74a4b79d4293261fc8c0'}]
18:33:30.950 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:33:30.950 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=260), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [212ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: OK, [214ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: OK, deferred=null) after lookup
18:33:30.950 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:30.953 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 616ea92ec0b3496fb52deb2da91bd772
18:33:30.956 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 616ea92ec0b3496fb52deb2da91bd772
18:33:30.956 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5df35001
18:33:31.041 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:31.041 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:31.041 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:31.042 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eae68b231bec4d52a4b3372911249c5e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.042 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:31.042 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:31.042 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:31.042 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eae68b231bec4d52a4b3372911249c5e for partition [<start>, 0x80000064) with scanner id null
18:33:31.042 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:31.042 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:31.042 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:31.043 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
18:33:31.043 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:31.044 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:31.044 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:31.044 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:31.044 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:31.044 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:31.044 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:31.044 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:31.044 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:31.044 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:31.045 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:33:31.045 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:31.045 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:31.045 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:31.046 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:31.046 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:31.046 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:31.046 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299998, tablet=5ee352da413147d39a7f82bb88ff1dda@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745),6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)[L],928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)]}]
18:33:31.046 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] connecting to peer
18:33:31.044 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:31.046 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:31.046 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
18:33:31.047 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e149bcead3246da1a11d8655e4333dfbc98a450823071869e975c9d085a6a186'}]
18:33:31.049 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:31.069 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x6f7bedda, L:/127.0.0.1:38248 - R:/127.5.136.61:43625] using SASL/PLAIN
18:33:31.087 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
18:33:31.089 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0ca41259ca7743c99aac8ead8fb35574, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.089 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0ca41259ca7743c99aac8ead8fb35574 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:31.095 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:31.103 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8ba55a97d55047f096401a4685d6b07e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.107 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] connecting to peer
18:33:31.108 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] Successfully connected to peer
18:33:31.123 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:33:31.124 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299998, tablet=7f92012997064cd8962f208efb8dce40@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745),6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253),928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)[L]]}]
18:33:31.135 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.3
18:33:31.138 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] Successfully connected to peer
18:33:31.150 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:31.151 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
18:33:31.152 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
18:33:31.156 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xdbe47605, L:/127.0.0.1:57548 - R:/127.4.179.3:43889] using SASL/PLAIN
18:33:31.159 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eae68b231bec4d52a4b3372911249c5e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.160 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eae68b231bec4d52a4b3372911249c5e for partition [<start>, 0x80000064) with scanner id null
18:33:31.167 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] connecting to peer
18:33:31.169 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0ca41259ca7743c99aac8ead8fb35574, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.169 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0ca41259ca7743c99aac8ead8fb35574 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:31.170 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
18:33:31.171 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
18:33:31.171 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
18:33:31.172 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535611146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:31.175 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.3
18:33:31.183 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] Successfully connected to peer
18:33:31.278 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8ba55a97d55047f096401a4685d6b07e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.279 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:31.279 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:31.279 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:31.280 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.3
18:33:31.280 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:31.280 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:31.280 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:31.281 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:31.281 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:31.281 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:31.281 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:31.283 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:31.283 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:31.283 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:31.283 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:31.284 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false, responseScanTimestamp = 7305361860440064001) for scanner KuduScanner(table=replication_test_table, tablet=bf4e623aabd94032905e80f9a4dbc79e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.285 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [7d25205c9925764e3a7ae2cd89531be41e303208d89ecbb569b24225cc3c8d73]
18:33:31.286 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
18:33:31.287 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:31.290 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:31.296 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [7d25205c9925764e3a7ae2cd89531be41e303208d89ecbb569b24225cc3c8d73]
18:33:31.297 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 7d25205c9925764e3a7ae2cd89531be41e303208d89ecbb569b24225cc3c8d73 finished by subtask 0; deferring removal (restored in pending)
18:33:31.298 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xdf3a8245, L:/127.0.0.1:57554 - R:/127.4.179.3:43889] using SASL/PLAIN
18:33:31.300 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:33:31.300 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:33:31.300 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 2f0efe0c81addbcaea565a6248e4a915 (2850 bytes, checkpointDuration=154 ms, finalizationTime=0 ms).
18:33:31.301 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] disconnecting while in state READY
18:33:31.302 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
18:33:31.303 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 7d25205c9925764e3a7ae2cd89531be41e303208d89ecbb569b24225cc3c8d73 from pending
18:33:31.303 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 1 finished splits from enumerator state
18:33:31.303 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:31.315 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361860440064001) for scanner KuduScanner(table=replication_test_table, tablet=5ee352da413147d39a7f82bb88ff1dda, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.315 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [ec95335cd4baccd6a2da2bdfe54c2b2464a866fb76fa74a4b79d4293261fc8c0]
18:33:31.316 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [ec95335cd4baccd6a2da2bdfe54c2b2464a866fb76fa74a4b79d4293261fc8c0]
18:33:31.316 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:33:31.316 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:33:31.318 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split ec95335cd4baccd6a2da2bdfe54c2b2464a866fb76fa74a4b79d4293261fc8c0 finished by subtask 2; deferring removal (restored in pending)
18:33:31.318 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] disconnecting while in state READY
18:33:31.319 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:31.321 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8a0c5327, L:/127.0.0.1:57564 - R:/127.4.179.3:43889] using SASL/PLAIN
18:33:31.322 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eae68b231bec4d52a4b3372911249c5e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:31.322 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ca41259ca7743c99aac8ead8fb35574 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:31.322 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8ba55a97d55047f096401a4685d6b07e for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:31.322 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=eae68b231bec4d52a4b3372911249c5e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=0ca41259ca7743c99aac8ead8fb35574@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=8ba55a97d55047f096401a4685d6b07e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}]
18:33:31.323 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eae68b231bec4d52a4b3372911249c5e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:31.323 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:31.323 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ca41259ca7743c99aac8ead8fb35574 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:31.323 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8ba55a97d55047f096401a4685d6b07e for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:31.323 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=eae68b231bec4d52a4b3372911249c5e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=0ca41259ca7743c99aac8ead8fb35574@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=8ba55a97d55047f096401a4685d6b07e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}]
18:33:31.323 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eae68b231bec4d52a4b3372911249c5e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:31.323 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ca41259ca7743c99aac8ead8fb35574 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:31.323 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8ba55a97d55047f096401a4685d6b07e for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:31.323 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=eae68b231bec4d52a4b3372911249c5e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=0ca41259ca7743c99aac8ead8fb35574@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=8ba55a97d55047f096401a4685d6b07e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}]
18:33:31.324 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eae68b231bec4d52a4b3372911249c5e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:31.324 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ca41259ca7743c99aac8ead8fb35574 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:31.324 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8ba55a97d55047f096401a4685d6b07e for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:31.324 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=eae68b231bec4d52a4b3372911249c5e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=0ca41259ca7743c99aac8ead8fb35574@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=8ba55a97d55047f096401a4685d6b07e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}]
18:33:31.324 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eae68b231bec4d52a4b3372911249c5e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:31.324 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ca41259ca7743c99aac8ead8fb35574 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:31.325 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8ba55a97d55047f096401a4685d6b07e for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:31.325 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=eae68b231bec4d52a4b3372911249c5e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=0ca41259ca7743c99aac8ead8fb35574@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=8ba55a97d55047f096401a4685d6b07e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}]
18:33:31.339 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eae68b231bec4d52a4b3372911249c5e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.340 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eae68b231bec4d52a4b3372911249c5e for partition [<start>, 0x80000064) with scanner id null
18:33:31.355 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361860440064001) for scanner KuduScanner(table=replication_test_table, tablet=7f92012997064cd8962f208efb8dce40, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.358 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [e149bcead3246da1a11d8655e4333dfbc98a450823071869e975c9d085a6a186]
18:33:31.358 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e149bcead3246da1a11d8655e4333dfbc98a450823071869e975c9d085a6a186]
18:33:31.358 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:33:31.358 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:33:31.359 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e149bcead3246da1a11d8655e4333dfbc98a450823071869e975c9d085a6a186 finished by subtask 3; deferring removal (restored in pending)
18:33:31.359 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] disconnecting while in state READY
18:33:31.360 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:31.363 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0ca41259ca7743c99aac8ead8fb35574, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.363 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0ca41259ca7743c99aac8ead8fb35574 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:31.367 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eae68b231bec4d52a4b3372911249c5e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:31.367 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ca41259ca7743c99aac8ead8fb35574 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:31.367 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8ba55a97d55047f096401a4685d6b07e for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:31.367 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=eae68b231bec4d52a4b3372911249c5e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=0ca41259ca7743c99aac8ead8fb35574@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=8ba55a97d55047f096401a4685d6b07e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}]
18:33:31.368 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eae68b231bec4d52a4b3372911249c5e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:31.368 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ca41259ca7743c99aac8ead8fb35574 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:31.368 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8ba55a97d55047f096401a4685d6b07e for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:31.368 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=eae68b231bec4d52a4b3372911249c5e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=0ca41259ca7743c99aac8ead8fb35574@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=8ba55a97d55047f096401a4685d6b07e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}]
18:33:31.368 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8ba55a97d55047f096401a4685d6b07e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.368 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eae68b231bec4d52a4b3372911249c5e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:31.368 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ca41259ca7743c99aac8ead8fb35574 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:31.369 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8ba55a97d55047f096401a4685d6b07e for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:31.369 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=eae68b231bec4d52a4b3372911249c5e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=0ca41259ca7743c99aac8ead8fb35574@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=8ba55a97d55047f096401a4685d6b07e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}]
18:33:31.369 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eae68b231bec4d52a4b3372911249c5e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:31.369 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ca41259ca7743c99aac8ead8fb35574 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:31.369 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8ba55a97d55047f096401a4685d6b07e for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:31.369 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=eae68b231bec4d52a4b3372911249c5e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=0ca41259ca7743c99aac8ead8fb35574@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=8ba55a97d55047f096401a4685d6b07e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}]
18:33:31.385 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eae68b231bec4d52a4b3372911249c5e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:31.385 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ca41259ca7743c99aac8ead8fb35574 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:31.385 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8ba55a97d55047f096401a4685d6b07e for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:31.385 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=eae68b231bec4d52a4b3372911249c5e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=0ca41259ca7743c99aac8ead8fb35574@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=8ba55a97d55047f096401a4685d6b07e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}]
18:33:31.386 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eae68b231bec4d52a4b3372911249c5e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:31.386 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ca41259ca7743c99aac8ead8fb35574 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:31.386 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8ba55a97d55047f096401a4685d6b07e for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:31.386 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=eae68b231bec4d52a4b3372911249c5e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=0ca41259ca7743c99aac8ead8fb35574@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=8ba55a97d55047f096401a4685d6b07e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}]
18:33:31.386 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eae68b231bec4d52a4b3372911249c5e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:31.386 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ca41259ca7743c99aac8ead8fb35574 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:31.386 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8ba55a97d55047f096401a4685d6b07e for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:31.387 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=eae68b231bec4d52a4b3372911249c5e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=0ca41259ca7743c99aac8ead8fb35574@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=8ba55a97d55047f096401a4685d6b07e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}]
18:33:31.395 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eae68b231bec4d52a4b3372911249c5e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:31.395 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ca41259ca7743c99aac8ead8fb35574 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:31.395 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8ba55a97d55047f096401a4685d6b07e for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:31.395 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=eae68b231bec4d52a4b3372911249c5e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=0ca41259ca7743c99aac8ead8fb35574@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=8ba55a97d55047f096401a4685d6b07e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}]
18:33:31.397 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:31.397 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:31.397 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:31.398 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:31.398 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:31.398 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:31.399 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:31.399 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:31.399 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:31.400 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eae68b231bec4d52a4b3372911249c5e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:31.400 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ca41259ca7743c99aac8ead8fb35574 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:31.400 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8ba55a97d55047f096401a4685d6b07e for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:31.400 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=eae68b231bec4d52a4b3372911249c5e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=0ca41259ca7743c99aac8ead8fb35574@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=8ba55a97d55047f096401a4685d6b07e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}]
18:33:31.400 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet eae68b231bec4d52a4b3372911249c5e for table 'replication_test_table' with partition [<start>, 0x80000064)
18:33:31.400 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ca41259ca7743c99aac8ead8fb35574 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
18:33:31.400 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8ba55a97d55047f096401a4685d6b07e for table 'replication_test_table' with partition [0x800000C8, <end>)
18:33:31.401 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=eae68b231bec4d52a4b3372911249c5e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=0ca41259ca7743c99aac8ead8fb35574@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=8ba55a97d55047f096401a4685d6b07e@[422c1c063b1444b38bf3ee5a445401d1(127.5.136.1:34063),9ea5388f32294500b5ec5ef882b64ee6(127.5.136.2:43565),bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)[L]]}]
18:33:31.402 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:31.402 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:31.402 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:31.402 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:31.428 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:31.428 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:31.428 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:31.429 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:31.429 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:31.429 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:31.429 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:31.429 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:31.429 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:31.430 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:31.430 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:31.430 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:31.430 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:31.431 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eae68b231bec4d52a4b3372911249c5e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.431 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eae68b231bec4d52a4b3372911249c5e for partition [<start>, 0x80000064) with scanner id null
18:33:31.436 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0ca41259ca7743c99aac8ead8fb35574, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.436 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0ca41259ca7743c99aac8ead8fb35574 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:31.445 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8ba55a97d55047f096401a4685d6b07e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.487 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] handling channelInactive
18:33:31.487 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] cleaning up while in state READY due to: connection closed
18:33:31.487 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
18:33:31.488 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:33:31.492 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] handling channelInactive
18:33:31.492 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:33:31.492 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] cleaning up while in state READY due to: connection closed
18:33:31.492 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:33:31.502 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eae68b231bec4d52a4b3372911249c5e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.502 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eae68b231bec4d52a4b3372911249c5e for partition [<start>, 0x80000064) with scanner id null
18:33:31.502 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:31.502 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:31.502 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:31.504 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:31.504 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:31.504 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:31.504 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:31.505 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:31.505 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:31.505 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:31.505 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:31.505 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:31.505 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:31.510 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0ca41259ca7743c99aac8ead8fb35574, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.510 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0ca41259ca7743c99aac8ead8fb35574 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:31.513 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:31.513 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:31.513 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:31.514 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:31.514 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:31.514 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:31.514 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:31.515 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:31.515 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:31.515 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:31.515 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:31.515 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:31.515 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:31.515 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8ba55a97d55047f096401a4685d6b07e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.531 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:31.531 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:31.531 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:31.531 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:31.531 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:31.531 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:31.532 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:31.532 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:31.532 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:31.532 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:31.532 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:31.532 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:31.532 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:31.543 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] handling channelInactive
18:33:31.543 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] cleaning up while in state READY due to: connection closed
18:33:31.543 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:33:31.543 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:33:31.571 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:31.571 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:31.572 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:31.572 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:31.572 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:31.572 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:31.572 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:31.572 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:31.573 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:31.573 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:31.573 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:31.573 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:31.573 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:31.576 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eae68b231bec4d52a4b3372911249c5e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.576 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eae68b231bec4d52a4b3372911249c5e for partition [<start>, 0x80000064) with scanner id null
18:33:31.583 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0ca41259ca7743c99aac8ead8fb35574, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.583 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0ca41259ca7743c99aac8ead8fb35574 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:31.593 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8ba55a97d55047f096401a4685d6b07e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.594 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:31.646 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535611646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:31.651 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eae68b231bec4d52a4b3372911249c5e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.651 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eae68b231bec4d52a4b3372911249c5e for partition [<start>, 0x80000064) with scanner id null
18:33:31.652 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:31.652 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:31.652 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:31.652 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=15, operationSize=950, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@216a8f95, flushNotification=Deferred@796743131(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:33:31.653 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:31.653 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:31.653 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:31.653 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:31.653 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:31.653 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)] connecting to peer
18:33:31.653 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:31.653 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:31.653 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:31.653 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:31.653 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:31.656 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:31.656 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:31.656 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:31.656 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:31.656 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:31.656 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:31.656 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:31.656 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:31.656 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:31.656 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:31.657 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:31.657 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:31.657 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:31.657 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:31.657 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:31.656 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:31.657 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:31.657 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:31.657 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:31.657 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:31.657 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:31.657 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:31.657 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:31.657 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:31.657 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:31.657 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:31.659 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0ca41259ca7743c99aac8ead8fb35574, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.659 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0ca41259ca7743c99aac8ead8fb35574 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:31.665 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:31.665 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:31.666 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:31.666 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:31.666 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:31.666 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:31.666 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:31.666 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:31.666 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:31.667 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:31.667 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:31.667 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:31.667 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:31.668 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8ba55a97d55047f096401a4685d6b07e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.672 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:31.672 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:31.672 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:31.672 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:31.672 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:31.672 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:31.672 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:31.672 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:31.672 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:31.672 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:31.672 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:31.673 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:31.673 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:31.675 [DEBUG - kudu-nio-3] (Connection.java:757) [peer bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)] Successfully connected to peer
18:33:31.725 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eae68b231bec4d52a4b3372911249c5e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.725 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eae68b231bec4d52a4b3372911249c5e for partition [<start>, 0x80000064) with scanner id null
18:33:31.726 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:31.726 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:31.726 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:31.727 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:31.727 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:31.727 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:31.727 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:31.727 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:31.727 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:31.727 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:31.727 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:31.727 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:31.727 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:31.738 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:31.745 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0ca41259ca7743c99aac8ead8fb35574, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.745 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0ca41259ca7743c99aac8ead8fb35574 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:31.751 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8ba55a97d55047f096401a4685d6b07e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.752 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xfa85bae2, L:/127.0.0.1:38048 - R:/127.5.136.3:39901] using TOKEN/null
18:33:31.785 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:31.822 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:31.824 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eae68b231bec4d52a4b3372911249c5e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.824 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eae68b231bec4d52a4b3372911249c5e for partition [<start>, 0x80000064) with scanner id null
18:33:31.832 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0ca41259ca7743c99aac8ead8fb35574, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.832 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0ca41259ca7743c99aac8ead8fb35574 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:31.844 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8ba55a97d55047f096401a4685d6b07e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.902 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eae68b231bec4d52a4b3372911249c5e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.902 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eae68b231bec4d52a4b3372911249c5e for partition [<start>, 0x80000064) with scanner id null
18:33:31.908 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0ca41259ca7743c99aac8ead8fb35574, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.908 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0ca41259ca7743c99aac8ead8fb35574 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:31.915 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8ba55a97d55047f096401a4685d6b07e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.950 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 2f0efe0c81addbcaea565a6248e4a915 (2224 bytes, checkpointDuration=304 ms, finalizationTime=0 ms).
18:33:31.952 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
18:33:31.953 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split ec95335cd4baccd6a2da2bdfe54c2b2464a866fb76fa74a4b79d4293261fc8c0 from pending
18:33:31.953 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split e149bcead3246da1a11d8655e4333dfbc98a450823071869e975c9d085a6a186 from pending
18:33:31.953 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 2 complete: removed 2 finished splits from enumerator state
18:33:31.975 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eae68b231bec4d52a4b3372911249c5e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.975 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eae68b231bec4d52a4b3372911249c5e for partition [<start>, 0x80000064) with scanner id null
18:33:31.982 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:31.982 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:31.982 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0ca41259ca7743c99aac8ead8fb35574, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:31.982 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:31.982 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0ca41259ca7743c99aac8ead8fb35574 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:31.982 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:31.982 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:31.982 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:31.987 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:31.987 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:31.987 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:31.987 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:31.987 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:31.987 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:31.987 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:31.998 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8ba55a97d55047f096401a4685d6b07e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:32.002 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table fab365c4f81c4747993e0603891a5ae6
18:33:32.010 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 616ea92ec0b3496fb52deb2da91bd772
18:33:32.014 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table fab365c4f81c4747993e0603891a5ae6
18:33:32.017 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 616ea92ec0b3496fb52deb2da91bd772
18:33:32.021 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table fab365c4f81c4747993e0603891a5ae6
18:33:32.024 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 616ea92ec0b3496fb52deb2da91bd772
18:33:32.067 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf4e623aabd94032905e80f9a4dbc79e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:32.068 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet bf4e623aabd94032905e80f9a4dbc79e for partition [<start>, 0x80000064) with scanner id null
18:33:32.068 [DEBUG - main] (Connection.java:748) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] connecting to peer
18:33:32.094 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] Successfully connected to peer
18:33:32.094 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:32.124 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:32.130 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:32.130 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:32.130 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:32.131 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.131 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.131 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.131 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.131 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.131 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.132 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.132 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.132 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.132 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:32.132 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x437991a5, L:/127.0.0.1:47532 - R:/127.4.179.3:43889] using TOKEN/null
18:33:32.142 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7f92012997064cd8962f208efb8dce40, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:32.142 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 7f92012997064cd8962f208efb8dce40 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:32.143 [DEBUG - main] (Connection.java:748) [peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)] connecting to peer
18:33:32.146 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535612146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:32.159 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 2f0efe0c81addbcaea565a6248e4a915 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:33:32.159 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)] Successfully connected to peer
18:33:32.161 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
18:33:32.193 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:32.203 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x6403cdfa, L:/127.0.0.1:47750 - R:/127.4.179.2:33745] using TOKEN/null
18:33:32.212 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:32.212 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:32.212 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:32.213 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:32.213 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:32.213 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:32.213 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:32.213 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:32.213 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:32.213 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:32.213 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:32.213 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:32.214 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:32.226 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:32.230 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:32.230 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:32.230 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:32.231 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.231 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.231 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.231 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5ee352da413147d39a7f82bb88ff1dda, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:32.231 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.231 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.231 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.232 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.232 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.232 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.232 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:32.242 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eae68b231bec4d52a4b3372911249c5e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:32.242 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eae68b231bec4d52a4b3372911249c5e for partition [<start>, 0x80000064) with scanner id null
18:33:32.248 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0ca41259ca7743c99aac8ead8fb35574, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:32.249 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0ca41259ca7743c99aac8ead8fb35574 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:32.257 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8ba55a97d55047f096401a4685d6b07e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:32.271 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bf4e623aabd94032905e80f9a4dbc79e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:32.271 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet bf4e623aabd94032905e80f9a4dbc79e for partition [<start>, 0x80000064) with scanner id null
18:33:32.289 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7f92012997064cd8962f208efb8dce40, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:32.290 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 7f92012997064cd8962f208efb8dce40 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:32.297 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5ee352da413147d39a7f82bb88ff1dda, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:32.320 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=eae68b231bec4d52a4b3372911249c5e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:32.320 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet eae68b231bec4d52a4b3372911249c5e for partition [<start>, 0x80000064) with scanner id null
18:33:32.324 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:32.332 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0ca41259ca7743c99aac8ead8fb35574, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:32.332 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0ca41259ca7743c99aac8ead8fb35574 for partition [0x80000064, 0x800000C8) with scanner id null
18:33:32.343 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8ba55a97d55047f096401a4685d6b07e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:32.343 [DEBUG - main] (Connection.java:575) [peer master-127.5.136.61:43625(127.5.136.61:43625)] disconnecting while in state READY
18:33:32.343 [DEBUG - main] (Connection.java:575) [peer master-127.5.136.62:42905(127.5.136.62:42905)] disconnecting while in state READY
18:33:32.343 [DEBUG - main] (Connection.java:575) [peer bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)] disconnecting while in state READY
18:33:32.343 [DEBUG - main] (Connection.java:575) [peer master-127.5.136.60:39171(127.5.136.60:39171)] disconnecting while in state READY
18:33:32.344 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.5.136.61:43625(127.5.136.61:43625)] handling channelInactive
18:33:32.344 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state READY due to: connection closed
18:33:32.344 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.5.136.62:42905(127.5.136.62:42905)] handling channelInactive
18:33:32.344 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state READY due to: connection closed
18:33:32.344 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.5.136.60:39171(127.5.136.60:39171)] handling channelInactive
18:33:32.344 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state READY due to: connection closed
18:33:32.345 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:32.346 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
18:33:32.346 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
18:33:32.346 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:33:32.350 [DEBUG - kudu-nio-3] (Connection.java:239) [peer bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)] handling channelInactive
18:33:32.351 [DEBUG - kudu-nio-3] (Connection.java:709) [peer bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)] cleaning up while in state READY due to: connection closed
18:33:32.351 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-3
18:33:32.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:32.352411  5664 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 5977
18:33:32.391 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:32.391 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:32.391 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:32.392 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:32.392 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:32.392 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:32.392 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:32.392 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:32.392 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:32.393 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:32.393 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:32.393 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:32.393 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:32.427 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:32.427 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:32.427 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:32.428 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.428 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.428 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.429 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.429 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.429 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.429 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.429 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.429 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.429 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:32.443 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table fab365c4f81c4747993e0603891a5ae6
18:33:32.447 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='6daad842ef93b69eb249d8bd6cc9e09e7d7a9205f232d4882c37d9e80e579c3d'}]
18:33:32.449 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:32.449 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:33:32.450 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='45966bff8a2c0d47c7df9ed1cfb7775df70f822c3032bcc3c391b1372377bda6'}]
18:33:32.450 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=298239, tablet=7f92012997064cd8962f208efb8dce40@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745),6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253),928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)[L]]}]
18:33:32.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:32.450069  6418 connection.cc:573] client connection to 127.5.136.1:34063 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:33:32.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:32.450556  6418 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:33:32.451 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:32.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:32.451889  5664 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 6196
18:33:32.466 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] connecting to peer
18:33:32.468 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='b2112f312d3e780fcdda5dd1915a5bcce411fc1f9381d00d7c92f4ee3c23cc74'}]
18:33:32.469 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:32.470 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:33:32.471 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=298239, tablet=5ee352da413147d39a7f82bb88ff1dda@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745),6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)[L],928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)]}]
18:33:32.478 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] Successfully connected to peer
18:33:32.480 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.3
18:33:32.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:32.481483  6418 consensus_peers.cc:597] T 8ba55a97d55047f096401a4685d6b07e P bca326a30e144d5080c5b2dd919d9c4b -> Peer 422c1c063b1444b38bf3ee5a445401d1 (127.5.136.1:34063): Couldn't send request to peer 422c1c063b1444b38bf3ee5a445401d1. Status: Network error: Client connection negotiation failed: client connection to 127.5.136.1:34063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
18:33:32.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:32.482103  6418 consensus_peers.cc:597] T eae68b231bec4d52a4b3372911249c5e P bca326a30e144d5080c5b2dd919d9c4b -> Peer 422c1c063b1444b38bf3ee5a445401d1 (127.5.136.1:34063): Couldn't send request to peer 422c1c063b1444b38bf3ee5a445401d1. Status: Network error: Client connection negotiation failed: client connection to 127.5.136.1:34063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
18:33:32.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:32.482645  6418 consensus_peers.cc:597] T 0ca41259ca7743c99aac8ead8fb35574 P bca326a30e144d5080c5b2dd919d9c4b -> Peer 422c1c063b1444b38bf3ee5a445401d1 (127.5.136.1:34063): Couldn't send request to peer 422c1c063b1444b38bf3ee5a445401d1. Status: Network error: Client connection negotiation failed: client connection to 127.5.136.1:34063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
18:33:32.488 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] connecting to peer
18:33:32.488 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:33:32.489 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=298239, tablet=bf4e623aabd94032905e80f9a4dbc79e@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)[L],6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253),928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)]}]
18:33:32.500 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:32.503 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] Successfully connected to peer
18:33:32.508 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] connecting to peer
18:33:32.512 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] Successfully connected to peer
18:33:32.516 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.3
18:33:32.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:32.519243  5664 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 6396
18:33:32.526 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:32.526 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:32.526 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:32.526 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.526 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.526 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.526 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.526 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.526 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.526 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.527 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.527 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.527 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:32.539 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:32.547 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:32.547 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc01dce37, L:/127.0.0.1:47542 - R:/127.4.179.3:43889] using SASL/PLAIN
18:33:32.547 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:32.547 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:32.547 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.547 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.547 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.548 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.548 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.548 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.548 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.548 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.548 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.548 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:32.568 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361868513280001) for scanner KuduScanner(table=replication_test_table, tablet=7f92012997064cd8962f208efb8dce40, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:32.568 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [6daad842ef93b69eb249d8bd6cc9e09e7d7a9205f232d4882c37d9e80e579c3d]
18:33:32.568 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [6daad842ef93b69eb249d8bd6cc9e09e7d7a9205f232d4882c37d9e80e579c3d]
18:33:32.568 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:33:32.568 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:33:32.569 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 6daad842ef93b69eb249d8bd6cc9e09e7d7a9205f232d4882c37d9e80e579c3d finished by subtask 0; deferring removal (restored in pending)
18:33:32.570 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] disconnecting while in state READY
18:33:32.572 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.3
18:33:32.577 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x04d35a25, L:/127.0.0.1:47550 - R:/127.4.179.3:43889] using SASL/PLAIN
18:33:32.595 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:32.597 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:32.599 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:32.599 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:32.600 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:32.600 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:32.600 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:32.600 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:32.600 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:32.600 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:32.600 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:32.600 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:32.600 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:32.600 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:32.600 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:32.605 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:32.630 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x69a59597, L:/127.0.0.1:47552 - R:/127.4.179.3:43889] using SASL/PLAIN
18:33:32.634 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] handling channelInactive
18:33:32.634 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] cleaning up while in state READY due to: connection closed
18:33:32.635 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:33:32.635 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:33:32.646 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535612646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:32.659 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361868513280001) for scanner KuduScanner(table=replication_test_table, tablet=bf4e623aabd94032905e80f9a4dbc79e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:32.659 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [45966bff8a2c0d47c7df9ed1cfb7775df70f822c3032bcc3c391b1372377bda6]
18:33:32.660 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [45966bff8a2c0d47c7df9ed1cfb7775df70f822c3032bcc3c391b1372377bda6]
18:33:32.660 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:33:32.660 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:33:32.661 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 2f0efe0c81addbcaea565a6248e4a915 (2880 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
18:33:32.661 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] disconnecting while in state READY
18:33:32.663 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 45966bff8a2c0d47c7df9ed1cfb7775df70f822c3032bcc3c391b1372377bda6 finished by subtask 1; deferring removal (restored in pending)
18:33:32.663 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
18:33:32.664 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split 45966bff8a2c0d47c7df9ed1cfb7775df70f822c3032bcc3c391b1372377bda6 from pending
18:33:32.664 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split 6daad842ef93b69eb249d8bd6cc9e09e7d7a9205f232d4882c37d9e80e579c3d from pending
18:33:32.664 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 4 complete: removed 2 finished splits from enumerator state
18:33:32.673 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:32.719 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] handling channelInactive
18:33:32.719 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] cleaning up while in state READY due to: connection closed
18:33:32.719 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
18:33:32.719 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:33:32.726 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:32.729 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:32.729 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:32.729 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:32.729 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:32.729 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:32.729 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:32.730 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:32.730 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:32.730 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:32.731 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:32.731 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:32.731 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:32.731 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:32.738 [DEBUG - kudu-nio-3] (Connection.java:239) [peer bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)] handling channelInactive
18:33:32.738 [DEBUG - kudu-nio-3] (Connection.java:709) [peer bca326a30e144d5080c5b2dd919d9c4b(127.5.136.3:39901)] cleaning up while in state READY due to: connection closed
18:33:32.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:32.740254  5664 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 5676
18:33:32.800 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:32.800 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:32.800 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:32.800 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:32.800 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:32.800 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:32.800 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:32.800 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:32.801 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:32.801 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:32.801 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:32.801 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:32.801 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:32.818 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361868513280001) for scanner KuduScanner(table=replication_test_table, tablet=5ee352da413147d39a7f82bb88ff1dda, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:32.818 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [b2112f312d3e780fcdda5dd1915a5bcce411fc1f9381d00d7c92f4ee3c23cc74]
18:33:32.819 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [b2112f312d3e780fcdda5dd1915a5bcce411fc1f9381d00d7c92f4ee3c23cc74]
18:33:32.819 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:33:32.819 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:33:32.820 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split b2112f312d3e780fcdda5dd1915a5bcce411fc1f9381d00d7c92f4ee3c23cc74 finished by subtask 2; deferring removal (restored in pending)
18:33:32.820 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] disconnecting while in state READY
18:33:32.821 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:32.822 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:32.830 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.5.136.62:42905(127.5.136.62:42905)] handling channelInactive
18:33:32.830 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state READY due to: connection closed
18:33:32.831 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.5.136.62:42905(127.5.136.62:42905)] handling channelInactive
18:33:32.831 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state READY due to: connection closed
18:33:32.832 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.5.136.62:42905(127.5.136.62:42905)] handling channelInactive
18:33:32.832 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state READY due to: connection closed
18:33:32.832 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.5.136.62:42905(127.5.136.62:42905)] handling channelInactive
18:33:32.832 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state READY due to: connection closed
18:33:32.840 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] handling channelInactive
18:33:32.840 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] cleaning up while in state READY due to: connection closed
18:33:32.840 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:33:32.840 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:33:32.843 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:32.843 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:32.843 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:32.844 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:32.844 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:32.844 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:32.844 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:32.844 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:32.844 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:32.844 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:32.844 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:32.844 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:32.844 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:32.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:32.851218  5664 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 5750
18:33:32.894 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.5.136.61:43625(127.5.136.61:43625)] handling channelInactive
18:33:32.894 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state READY due to: connection closed
18:33:32.894 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.5.136.61:43625(127.5.136.61:43625)] handling channelInactive
18:33:32.896 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state READY due to: connection closed
18:33:32.896 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.5.136.61:43625(127.5.136.61:43625)] handling channelInactive
18:33:32.896 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state READY due to: connection closed
18:33:32.897 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.5.136.61:43625(127.5.136.61:43625)] handling channelInactive
18:33:32.897 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state READY due to: connection closed
18:33:32.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:32.908808  5664 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 5830
18:33:32.958 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.5.136.60:39171(127.5.136.60:39171)] handling channelInactive
18:33:32.958 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state READY due to: connection closed
18:33:32.958 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.5.136.60:39171(127.5.136.60:39171)] handling channelInactive
18:33:32.959 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.5.136.60:39171(127.5.136.60:39171)] handling channelInactive
18:33:32.959 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state READY due to: connection closed
18:33:32.959 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state READY due to: connection closed
18:33:32.958 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.5.136.60:39171(127.5.136.60:39171)] handling channelInactive
18:33:32.959 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state READY due to: connection closed
18:33:32.974 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:32.974 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:32.974 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:32.975 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.975 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.975 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:32.975 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.975 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.975 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.975 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.975 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:32.975 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:32.975 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:33.017 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:33.017 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:33.017 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:33.017 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:33.017 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:33.017 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:33.017 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:33.017 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:33.017 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:33.018 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:33.018 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:33.017 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:33.018 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:33.095 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:33.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535613146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:33.162 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:33.162 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:33.162 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:33.162 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.162 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.162 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.162 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.163 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.163 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.163 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.163 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.163 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.163 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:33.168 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 2f0efe0c81addbcaea565a6248e4a915 (1600 bytes, checkpointDuration=22 ms, finalizationTime=0 ms).
18:33:33.170 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
18:33:33.171 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split b2112f312d3e780fcdda5dd1915a5bcce411fc1f9381d00d7c92f4ee3c23cc74 from pending
18:33:33.171 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 1 finished splits from enumerator state
18:33:33.197 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:33.197 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:33.197 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:33.198 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.198 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.198 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.198 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.198 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.198 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.203 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.203 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.203 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.203 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:33.215 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:33.216 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:33.216 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:33.216 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:33.216 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:33.216 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:33.216 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:33.216 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:33.216 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:33.217 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:33.217 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:33.217 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:33.217 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:33.226 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:33.322 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:33.385 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:33.385 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:33.385 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:33.386 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.386 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.386 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.386 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.386 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.386 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.386 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.386 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.386 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.387 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:33.595 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:33.595 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:33.596 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:33.596 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:33.596 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:33.596 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:33.596 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:33.596 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:33.596 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:33.596 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:33.596 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:33.596 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:33.597 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:33.597 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:33.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535613646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:33.660 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 2f0efe0c81addbcaea565a6248e4a915 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
18:33:33.664 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
18:33:33.674 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:33.674 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:33.674 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:33.675 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:33.675 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:33.675 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:33.676 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:33.676 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:33.676 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:33.676 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:33.676 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:33.676 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:33.676 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:33.683 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:33.683 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:33.684 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:33.684 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.684 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.684 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.684 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.684 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.684 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.685 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.685 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.685 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.685 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:33.726 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:33.759 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:33.759 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:33.760 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:33.760 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.760 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.760 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.760 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.760 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.760 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.760 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.760 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.760 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.760 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:33.822 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:33.976 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:33.976 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:33.976 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:33.977 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.977 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.977 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:33.977 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.977 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.977 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:33.977 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.978 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.978 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:33.978 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:34.056 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:34.056 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:34.056 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:34.056 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:34.057 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:34.057 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:34.057 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:34.057 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:34.057 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:34.057 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:34.057 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:34.057 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:34.057 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:34.095 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:34.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535614146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:34.162 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 2f0efe0c81addbcaea565a6248e4a915 (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
18:33:34.164 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
18:33:34.226 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:34.322 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:34.436 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table fab365c4f81c4747993e0603891a5ae6
18:33:34.437 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:34.437 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:34.437 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:34.438 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:34.439 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:34.439 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:34.439 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:34.439 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:34.439 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:34.439 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:34.440 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:34.440 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:34.440 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:34.440 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='68677ad43cefc3abbe3456b84493878b8c75bbb4e3e4f478b051d7ce4f77143c'}]
18:33:34.442 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:34.442 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='78aa2214b8e09df766f04fd2441160cc875862151501cfae96650b68302545b3'}]
18:33:34.444 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:34.444 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='3f6a1bcfd9b6d3a0a8c4cc1123253a981afda71bda1ea2445053dc199027ea71'}]
18:33:34.445 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:34.445 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:33:34.445 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:33:34.445 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
18:33:34.446 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=296247, tablet=5ee352da413147d39a7f82bb88ff1dda@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745),6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)[L],928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)]}]
18:33:34.446 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=296247, tablet=7f92012997064cd8962f208efb8dce40@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745),6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253),928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)[L]]}]
18:33:34.446 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=296247, tablet=bf4e623aabd94032905e80f9a4dbc79e@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)[L],6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253),928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)]}]
18:33:34.458 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] connecting to peer
18:33:34.459 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] connecting to peer
18:33:34.467 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] connecting to peer
18:33:34.481 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] Successfully connected to peer
18:33:34.488 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] Successfully connected to peer
18:33:34.494 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] Successfully connected to peer
18:33:34.496 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:34.496 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:34.496 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:34.496 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:34.496 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:34.496 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:34.496 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:34.496 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:34.496 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:34.496 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:34.496 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:34.496 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:34.496 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:34.501 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.3
18:33:34.509 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:34.522 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.3
18:33:34.526 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:34.526 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:34.526 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:34.526 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:34.526 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:34.526 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:34.526 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:34.526 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:34.527 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:34.527 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:34.527 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:34.527 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:34.527 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:34.527 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf6d40c2e, L:/127.0.0.1:47566 - R:/127.4.179.3:43889] using SASL/PLAIN
18:33:34.530 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.3
18:33:34.535 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:34.539 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xbad5d065, L:/127.0.0.1:47580 - R:/127.4.179.3:43889] using SASL/PLAIN
18:33:34.545 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:34.545 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:34.545 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:34.545 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:34.545 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:34.545 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:34.545 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:34.545 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:34.545 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:34.546 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:34.546 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:34.546 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:34.546 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:34.549 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:34.559 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xae0d3995, L:/127.0.0.1:47570 - R:/127.4.179.3:43889] using SASL/PLAIN
18:33:34.571 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361876697088001) for scanner KuduScanner(table=replication_test_table, tablet=7f92012997064cd8962f208efb8dce40, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:34.571 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [78aa2214b8e09df766f04fd2441160cc875862151501cfae96650b68302545b3]
18:33:34.571 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [78aa2214b8e09df766f04fd2441160cc875862151501cfae96650b68302545b3]
18:33:34.572 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
18:33:34.572 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
18:33:34.573 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 78aa2214b8e09df766f04fd2441160cc875862151501cfae96650b68302545b3 finished by subtask 0; deferring removal (restored in pending)
18:33:34.573 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] disconnecting while in state READY
18:33:34.573 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:34.594 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:34.595 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] handling channelInactive
18:33:34.595 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] cleaning up while in state READY due to: connection closed
18:33:34.595 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
18:33:34.595 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
18:33:34.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535614646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:34.658 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 2f0efe0c81addbcaea565a6248e4a915 (2880 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:33:34.663 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
18:33:34.663 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 78aa2214b8e09df766f04fd2441160cc875862151501cfae96650b68302545b3 from pending
18:33:34.663 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 1 finished splits from enumerator state
18:33:34.727 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:34.747 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361876697088001) for scanner KuduScanner(table=replication_test_table, tablet=5ee352da413147d39a7f82bb88ff1dda, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:34.747 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [3f6a1bcfd9b6d3a0a8c4cc1123253a981afda71bda1ea2445053dc199027ea71]
18:33:34.747 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [3f6a1bcfd9b6d3a0a8c4cc1123253a981afda71bda1ea2445053dc199027ea71]
18:33:34.748 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:33:34.748 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:33:34.749 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 3f6a1bcfd9b6d3a0a8c4cc1123253a981afda71bda1ea2445053dc199027ea71 finished by subtask 1; deferring removal (restored in pending)
18:33:34.749 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] disconnecting while in state READY
18:33:34.749 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:34.788 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] handling channelInactive
18:33:34.788 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] cleaning up while in state READY due to: connection closed
18:33:34.789 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:33:34.789 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:33:34.804 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361876697088001) for scanner KuduScanner(table=replication_test_table, tablet=bf4e623aabd94032905e80f9a4dbc79e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:34.804 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [68677ad43cefc3abbe3456b84493878b8c75bbb4e3e4f478b051d7ce4f77143c]
18:33:34.804 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [68677ad43cefc3abbe3456b84493878b8c75bbb4e3e4f478b051d7ce4f77143c]
18:33:34.805 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:33:34.805 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:33:34.806 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 68677ad43cefc3abbe3456b84493878b8c75bbb4e3e4f478b051d7ce4f77143c finished by subtask 3; deferring removal (restored in pending)
18:33:34.806 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] disconnecting while in state READY
18:33:34.807 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:34.822 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:34.827 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] handling channelInactive
18:33:34.827 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] cleaning up while in state READY due to: connection closed
18:33:34.828 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:33:34.828 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:33:35.062 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:35.062 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:35.062 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:35.063 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:35.063 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:35.063 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:35.063 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:35.063 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:35.063 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:35.063 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:35.063 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:35.063 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:35.064 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:35.071 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:35.071 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:35.071 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:35.071 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:35.071 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:35.071 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:35.071 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:35.071 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:35.071 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:35.072 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:35.072 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:35.071 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:35.072 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:35.072 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:35.072 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:35.072 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:35.072 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:35.072 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:35.072 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:35.072 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:35.072 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:35.072 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:35.072 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:35.072 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:35.072 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:35.072 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:35.094 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:35.116 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:35.117 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:35.117 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:35.117 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:35.117 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:35.117 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:35.118 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:35.118 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:35.118 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:35.118 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:35.118 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:35.118 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:35.118 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:35.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535615146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:35.157 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:33:35.162 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
18:33:35.163 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 3f6a1bcfd9b6d3a0a8c4cc1123253a981afda71bda1ea2445053dc199027ea71 from pending
18:33:35.163 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 68677ad43cefc3abbe3456b84493878b8c75bbb4e3e4f478b051d7ce4f77143c from pending
18:33:35.163 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 9 complete: removed 2 finished splits from enumerator state
18:33:35.166 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:35.167 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:35.167 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:35.168 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:35.168 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:35.169 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:35.169 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:35.169 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:35.169 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:35.169 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:35.169 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:35.169 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:35.170 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:35.227 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:35.248 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:35.248 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:35.249 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:35.249 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:35.249 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:35.249 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:35.249 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:35.249 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:35.249 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:35.249 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:35.249 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:35.249 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:35.249 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:35.321 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:35.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:33:35Z chronyd exiting
18:33:35.372 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:35.372 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:35.372 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:35.372 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:35.372 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:35.373 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:35.373 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:35.373 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:35.373 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:35.373 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:35.373 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:35.373 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:35.373 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:35.429 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:35.429 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:35.430 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:35.430 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:35.430 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:35.430 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:35.431 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:35.431 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:35.431 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:35.431 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:35.431 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:35.431 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:35.431 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:35.594 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:35.646 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535615646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:35.659 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 2f0efe0c81addbcaea565a6248e4a915 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:33:35.660 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
18:33:35.727 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:35.772 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:35.772 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:35.772 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:35.772 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:35.772 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:35.772 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:35.773 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:35.773 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:35.773 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:35.773 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:35.773 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:35.773 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:35.773 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:35.821 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:35.900 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:35.900 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:35.900 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:35.901 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:35.901 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:35.901 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:35.901 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:35.901 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:35.901 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:35.901 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:35.901 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:35.902 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:35.902 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:36.094 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:36.146 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535616146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:36.164 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 2f0efe0c81addbcaea565a6248e4a915 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
18:33:36.167 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
18:33:36.227 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:36.321 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:36.324 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:36.324 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:36.324 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:36.324 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:36.324 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:36.325 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:36.325 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:36.325 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:36.325 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:36.325 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:36.325 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:36.325 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:36.325 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:36.397 [DEBUG - main] (Connection.java:575) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] disconnecting while in state READY
18:33:36.397 [DEBUG - main] (Connection.java:575) [peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)] disconnecting while in state READY
18:33:36.397 [DEBUG - main] (Connection.java:575) [peer master-127.4.179.60:34679(127.4.179.60:34679)] disconnecting while in state READY
18:33:36.397 [DEBUG - main] (Connection.java:575) [peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)] disconnecting while in state READY
18:33:36.397 [DEBUG - main] (Connection.java:575) [peer master-127.4.179.62:35121(127.4.179.62:35121)] disconnecting while in state READY
18:33:36.398 [DEBUG - main] (Connection.java:575) [peer master-127.4.179.61:44733(127.4.179.61:44733)] disconnecting while in state READY
18:33:36.398 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] handling channelInactive
18:33:36.398 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] cleaning up while in state READY due to: connection closed
18:33:36.399 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.179.60:34679(127.4.179.60:34679)] handling channelInactive
18:33:36.399 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state READY due to: connection closed
18:33:36.399 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)] handling channelInactive
18:33:36.399 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)] cleaning up while in state READY due to: connection closed
18:33:36.399 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.179.62:35121(127.4.179.62:35121)] handling channelInactive
18:33:36.400 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state READY due to: connection closed
18:33:36.400 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.179.61:44733(127.4.179.61:44733)] handling channelInactive
18:33:36.400 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state READY due to: connection closed
18:33:36.402 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:36.404 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:36.404 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-5
18:33:36.404 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:36.404 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:36.404 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
18:33:36.404 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:36.404 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:36.405 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:36.405 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:36.405 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:36.405 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:36.405 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 28 thread-local buffer(s) from thread: kudu-nio-0
18:33:36.404 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
18:33:36.404 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:36.405 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:36.405 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:36.405 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:36.406 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-4
18:33:36.406 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)] handling channelInactive
18:33:36.406 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)] cleaning up while in state READY due to: connection closed
18:33:36.406 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-3
18:33:36.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:36.407338  4812 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 5180
18:33:36.432 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table fab365c4f81c4747993e0603891a5ae6
18:33:36.439 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='94ddfbfeeefcb8a653ddc2691aa845e0f96ee5b4a3693c641b01fb640af82fd0'}]
18:33:36.441 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:36.442 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
18:33:36.442 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='71efc64f8ee31bd6f1b0d89671c3a878e9c00d7aecafb624918aa5a372097d13'}]
18:33:36.442 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=294251, tablet=bf4e623aabd94032905e80f9a4dbc79e@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)[L],6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253),928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)]}]
18:33:36.443 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:36.443 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='f7644367e0d219d16d40733e261a9ee43f698254f6275ef06d55c2c9ffc19988'}]
18:33:36.445 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:36.445 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
18:33:36.445 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
18:33:36.445 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=294251, tablet=5ee352da413147d39a7f82bb88ff1dda@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745),6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)[L],928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)]}]
18:33:36.446 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=294251, tablet=7f92012997064cd8962f208efb8dce40@[5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745),6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253),928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)[L]]}]
18:33:36.449 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] connecting to peer
18:33:36.467 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] connecting to peer
18:33:36.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:36.467201  5402 connection.cc:573] client connection to 127.4.179.1:45253 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:33:36.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:36.467779  5402 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:33:36.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:36.477733  4812 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 5378
18:33:36.491 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] connecting to peer
18:33:36.495 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:36.496 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:36.496 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:36.496 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:36.496 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:36.496 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:36.496 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:36.497 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:36.497 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:36.497 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] Successfully connected to peer
18:33:36.498 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:36.498 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:36.498 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:36.498 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:36.501 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.3
18:33:36.502 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] Successfully connected to peer
18:33:36.509 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:36.512 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x35bee82a, L:/127.0.0.1:47596 - R:/127.4.179.3:43889] using SASL/PLAIN
18:33:36.514 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] Successfully connected to peer
18:33:36.514 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.3
18:33:36.517 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:36.517 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:36.517 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:36.517 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:36.517 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:36.518 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:36.518 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:36.518 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:36.518 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:36.518 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:36.518 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:36.518 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:36.518 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:36.522 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:36.530 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xef851832, L:/127.0.0.1:47602 - R:/127.4.179.3:43889] using SASL/PLAIN
18:33:36.531 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305361884889088001) for scanner KuduScanner(table=replication_test_table, tablet=7f92012997064cd8962f208efb8dce40, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:33:36.531 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [71efc64f8ee31bd6f1b0d89671c3a878e9c00d7aecafb624918aa5a372097d13]
18:33:36.531 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [71efc64f8ee31bd6f1b0d89671c3a878e9c00d7aecafb624918aa5a372097d13]
18:33:36.532 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
18:33:36.532 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
18:33:36.532 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] disconnecting while in state READY
18:33:36.533 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 71efc64f8ee31bd6f1b0d89671c3a878e9c00d7aecafb624918aa5a372097d13 finished by subtask 0; deferring removal (restored in pending)
18:33:36.533 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:36.534 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.3
18:33:36.541 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:36.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:36.543358  4812 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 5519
18:33:36.545 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] handling channelInactive
18:33:36.545 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] cleaning up while in state READY due to: connection closed
18:33:36.546 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:33:36.546 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
18:33:36.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:36.592245  4812 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 4824
18:33:36.593 [ERROR - kudu-nio-0] (Connection.java:452) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] unexpected exception from downstream on [id: 0xef851832, L:/127.0.0.1:47602 - R:/127.4.179.3:43889]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:36.593 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] cleaning up while in state READY due to: [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] unexpected exception from downstream on [id: 0xef851832, L:/127.0.0.1:47602 - R:/127.4.179.3:43889]
18:33:36.593 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889) for tablet 5ee352da413147d39a7f82bb88ff1dda: [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] unexpected exception from downstream on [id: 0xef851832, L:/127.0.0.1:47602 - R:/127.4.179.3:43889]
18:33:36.594 [ERROR - kudu-nio-0] (Connection.java:452) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] unexpected exception from downstream on [id: 0x85e7707f, L:/127.0.0.1:47606 - R:/127.4.179.3:43889]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:36.594 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] cleaning up while in state NEGOTIATING due to: [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] unexpected exception from downstream on [id: 0x85e7707f, L:/127.0.0.1:47606 - R:/127.4.179.3:43889]
18:33:36.594 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889) for tablet bf4e623aabd94032905e80f9a4dbc79e: [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] unexpected exception from downstream on [id: 0x85e7707f, L:/127.0.0.1:47606 - R:/127.4.179.3:43889]
18:33:36.594 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:36.596 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] handling channelInactive
18:33:36.596 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] handling channelInactive
18:33:36.608 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)] connecting to peer
18:33:36.609 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745): Connection refused: /127.4.179.2:33745
18:33:36.609 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)] cleaning up while in state CONNECTING due to: Failed to connect to peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745): Connection refused: /127.4.179.2:33745
18:33:36.609 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745) for tablet 5ee352da413147d39a7f82bb88ff1dda: Failed to connect to peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745): Connection refused: /127.4.179.2:33745
18:33:36.610 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)] connecting to peer
18:33:36.611 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745): Connection refused: /127.4.179.2:33745
18:33:36.611 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)] cleaning up while in state CONNECTING due to: Failed to connect to peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745): Connection refused: /127.4.179.2:33745
18:33:36.611 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745) for tablet bf4e623aabd94032905e80f9a4dbc79e: Failed to connect to peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745): Connection refused: /127.4.179.2:33745
18:33:36.627 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)] connecting to peer
18:33:36.628 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253): Connection refused: /127.4.179.1:45253
18:33:36.628 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)] cleaning up while in state CONNECTING due to: Failed to connect to peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253): Connection refused: /127.4.179.1:45253
18:33:36.628 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253) for tablet 5ee352da413147d39a7f82bb88ff1dda: Failed to connect to peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253): Connection refused: /127.4.179.1:45253
18:33:36.631 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)] connecting to peer
18:33:36.631 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253): Connection refused: /127.4.179.1:45253
18:33:36.631 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)] cleaning up while in state CONNECTING due to: Failed to connect to peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253): Connection refused: /127.4.179.1:45253
18:33:36.632 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253) for tablet bf4e623aabd94032905e80f9a4dbc79e: Failed to connect to peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253): Connection refused: /127.4.179.1:45253
18:33:36.637 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.179.62:35121(127.4.179.62:35121)] handling channelInactive
18:33:36.637 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state READY due to: connection closed
18:33:36.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:36.644230  4812 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 4894
18:33:36.646 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535616646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:36.650 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:36.651 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:36.651 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:36.652 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.652 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.652 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.659 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:36.659 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.4.179.60:34679(127.4.179.60:34679)] Successfully connected to peer
18:33:36.660 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 2f0efe0c81addbcaea565a6248e4a915 (2880 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
18:33:36.660 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:36.661 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
18:33:36.661 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 71efc64f8ee31bd6f1b0d89671c3a878e9c00d7aecafb624918aa5a372097d13 from pending
18:33:36.661 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 12 complete: removed 1 finished splits from enumerator state
18:33:36.662 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.662 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.662 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.663 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:36.663 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.4.179.60:34679(127.4.179.60:34679)] Successfully connected to peer
18:33:36.668 [DEBUG - kudu-nio-4] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.60
18:33:36.668 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.4.179.61:44733(127.4.179.61:44733)] Successfully connected to peer
18:33:36.670 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.4.179.61:44733(127.4.179.61:44733)] Successfully connected to peer
18:33:36.676 [DEBUG - kudu-nio-4] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.179.60
18:33:36.676 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:36.679 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679] using SASL/PLAIN
18:33:36.688 [ERROR - kudu-nio-5] (Connection.java:452) [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:36.688 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state NEGOTIATING due to: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733]
18:33:36.688 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733]
18:33:36.688 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:36.688 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.4.179.61:44733(127.4.179.61:44733)] handling channelInactive
18:33:36.689 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:33:36.689 [ERROR - kudu-nio-5] (Connection.java:452) [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:36.689 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state NEGOTIATING due to: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733]
18:33:36.689 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733]
18:33:36.689 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.179.61:44733(127.4.179.61:44733)] handling channelInactive
18:33:36.689 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state READY due to: connection closed
18:33:36.689 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.4.179.61:44733(127.4.179.61:44733)] handling channelInactive
18:33:36.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:36.691224  4812 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 4979
18:33:36.707 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:36.709 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:36.709 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.709 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.710 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.710 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.710 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.710 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.726 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:36.729 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:36.729 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:36.729 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:36.729 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:36.729 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:36.729 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:36.729 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:36.729 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:36.729 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:36.729 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:36.730 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:36.730 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:36.730 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:36.731 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.179.60:34679(127.4.179.60:34679)] handling channelInactive
18:33:36.731 [ERROR - kudu-nio-4] (Connection.java:452) [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:36.731 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state READY due to: connection closed
18:33:36.731 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state NEGOTIATING due to: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679]
18:33:36.731 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679]
18:33:36.731 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:36.732 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.4.179.60:34679(127.4.179.60:34679)] handling channelInactive
18:33:36.734 [ERROR - kudu-nio-4] (Connection.java:452) [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:36.734 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state READY due to: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679]
18:33:36.734 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679]
18:33:36.734 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:36.735 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.4.179.60:34679(127.4.179.60:34679)] handling channelInactive
18:33:36.748 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:36.748 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:36.748 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.748 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:36.748 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.748 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.748 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.748 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.749 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.749 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.749 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.749 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.749 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:36.750 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:36.750 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:36.751 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:36.751 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.751 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.751 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.751 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.751 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.751 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.752 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.752 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.752 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.752 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:36.767 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:36.768 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:36.768 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:36.768 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.768 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.768 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.768 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.768 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.768 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.768 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.768 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.768 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.768 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:36.770 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:36.770 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:36.770 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:36.770 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.770 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.771 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.771 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.771 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.771 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.771 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.771 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.771 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.771 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:36.787 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:36.787 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:36.788 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:36.788 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.788 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.788 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.788 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.788 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.788 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.788 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.788 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.788 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.788 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:36.790 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:36.790 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:36.790 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:36.790 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.790 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.790 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.790 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.790 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.790 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.790 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.790 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.790 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.790 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:36.810 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:36.810 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:36.811 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:36.811 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.811 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.811 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.811 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.811 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.811 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.811 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.811 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.812 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.812 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:36.821 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:36.827 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:36.827 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:36.827 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:36.827 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.828 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.828 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.828 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.828 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.828 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.828 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.828 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.828 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.828 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:36.848 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:36.848 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:36.848 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:36.848 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.848 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.848 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.848 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.848 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.848 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.849 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.848 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.849 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.849 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:36.850 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:36.850 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:36.850 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:36.850 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.850 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.850 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.851 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.851 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.851 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.851 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.851 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.851 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.851 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:36.890 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:36.890 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:36.890 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:36.890 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.890 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.891 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.891 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.890 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.891 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.891 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.891 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.891 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.891 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:36.916 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:36.916 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:36.917 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:36.917 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:36.917 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:36.917 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:36.917 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:36.917 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:36.917 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:36.917 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:36.917 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:36.917 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:36.918 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:36.938 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:36.938 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:36.938 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:36.939 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:36.939 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:36.939 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:36.939 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:36.939 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:36.939 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:36.939 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:36.939 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:36.939 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:36.939 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:36.947 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:36.947 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:36.947 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:36.947 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.947 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.947 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.947 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.947 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.948 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.948 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.948 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.948 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.948 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:36.990 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:36.990 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:36.990 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:36.991 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.991 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.991 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.991 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.991 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.991 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.991 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:36.991 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:36.991 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:36.991 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:37.086 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:37.087 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:37.087 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:37.087 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:37.087 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:37.087 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:37.088 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:37.088 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:37.088 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:37.088 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:37.088 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:37.088 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:37.089 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:37.095 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:37.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535617146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:37.147 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:37.147 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:37.148 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:37.148 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.148 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.148 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.148 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.148 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.148 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.148 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.149 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.149 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.149 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:37.158 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:33:37.158 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
18:33:37.161 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:37.162 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:37.162 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:37.162 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.162 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.162 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.162 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.163 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.163 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.163 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.163 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.163 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.163 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:37.192 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:37.192 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:37.192 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:37.193 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:37.193 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:37.193 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:37.193 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:37.193 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:37.193 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:37.193 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:37.193 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:37.193 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:37.193 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:37.207 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:37.207 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:37.207 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:37.208 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.208 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.208 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.208 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.208 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.208 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.208 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.208 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.209 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.209 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:37.226 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:37.230 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:37.230 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:37.230 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:37.230 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.230 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.231 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.231 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.230 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.231 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.231 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.231 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.231 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.231 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:37.322 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:37.327 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:37.328 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:37.328 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:37.328 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.328 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.328 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.328 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.328 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.328 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.329 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.328 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.329 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.329 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:37.336 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:37.336 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:37.336 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:37.336 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:37.336 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:37.336 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:37.336 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:37.337 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:37.337 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:37.337 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:37.337 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:37.337 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:37.337 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:37.469 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:37.469 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:37.469 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:37.470 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:37.470 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:37.470 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:37.470 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:37.470 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:37.470 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:37.470 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:37.470 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:37.470 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:37.470 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:37.476 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:37.476 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:37.476 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:37.477 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:37.477 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:37.477 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:37.477 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:37.477 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:37.477 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:37.477 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:37.477 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:37.477 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:37.477 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:37.514 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:37.514 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:37.514 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:37.515 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:37.515 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:37.515 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:37.515 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:37.515 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:37.515 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:37.515 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:37.515 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:37.515 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:37.515 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:37.572 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:37.572 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:37.572 [DEBUG - pool-286-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:37.572 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:37.572 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:37.572 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:37.572 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:37.572 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:37.572 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:37.573 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:37.573 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:37.573 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:37.573 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:37.595 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:37.630 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:37.630 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:37.630 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:37.631 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.631 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.631 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.631 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.631 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.631 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.631 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.631 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.631 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.631 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:37.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535617646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:37.651 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:37.651 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:37.652 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:37.652 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:37.652 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:37.652 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:37.653 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:37.653 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:37.653 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:37.652 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:37.653 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:37.653 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:37.653 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:37.657 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:33:37.658 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
18:33:37.664 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:37.664 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:37.664 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:37.664 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.664 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.664 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.664 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.664 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.664 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.665 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.665 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.665 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.665 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:37.670 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:37.670 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:37.670 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:37.671 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.671 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.671 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.671 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:37.671 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.671 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:37.671 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.671 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.671 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:37.671 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:37.727 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:37.740 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:37.740 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:37.740 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:37.740 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.740 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.741 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.741 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.741 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.741 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.741 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.741 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.741 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.741 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:37.822 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:37.856 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:37.856 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:37.857 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:37.857 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:37.857 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:37.857 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:37.857 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:37.857 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:37.857 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:37.857 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:37.858 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:37.858 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:37.858 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:37.872 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:37.872 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:37.872 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:37.873 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.873 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.873 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.873 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.873 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.873 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.873 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.873 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.873 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.873 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:37.935 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:37.936 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:37.936 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:37.936 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.936 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.936 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.936 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.936 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.936 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.936 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.936 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.936 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.936 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:37.942 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:37.942 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:37.942 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:37.942 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.942 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.942 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.942 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.942 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.942 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.943 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.943 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.943 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.943 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:37.984 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:37.984 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:37.984 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:37.985 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.985 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.985 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.985 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.985 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:37.985 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.985 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.985 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:37.985 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:37.985 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:38.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:33:37Z chronyd exiting
18:33:38.045 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RESTARTING to RUNNING.
18:33:38.046 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job fa73e37017778341a79e5b3ef3d55eb9 from Checkpoint 69 @ 1783535448409 for fa73e37017778341a79e5b3ef3d55eb9 located at file:/tmp/junit12731664100414606042/checkpoints/fa73e37017778341a79e5b3ef3d55eb9/chk-69.
18:33:38.046 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
18:33:38.047 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:33:38.047 [INFO - Thread-53] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:33:38.047 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from CREATED to SCHEDULED.
18:33:38.047 [DEBUG - Thread-53] (Connection.java:575) [peer master-127.28.68.190:40429(127.28.68.190:40429)] disconnecting while in state TERMINATED
18:33:38.047 [DEBUG - Thread-53] (Connection.java:575) [peer master-127.28.68.188:38393(127.28.68.188:38393)] disconnecting while in state TERMINATED
18:33:38.048 [DEBUG - Thread-53] (Connection.java:575) [peer master-127.28.68.189:33753(127.28.68.189:33753)] disconnecting while in state TERMINATED
18:33:38.048 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:38.048 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:33:38.048 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from SCHEDULED to DEPLOYING.
18:33:38.048 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #7) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 1623ba59e704d1676486c6f13d60068c
18:33:38.049 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CREATED to SCHEDULED.
18:33:38.049 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 1623ba59e704d1676486c6f13d60068c.
18:33:38.050 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from SCHEDULED to DEPLOYING.
18:33:38.050 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #7) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 409256c48f07c3602c01f545df4e7b3c
18:33:38.050 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:33:38.050 [INFO - Thread-53] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:33:38.050 [INFO - Thread-53] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:33:38.051 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_7), deploy into slot with allocation id 1623ba59e704d1676486c6f13d60068c.
18:33:38.051 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 409256c48f07c3602c01f545df4e7b3c.
18:33:38.051 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from CREATED to DEPLOYING.
18:33:38.051 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_7) [DEPLOYING].
18:33:38.052 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_7), deploy into slot with allocation id 409256c48f07c3602c01f545df4e7b3c.
18:33:38.052 [DEBUG - Thread-53] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:38.052 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@497841a4
18:33:38.052 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:38.052 [INFO - Thread-53] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:33:38.052 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CREATED to DEPLOYING.
18:33:38.053 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_7) [DEPLOYING].
18:33:38.053 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:33:38.053 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from DEPLOYING to INITIALIZING.
18:33:38.053 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1c9d20bd
18:33:38.053 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:38.053 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:33:38.053 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from DEPLOYING to INITIALIZING.
18:33:38.054 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to SCHEDULED.
18:33:38.055 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:38.055 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from SCHEDULED to DEPLOYING.
18:33:38.055 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #6) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 120c9de24dd4d7d83c84cb1a65b36252
18:33:38.055 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CREATED to SCHEDULED.
18:33:38.055 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 120c9de24dd4d7d83c84cb1a65b36252.
18:33:38.056 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:33:38.056 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from SCHEDULED to DEPLOYING.
18:33:38.056 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #7) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d
18:33:38.056 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_6), deploy into slot with allocation id 120c9de24dd4d7d83c84cb1a65b36252.
18:33:38.056 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from DEPLOYING to INITIALIZING.
18:33:38.056 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@299dc03
18:33:38.056 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from DEPLOYING to INITIALIZING.
18:33:38.057 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot fe2a3c24d55fce5c8d5a55c4e880b53d.
18:33:38.057 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:38.058 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:38.058 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:38.058 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:38.058 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_7), deploy into slot with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d.
18:33:38.058 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to DEPLOYING.
18:33:38.058 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) [DEPLOYING].
18:33:38.058 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:38.059 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@738f8c86
18:33:38.059 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:38.059 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:33:38.059 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
18:33:38.059 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
18:33:38.061 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@578a4164
18:33:38.062 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:38.068 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CREATED to DEPLOYING.
18:33:38.068 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_7) [DEPLOYING].
18:33:38.068 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2d6359f1
18:33:38.068 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@13acb8eb
18:33:38.068 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:38.068 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:33:38.069 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from DEPLOYING to INITIALIZING.
18:33:38.069 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from DEPLOYING to INITIALIZING.
18:33:38.069 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:38.070 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.070 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.071 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.071 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.071 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.071 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@268cc2df
18:33:38.072 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.072 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.073 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.073 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:38.073 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.074 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.074 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:38.074 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.079 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.079 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.080 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.080 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.083 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.084 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.084 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.084 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.084 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.087 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:38.087 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.087 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.087 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.088 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.089 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.089 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.089 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.089 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.089 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.089 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.089 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.090 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.090 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.090 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.090 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.090 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.091 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:38.091 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.091 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.091 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.093 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.093 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.094 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.094 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.094 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.094 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.094 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.094 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.094 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.094 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.094 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.094 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.094 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.094 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.094 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.094 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.095 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.095 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.095 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:38.095 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.095 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.095 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:38.095 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.096 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.096 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.096 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.096 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.096 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.096 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.096 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.096 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.096 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.096 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.096 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.096 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.096 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.096 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.104 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.104 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.104 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.105 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.105 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.105 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.105 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.105 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.105 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.105 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.105 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.105 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.105 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.110 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.111 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.111 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.111 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.111 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.111 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.111 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.111 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.111 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.111 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.112 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.112 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.112 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.114 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.114 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.114 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:38.115 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.115 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.115 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.115 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.115 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.115 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:38.115 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.115 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.115 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.115 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.116 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.116 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.116 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.116 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.116 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.116 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.116 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.116 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.116 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.116 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.116 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.116 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.117 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:38.117 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.117 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.117 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.117 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.117 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.117 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.117 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.117 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.117 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.117 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.117 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.117 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.118 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:38.124 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.125 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.125 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.125 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.125 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.125 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.125 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.125 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.125 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.125 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.125 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.126 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.126 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.131 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.131 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.131 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.131 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.131 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.131 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.131 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.131 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.131 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.131 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.131 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.131 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.131 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.134 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.134 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:38.134 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.135 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.135 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:38.135 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.135 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.135 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.135 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.135 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.135 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.135 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.135 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.135 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.135 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.135 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.135 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:38.135 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.136 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.136 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.136 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.136 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.136 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.136 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.136 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.136 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.136 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.136 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.136 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:38.136 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.136 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.136 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.136 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.136 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.136 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.137 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.137 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.137 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.137 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.144 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.145 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.145 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.145 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.145 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.145 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.145 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.145 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.145 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.145 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.145 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.145 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.145 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.145 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:38.145 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:38.145 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:38.146 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:38.146 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:38.146 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:38.146 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:38.146 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:38.146 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:38.146 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:38.146 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:38.146 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:38.146 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:38.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535618146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:38.150 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.150 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.150 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.150 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.150 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.151 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.151 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.151 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.151 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.151 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.151 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.151 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.151 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.154 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.154 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.154 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.154 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.154 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.154 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.155 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.155 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.155 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.155 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.155 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:38.155 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.155 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.155 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.155 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.155 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.155 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.155 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.155 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.155 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.155 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.155 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:38.155 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.155 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.155 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.156 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.157 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.157 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.155 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.157 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.157 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.155 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:38.155 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.157 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.157 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.157 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.157 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.157 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.158 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:38.158 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:33:38.159 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
18:33:38.164 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:38.164 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:38.164 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:38.164 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.164 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:38.164 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:38.164 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.164 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:38.164 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:38.164 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:38.164 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:38.164 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.164 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.164 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.164 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.164 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.164 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:38.164 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.165 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.165 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.165 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:38.165 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.165 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.165 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:38.165 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.165 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:38.174 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.174 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.174 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.174 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.174 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.174 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.174 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.174 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.174 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.174 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.174 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.174 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.174 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.174 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.174 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.174 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:38.174 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.175 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:38.175 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.175 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.175 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.175 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.175 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.175 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:38.175 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.175 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.175 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.175 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.175 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.175 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.175 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.175 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.175 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.175 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.175 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.175 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.175 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.175 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.175 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:38.191 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.191 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.191 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.191 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.191 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.191 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.191 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.191 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.191 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.191 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.191 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.191 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.191 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.194 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.194 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.194 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.194 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.194 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.194 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.194 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.195 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.195 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.195 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.195 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.195 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.195 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.205 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.205 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.205 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.205 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.205 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.205 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.205 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.205 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.205 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.205 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.205 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.205 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.205 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.214 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:38.214 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:38.214 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:38.215 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.215 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.215 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.215 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.215 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.215 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.215 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.215 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.215 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.215 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.215 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.215 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.215 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:38.215 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.215 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.215 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.215 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.215 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.215 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.216 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.216 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.216 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.216 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.224 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.224 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.225 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.225 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.225 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.225 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.225 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.225 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.225 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.225 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.225 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.225 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.225 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.227 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:38.229 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:38.229 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:38.229 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:38.229 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:38.229 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:38.229 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:38.229 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:38.229 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:38.229 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:38.229 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:38.229 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:38.229 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:38.229 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:38.234 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.234 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.234 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.235 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.235 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.235 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.235 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.235 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.235 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.235 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:38.235 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.235 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.235 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:38.235 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.235 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.235 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:38.235 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.235 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.235 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.235 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.235 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.235 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.235 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.235 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.235 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.235 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:38.244 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.244 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.244 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.244 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.244 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.244 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.244 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.244 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.244 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.244 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.244 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.244 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.245 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.254 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:38.254 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:38.254 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:38.255 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.255 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.255 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.255 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.255 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.255 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.255 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.255 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.255 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.255 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:38.271 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.271 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.271 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.271 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.271 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.271 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.271 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.271 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.271 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.271 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.271 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.271 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.271 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.274 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.274 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.274 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.274 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.274 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.274 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.274 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.274 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.274 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.274 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.274 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.274 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.274 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.322 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:38.354 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.355 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.355 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.355 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.355 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.355 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.355 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.355 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.355 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.355 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.355 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.355 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.355 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.368 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:38.368 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:38.368 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:38.368 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:38.368 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:38.368 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:38.368 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:38.368 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:38.368 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:38.368 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:38.368 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:38.368 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:38.369 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:38.374 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.374 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.374 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.374 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.374 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.374 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.374 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.374 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.374 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.374 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.374 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.374 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.375 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.379 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:38.379 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:38.380 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:38.380 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:38.380 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:38.380 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:38.380 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:38.380 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:38.380 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:38.380 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:38.380 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:38.380 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:38.380 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:38.384 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.384 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.384 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.384 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.384 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.384 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.385 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.385 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.385 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.385 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.385 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.385 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.385 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.390 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.390 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.390 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.390 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.390 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.390 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.390 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.390 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.390 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.390 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.390 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.390 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.390 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.455 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:38.455 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:38.455 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:38.455 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.455 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.455 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.456 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.456 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.456 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.455 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.456 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.456 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.456 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:38.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:38.564 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.564 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.565 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.565 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.565 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.565 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.565 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.565 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.565 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.565 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.565 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.565 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.565 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.570 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.570 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.570 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.570 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.570 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.570 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.571 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.571 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.571 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.571 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.571 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.571 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.571 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.575 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.575 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.575 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.575 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.575 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.575 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.575 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.575 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.575 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.575 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.575 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.576 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.576 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.594 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:38.594 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.594 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.595 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.595 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.595 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.595 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.595 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.595 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.595 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.595 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.595 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.595 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.595 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.620 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:38.620 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:38.620 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:38.620 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:38.620 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:38.620 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:38.621 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:38.621 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:38.621 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:38.621 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:38.621 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:38.621 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:38.621 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:38.631 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.631 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.631 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.631 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.631 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.631 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.631 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.631 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.631 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.631 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.631 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.631 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.632 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.636 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:38.636 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:38.637 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:38.637 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:38.637 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:38.637 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:38.637 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:38.637 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:38.637 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:38.637 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:38.637 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:38.637 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:38.637 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:38.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535618646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:38.655 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
18:33:38.655 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
18:33:38.664 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:38.665 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:38.665 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:38.665 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:38.665 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:38.665 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:38.665 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:38.665 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:38.665 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:38.665 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:38.665 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:38.665 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:38.665 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:38.711 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.711 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.711 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.711 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.711 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.711 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.711 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.711 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.711 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.712 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.711 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.712 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.712 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.727 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:38.794 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.794 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.794 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.795 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.795 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.795 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.795 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.795 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.795 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.795 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.795 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.795 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.795 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.815 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:38.815 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:38.815 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:38.815 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.815 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.815 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.815 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.815 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.815 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.815 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:38.815 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:38.815 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:38.816 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:38.822 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:38.906 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:38.906 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:38.907 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:38.907 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:38.907 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:38.907 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:38.907 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:38.907 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:38.907 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:38.907 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:38.907 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:38.907 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:38.907 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:38.975 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:38.975 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:38.975 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:38.975 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.976 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.976 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:38.976 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.976 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.976 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.976 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.976 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:38.976 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:38.976 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:38.976 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:38.976 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:38.976 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:38.976 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:38.976 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:38.976 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:38.976 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:38.976 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:38.976 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:38.976 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:38.977 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:38.977 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:38.977 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:39.016 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:39.017 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:39.017 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:39.017 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.017 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.017 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.017 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.017 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.017 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.017 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.017 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.017 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.017 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:39.029 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:39.030 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:39.030 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:39.030 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:39.030 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:39.030 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:39.030 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:39.030 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:39.030 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:39.031 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:39.030 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:39.031 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:39.031 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:39.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
.18:33:39.051 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783535619051
18:33:39.051 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783535619051
18:33:39.057 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
18:33:39.062 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
18:33:39.062 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
18:33:39.062 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskSwO0Je/test-tmp
18:33:39.063 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
18:33:39.063 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskSwO0Je/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
18:33:39.067 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

18:33:39.094 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:39.094 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:39.094 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:39.095 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:39.095 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:39.095 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:39.095 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:39.095 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:39.095 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:39.095 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:39.095 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:39.095 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:39.095 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:39.095 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:39.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535619146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:39.151 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:39.151 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:39.151 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:39.152 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:39.152 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:39.152 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:39.152 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:39.152 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:39.152 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:39.152 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:39.153 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:39.153 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:39.153 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:39.157 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:33:39.158 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
18:33:39.227 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:39.244 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:39.244 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:39.244 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:39.244 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.244 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.244 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.244 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.244 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.244 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.245 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.245 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.245 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.245 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:39.257 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:39.258 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:39.258 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:39.258 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.258 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.258 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.258 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.258 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.258 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.258 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.258 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.258 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.258 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:39.321 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:39.375 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:39.375 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:39.375 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:39.375 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:39.375 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:39.375 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:39.375 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:39.375 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:39.375 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:39.375 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:39.375 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:39.375 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:39.376 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:39.457 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:33:39.457 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

18:33:39.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:39.460708  7124 mini_oidc.cc:150] Starting JWKS server
18:33:39.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:39.464125  7124 webserver.cc:534] Webserver started at http://127.0.0.1:36899/ using document root <none> and password file <none>
18:33:39.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:39.464510  7124 mini_oidc.cc:186] Starting OIDC Discovery server
18:33:39.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:39.466361  7124 webserver.cc:534] Webserver started at http://127.0.0.1:42975/ using document root <none> and password file <none>
18:33:39.472 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:39.472 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:39.472 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:39.472 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.472 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.472 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.472 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.472 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.472 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.472 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.472 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.472 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.472 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:39.514 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:39.514 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:39.514 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:39.515 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:39.515 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:39.515 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:39.515 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:39.515 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:39.515 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:39.515 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:39.515 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:39.515 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:39.515 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:39.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:33:39Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
18:33:39.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:33:39Z Disabled control of system clock
18:33:39.524 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:39.524 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:39.524 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:39.524 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:39.524 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:39.524 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:39.524 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:39.524 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:39.524 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:39.524 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:39.524 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:39.524 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:39.525 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:39.536084  7124 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/wal
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/data
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/logs
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/data/info.pb
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:33:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:33:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:33:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:33:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.245.62:36853
18:33:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.245.62
18:33:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.245.20:33853
18:33:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:33:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.6.245.62:36853,127.6.245.61:44495,127.6.245.60:46787
18:33:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:33:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36899/jwks.json with env {}
18:33:39.537 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:39.538 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:39.538 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:39.538 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.538 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.538 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.538 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.538 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.538 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.538 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.538 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.538 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.538 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:39.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:39.575 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:39.575 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:39.575 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:39.575 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:39.575 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:39.575 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:39.576 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:39.576 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:39.575 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:39.576 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:39.576 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:39.576 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:39.576 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:39.584 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:39.584 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:39.584 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:39.585 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:39.585 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:39.585 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:39.585 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:39.585 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:39.585 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:39.585 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:39.585 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:39.585 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:39.585 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:39.594 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:39.621 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:39.622 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:39.622 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:39.622 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.622 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.622 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.622 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.622 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.622 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.622 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.622 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.622 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.622 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:39.639 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:39.640 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:39.640 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:39.640 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.640 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.640 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.640 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:39.640 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.640 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.640 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.640 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:39.640 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:39.640 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:39.646 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535619646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:39.655 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:33:39.656 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
18:33:39.727 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:39.821 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:39.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:39.872129  7136 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:33:39.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:39.872697  7136 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:33:39.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:39.873229  7136 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:33:39.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:39.908912  7136 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:33:39.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:39.909189  7136 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:33:39.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:39.909389  7136 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:33:39.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:39.909593  7136 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:33:39.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:39.909854  7136 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:33:39.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:39.910025  7136 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36899/jwks.json
18:33:39.936 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:39.936 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:39.936 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:39.937 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:39.937 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:39.937 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:39.937 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:39.937 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:39.937 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:39.937 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:39.937 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:39.937 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:39.937 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:39.951349  7136 master_runner.cc:387] Master server non-default flags:
18:33:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.245.20:33853
18:33:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/data
18:33:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/wal
18:33:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:33:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.6.245.62:36853,127.6.245.61:44495,127.6.245.60:46787
18:33:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.245.62:36853
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36899/jwks.json
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/data/info.pb
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.245.62
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/logs
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:33:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:33:39.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:39.953119  7136 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:33:39.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:39.954799  7136 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:33:39.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:39.966635  7142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:39.970 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:39.970 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:39.970 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:39.970 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:39.970 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:39.970 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:39.971 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:39.971 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:39.971 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:39.971 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:39.971 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:39.971 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:39.971 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:40.006 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:40.006 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:40.006 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:40.006 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:40.007 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:40.007 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:40.007 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:40.007 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:40.007 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:40.006 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:40.007 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:40.007 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:40.007 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:40.045 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:40.095 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:40.116 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:40.117 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:40.117 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:40.118 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:40.118 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:40.118 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:40.118 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:40.118 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:40.118 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:40.119 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:40.119 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:40.119 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:40.119 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:40.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535620146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:40.158 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:33:40.159 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
18:33:40.160 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:40.160 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:40.160 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:40.160 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:40.160 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:40.160 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:40.160 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:40.160 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:40.160 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:40.160 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:40.161 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:40.161 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:40.161 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:40.180 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:40.180 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:40.180 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:40.180 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:40.181 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:40.181 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:40.181 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:40.181 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:40.181 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:40.181 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:40.181 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:40.181 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:40.182 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:40.195 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:40.195 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:40.195 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:40.196 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:40.196 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:40.196 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:40.196 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:40.196 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:40.196 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:40.197 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:40.197 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:40.197 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:40.197 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:40.226 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:40.321 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:40.395 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:40.395 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:40.395 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:40.396 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:40.396 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:40.396 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:40.396 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:40.396 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:40.396 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:40.397 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:40.397 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:40.397 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:40.397 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:40.431 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:40.431 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:40.431 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:40.432 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:40.432 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:40.432 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:40.432 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:40.432 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:40.432 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:40.432 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:40.433 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:40.433 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:40.433 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:40.454 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:40.454 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:40.455 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:40.455 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:40.455 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:40.455 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:40.455 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:40.455 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:40.455 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:40.455 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:40.456 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:40.455 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:40.456 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:40.525 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:40.525 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:40.525 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:40.525 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:40.526 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:40.526 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:40.526 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:40.526 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:40.526 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:40.526 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:40.526 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:40.526 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:40.526 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:40.545 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:40.545 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:40.545 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:40.545 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:40.546 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:40.546 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:40.546 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:40.546 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:40.546 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:40.546 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:40.547 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:40.547 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:40.547 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:40.547 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:40.589 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:40.589 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:40.590 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:40.590 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:40.590 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:40.590 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:40.590 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:40.590 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:40.591 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:40.591 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:40.591 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:40.591 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:40.591 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:40.595 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:40.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535620646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:40.651 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:40.651 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:40.651 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:40.652 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:40.652 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:40.652 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:40.652 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:40.652 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:40.652 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:40.653 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:40.653 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:40.653 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:40.653 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:40.657 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:33:40.658 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
18:33:40.726 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:40.726 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:40.726 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:40.727 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:40.727 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:40.727 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:40.727 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:40.727 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:40.727 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:40.727 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:40.727 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:40.727 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:40.727 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:40.728 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:40.822 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:41.045 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:41.051 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:41.051 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:41.052 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:41.052 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:41.052 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:41.052 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:41.052 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:41.052 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:41.052 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:41.052 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:41.052 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:41.052 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:41.052 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:41.082 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:41.082 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:41.082 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:41.083 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:41.083 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:41.083 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:41.083 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:41.083 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:41.083 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:41.083 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:41.083 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:41.083 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:41.083 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:41.095 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:41.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535621146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:41.154 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:33:41.155 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
18:33:41.215 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:41.215 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:41.215 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:41.216 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:41.216 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:41.216 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:41.216 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:41.216 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:41.216 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:41.216 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:41.216 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:41.216 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:41.216 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:41.227 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:41.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:39.967875  7143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:41.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.306406  7145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:41.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.308570  7144 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1336 milliseconds
18:33:41.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.308736  7136 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:33:41.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.310034  7136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:33:41.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.312662  7136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:33:41.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.314064  7136 hybrid_clock.cc:648] HybridClock initialized: now 1783535621314026 us; error 56 us; skew 500 ppm
18:33:41.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.315003  7136 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:33:41.321 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:41.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.322175  7136 webserver.cc:534] Webserver started at http://127.6.245.62:42501/ using document root <none> and password file <none>
18:33:41.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.323150  7136 fs_manager.cc:362] Metadata directory not provided
18:33:41.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.323344  7136 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:33:41.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.323766  7136 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:33:41.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.328362  7136 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/data/instance:
18:33:41.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "49a9fbba28f94c37a34f0113f2cfdc5c"
18:33:41.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:41 on dist-test-slave-dxnw"
18:33:41.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.329752  7136 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/wal/instance:
18:33:41.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "49a9fbba28f94c37a34f0113f2cfdc5c"
18:33:41.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:41 on dist-test-slave-dxnw"
18:33:41.336 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:41.336 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:41.336 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:41.336 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:41.337 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:41.337 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:41.337 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:41.337 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:41.337 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:41.337 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:41.337 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:41.337 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:41.337 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:41.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.338169  7136 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.010s	sys 0.000s
18:33:41.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.345214  7152 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:33:41.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.346621  7136 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.006s	sys 0.000s
18:33:41.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.347011  7136 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/wal
18:33:41.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "49a9fbba28f94c37a34f0113f2cfdc5c"
18:33:41.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:41 on dist-test-slave-dxnw"
18:33:41.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.347515  7136 fs_report.cc:389] FS layout report
18:33:41.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:33:41.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/wal
18:33:41.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/wal
18:33:41.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/data/data
18:33:41.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:33:41.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:33:41.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:33:41.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:33:41.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:33:41.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:33:41.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:33:41.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:33:41.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:33:41.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:33:41.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:33:41.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.409161  7136 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:33:41.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.411098  7136 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:33:41.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.411795  7136 kserver.cc:163] Server-wide thread pool size limit: 3276
18:33:41.436 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:41.436 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:41.437 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:41.437 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:41.437 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:41.437 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:41.437 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:41.437 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:41.437 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:41.437 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:41.437 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:41.437 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:41.437 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:41.495 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:41.496 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:41.496 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:41.496 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:41.496 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:41.496 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:41.496 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:41.496 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:41.497 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:41.497 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:41.497 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:41.497 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:41.497 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:41.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.514336  7136 rpc_server.cc:307] RPC server started. Bound to: 127.6.245.62:36853
18:33:41.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.514487  7203 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.245.62:36853 every 8 connection(s)
18:33:41.516 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:41.517 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:41.517 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:41.517 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:41.517 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:41.517 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:41.517 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:41.517 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:41.517 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:41.517 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:41.517 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:41.517 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:41.517 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:41.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.518033  7136 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/data/info.pb
18:33:41.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.523952  7124 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 7136
18:33:41.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.524456  7124 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-0/wal/instance
18:33:41.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.526024  7204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.529740  7124 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/wal
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/data
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/logs
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/data/info.pb
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.245.61:44495
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.245.61
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.245.20:33853
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.6.245.62:36853,127.6.245.61:44495,127.6.245.60:46787
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:33:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36899/jwks.json with env {}
18:33:41.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.539855  7204 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } has no permanent_uuid. Determining permanent_uuid...
18:33:41.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:41.564 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:41.564 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:41.564 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:41.564 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:41.564 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:41.564 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:41.564 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:41.564 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:41.564 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:41.565 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:41.565 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:41.565 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:41.565 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:41.565 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:41.565 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:41.566 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:41.566 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:41.566 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:41.566 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:41.566 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:41.566 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:41.566 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:41.566 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:41.566 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:41.566 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:41.566 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:41.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.577585  7204 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } has no permanent_uuid. Determining permanent_uuid...
18:33:41.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.580813  7153 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.245.61:44495: connect: Connection refused (error 111)
18:33:41.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.585386  7204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.61:44495: Network error: Client connection negotiation failed: client connection to 127.6.245.61:44495: connect: Connection refused (error 111)
18:33:41.595 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:41.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.635001  7204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } attempt: 1
18:33:41.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.639744  7204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.61:44495: Network error: Client connection negotiation failed: client connection to 127.6.245.61:44495: connect: Connection refused (error 111)
18:33:41.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535621646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:41.655 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
18:33:41.655 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
18:33:41.685 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:41.685 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:41.685 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:41.685 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:41.685 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:41.685 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:41.685 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:41.685 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:41.685 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:41.686 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:41.686 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:41.686 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:41.686 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:41.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.708252  7204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } attempt: 2
18:33:41.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.713182  7204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.61:44495: Network error: Client connection negotiation failed: client connection to 127.6.245.61:44495: connect: Connection refused (error 111)
18:33:41.726 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:41.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.804704  7204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } attempt: 3
18:33:41.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.809677  7204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.61:44495: Network error: Client connection negotiation failed: client connection to 127.6.245.61:44495: connect: Connection refused (error 111)
18:33:41.822 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:41.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.885629  7206 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:33:41.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.886212  7206 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:33:41.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.886777  7206 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:33:41.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.922484  7206 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:33:41.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.922819  7206 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:33:41.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.923099  7206 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:33:41.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.923311  7206 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:33:41.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.923609  7206 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:33:41.923 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:41.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.923870  7206 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36899/jwks.json
18:33:41.924 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:41.924 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:41.924 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:41.924 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:41.924 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:41.924 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:41.924 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:41.924 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:41.924 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:41.924 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:41.924 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:41.924 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:41.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.953091  7204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } attempt: 4
18:33:41.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.957960  7204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.61:44495: Network error: Client connection negotiation failed: client connection to 127.6.245.61:44495: connect: Connection refused (error 111)
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.965672  7206 master_runner.cc:387] Master server non-default flags:
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.245.20:33853
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/data
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/wal
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.6.245.62:36853,127.6.245.61:44495,127.6.245.60:46787
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.245.61:44495
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36899/jwks.json
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/data/info.pb
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.245.61
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/logs
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:33:41.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:33:41.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.967291  7206 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:33:41.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:41.969202  7206 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:33:41.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.980844  7215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:42.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:42.047 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:42.048 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:42.048 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:42.048 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:42.048 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:42.048 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:42.049 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:42.049 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:42.049 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:42.049 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:42.048 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:42.049 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:42.049 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:42.095 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:42.096 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:42.096 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:42.096 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:42.097 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:42.097 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:42.097 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:42.098 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:42.098 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:42.098 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:42.098 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:42.098 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:42.098 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:42.099 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:42.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535622146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:42.163 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
18:33:42.167 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
18:33:42.171 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:42.171 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:42.171 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:42.172 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:42.172 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:42.172 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:42.172 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:42.172 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:42.172 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:42.172 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:42.172 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:42.172 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:42.172 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:42.227 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:42.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:42.257436  7204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } attempt: 5
18:33:42.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:42.267509  7204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.61:44495: Network error: Client connection negotiation failed: client connection to 127.6.245.61:44495: connect: Connection refused (error 111)
18:33:42.323 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:42.334 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:42.335 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:42.335 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:42.335 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:42.335 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:42.335 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:42.335 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:42.335 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:42.335 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:42.336 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:42.336 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:42.336 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:42.336 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:42.349 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:42.350 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:42.350 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:42.350 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:42.350 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:42.350 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:42.351 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:42.351 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:42.351 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:42.351 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:42.351 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:42.351 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:42.351 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:42.485 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:42.485 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:42.485 [DEBUG - pool-306-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:42.486 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:42.486 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:42.486 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:42.487 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:42.487 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:42.487 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:42.487 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:42.487 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:42.488 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:42.488 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:42.489 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26702), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [92ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [106ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [108ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [108ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [129ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [143ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [143ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [169ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [172ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [172ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [173ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [174ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [174ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [182ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [209ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [209ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [243ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [263ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [263ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [264ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [264ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [363ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [363ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [397ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [397ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [398ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [398ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [398ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [398ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [464ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1003ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2661ms] refreshing cache from master, [2661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2663ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2663ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2663ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3321ms] refreshing cache from master, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3322ms] too many traces: truncated at 100 traces, deferred=Deferred@155008143(state=PENDING, result=null, callback=(continuation of Deferred@2094903734 after retry RPC after error@1667436602) -> (continuation of Deferred@836771348 after retry RPC after error@1364821475) -> (continuation of Deferred@1075371647 after retry RPC after error@998372486) -> (continuation of Deferred@178281820 after retry RPC after error@390838134) -> (continuation of Deferred@287729862 after retry RPC after error@624397216) -> (continuation of Deferred@762673383 after retry RPC after error@1733265976) -> (continuation of Deferred@1158524495 after retry RPC after error@1560172485) -> (continuation of Deferred@1523232509 after retry RPC after error@1095754198) -> (continuation of Deferred@1771585638 after retry RPC after error@1198940911) -> (continuation of Deferred@1212453306 after retry RPC after error@1983617077) -> (continuation of Deferred@1569418724 after retry RPC after error@689835424) -> (continuation of Deferred@1161527416 after retry RPC after error@1877693146) -> (continuation of Deferred@1770645134 after retry RPC after error@807638290) -> (continuation of Deferred@688061230 after retry RPC after error@483004758) -> (continuation of Deferred@978401751 after retry RPC after error@376877194) -> (continuation of Deferred@672396001 after retry RPC after error@1679758868) -> (continuation of Deferred@1462961345 after retry RPC after error@1960971341) -> (continuation of Deferred@1137798346 after retry RPC after error@1608678674) -> (continuation of Deferred@280526627 after retry RPC after error@1960610077) -> (continuation of Deferred@1017318512 after retry RPC after error@1885731867) -> (continuation of Deferred@595055699 after retry RPC after error@863184193) -> (continuation of Deferred@387416019 after retry RPC after error@1221450766) -> (continuation of Deferred@1434799112 after retry RPC after error@2146837204) -> (continuation of Deferred@1404252958 after retry RPC after error@1975040202) -> (continuation of Deferred@178413433 after retry RPC after error@1141648507), errback=(continuation of Deferred@2094903734 after retry RPC after error@1667436602) -> (continuation of Deferred@836771348 after retry RPC after error@1364821475) -> (continuation of Deferred@1075371647 after retry RPC after error@998372486) -> (continuation of Deferred@178281820 after retry RPC after error@390838134) -> (continuation of Deferred@287729862 after retry RPC after error@624397216) -> (continuation of Deferred@762673383 after retry RPC after error@1733265976) -> (continuation of Deferred@1158524495 after retry RPC after error@1560172485) -> (continuation of Deferred@1523232509 after retry RPC after error@1095754198) -> (continuation of Deferred@1771585638 after retry RPC after error@1198940911) -> (continuation of Deferred@1212453306 after retry RPC after error@1983617077) -> (continuation of Deferred@1569418724 after retry RPC after error@689835424) -> (continuation of Deferred@1161527416 after retry RPC after error@1877693146) -> (continuation of Deferred@1770645134 after retry RPC after error@807638290) -> (continuation of Deferred@688061230 after retry RPC after error@483004758) -> (continuation of Deferred@978401751 after retry RPC after error@376877194) -> (continuation of Deferred@672396001 after retry RPC after error@1679758868) -> (continuation of Deferred@1462961345 after retry RPC after error@1960971341) -> (continuation of Deferred@1137798346 after retry RPC after error@1608678674) -> (continuation of Deferred@280526627 after retry RPC after error@1960610077) -> (continuation of Deferred@1017318512 after retry RPC after error@1885731867) -> (continuation of Deferred@595055699 after retry RPC after error@863184193) -> (continuation of Deferred@387416019 after retry RPC after error@1221450766) -> (continuation of Deferred@1434799112 after retry RPC after error@2146837204) -> (continuation of Deferred@1404252958 after retry RPC after error@1975040202) -> (continuation of Deferred@178413433 after retry RPC after error@1141648507)))
18:33:42.498 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
18:33:42.498 [WARN - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26702), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [92ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [106ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [108ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [108ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [129ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [143ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [143ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [169ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [172ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [172ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [173ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [174ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [174ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [182ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [209ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [209ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [243ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [263ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [263ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [264ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [264ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [363ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [363ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [397ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [397ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [398ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [398ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [398ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [398ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [464ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1003ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2661ms] refreshing cache from master, [2661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2663ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2663ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2663ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3321ms] refreshing cache from master, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3322ms] too many traces: truncated at 100 traces, deferred=Deferred@155008143(state=PENDING, result=null, callback=(continuation of Deferred@2094903734 after retry RPC after error@1667436602) -> (continuation of Deferred@836771348 after retry RPC after error@1364821475) -> (continuation of Deferred@1075371647 after retry RPC after error@998372486) -> (continuation of Deferred@178281820 after retry RPC after error@390838134) -> (continuation of Deferred@287729862 after retry RPC after error@624397216) -> (continuation of Deferred@762673383 after retry RPC after error@1733265976) -> (continuation of Deferred@1158524495 after retry RPC after error@1560172485) -> (continuation of Deferred@1523232509 after retry RPC after error@1095754198) -> (continuation of Deferred@1771585638 after retry RPC after error@1198940911) -> (continuation of Deferred@1212453306 after retry RPC after error@1983617077) -> (continuation of Deferred@1569418724 after retry RPC after error@689835424) -> (continuation of Deferred@1161527416 after retry RPC after error@1877693146) -> (continuation of Deferred@1770645134 after retry RPC after error@807638290) -> (continuation of Deferred@688061230 after retry RPC after error@483004758) -> (continuation of Deferred@978401751 after retry RPC after error@376877194) -> (continuation of Deferred@672396001 after retry RPC after error@1679758868) -> (continuation of Deferred@1462961345 after retry RPC after error@1960971341) -> (continuation of Deferred@1137798346 after retry RPC after error@1608678674) -> (continuation of Deferred@280526627 after retry RPC after error@1960610077) -> (continuation of Deferred@1017318512 after retry RPC after error@1885731867) -> (continuation of Deferred@595055699 after retry RPC after error@863184193) -> (continuation of Deferred@387416019 after retry RPC after error@1221450766) -> (continuation of Deferred@1434799112 after retry RPC after error@2146837204) -> (continuation of Deferred@1404252958 after retry RPC after error@1975040202) -> (continuation of Deferred@178413433 after retry RPC after error@1141648507), errback=(continuation of Deferred@2094903734 after retry RPC after error@1667436602) -> (continuation of Deferred@836771348 after retry RPC after error@1364821475) -> (continuation of Deferred@1075371647 after retry RPC after error@998372486) -> (continuation of Deferred@178281820 after retry RPC after error@390838134) -> (continuation of Deferred@287729862 after retry RPC after error@624397216) -> (continuation of Deferred@762673383 after retry RPC after error@1733265976) -> (continuation of Deferred@1158524495 after retry RPC after error@1560172485) -> (continuation of Deferred@1523232509 after retry RPC after error@1095754198) -> (continuation of Deferred@1771585638 after retry RPC after error@1198940911) -> (continuation of Deferred@1212453306 after retry RPC after error@1983617077) -> (continuation of Deferred@1569418724 after retry RPC after error@689835424) -> (continuation of Deferred@1161527416 after retry RPC after error@1877693146) -> (continuation of Deferred@1770645134 after retry RPC after error@807638290) -> (continuation of Deferred@688061230 after retry RPC after error@483004758) -> (continuation of Deferred@978401751 after retry RPC after error@376877194) -> (continuation of Deferred@672396001 after retry RPC after error@1679758868) -> (continuation of Deferred@1462961345 after retry RPC after error@1960971341) -> (continuation of Deferred@1137798346 after retry RPC after error@1608678674) -> (continuation of Deferred@280526627 after retry RPC after error@1960610077) -> (continuation of Deferred@1017318512 after retry RPC after error@1885731867) -> (continuation of Deferred@595055699 after retry RPC after error@863184193) -> (continuation of Deferred@387416019 after retry RPC after error@1221450766) -> (continuation of Deferred@1434799112 after retry RPC after error@2146837204) -> (continuation of Deferred@1404252958 after retry RPC after error@1975040202) -> (continuation of Deferred@178413433 after retry RPC after error@1141648507)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:42.500 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
18:33:42.503 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#4 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
18:33:42.507 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26702), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [92ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [106ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [108ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [108ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [129ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [143ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [143ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [169ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [172ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [172ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [173ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [174ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [174ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [182ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [209ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [209ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [243ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [263ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [263ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [264ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [264ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [363ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [363ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [397ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [397ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [398ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [398ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [398ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [398ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [464ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1003ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2661ms] refreshing cache from master, [2661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2663ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2663ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2663ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3321ms] refreshing cache from master, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3322ms] too many traces: truncated at 100 traces, deferred=Deferred@155008143(state=PENDING, result=null, callback=(continuation of Deferred@2094903734 after retry RPC after error@1667436602) -> (continuation of Deferred@836771348 after retry RPC after error@1364821475) -> (continuation of Deferred@1075371647 after retry RPC after error@998372486) -> (continuation of Deferred@178281820 after retry RPC after error@390838134) -> (continuation of Deferred@287729862 after retry RPC after error@624397216) -> (continuation of Deferred@762673383 after retry RPC after error@1733265976) -> (continuation of Deferred@1158524495 after retry RPC after error@1560172485) -> (continuation of Deferred@1523232509 after retry RPC after error@1095754198) -> (continuation of Deferred@1771585638 after retry RPC after error@1198940911) -> (continuation of Deferred@1212453306 after retry RPC after error@1983617077) -> (continuation of Deferred@1569418724 after retry RPC after error@689835424) -> (continuation of Deferred@1161527416 after retry RPC after error@1877693146) -> (continuation of Deferred@1770645134 after retry RPC after error@807638290) -> (continuation of Deferred@688061230 after retry RPC after error@483004758) -> (continuation of Deferred@978401751 after retry RPC after error@376877194) -> (continuation of Deferred@672396001 after retry RPC after error@1679758868) -> (continuation of Deferred@1462961345 after retry RPC after error@1960971341) -> (continuation of Deferred@1137798346 after retry RPC after error@1608678674) -> (continuation of Deferred@280526627 after retry RPC after error@1960610077) -> (continuation of Deferred@1017318512 after retry RPC after error@1885731867) -> (continuation of Deferred@595055699 after retry RPC after error@863184193) -> (continuation of Deferred@387416019 after retry RPC after error@1221450766) -> (continuation of Deferred@1434799112 after retry RPC after error@2146837204) -> (continuation of Deferred@1404252958 after retry RPC after error@1975040202) -> (continuation of Deferred@178413433 after retry RPC after error@1141648507), errback=(continuation of Deferred@2094903734 after retry RPC after error@1667436602) -> (continuation of Deferred@836771348 after retry RPC after error@1364821475) -> (continuation of Deferred@1075371647 after retry RPC after error@998372486) -> (continuation of Deferred@178281820 after retry RPC after error@390838134) -> (continuation of Deferred@287729862 after retry RPC after error@624397216) -> (continuation of Deferred@762673383 after retry RPC after error@1733265976) -> (continuation of Deferred@1158524495 after retry RPC after error@1560172485) -> (continuation of Deferred@1523232509 after retry RPC after error@1095754198) -> (continuation of Deferred@1771585638 after retry RPC after error@1198940911) -> (continuation of Deferred@1212453306 after retry RPC after error@1983617077) -> (continuation of Deferred@1569418724 after retry RPC after error@689835424) -> (continuation of Deferred@1161527416 after retry RPC after error@1877693146) -> (continuation of Deferred@1770645134 after retry RPC after error@807638290) -> (continuation of Deferred@688061230 after retry RPC after error@483004758) -> (continuation of Deferred@978401751 after retry RPC after error@376877194) -> (continuation of Deferred@672396001 after retry RPC after error@1679758868) -> (continuation of Deferred@1462961345 after retry RPC after error@1960971341) -> (continuation of Deferred@1137798346 after retry RPC after error@1608678674) -> (continuation of Deferred@280526627 after retry RPC after error@1960610077) -> (continuation of Deferred@1017318512 after retry RPC after error@1885731867) -> (continuation of Deferred@595055699 after retry RPC after error@863184193) -> (continuation of Deferred@387416019 after retry RPC after error@1221450766) -> (continuation of Deferred@1434799112 after retry RPC after error@2146837204) -> (continuation of Deferred@1404252958 after retry RPC after error@1975040202) -> (continuation of Deferred@178413433 after retry RPC after error@1141648507)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:42.509 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
18:33:42.509 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state RUNNING to RESTARTING.
18:33:42.509 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:42.510 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#4) of source Source: KuduSource.
18:33:42.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:42.595 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:42.604 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:42.604 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:42.604 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:42.605 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:42.605 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:42.605 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:42.606 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:42.606 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:42.606 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:42.606 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:42.606 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:42.607 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:42.607 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:42.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535622646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:42.665 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
18:33:42.667 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
18:33:42.727 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:42.778 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:42.778 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:42.778 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:42.779 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:42.779 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:42.779 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:42.780 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:42.780 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:42.780 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:42.780 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:42.780 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:42.780 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:42.780 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:42.791 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:42.791 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:42.792 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:42.792 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:42.792 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:42.792 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:42.793 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:42.793 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:42.793 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:42.793 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:42.793 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:42.793 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:42.793 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:42.806 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:42.806 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:42.806 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:42.807 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:42.807 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:42.807 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:42.807 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:42.807 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:42.808 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:42.808 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:42.808 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:42.808 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:42.808 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:42.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:42.824728  7204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } attempt: 6
18:33:42.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:42.849527  7204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.61:44495: Network error: Client connection negotiation failed: client connection to 127.6.245.61:44495: connect: Connection refused (error 111)
18:33:43.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:43.094 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:43.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535623146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:43.165 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
18:33:43.166 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
18:33:43.194 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:43.195 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:43.195 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:43.195 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:43.195 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:43.196 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:43.196 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:43.196 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:43.196 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:43.196 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:43.196 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:43.196 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:43.196 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:43.199 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:43.199 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:43.199 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:43.199 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:43.199 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:43.199 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:43.199 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:43.200 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:43.200 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:43.200 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:43.200 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:43.200 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:43.200 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:43.226 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:43.294 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:43.294 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:43.294 [DEBUG - pool-302-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:43.295 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:43.295 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:43.295 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:43.295 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:43.295 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:43.295 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:43.295 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:43.296 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:43.296 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:43.296 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:43.296 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27529), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [48ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [49ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [50ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [124ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [126ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [127ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [152ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [154ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [159ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [159ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [182ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [202ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [243ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [363ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [402ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [682ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1660ms] refreshing cache from master, [1660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1661ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1662ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2261ms] refreshing cache from master, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2263ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2263ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [4421ms] refreshing cache from master, [4421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4423ms] too many traces: truncated at 100 traces, deferred=Deferred@1462855458(state=PENDING, result=null, callback=(continuation of Deferred@1406730002 after retry RPC after error@1700742493) -> (continuation of Deferred@78010546 after retry RPC after error@1483880307) -> (continuation of Deferred@1279685376 after retry RPC after error@1395434104) -> (continuation of Deferred@1710818151 after retry RPC after error@754546948) -> (continuation of Deferred@1398329832 after retry RPC after error@1699841689) -> (continuation of Deferred@1218335599 after retry RPC after error@793260577) -> (continuation of Deferred@973758897 after retry RPC after error@1401310503) -> (continuation of Deferred@1765374227 after retry RPC after error@118396719) -> (continuation of Deferred@1851812246 after retry RPC after error@258928136) -> (continuation of Deferred@759037719 after retry RPC after error@1585033840) -> (continuation of Deferred@867716336 after retry RPC after error@1272900129) -> (continuation of Deferred@156856586 after retry RPC after error@438351971) -> (continuation of Deferred@1804511259 after retry RPC after error@1463666857) -> (continuation of Deferred@363737701 after retry RPC after error@173175571) -> (continuation of Deferred@344116274 after retry RPC after error@759379595) -> (continuation of Deferred@1226441820 after retry RPC after error@1346976903) -> (continuation of Deferred@1386777056 after retry RPC after error@1726683728) -> (continuation of Deferred@2144000565 after retry RPC after error@1719561295) -> (continuation of Deferred@1888427753 after retry RPC after error@1309188914) -> (continuation of Deferred@1740293044 after retry RPC after error@1924388632) -> (continuation of Deferred@2051270641 after retry RPC after error@1901710008) -> (continuation of Deferred@1087307844 after retry RPC after error@749212754), errback=(continuation of Deferred@1406730002 after retry RPC after error@1700742493) -> (continuation of Deferred@78010546 after retry RPC after error@1483880307) -> (continuation of Deferred@1279685376 after retry RPC after error@1395434104) -> (continuation of Deferred@1710818151 after retry RPC after error@754546948) -> (continuation of Deferred@1398329832 after retry RPC after error@1699841689) -> (continuation of Deferred@1218335599 after retry RPC after error@793260577) -> (continuation of Deferred@973758897 after retry RPC after error@1401310503) -> (continuation of Deferred@1765374227 after retry RPC after error@118396719) -> (continuation of Deferred@1851812246 after retry RPC after error@258928136) -> (continuation of Deferred@759037719 after retry RPC after error@1585033840) -> (continuation of Deferred@867716336 after retry RPC after error@1272900129) -> (continuation of Deferred@156856586 after retry RPC after error@438351971) -> (continuation of Deferred@1804511259 after retry RPC after error@1463666857) -> (continuation of Deferred@363737701 after retry RPC after error@173175571) -> (continuation of Deferred@344116274 after retry RPC after error@759379595) -> (continuation of Deferred@1226441820 after retry RPC after error@1346976903) -> (continuation of Deferred@1386777056 after retry RPC after error@1726683728) -> (continuation of Deferred@2144000565 after retry RPC after error@1719561295) -> (continuation of Deferred@1888427753 after retry RPC after error@1309188914) -> (continuation of Deferred@1740293044 after retry RPC after error@1924388632) -> (continuation of Deferred@2051270641 after retry RPC after error@1901710008) -> (continuation of Deferred@1087307844 after retry RPC after error@749212754)))
18:33:43.297 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
18:33:43.297 [WARN - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27529), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [48ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [49ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [50ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [124ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [126ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [127ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [152ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [154ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [159ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [159ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [182ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [202ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [243ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [363ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [402ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [682ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1660ms] refreshing cache from master, [1660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1661ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1662ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2261ms] refreshing cache from master, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2263ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2263ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [4421ms] refreshing cache from master, [4421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4423ms] too many traces: truncated at 100 traces, deferred=Deferred@1462855458(state=PENDING, result=null, callback=(continuation of Deferred@1406730002 after retry RPC after error@1700742493) -> (continuation of Deferred@78010546 after retry RPC after error@1483880307) -> (continuation of Deferred@1279685376 after retry RPC after error@1395434104) -> (continuation of Deferred@1710818151 after retry RPC after error@754546948) -> (continuation of Deferred@1398329832 after retry RPC after error@1699841689) -> (continuation of Deferred@1218335599 after retry RPC after error@793260577) -> (continuation of Deferred@973758897 after retry RPC after error@1401310503) -> (continuation of Deferred@1765374227 after retry RPC after error@118396719) -> (continuation of Deferred@1851812246 after retry RPC after error@258928136) -> (continuation of Deferred@759037719 after retry RPC after error@1585033840) -> (continuation of Deferred@867716336 after retry RPC after error@1272900129) -> (continuation of Deferred@156856586 after retry RPC after error@438351971) -> (continuation of Deferred@1804511259 after retry RPC after error@1463666857) -> (continuation of Deferred@363737701 after retry RPC after error@173175571) -> (continuation of Deferred@344116274 after retry RPC after error@759379595) -> (continuation of Deferred@1226441820 after retry RPC after error@1346976903) -> (continuation of Deferred@1386777056 after retry RPC after error@1726683728) -> (continuation of Deferred@2144000565 after retry RPC after error@1719561295) -> (continuation of Deferred@1888427753 after retry RPC after error@1309188914) -> (continuation of Deferred@1740293044 after retry RPC after error@1924388632) -> (continuation of Deferred@2051270641 after retry RPC after error@1901710008) -> (continuation of Deferred@1087307844 after retry RPC after error@749212754), errback=(continuation of Deferred@1406730002 after retry RPC after error@1700742493) -> (continuation of Deferred@78010546 after retry RPC after error@1483880307) -> (continuation of Deferred@1279685376 after retry RPC after error@1395434104) -> (continuation of Deferred@1710818151 after retry RPC after error@754546948) -> (continuation of Deferred@1398329832 after retry RPC after error@1699841689) -> (continuation of Deferred@1218335599 after retry RPC after error@793260577) -> (continuation of Deferred@973758897 after retry RPC after error@1401310503) -> (continuation of Deferred@1765374227 after retry RPC after error@118396719) -> (continuation of Deferred@1851812246 after retry RPC after error@258928136) -> (continuation of Deferred@759037719 after retry RPC after error@1585033840) -> (continuation of Deferred@867716336 after retry RPC after error@1272900129) -> (continuation of Deferred@156856586 after retry RPC after error@438351971) -> (continuation of Deferred@1804511259 after retry RPC after error@1463666857) -> (continuation of Deferred@363737701 after retry RPC after error@173175571) -> (continuation of Deferred@344116274 after retry RPC after error@759379595) -> (continuation of Deferred@1226441820 after retry RPC after error@1346976903) -> (continuation of Deferred@1386777056 after retry RPC after error@1726683728) -> (continuation of Deferred@2144000565 after retry RPC after error@1719561295) -> (continuation of Deferred@1888427753 after retry RPC after error@1309188914) -> (continuation of Deferred@1740293044 after retry RPC after error@1924388632) -> (continuation of Deferred@2051270641 after retry RPC after error@1901710008) -> (continuation of Deferred@1087307844 after retry RPC after error@749212754)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.124:38627
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:43.298 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_5).
18:33:43.300 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#5 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_5.
18:33:43.303 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27529), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [48ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [49ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [50ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [124ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [126ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [127ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [152ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [154ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [159ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [159ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [182ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [202ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [243ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [362ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [363ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [402ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [682ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1660ms] refreshing cache from master, [1660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1661ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1662ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2261ms] refreshing cache from master, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2263ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2263ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [4421ms] refreshing cache from master, [4421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4423ms] too many traces: truncated at 100 traces, deferred=Deferred@1462855458(state=PENDING, result=null, callback=(continuation of Deferred@1406730002 after retry RPC after error@1700742493) -> (continuation of Deferred@78010546 after retry RPC after error@1483880307) -> (continuation of Deferred@1279685376 after retry RPC after error@1395434104) -> (continuation of Deferred@1710818151 after retry RPC after error@754546948) -> (continuation of Deferred@1398329832 after retry RPC after error@1699841689) -> (continuation of Deferred@1218335599 after retry RPC after error@793260577) -> (continuation of Deferred@973758897 after retry RPC after error@1401310503) -> (continuation of Deferred@1765374227 after retry RPC after error@118396719) -> (continuation of Deferred@1851812246 after retry RPC after error@258928136) -> (continuation of Deferred@759037719 after retry RPC after error@1585033840) -> (continuation of Deferred@867716336 after retry RPC after error@1272900129) -> (continuation of Deferred@156856586 after retry RPC after error@438351971) -> (continuation of Deferred@1804511259 after retry RPC after error@1463666857) -> (continuation of Deferred@363737701 after retry RPC after error@173175571) -> (continuation of Deferred@344116274 after retry RPC after error@759379595) -> (continuation of Deferred@1226441820 after retry RPC after error@1346976903) -> (continuation of Deferred@1386777056 after retry RPC after error@1726683728) -> (continuation of Deferred@2144000565 after retry RPC after error@1719561295) -> (continuation of Deferred@1888427753 after retry RPC after error@1309188914) -> (continuation of Deferred@1740293044 after retry RPC after error@1924388632) -> (continuation of Deferred@2051270641 after retry RPC after error@1901710008) -> (continuation of Deferred@1087307844 after retry RPC after error@749212754), errback=(continuation of Deferred@1406730002 after retry RPC after error@1700742493) -> (continuation of Deferred@78010546 after retry RPC after error@1483880307) -> (continuation of Deferred@1279685376 after retry RPC after error@1395434104) -> (continuation of Deferred@1710818151 after retry RPC after error@754546948) -> (continuation of Deferred@1398329832 after retry RPC after error@1699841689) -> (continuation of Deferred@1218335599 after retry RPC after error@793260577) -> (continuation of Deferred@973758897 after retry RPC after error@1401310503) -> (continuation of Deferred@1765374227 after retry RPC after error@118396719) -> (continuation of Deferred@1851812246 after retry RPC after error@258928136) -> (continuation of Deferred@759037719 after retry RPC after error@1585033840) -> (continuation of Deferred@867716336 after retry RPC after error@1272900129) -> (continuation of Deferred@156856586 after retry RPC after error@438351971) -> (continuation of Deferred@1804511259 after retry RPC after error@1463666857) -> (continuation of Deferred@363737701 after retry RPC after error@173175571) -> (continuation of Deferred@344116274 after retry RPC after error@759379595) -> (continuation of Deferred@1226441820 after retry RPC after error@1346976903) -> (continuation of Deferred@1386777056 after retry RPC after error@1726683728) -> (continuation of Deferred@2144000565 after retry RPC after error@1719561295) -> (continuation of Deferred@1888427753 after retry RPC after error@1309188914) -> (continuation of Deferred@1740293044 after retry RPC after error@1924388632) -> (continuation of Deferred@2051270641 after retry RPC after error@1901710008) -> (continuation of Deferred@1087307844 after retry RPC after error@749212754)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.124:38627
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:43.303 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:33:43.304 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#5) of source Source: KuduSource.
18:33:43.305 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_5.
18:33:43.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:43.349090  7200 debug-util.cc:398] Leaking SignalData structure 0x7b0800070060 after lost signal to thread 7137
18:33:43.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:43.349929  7200 debug-util.cc:398] Leaking SignalData structure 0x7b08000707a0 after lost signal to thread 7203
18:33:43.469 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:43.469 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:43.469 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:43.469 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:43.469 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:43.469 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:43.469 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:43.470 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:43.470 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:43.470 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:43.470 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:43.470 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:43.470 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:43.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:43.394567  7214 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 7206
18:33:43.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:43.500247  7206 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.519s	user 0.511s	sys 0.997s
18:33:43.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:43.500701  7206 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.520s	user 0.511s	sys 0.997s
18:33:43.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:41.981935  7216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:43.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:43.502558  7218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:43.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:43.507268  7217 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1519 milliseconds
18:33:43.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.507316  7206 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:33:43.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.508955  7206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:33:43.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.511770  7206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:33:43.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.513348  7206 hybrid_clock.cc:648] HybridClock initialized: now 1783535623513324 us; error 50 us; skew 500 ppm
18:33:43.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.514307  7206 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:33:43.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.521944  7206 webserver.cc:534] Webserver started at http://127.6.245.61:44463/ using document root <none> and password file <none>
18:33:43.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.523033  7206 fs_manager.cc:362] Metadata directory not provided
18:33:43.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.523277  7206 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:33:43.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.523778  7206 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:33:43.524 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:43.524 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:43.524 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:43.524 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:43.524 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:43.525 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:43.525 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:43.525 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:43.525 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:43.525 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:43.525 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:43.525 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:43.525 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:43.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.529088  7206 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/data/instance:
18:33:43.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8578841b721446e1824b2561386baa9b"
18:33:43.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:43 on dist-test-slave-dxnw"
18:33:43.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.530326  7206 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/wal/instance:
18:33:43.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8578841b721446e1824b2561386baa9b"
18:33:43.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:43 on dist-test-slave-dxnw"
18:33:43.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.540364  7206 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.004s	sys 0.004s
18:33:43.545 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:43.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.547569  7228 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:33:43.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.549049  7206 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
18:33:43.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.549432  7206 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/wal
18:33:43.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8578841b721446e1824b2561386baa9b"
18:33:43.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:43 on dist-test-slave-dxnw"
18:33:43.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.549793  7206 fs_report.cc:389] FS layout report
18:33:43.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:33:43.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/wal
18:33:43.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/wal
18:33:43.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/data/data
18:33:43.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:33:43.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:33:43.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:33:43.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:33:43.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:33:43.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:33:43.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:33:43.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:33:43.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:33:43.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:33:43.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:33:43.574 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:43.574 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:43.575 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:43.575 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:43.575 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:43.575 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:43.575 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:43.575 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:43.575 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:43.575 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:43.576 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:43.576 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:43.576 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:43.594 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:43.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.609351  7206 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:33:43.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.611200  7206 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:33:43.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.611799  7206 kserver.cc:163] Server-wide thread pool size limit: 3276
18:33:43.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535623646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:43.655 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:33:43.657 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
18:33:43.715 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:43.716 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:43.716 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:43.716 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:43.716 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:43.716 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:43.716 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:43.716 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:43.716 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:43.717 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:43.717 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:43.717 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:43.717 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:43.719 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:43.719 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:43.719 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:43.719 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:43.719 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:43.720 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:43.720 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:43.720 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:43.720 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:43.720 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:43.720 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:43.720 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:43.720 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:43.726 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:43.755 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:43.755 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:43.755 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:43.755 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:43.755 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:43.755 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:43.755 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:43.755 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:43.756 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:43.756 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:43.756 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:43.756 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:43.756 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:43.756 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:43.756 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:43.756 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:43.756 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:43.756 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:43.756 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:43.757 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:43.757 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:43.757 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:43.757 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:43.757 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:43.757 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:43.757 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:43.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.782455  7206 rpc_server.cc:307] RPC server started. Bound to: 127.6.245.61:44495
18:33:43.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.782647  7279 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.245.61:44495 every 8 connection(s)
18:33:43.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.785601  7206 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/data/info.pb
18:33:43.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.790247  7124 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 7206
18:33:43.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.790768  7124 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-1/wal/instance
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.794014  7280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.793946  7124 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/wal
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/data
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/logs
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/data/info.pb
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:33:43.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:33:43.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:33:43.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.245.60:46787
18:33:43.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.245.60
18:33:43.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:43.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.245.20:33853
18:33:43.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:43.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:43.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:43.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:33:43.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.6.245.62:36853,127.6.245.61:44495,127.6.245.60:46787
18:33:43.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:33:43.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36899/jwks.json with env {}
18:33:43.796 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:43.796 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:43.796 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:43.796 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:43.797 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:43.797 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:43.797 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:43.797 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:43.797 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:43.797 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:43.797 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:43.797 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:43.797 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:43.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.807320  7280 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } has no permanent_uuid. Determining permanent_uuid...
18:33:43.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.848323  7280 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } has no permanent_uuid. Determining permanent_uuid...
18:33:43.856 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:43.856 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:43.856 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:43.856 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:43.856 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:43.857 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:43.857 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:43.857 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:43.857 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:43.857 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:43.857 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:43.857 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:43.857 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:43.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.869717  7280 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } has no permanent_uuid. Determining permanent_uuid...
18:33:43.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:43.873109  7232 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.245.60:46787: connect: Connection refused (error 111)
18:33:43.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:43.879179  7280 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.60:46787: Network error: Client connection negotiation failed: client connection to 127.6.245.60:46787: connect: Connection refused (error 111)
18:33:43.891 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:43.891 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:43.891 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:43.891 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:43.892 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:43.892 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:43.892 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:43.892 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:43.892 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:43.892 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:43.893 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:43.893 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:43.893 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:43.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.910105  7204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } attempt: 7
18:33:43.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.926170  7204 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } has no permanent_uuid. Determining permanent_uuid...
18:33:43.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:43.928736  7280 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } attempt: 1
18:33:43.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:43.934818  7280 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.60:46787: Network error: Client connection negotiation failed: client connection to 127.6.245.60:46787: connect: Connection refused (error 111)
18:33:43.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:43.942058  7204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.60:46787: Network error: Client connection negotiation failed: client connection to 127.6.245.60:46787: connect: Connection refused (error 111)
18:33:44.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:44.000502  7204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } attempt: 1
18:33:44.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:44.003361  7280 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } attempt: 2
18:33:44.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.007635  7204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.60:46787: Network error: Client connection negotiation failed: client connection to 127.6.245.60:46787: connect: Connection refused (error 111)
18:33:44.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.010532  7280 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.60:46787: Network error: Client connection negotiation failed: client connection to 127.6.245.60:46787: connect: Connection refused (error 111)
18:33:44.017 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:44.017 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:44.017 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:44.017 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:44.017 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:44.017 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:44.017 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:44.017 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:44.017 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:44.018 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:44.018 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:44.018 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:44.018 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:44.025 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:44.026 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:44.026 [DEBUG - pool-304-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:44.026 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:44.026 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:44.026 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:44.026 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:44.026 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:44.026 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:44.027 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:44.027 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:44.027 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:44.027 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:44.027 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28243), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [34ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [67ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [77ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [78ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [97ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [99ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [100ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [128ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [131ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [136ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [136ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [141ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [164ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [204ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [204ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [283ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [283ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [343ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [344ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [345ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [345ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [386ms] refreshing cache from master, [386ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [386ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [386ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [394ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [395ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [395ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [396ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1123ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2882ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3041ms] refreshing cache from master, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3042ms] too many traces: truncated at 100 traces, deferred=Deferred@713112698(state=PENDING, result=null, callback=(continuation of Deferred@2071949346 after retry RPC after error@229967889) -> (continuation of Deferred@1299416616 after retry RPC after error@1857159440) -> (continuation of Deferred@1858896516 after retry RPC after error@1260190412) -> (continuation of Deferred@445609793 after retry RPC after error@1682661249) -> (continuation of Deferred@1855535406 after retry RPC after error@1124037803) -> (continuation of Deferred@590034634 after retry RPC after error@488817273) -> (continuation of Deferred@978704570 after retry RPC after error@62302583) -> (continuation of Deferred@2043757229 after retry RPC after error@1928034020) -> (continuation of Deferred@1726996491 after retry RPC after error@1344540848) -> (continuation of Deferred@588506163 after retry RPC after error@174516963) -> (continuation of Deferred@319863836 after retry RPC after error@1665245022) -> (continuation of Deferred@1607458169 after retry RPC after error@1656948113) -> (continuation of Deferred@1948628361 after retry RPC after error@468811580) -> (continuation of Deferred@980704558 after retry RPC after error@1080113276) -> (continuation of Deferred@422663172 after retry RPC after error@153731201) -> (continuation of Deferred@288125351 after retry RPC after error@1481054502) -> (continuation of Deferred@1262876510 after retry RPC after error@204409727) -> (continuation of Deferred@2122117652 after retry RPC after error@512907988) -> (continuation of Deferred@2055840095 after retry RPC after error@235485570) -> (continuation of Deferred@394036741 after retry RPC after error@464792260) -> (continuation of Deferred@746648500 after retry RPC after error@1795295887) -> (continuation of Deferred@406713668 after retry RPC after error@577048205) -> (continuation of Deferred@164840486 after retry RPC after error@1920889313) -> (continuation of Deferred@94256447 after retry RPC after error@260393575) -> (continuation of Deferred@476368325 after retry RPC after error@487868113) -> (continuation of Deferred@1771562889 after retry RPC after error@1281642158) -> (continuation of Deferred@1985259522 after retry RPC after error@1229540055) -> (continuation of Deferred@523519960 after retry RPC after error@1900772270), errback=(continuation of Deferred@2071949346 after retry RPC after error@229967889) -> (continuation of Deferred@1299416616 after retry RPC after error@1857159440) -> (continuation of Deferred@1858896516 after retry RPC after error@1260190412) -> (continuation of Deferred@445609793 after retry RPC after error@1682661249) -> (continuation of Deferred@1855535406 after retry RPC after error@1124037803) -> (continuation of Deferred@590034634 after retry RPC after error@488817273) -> (continuation of Deferred@978704570 after retry RPC after error@62302583) -> (continuation of Deferred@2043757229 after retry RPC after error@1928034020) -> (continuation of Deferred@1726996491 after retry RPC after error@1344540848) -> (continuation of Deferred@588506163 after retry RPC after error@174516963) -> (continuation of Deferred@319863836 after retry RPC after error@1665245022) -> (continuation of Deferred@1607458169 after retry RPC after error@1656948113) -> (continuation of Deferred@1948628361 after retry RPC after error@468811580) -> (continuation of Deferred@980704558 after retry RPC after error@1080113276) -> (continuation of Deferred@422663172 after retry RPC after error@153731201) -> (continuation of Deferred@288125351 after retry RPC after error@1481054502) -> (continuation of Deferred@1262876510 after retry RPC after error@204409727) -> (continuation of Deferred@2122117652 after retry RPC after error@512907988) -> (continuation of Deferred@2055840095 after retry RPC after error@235485570) -> (continuation of Deferred@394036741 after retry RPC after error@464792260) -> (continuation of Deferred@746648500 after retry RPC after error@1795295887) -> (continuation of Deferred@406713668 after retry RPC after error@577048205) -> (continuation of Deferred@164840486 after retry RPC after error@1920889313) -> (continuation of Deferred@94256447 after retry RPC after error@260393575) -> (continuation of Deferred@476368325 after retry RPC after error@487868113) -> (continuation of Deferred@1771562889 after retry RPC after error@1281642158) -> (continuation of Deferred@1985259522 after retry RPC after error@1229540055) -> (continuation of Deferred@523519960 after retry RPC after error@1900772270)))
18:33:44.028 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
18:33:44.028 [WARN - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28243), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [34ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [67ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [77ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [78ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [97ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [99ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [100ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [128ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [131ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [136ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [136ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [141ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [164ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [204ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [204ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [283ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [283ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [343ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [344ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [345ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [345ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [386ms] refreshing cache from master, [386ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [386ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [386ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [394ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [395ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [395ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [396ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1123ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2882ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3041ms] refreshing cache from master, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3042ms] too many traces: truncated at 100 traces, deferred=Deferred@713112698(state=PENDING, result=null, callback=(continuation of Deferred@2071949346 after retry RPC after error@229967889) -> (continuation of Deferred@1299416616 after retry RPC after error@1857159440) -> (continuation of Deferred@1858896516 after retry RPC after error@1260190412) -> (continuation of Deferred@445609793 after retry RPC after error@1682661249) -> (continuation of Deferred@1855535406 after retry RPC after error@1124037803) -> (continuation of Deferred@590034634 after retry RPC after error@488817273) -> (continuation of Deferred@978704570 after retry RPC after error@62302583) -> (continuation of Deferred@2043757229 after retry RPC after error@1928034020) -> (continuation of Deferred@1726996491 after retry RPC after error@1344540848) -> (continuation of Deferred@588506163 after retry RPC after error@174516963) -> (continuation of Deferred@319863836 after retry RPC after error@1665245022) -> (continuation of Deferred@1607458169 after retry RPC after error@1656948113) -> (continuation of Deferred@1948628361 after retry RPC after error@468811580) -> (continuation of Deferred@980704558 after retry RPC after error@1080113276) -> (continuation of Deferred@422663172 after retry RPC after error@153731201) -> (continuation of Deferred@288125351 after retry RPC after error@1481054502) -> (continuation of Deferred@1262876510 after retry RPC after error@204409727) -> (continuation of Deferred@2122117652 after retry RPC after error@512907988) -> (continuation of Deferred@2055840095 after retry RPC after error@235485570) -> (continuation of Deferred@394036741 after retry RPC after error@464792260) -> (continuation of Deferred@746648500 after retry RPC after error@1795295887) -> (continuation of Deferred@406713668 after retry RPC after error@577048205) -> (continuation of Deferred@164840486 after retry RPC after error@1920889313) -> (continuation of Deferred@94256447 after retry RPC after error@260393575) -> (continuation of Deferred@476368325 after retry RPC after error@487868113) -> (continuation of Deferred@1771562889 after retry RPC after error@1281642158) -> (continuation of Deferred@1985259522 after retry RPC after error@1229540055) -> (continuation of Deferred@523519960 after retry RPC after error@1900772270), errback=(continuation of Deferred@2071949346 after retry RPC after error@229967889) -> (continuation of Deferred@1299416616 after retry RPC after error@1857159440) -> (continuation of Deferred@1858896516 after retry RPC after error@1260190412) -> (continuation of Deferred@445609793 after retry RPC after error@1682661249) -> (continuation of Deferred@1855535406 after retry RPC after error@1124037803) -> (continuation of Deferred@590034634 after retry RPC after error@488817273) -> (continuation of Deferred@978704570 after retry RPC after error@62302583) -> (continuation of Deferred@2043757229 after retry RPC after error@1928034020) -> (continuation of Deferred@1726996491 after retry RPC after error@1344540848) -> (continuation of Deferred@588506163 after retry RPC after error@174516963) -> (continuation of Deferred@319863836 after retry RPC after error@1665245022) -> (continuation of Deferred@1607458169 after retry RPC after error@1656948113) -> (continuation of Deferred@1948628361 after retry RPC after error@468811580) -> (continuation of Deferred@980704558 after retry RPC after error@1080113276) -> (continuation of Deferred@422663172 after retry RPC after error@153731201) -> (continuation of Deferred@288125351 after retry RPC after error@1481054502) -> (continuation of Deferred@1262876510 after retry RPC after error@204409727) -> (continuation of Deferred@2122117652 after retry RPC after error@512907988) -> (continuation of Deferred@2055840095 after retry RPC after error@235485570) -> (continuation of Deferred@394036741 after retry RPC after error@464792260) -> (continuation of Deferred@746648500 after retry RPC after error@1795295887) -> (continuation of Deferred@406713668 after retry RPC after error@577048205) -> (continuation of Deferred@164840486 after retry RPC after error@1920889313) -> (continuation of Deferred@94256447 after retry RPC after error@260393575) -> (continuation of Deferred@476368325 after retry RPC after error@487868113) -> (continuation of Deferred@1771562889 after retry RPC after error@1281642158) -> (continuation of Deferred@1985259522 after retry RPC after error@1229540055) -> (continuation of Deferred@523519960 after retry RPC after error@1900772270)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:44.029 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
18:33:44.031 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#5 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
18:33:44.033 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28243), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [34ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [67ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [77ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [78ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [97ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [99ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [100ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [128ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [131ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [136ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [136ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [141ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [163ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [164ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [204ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [204ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [283ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [283ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [343ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [344ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [345ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [345ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [386ms] refreshing cache from master, [386ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [386ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [386ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [394ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [395ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [395ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [396ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1121ms] refreshing cache from master, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1123ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1123ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2882ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3041ms] refreshing cache from master, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3042ms] too many traces: truncated at 100 traces, deferred=Deferred@713112698(state=PENDING, result=null, callback=(continuation of Deferred@2071949346 after retry RPC after error@229967889) -> (continuation of Deferred@1299416616 after retry RPC after error@1857159440) -> (continuation of Deferred@1858896516 after retry RPC after error@1260190412) -> (continuation of Deferred@445609793 after retry RPC after error@1682661249) -> (continuation of Deferred@1855535406 after retry RPC after error@1124037803) -> (continuation of Deferred@590034634 after retry RPC after error@488817273) -> (continuation of Deferred@978704570 after retry RPC after error@62302583) -> (continuation of Deferred@2043757229 after retry RPC after error@1928034020) -> (continuation of Deferred@1726996491 after retry RPC after error@1344540848) -> (continuation of Deferred@588506163 after retry RPC after error@174516963) -> (continuation of Deferred@319863836 after retry RPC after error@1665245022) -> (continuation of Deferred@1607458169 after retry RPC after error@1656948113) -> (continuation of Deferred@1948628361 after retry RPC after error@468811580) -> (continuation of Deferred@980704558 after retry RPC after error@1080113276) -> (continuation of Deferred@422663172 after retry RPC after error@153731201) -> (continuation of Deferred@288125351 after retry RPC after error@1481054502) -> (continuation of Deferred@1262876510 after retry RPC after error@204409727) -> (continuation of Deferred@2122117652 after retry RPC after error@512907988) -> (continuation of Deferred@2055840095 after retry RPC after error@235485570) -> (continuation of Deferred@394036741 after retry RPC after error@464792260) -> (continuation of Deferred@746648500 after retry RPC after error@1795295887) -> (continuation of Deferred@406713668 after retry RPC after error@577048205) -> (continuation of Deferred@164840486 after retry RPC after error@1920889313) -> (continuation of Deferred@94256447 after retry RPC after error@260393575) -> (continuation of Deferred@476368325 after retry RPC after error@487868113) -> (continuation of Deferred@1771562889 after retry RPC after error@1281642158) -> (continuation of Deferred@1985259522 after retry RPC after error@1229540055) -> (continuation of Deferred@523519960 after retry RPC after error@1900772270), errback=(continuation of Deferred@2071949346 after retry RPC after error@229967889) -> (continuation of Deferred@1299416616 after retry RPC after error@1857159440) -> (continuation of Deferred@1858896516 after retry RPC after error@1260190412) -> (continuation of Deferred@445609793 after retry RPC after error@1682661249) -> (continuation of Deferred@1855535406 after retry RPC after error@1124037803) -> (continuation of Deferred@590034634 after retry RPC after error@488817273) -> (continuation of Deferred@978704570 after retry RPC after error@62302583) -> (continuation of Deferred@2043757229 after retry RPC after error@1928034020) -> (continuation of Deferred@1726996491 after retry RPC after error@1344540848) -> (continuation of Deferred@588506163 after retry RPC after error@174516963) -> (continuation of Deferred@319863836 after retry RPC after error@1665245022) -> (continuation of Deferred@1607458169 after retry RPC after error@1656948113) -> (continuation of Deferred@1948628361 after retry RPC after error@468811580) -> (continuation of Deferred@980704558 after retry RPC after error@1080113276) -> (continuation of Deferred@422663172 after retry RPC after error@153731201) -> (continuation of Deferred@288125351 after retry RPC after error@1481054502) -> (continuation of Deferred@1262876510 after retry RPC after error@204409727) -> (continuation of Deferred@2122117652 after retry RPC after error@512907988) -> (continuation of Deferred@2055840095 after retry RPC after error@235485570) -> (continuation of Deferred@394036741 after retry RPC after error@464792260) -> (continuation of Deferred@746648500 after retry RPC after error@1795295887) -> (continuation of Deferred@406713668 after retry RPC after error@577048205) -> (continuation of Deferred@164840486 after retry RPC after error@1920889313) -> (continuation of Deferred@94256447 after retry RPC after error@260393575) -> (continuation of Deferred@476368325 after retry RPC after error@487868113) -> (continuation of Deferred@1771562889 after retry RPC after error@1281642158) -> (continuation of Deferred@1985259522 after retry RPC after error@1229540055) -> (continuation of Deferred@523519960 after retry RPC after error@1900772270)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:44.034 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#5) of source Source: KuduSource.
18:33:44.034 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:33:44.036 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
18:33:44.045 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:44.063 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:44.064 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:44.064 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:44.064 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.064 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.064 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.064 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.064 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.064 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.065 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.065 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.065 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.065 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:44.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:44.089103  7204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } attempt: 2
18:33:44.090 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:44.090 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:44.090 [DEBUG - pool-300-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:44.091 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:44.091 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:44.091 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:44.091 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:44.091 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:44.091 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:44.091 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:44.091 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:44.091 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:44.092 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:44.092 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28327), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [150ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [151ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [152ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [152ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [173ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [174ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [181ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [210ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [211ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [211ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [212ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [212ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [221ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [242ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [261ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [263ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [281ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [281ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [282ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [344ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [580ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [582ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [582ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [582ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [583ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [842ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [842ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [843ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1360ms] refreshing cache from master, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1362ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2960ms] refreshing cache from master, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2962ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2962ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2962ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [4620ms] refreshing cache from master, [4620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4622ms] too many traces: truncated at 100 traces, deferred=Deferred@987790456(state=PENDING, result=null, callback=(continuation of Deferred@2063308647 after retry RPC after error@549481806) -> (continuation of Deferred@1353102700 after retry RPC after error@1771835580) -> (continuation of Deferred@1341841991 after retry RPC after error@1827884267) -> (continuation of Deferred@152803788 after retry RPC after error@745891) -> (continuation of Deferred@419119935 after retry RPC after error@1855574239) -> (continuation of Deferred@991555897 after retry RPC after error@1623492992) -> (continuation of Deferred@577031196 after retry RPC after error@47968167) -> (continuation of Deferred@1992247036 after retry RPC after error@854808866) -> (continuation of Deferred@913536844 after retry RPC after error@1795690738) -> (continuation of Deferred@1737241545 after retry RPC after error@1327385683) -> (continuation of Deferred@1660586987 after retry RPC after error@1230936262) -> (continuation of Deferred@1330309215 after retry RPC after error@1913346353) -> (continuation of Deferred@1150824776 after retry RPC after error@2034047413) -> (continuation of Deferred@1638735581 after retry RPC after error@1237778696) -> (continuation of Deferred@1288731401 after retry RPC after error@1563501463) -> (continuation of Deferred@1415812378 after retry RPC after error@626852319) -> (continuation of Deferred@1780104782 after retry RPC after error@1046709505) -> (continuation of Deferred@1986006162 after retry RPC after error@1006549112) -> (continuation of Deferred@11344135 after retry RPC after error@583323550) -> (continuation of Deferred@1412842440 after retry RPC after error@449121358) -> (continuation of Deferred@1917344560 after retry RPC after error@1987367640) -> (continuation of Deferred@280684509 after retry RPC after error@581910264) -> (continuation of Deferred@302932038 after retry RPC after error@1119650509) -> (continuation of Deferred@100602184 after retry RPC after error@1585231857) -> (continuation of Deferred@1066528808 after retry RPC after error@421378045), errback=(continuation of Deferred@2063308647 after retry RPC after error@549481806) -> (continuation of Deferred@1353102700 after retry RPC after error@1771835580) -> (continuation of Deferred@1341841991 after retry RPC after error@1827884267) -> (continuation of Deferred@152803788 after retry RPC after error@745891) -> (continuation of Deferred@419119935 after retry RPC after error@1855574239) -> (continuation of Deferred@991555897 after retry RPC after error@1623492992) -> (continuation of Deferred@577031196 after retry RPC after error@47968167) -> (continuation of Deferred@1992247036 after retry RPC after error@854808866) -> (continuation of Deferred@913536844 after retry RPC after error@1795690738) -> (continuation of Deferred@1737241545 after retry RPC after error@1327385683) -> (continuation of Deferred@1660586987 after retry RPC after error@1230936262) -> (continuation of Deferred@1330309215 after retry RPC after error@1913346353) -> (continuation of Deferred@1150824776 after retry RPC after error@2034047413) -> (continuation of Deferred@1638735581 after retry RPC after error@1237778696) -> (continuation of Deferred@1288731401 after retry RPC after error@1563501463) -> (continuation of Deferred@1415812378 after retry RPC after error@626852319) -> (continuation of Deferred@1780104782 after retry RPC after error@1046709505) -> (continuation of Deferred@1986006162 after retry RPC after error@1006549112) -> (continuation of Deferred@11344135 after retry RPC after error@583323550) -> (continuation of Deferred@1412842440 after retry RPC after error@449121358) -> (continuation of Deferred@1917344560 after retry RPC after error@1987367640) -> (continuation of Deferred@280684509 after retry RPC after error@581910264) -> (continuation of Deferred@302932038 after retry RPC after error@1119650509) -> (continuation of Deferred@100602184 after retry RPC after error@1585231857) -> (continuation of Deferred@1066528808 after retry RPC after error@421378045)))
18:33:44.093 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
18:33:44.093 [WARN - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28327), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [150ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [151ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [152ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [152ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [173ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [174ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [181ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [210ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [211ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [211ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [212ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [212ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [221ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [242ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [261ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [263ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [281ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [281ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [282ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [344ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [580ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [582ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [582ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [582ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [583ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [842ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [842ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [843ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1360ms] refreshing cache from master, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1362ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2960ms] refreshing cache from master, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2962ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2962ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2962ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [4620ms] refreshing cache from master, [4620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4622ms] too many traces: truncated at 100 traces, deferred=Deferred@987790456(state=PENDING, result=null, callback=(continuation of Deferred@2063308647 after retry RPC after error@549481806) -> (continuation of Deferred@1353102700 after retry RPC after error@1771835580) -> (continuation of Deferred@1341841991 after retry RPC after error@1827884267) -> (continuation of Deferred@152803788 after retry RPC after error@745891) -> (continuation of Deferred@419119935 after retry RPC after error@1855574239) -> (continuation of Deferred@991555897 after retry RPC after error@1623492992) -> (continuation of Deferred@577031196 after retry RPC after error@47968167) -> (continuation of Deferred@1992247036 after retry RPC after error@854808866) -> (continuation of Deferred@913536844 after retry RPC after error@1795690738) -> (continuation of Deferred@1737241545 after retry RPC after error@1327385683) -> (continuation of Deferred@1660586987 after retry RPC after error@1230936262) -> (continuation of Deferred@1330309215 after retry RPC after error@1913346353) -> (continuation of Deferred@1150824776 after retry RPC after error@2034047413) -> (continuation of Deferred@1638735581 after retry RPC after error@1237778696) -> (continuation of Deferred@1288731401 after retry RPC after error@1563501463) -> (continuation of Deferred@1415812378 after retry RPC after error@626852319) -> (continuation of Deferred@1780104782 after retry RPC after error@1046709505) -> (continuation of Deferred@1986006162 after retry RPC after error@1006549112) -> (continuation of Deferred@11344135 after retry RPC after error@583323550) -> (continuation of Deferred@1412842440 after retry RPC after error@449121358) -> (continuation of Deferred@1917344560 after retry RPC after error@1987367640) -> (continuation of Deferred@280684509 after retry RPC after error@581910264) -> (continuation of Deferred@302932038 after retry RPC after error@1119650509) -> (continuation of Deferred@100602184 after retry RPC after error@1585231857) -> (continuation of Deferred@1066528808 after retry RPC after error@421378045), errback=(continuation of Deferred@2063308647 after retry RPC after error@549481806) -> (continuation of Deferred@1353102700 after retry RPC after error@1771835580) -> (continuation of Deferred@1341841991 after retry RPC after error@1827884267) -> (continuation of Deferred@152803788 after retry RPC after error@745891) -> (continuation of Deferred@419119935 after retry RPC after error@1855574239) -> (continuation of Deferred@991555897 after retry RPC after error@1623492992) -> (continuation of Deferred@577031196 after retry RPC after error@47968167) -> (continuation of Deferred@1992247036 after retry RPC after error@854808866) -> (continuation of Deferred@913536844 after retry RPC after error@1795690738) -> (continuation of Deferred@1737241545 after retry RPC after error@1327385683) -> (continuation of Deferred@1660586987 after retry RPC after error@1230936262) -> (continuation of Deferred@1330309215 after retry RPC after error@1913346353) -> (continuation of Deferred@1150824776 after retry RPC after error@2034047413) -> (continuation of Deferred@1638735581 after retry RPC after error@1237778696) -> (continuation of Deferred@1288731401 after retry RPC after error@1563501463) -> (continuation of Deferred@1415812378 after retry RPC after error@626852319) -> (continuation of Deferred@1780104782 after retry RPC after error@1046709505) -> (continuation of Deferred@1986006162 after retry RPC after error@1006549112) -> (continuation of Deferred@11344135 after retry RPC after error@583323550) -> (continuation of Deferred@1412842440 after retry RPC after error@449121358) -> (continuation of Deferred@1917344560 after retry RPC after error@1987367640) -> (continuation of Deferred@280684509 after retry RPC after error@581910264) -> (continuation of Deferred@302932038 after retry RPC after error@1119650509) -> (continuation of Deferred@100602184 after retry RPC after error@1585231857) -> (continuation of Deferred@1066528808 after retry RPC after error@421378045)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.125:40423
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:44.094 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#4 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
18:33:44.094 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:44.097 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#4 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
18:33:44.099 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28327), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [150ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [151ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [152ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [152ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [173ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [174ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [181ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [209ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [210ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [211ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [211ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [212ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [212ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [221ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [242ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [261ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [263ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [281ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [281ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [282ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [344ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [580ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [582ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [582ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [582ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [583ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [842ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [842ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [843ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1360ms] refreshing cache from master, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1362ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2960ms] refreshing cache from master, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2962ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2962ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2962ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [4620ms] refreshing cache from master, [4620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4622ms] too many traces: truncated at 100 traces, deferred=Deferred@987790456(state=PENDING, result=null, callback=(continuation of Deferred@2063308647 after retry RPC after error@549481806) -> (continuation of Deferred@1353102700 after retry RPC after error@1771835580) -> (continuation of Deferred@1341841991 after retry RPC after error@1827884267) -> (continuation of Deferred@152803788 after retry RPC after error@745891) -> (continuation of Deferred@419119935 after retry RPC after error@1855574239) -> (continuation of Deferred@991555897 after retry RPC after error@1623492992) -> (continuation of Deferred@577031196 after retry RPC after error@47968167) -> (continuation of Deferred@1992247036 after retry RPC after error@854808866) -> (continuation of Deferred@913536844 after retry RPC after error@1795690738) -> (continuation of Deferred@1737241545 after retry RPC after error@1327385683) -> (continuation of Deferred@1660586987 after retry RPC after error@1230936262) -> (continuation of Deferred@1330309215 after retry RPC after error@1913346353) -> (continuation of Deferred@1150824776 after retry RPC after error@2034047413) -> (continuation of Deferred@1638735581 after retry RPC after error@1237778696) -> (continuation of Deferred@1288731401 after retry RPC after error@1563501463) -> (continuation of Deferred@1415812378 after retry RPC after error@626852319) -> (continuation of Deferred@1780104782 after retry RPC after error@1046709505) -> (continuation of Deferred@1986006162 after retry RPC after error@1006549112) -> (continuation of Deferred@11344135 after retry RPC after error@583323550) -> (continuation of Deferred@1412842440 after retry RPC after error@449121358) -> (continuation of Deferred@1917344560 after retry RPC after error@1987367640) -> (continuation of Deferred@280684509 after retry RPC after error@581910264) -> (continuation of Deferred@302932038 after retry RPC after error@1119650509) -> (continuation of Deferred@100602184 after retry RPC after error@1585231857) -> (continuation of Deferred@1066528808 after retry RPC after error@421378045), errback=(continuation of Deferred@2063308647 after retry RPC after error@549481806) -> (continuation of Deferred@1353102700 after retry RPC after error@1771835580) -> (continuation of Deferred@1341841991 after retry RPC after error@1827884267) -> (continuation of Deferred@152803788 after retry RPC after error@745891) -> (continuation of Deferred@419119935 after retry RPC after error@1855574239) -> (continuation of Deferred@991555897 after retry RPC after error@1623492992) -> (continuation of Deferred@577031196 after retry RPC after error@47968167) -> (continuation of Deferred@1992247036 after retry RPC after error@854808866) -> (continuation of Deferred@913536844 after retry RPC after error@1795690738) -> (continuation of Deferred@1737241545 after retry RPC after error@1327385683) -> (continuation of Deferred@1660586987 after retry RPC after error@1230936262) -> (continuation of Deferred@1330309215 after retry RPC after error@1913346353) -> (continuation of Deferred@1150824776 after retry RPC after error@2034047413) -> (continuation of Deferred@1638735581 after retry RPC after error@1237778696) -> (continuation of Deferred@1288731401 after retry RPC after error@1563501463) -> (continuation of Deferred@1415812378 after retry RPC after error@626852319) -> (continuation of Deferred@1780104782 after retry RPC after error@1046709505) -> (continuation of Deferred@1986006162 after retry RPC after error@1006549112) -> (continuation of Deferred@11344135 after retry RPC after error@583323550) -> (continuation of Deferred@1412842440 after retry RPC after error@449121358) -> (continuation of Deferred@1917344560 after retry RPC after error@1987367640) -> (continuation of Deferred@280684509 after retry RPC after error@581910264) -> (continuation of Deferred@302932038 after retry RPC after error@1119650509) -> (continuation of Deferred@100602184 after retry RPC after error@1585231857) -> (continuation of Deferred@1066528808 after retry RPC after error@421378045)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.125:40423
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:44.100 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#4) of source Source: KuduSource.
18:33:44.101 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job f6e63683f34d031c5da392b08baea20c
18:33:44.101 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
18:33:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:44.102034  7280 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } attempt: 3
18:33:44.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.108553  7280 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.60:46787: Network error: Client connection negotiation failed: client connection to 127.6.245.60:46787: connect: Connection refused (error 111)
18:33:44.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.110201  7204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.60:46787: Network error: Client connection negotiation failed: client connection to 127.6.245.60:46787: connect: Connection refused (error 111)
18:33:44.146 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535624146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:44.156 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:33:44.157 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
18:33:44.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:44.195686  7204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } attempt: 3
18:33:44.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.201370  7204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.60:46787: Network error: Client connection negotiation failed: client connection to 127.6.245.60:46787: connect: Connection refused (error 111)
18:33:44.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.210178  7282 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:33:44.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.211037  7282 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:33:44.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.211889  7282 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:33:44.226 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:44.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:44.252096  7280 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } attempt: 4
18:33:44.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.254601  7282 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:33:44.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.255064  7282 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:33:44.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.255483  7282 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:33:44.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.255906  7282 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:33:44.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.256321  7282 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:33:44.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.256618  7282 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36899/jwks.json
18:33:44.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.258347  7280 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.60:46787: Network error: Client connection negotiation failed: client connection to 127.6.245.60:46787: connect: Connection refused (error 111)
18:33:44.276 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:44.276 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:44.276 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:44.276 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.277 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.277 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.277 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.277 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.277 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.277 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.277 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.277 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.277 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:44.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:44.304395  7282 master_runner.cc:387] Master server non-default flags:
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.245.20:33853
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/data
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/wal
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.6.245.62:36853,127.6.245.61:44495,127.6.245.60:46787
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.245.60:46787
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36899/jwks.json
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/data/info.pb
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.245.60
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/logs
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:33:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:33:44.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:44.305986  7282 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:33:44.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:44.308140  7282 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:33:44.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.321612  7294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:44.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:44.341794  7204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } attempt: 4
18:33:44.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.349493  7204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.60:46787: Network error: Client connection negotiation failed: client connection to 127.6.245.60:46787: connect: Connection refused (error 111)
18:33:44.439 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:44.440 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:44.440 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:44.440 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.440 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.440 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.443 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.443 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.443 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.443 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.443 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.443 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.443 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:44.468 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:44.468 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:44.468 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:44.469 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.469 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.469 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.470 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.470 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.470 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.470 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.470 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.470 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.470 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:44.471 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28674), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [7ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [9ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [10ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [10ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [42ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [43ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [75ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [79ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [80ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [81ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [481ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [543ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [543ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [641ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [641ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [642ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1140ms] refreshing cache from master, [1140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1143ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [5241ms] refreshing cache from master, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [5242ms] too many traces: truncated at 100 traces, deferred=Deferred@812642613(state=PENDING, result=null, callback=(continuation of Deferred@1321281013 after retry RPC after error@2021141039) -> (continuation of Deferred@951533374 after retry RPC after error@1998489412) -> (continuation of Deferred@817359583 after retry RPC after error@153589684) -> (continuation of Deferred@149423969 after retry RPC after error@189760927) -> (continuation of Deferred@69297979 after retry RPC after error@823052860) -> (continuation of Deferred@2039808115 after retry RPC after error@234946979) -> (continuation of Deferred@18261991 after retry RPC after error@1183765203) -> (continuation of Deferred@390710505 after retry RPC after error@289653690) -> (continuation of Deferred@635332586 after retry RPC after error@360067528) -> (continuation of Deferred@1287766275 after retry RPC after error@1125156146) -> (continuation of Deferred@354896781 after retry RPC after error@838582416) -> (continuation of Deferred@1936774773 after retry RPC after error@873395260) -> (continuation of Deferred@458926611 after retry RPC after error@1951012520) -> (continuation of Deferred@24950058 after retry RPC after error@1116737069) -> (continuation of Deferred@206847582 after retry RPC after error@672106026) -> (continuation of Deferred@1279177700 after retry RPC after error@236793128) -> (continuation of Deferred@597050491 after retry RPC after error@2013047029) -> (continuation of Deferred@1315214461 after retry RPC after error@704087284) -> (continuation of Deferred@953399341 after retry RPC after error@721028290) -> (continuation of Deferred@1079487132 after retry RPC after error@1435649606) -> (continuation of Deferred@1881513481 after retry RPC after error@176380123) -> (continuation of Deferred@2013073501 after retry RPC after error@807061650), errback=(continuation of Deferred@1321281013 after retry RPC after error@2021141039) -> (continuation of Deferred@951533374 after retry RPC after error@1998489412) -> (continuation of Deferred@817359583 after retry RPC after error@153589684) -> (continuation of Deferred@149423969 after retry RPC after error@189760927) -> (continuation of Deferred@69297979 after retry RPC after error@823052860) -> (continuation of Deferred@2039808115 after retry RPC after error@234946979) -> (continuation of Deferred@18261991 after retry RPC after error@1183765203) -> (continuation of Deferred@390710505 after retry RPC after error@289653690) -> (continuation of Deferred@635332586 after retry RPC after error@360067528) -> (continuation of Deferred@1287766275 after retry RPC after error@1125156146) -> (continuation of Deferred@354896781 after retry RPC after error@838582416) -> (continuation of Deferred@1936774773 after retry RPC after error@873395260) -> (continuation of Deferred@458926611 after retry RPC after error@1951012520) -> (continuation of Deferred@24950058 after retry RPC after error@1116737069) -> (continuation of Deferred@206847582 after retry RPC after error@672106026) -> (continuation of Deferred@1279177700 after retry RPC after error@236793128) -> (continuation of Deferred@597050491 after retry RPC after error@2013047029) -> (continuation of Deferred@1315214461 after retry RPC after error@704087284) -> (continuation of Deferred@953399341 after retry RPC after error@721028290) -> (continuation of Deferred@1079487132 after retry RPC after error@1435649606) -> (continuation of Deferred@1881513481 after retry RPC after error@176380123) -> (continuation of Deferred@2013073501 after retry RPC after error@807061650)))
18:33:44.472 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:44.472 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:44.472 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:44.473 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28674), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [7ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [9ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [10ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [10ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [42ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [43ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [75ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [79ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [80ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [81ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [481ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [543ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [543ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [641ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [641ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [642ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1140ms] refreshing cache from master, [1140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1143ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [5241ms] refreshing cache from master, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [5242ms] too many traces: truncated at 100 traces, deferred=Deferred@812642613(state=PENDING, result=null, callback=(continuation of Deferred@1321281013 after retry RPC after error@2021141039) -> (continuation of Deferred@951533374 after retry RPC after error@1998489412) -> (continuation of Deferred@817359583 after retry RPC after error@153589684) -> (continuation of Deferred@149423969 after retry RPC after error@189760927) -> (continuation of Deferred@69297979 after retry RPC after error@823052860) -> (continuation of Deferred@2039808115 after retry RPC after error@234946979) -> (continuation of Deferred@18261991 after retry RPC after error@1183765203) -> (continuation of Deferred@390710505 after retry RPC after error@289653690) -> (continuation of Deferred@635332586 after retry RPC after error@360067528) -> (continuation of Deferred@1287766275 after retry RPC after error@1125156146) -> (continuation of Deferred@354896781 after retry RPC after error@838582416) -> (continuation of Deferred@1936774773 after retry RPC after error@873395260) -> (continuation of Deferred@458926611 after retry RPC after error@1951012520) -> (continuation of Deferred@24950058 after retry RPC after error@1116737069) -> (continuation of Deferred@206847582 after retry RPC after error@672106026) -> (continuation of Deferred@1279177700 after retry RPC after error@236793128) -> (continuation of Deferred@597050491 after retry RPC after error@2013047029) -> (continuation of Deferred@1315214461 after retry RPC after error@704087284) -> (continuation of Deferred@953399341 after retry RPC after error@721028290) -> (continuation of Deferred@1079487132 after retry RPC after error@1435649606) -> (continuation of Deferred@1881513481 after retry RPC after error@176380123) -> (continuation of Deferred@2013073501 after retry RPC after error@807061650), errback=(continuation of Deferred@1321281013 after retry RPC after error@2021141039) -> (continuation of Deferred@951533374 after retry RPC after error@1998489412) -> (continuation of Deferred@817359583 after retry RPC after error@153589684) -> (continuation of Deferred@149423969 after retry RPC after error@189760927) -> (continuation of Deferred@69297979 after retry RPC after error@823052860) -> (continuation of Deferred@2039808115 after retry RPC after error@234946979) -> (continuation of Deferred@18261991 after retry RPC after error@1183765203) -> (continuation of Deferred@390710505 after retry RPC after error@289653690) -> (continuation of Deferred@635332586 after retry RPC after error@360067528) -> (continuation of Deferred@1287766275 after retry RPC after error@1125156146) -> (continuation of Deferred@354896781 after retry RPC after error@838582416) -> (continuation of Deferred@1936774773 after retry RPC after error@873395260) -> (continuation of Deferred@458926611 after retry RPC after error@1951012520) -> (continuation of Deferred@24950058 after retry RPC after error@1116737069) -> (continuation of Deferred@206847582 after retry RPC after error@672106026) -> (continuation of Deferred@1279177700 after retry RPC after error@236793128) -> (continuation of Deferred@597050491 after retry RPC after error@2013047029) -> (continuation of Deferred@1315214461 after retry RPC after error@704087284) -> (continuation of Deferred@953399341 after retry RPC after error@721028290) -> (continuation of Deferred@1079487132 after retry RPC after error@1435649606) -> (continuation of Deferred@1881513481 after retry RPC after error@176380123) -> (continuation of Deferred@2013073501 after retry RPC after error@807061650)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28674), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [7ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [9ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [10ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [10ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [42ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [43ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [75ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [79ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [80ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [81ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [481ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [543ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [543ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [641ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [641ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [642ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1140ms] refreshing cache from master, [1140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1143ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [5241ms] refreshing cache from master, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [5242ms] too many traces: truncated at 100 traces, deferred=Deferred@812642613(state=PENDING, result=null, callback=(continuation of Deferred@1321281013 after retry RPC after error@2021141039) -> (continuation of Deferred@951533374 after retry RPC after error@1998489412) -> (continuation of Deferred@817359583 after retry RPC after error@153589684) -> (continuation of Deferred@149423969 after retry RPC after error@189760927) -> (continuation of Deferred@69297979 after retry RPC after error@823052860) -> (continuation of Deferred@2039808115 after retry RPC after error@234946979) -> (continuation of Deferred@18261991 after retry RPC after error@1183765203) -> (continuation of Deferred@390710505 after retry RPC after error@289653690) -> (continuation of Deferred@635332586 after retry RPC after error@360067528) -> (continuation of Deferred@1287766275 after retry RPC after error@1125156146) -> (continuation of Deferred@354896781 after retry RPC after error@838582416) -> (continuation of Deferred@1936774773 after retry RPC after error@873395260) -> (continuation of Deferred@458926611 after retry RPC after error@1951012520) -> (continuation of Deferred@24950058 after retry RPC after error@1116737069) -> (continuation of Deferred@206847582 after retry RPC after error@672106026) -> (continuation of Deferred@1279177700 after retry RPC after error@236793128) -> (continuation of Deferred@597050491 after retry RPC after error@2013047029) -> (continuation of Deferred@1315214461 after retry RPC after error@704087284) -> (continuation of Deferred@953399341 after retry RPC after error@721028290) -> (continuation of Deferred@1079487132 after retry RPC after error@1435649606) -> (continuation of Deferred@1881513481 after retry RPC after error@176380123) -> (continuation of Deferred@2013073501 after retry RPC after error@807061650), errback=(continuation of Deferred@1321281013 after retry RPC after error@2021141039) -> (continuation of Deferred@951533374 after retry RPC after error@1998489412) -> (continuation of Deferred@817359583 after retry RPC after error@153589684) -> (continuation of Deferred@149423969 after retry RPC after error@189760927) -> (continuation of Deferred@69297979 after retry RPC after error@823052860) -> (continuation of Deferred@2039808115 after retry RPC after error@234946979) -> (continuation of Deferred@18261991 after retry RPC after error@1183765203) -> (continuation of Deferred@390710505 after retry RPC after error@289653690) -> (continuation of Deferred@635332586 after retry RPC after error@360067528) -> (continuation of Deferred@1287766275 after retry RPC after error@1125156146) -> (continuation of Deferred@354896781 after retry RPC after error@838582416) -> (continuation of Deferred@1936774773 after retry RPC after error@873395260) -> (continuation of Deferred@458926611 after retry RPC after error@1951012520) -> (continuation of Deferred@24950058 after retry RPC after error@1116737069) -> (continuation of Deferred@206847582 after retry RPC after error@672106026) -> (continuation of Deferred@1279177700 after retry RPC after error@236793128) -> (continuation of Deferred@597050491 after retry RPC after error@2013047029) -> (continuation of Deferred@1315214461 after retry RPC after error@704087284) -> (continuation of Deferred@953399341 after retry RPC after error@721028290) -> (continuation of Deferred@1079487132 after retry RPC after error@1435649606) -> (continuation of Deferred@1881513481 after retry RPC after error@176380123) -> (continuation of Deferred@2013073501 after retry RPC after error@807061650)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.11.253:35677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:44.474 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.474 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.474 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.475 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.475 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.475 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.475 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.475 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.475 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.475 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:44.478 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28674), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [7ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [9ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [10ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [10ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [42ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [43ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [75ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [79ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [80ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [81ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [481ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [543ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [543ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [641ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [641ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [642ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1140ms] refreshing cache from master, [1140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1143ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [5241ms] refreshing cache from master, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [5242ms] too many traces: truncated at 100 traces, deferred=Deferred@812642613(state=PENDING, result=null, callback=(continuation of Deferred@1321281013 after retry RPC after error@2021141039) -> (continuation of Deferred@951533374 after retry RPC after error@1998489412) -> (continuation of Deferred@817359583 after retry RPC after error@153589684) -> (continuation of Deferred@149423969 after retry RPC after error@189760927) -> (continuation of Deferred@69297979 after retry RPC after error@823052860) -> (continuation of Deferred@2039808115 after retry RPC after error@234946979) -> (continuation of Deferred@18261991 after retry RPC after error@1183765203) -> (continuation of Deferred@390710505 after retry RPC after error@289653690) -> (continuation of Deferred@635332586 after retry RPC after error@360067528) -> (continuation of Deferred@1287766275 after retry RPC after error@1125156146) -> (continuation of Deferred@354896781 after retry RPC after error@838582416) -> (continuation of Deferred@1936774773 after retry RPC after error@873395260) -> (continuation of Deferred@458926611 after retry RPC after error@1951012520) -> (continuation of Deferred@24950058 after retry RPC after error@1116737069) -> (continuation of Deferred@206847582 after retry RPC after error@672106026) -> (continuation of Deferred@1279177700 after retry RPC after error@236793128) -> (continuation of Deferred@597050491 after retry RPC after error@2013047029) -> (continuation of Deferred@1315214461 after retry RPC after error@704087284) -> (continuation of Deferred@953399341 after retry RPC after error@721028290) -> (continuation of Deferred@1079487132 after retry RPC after error@1435649606) -> (continuation of Deferred@1881513481 after retry RPC after error@176380123) -> (continuation of Deferred@2013073501 after retry RPC after error@807061650), errback=(continuation of Deferred@1321281013 after retry RPC after error@2021141039) -> (continuation of Deferred@951533374 after retry RPC after error@1998489412) -> (continuation of Deferred@817359583 after retry RPC after error@153589684) -> (continuation of Deferred@149423969 after retry RPC after error@189760927) -> (continuation of Deferred@69297979 after retry RPC after error@823052860) -> (continuation of Deferred@2039808115 after retry RPC after error@234946979) -> (continuation of Deferred@18261991 after retry RPC after error@1183765203) -> (continuation of Deferred@390710505 after retry RPC after error@289653690) -> (continuation of Deferred@635332586 after retry RPC after error@360067528) -> (continuation of Deferred@1287766275 after retry RPC after error@1125156146) -> (continuation of Deferred@354896781 after retry RPC after error@838582416) -> (continuation of Deferred@1936774773 after retry RPC after error@873395260) -> (continuation of Deferred@458926611 after retry RPC after error@1951012520) -> (continuation of Deferred@24950058 after retry RPC after error@1116737069) -> (continuation of Deferred@206847582 after retry RPC after error@672106026) -> (continuation of Deferred@1279177700 after retry RPC after error@236793128) -> (continuation of Deferred@597050491 after retry RPC after error@2013047029) -> (continuation of Deferred@1315214461 after retry RPC after error@704087284) -> (continuation of Deferred@953399341 after retry RPC after error@721028290) -> (continuation of Deferred@1079487132 after retry RPC after error@1435649606) -> (continuation of Deferred@1881513481 after retry RPC after error@176380123) -> (continuation of Deferred@2013073501 after retry RPC after error@807061650)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28674), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [7ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [9ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [10ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [10ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [42ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [43ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [75ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [79ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [80ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [81ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [481ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [543ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [543ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [641ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [641ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [642ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [642ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1140ms] refreshing cache from master, [1140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1143ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [5241ms] refreshing cache from master, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [5241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [5242ms] too many traces: truncated at 100 traces, deferred=Deferred@812642613(state=PENDING, result=null, callback=(continuation of Deferred@1321281013 after retry RPC after error@2021141039) -> (continuation of Deferred@951533374 after retry RPC after error@1998489412) -> (continuation of Deferred@817359583 after retry RPC after error@153589684) -> (continuation of Deferred@149423969 after retry RPC after error@189760927) -> (continuation of Deferred@69297979 after retry RPC after error@823052860) -> (continuation of Deferred@2039808115 after retry RPC after error@234946979) -> (continuation of Deferred@18261991 after retry RPC after error@1183765203) -> (continuation of Deferred@390710505 after retry RPC after error@289653690) -> (continuation of Deferred@635332586 after retry RPC after error@360067528) -> (continuation of Deferred@1287766275 after retry RPC after error@1125156146) -> (continuation of Deferred@354896781 after retry RPC after error@838582416) -> (continuation of Deferred@1936774773 after retry RPC after error@873395260) -> (continuation of Deferred@458926611 after retry RPC after error@1951012520) -> (continuation of Deferred@24950058 after retry RPC after error@1116737069) -> (continuation of Deferred@206847582 after retry RPC after error@672106026) -> (continuation of Deferred@1279177700 after retry RPC after error@236793128) -> (continuation of Deferred@597050491 after retry RPC after error@2013047029) -> (continuation of Deferred@1315214461 after retry RPC after error@704087284) -> (continuation of Deferred@953399341 after retry RPC after error@721028290) -> (continuation of Deferred@1079487132 after retry RPC after error@1435649606) -> (continuation of Deferred@1881513481 after retry RPC after error@176380123) -> (continuation of Deferred@2013073501 after retry RPC after error@807061650), errback=(continuation of Deferred@1321281013 after retry RPC after error@2021141039) -> (continuation of Deferred@951533374 after retry RPC after error@1998489412) -> (continuation of Deferred@817359583 after retry RPC after error@153589684) -> (continuation of Deferred@149423969 after retry RPC after error@189760927) -> (continuation of Deferred@69297979 after retry RPC after error@823052860) -> (continuation of Deferred@2039808115 after retry RPC after error@234946979) -> (continuation of Deferred@18261991 after retry RPC after error@1183765203) -> (continuation of Deferred@390710505 after retry RPC after error@289653690) -> (continuation of Deferred@635332586 after retry RPC after error@360067528) -> (continuation of Deferred@1287766275 after retry RPC after error@1125156146) -> (continuation of Deferred@354896781 after retry RPC after error@838582416) -> (continuation of Deferred@1936774773 after retry RPC after error@873395260) -> (continuation of Deferred@458926611 after retry RPC after error@1951012520) -> (continuation of Deferred@24950058 after retry RPC after error@1116737069) -> (continuation of Deferred@206847582 after retry RPC after error@672106026) -> (continuation of Deferred@1279177700 after retry RPC after error@236793128) -> (continuation of Deferred@597050491 after retry RPC after error@2013047029) -> (continuation of Deferred@1315214461 after retry RPC after error@704087284) -> (continuation of Deferred@953399341 after retry RPC after error@721028290) -> (continuation of Deferred@1079487132 after retry RPC after error@1435649606) -> (continuation of Deferred@1881513481 after retry RPC after error@176380123) -> (continuation of Deferred@2013073501 after retry RPC after error@807061650)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.11.253:35677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:44.478 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:33:44.479 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:44.479 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:44.479 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:44.480 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.480 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.480 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.480 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.480 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.480 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.481 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.481 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.481 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.481 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:44.488 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:44.488 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:44.488 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:44.488 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.489 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.489 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.489 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.489 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.489 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.489 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.489 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.490 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.490 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:44.508 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:44.509 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:44.509 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:44.509 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.509 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.509 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.510 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.510 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.510 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.510 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.510 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.510 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.510 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:44.514 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:44.515 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:44.515 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:44.515 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:44.515 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:44.515 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:44.515 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:44.516 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:44.516 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:44.516 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:44.516 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:44.516 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:44.516 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:44.533 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:44.534 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:44.534 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:44.534 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:44.534 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:44.534 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:44.535 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:44.535 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:44.535 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:44.538 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:44.538 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:44.538 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:44.538 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:44.539 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:44.539 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:44.539 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:44.539 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.540 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.540 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.540 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.540 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.540 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.540 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.540 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.543 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.543 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:44.548 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:44.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:44.557798  7280 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } attempt: 5
18:33:44.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.564749  7280 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.60:46787: Network error: Client connection negotiation failed: client connection to 127.6.245.60:46787: connect: Connection refused (error 111)
18:33:44.568 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:44.568 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:44.568 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:44.569 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.569 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.569 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.569 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.569 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.569 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.569 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.569 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.569 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.569 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:44.594 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:44.608 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:44.608 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:44.608 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:44.608 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.609 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.609 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.609 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.609 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.609 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.609 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.609 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.609 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.609 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:44.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:44.632936  7204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } attempt: 5
18:33:44.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.640280  7204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.60:46787: Network error: Client connection negotiation failed: client connection to 127.6.245.60:46787: connect: Connection refused (error 111)
18:33:44.646 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535624646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:44.655 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:44.655 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:44.655 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:44.656 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.656 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.656 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.656 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.656 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.656 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.656 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.656 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.656 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.656 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:44.659 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:33:44.662 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
18:33:44.669 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:44.669 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:44.669 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:44.669 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.669 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.669 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.669 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.669 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.669 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.670 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.670 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.670 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.670 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:44.691 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:44.691 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:44.691 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:44.691 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:44.691 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:44.691 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:44.691 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:44.692 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:44.692 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:44.692 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:44.692 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:44.692 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:44.692 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:44.701 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:44.701 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:44.702 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:44.702 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.702 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.702 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.703 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.703 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.703 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.703 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.703 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.703 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.703 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:44.727 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:44.769 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:44.769 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:44.769 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:44.769 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.770 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.770 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.770 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:44.770 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.770 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.770 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:44.770 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.771 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:44.771 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:44.858 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:44.858 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:44.858 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:44.859 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.859 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.859 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:44.859 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.859 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.860 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:44.860 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.860 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.860 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:44.860 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:44.867 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:44.867 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:44.867 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:44.868 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:44.868 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:44.868 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:44.868 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:44.868 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:44.868 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:44.869 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:44.869 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:44.869 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:44.869 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:44.916 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:44.916 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:44.916 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:44.916 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:44.916 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:44.916 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:44.916 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:44.916 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:44.916 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:44.917 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:44.917 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:44.917 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:44.917 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:45.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:45.048 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:45.049 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:45.049 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:45.049 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:45.049 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:45.049 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:45.050 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:45.050 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:45.050 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:45.051 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:45.051 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:45.051 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:45.051 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:45.095 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:45.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.112283  7280 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } attempt: 6
18:33:45.144 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:45.144 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:45.144 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:45.145 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:45.145 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:45.145 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:45.146 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:45.146 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:45.146 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:45.146 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:45.146 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:45.146 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:45.147 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:45.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535625146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:45.157 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:33:45.159 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
18:33:45.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:45.162128  7280 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.60:46787: Network error: Client connection negotiation failed: client connection to 127.6.245.60:46787: connect: Connection refused (error 111)
18:33:45.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.192772  7204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } attempt: 6
18:33:45.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:45.225546  7204 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.245.60:46787: Network error: Client connection negotiation failed: client connection to 127.6.245.60:46787: connect: Connection refused (error 111)
18:33:45.226 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:45.251 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:45.251 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:45.251 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:45.252 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:45.252 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:45.252 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:45.252 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:45.252 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:45.252 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:45.252 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:45.252 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:45.252 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:45.252 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:45.335 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:45.335 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:45.335 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:45.336 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:45.336 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:45.336 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:45.336 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:45.336 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:45.336 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:45.336 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:45.337 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:45.337 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:45.337 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:45.337 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:45.337 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:45.337 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:45.337 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:45.337 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:45.337 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:45.338 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:45.338 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:45.338 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:45.338 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:45.338 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:45.339 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:45.339 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:45.416 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:45.416 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:45.416 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:45.416 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:45.417 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:45.417 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:45.416 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:45.417 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:45.417 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:45.417 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:45.417 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:45.417 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:45.417 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:45.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:45.552 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:45.552 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:45.552 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:45.552 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:45.552 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:45.552 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:45.552 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:45.552 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:45.552 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:45.553 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:45.553 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:45.553 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:45.553 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:45.595 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:45.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535625646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:45.657 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:33:45.658 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
18:33:45.727 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:45.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:45.725399  7293 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 7282
18:33:45.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:44.323405  7295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:45.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:45.880409  7282 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.560s	user 0.571s	sys 0.918s
18:33:45.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:45.880815  7282 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.560s	user 0.571s	sys 0.918s
18:33:45.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.890134  7282 server_base.cc:1061] running on GCE node
18:33:45.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:45.890300  7302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:45.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.891659  7282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:33:45.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.894098  7282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:33:45.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.895498  7282 hybrid_clock.cc:648] HybridClock initialized: now 1783535625895455 us; error 37 us; skew 500 ppm
18:33:45.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.896425  7282 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:33:45.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.902729  7282 webserver.cc:534] Webserver started at http://127.6.245.60:40801/ using document root <none> and password file <none>
18:33:45.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.903991  7282 fs_manager.cc:362] Metadata directory not provided
18:33:45.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.904207  7282 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:33:45.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.904623  7282 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:33:45.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.909292  7282 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/data/instance:
18:33:45.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "87fa3cf87af5433c8c0eeecae2dbf25e"
18:33:45.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:45 on dist-test-slave-dxnw"
18:33:45.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.910367  7282 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/wal/instance:
18:33:45.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "87fa3cf87af5433c8c0eeecae2dbf25e"
18:33:45.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:45 on dist-test-slave-dxnw"
18:33:45.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.918390  7282 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
18:33:45.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.924911  7308 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:33:45.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.926174  7282 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
18:33:45.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.926479  7282 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/wal
18:33:45.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "87fa3cf87af5433c8c0eeecae2dbf25e"
18:33:45.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:45 on dist-test-slave-dxnw"
18:33:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.926895  7282 fs_report.cc:389] FS layout report
18:33:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:33:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/wal
18:33:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/wal
18:33:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/data/data
18:33:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:33:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:33:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:33:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:33:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:33:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:33:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:33:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:33:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:33:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:33:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:33:45.990 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:45.991 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:45.991 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:45.991 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:45.991 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:45.991 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:45.991 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:45.991 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:45.991 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:45.991 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:45.991 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:45.991 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:45.991 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:45.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.997429  7282 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:33:45.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.999159  7282 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:33:45.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:45.999639  7282 kserver.cc:163] Server-wide thread pool size limit: 3276
18:33:46.028 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:46.028 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:46.029 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:46.029 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:46.029 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:46.029 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:46.029 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:46.029 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:46.029 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:46.029 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:46.029 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:46.030 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:46.030 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:46.045 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:46.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.084270  7282 rpc_server.cc:307] RPC server started. Bound to: 127.6.245.60:46787
18:33:46.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.084354  7359 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.245.60:46787 every 8 connection(s)
18:33:46.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.087775  7282 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/data/info.pb
18:33:46.095 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:46.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.094991  7360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:46.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.096561  7124 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 7282
18:33:46.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.097085  7124 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/master-2/wal/instance
18:33:46.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.113843  7360 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } has no permanent_uuid. Determining permanent_uuid...
18:33:46.134 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:46.135 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:46.135 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:46.135 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:46.135 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:46.135 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:46.135 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:46.135 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:46.135 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:46.136 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:46.136 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:46.136 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:46.136 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:46.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.145246  7360 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } has no permanent_uuid. Determining permanent_uuid...
18:33:46.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535626146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:46.155 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
18:33:46.155 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
18:33:46.158 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:46.158 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:46.158 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:46.158 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:46.158 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:46.158 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:46.158 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:46.158 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:46.159 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:46.159 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:46.159 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:46.159 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:46.159 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:46.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.164388  7360 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } has no permanent_uuid. Determining permanent_uuid...
18:33:46.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.185333  7360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e: Bootstrap starting.
18:33:46.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.193897  7360 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e: Neither blocks nor log segments found. Creating new log.
18:33:46.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.196116  7360 log.cc:826] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e: Log is configured to *not* fsync() on all Append() calls
18:33:46.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.201835  7360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e: No bootstrap required, opened a new log
18:33:46.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.222746  7280 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } attempt: 7
18:33:46.227 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:46.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.237352  7360 raft_consensus.cc:359] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } }
18:33:46.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.238308  7360 raft_consensus.cc:385] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:46.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.238648  7360 raft_consensus.cc:740] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87fa3cf87af5433c8c0eeecae2dbf25e, State: Initialized, Role: FOLLOWER
18:33:46.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.239704  7360 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } }
18:33:46.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.247386  7280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b: Bootstrap starting.
18:33:46.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.253968  7370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } } }
18:33:46.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:46.255692  7314 tablet.cc:2406] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:33:46.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.256379  7360 sys_catalog.cc:565] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [sys.catalog]: configured and running, proceeding with master startup.
18:33:46.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.257421  7370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [sys.catalog]: This master's current role is: FOLLOWER
18:33:46.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.258471  7280 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b: Neither blocks nor log segments found. Creating new log.
18:33:46.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.258996  7204 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } attempt: 7
18:33:46.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.261795  7280 log.cc:826] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b: Log is configured to *not* fsync() on all Append() calls
18:33:46.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.272222  7280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b: No bootstrap required, opened a new log
18:33:46.276 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:46.277 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:46.277 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:46.277 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:46.277 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:46.277 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:46.278 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:46.278 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:46.278 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:46.278 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:46.278 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:46.278 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:46.278 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:46.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.301627  7204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c: Bootstrap starting.
18:33:46.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.311148  7204 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c: Neither blocks nor log segments found. Creating new log.
18:33:46.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.313198  7280 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } }
18:33:46.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.313988  7204 log.cc:826] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c: Log is configured to *not* fsync() on all Append() calls
18:33:46.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.314193  7280 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:46.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.314651  7280 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8578841b721446e1824b2561386baa9b, State: Initialized, Role: FOLLOWER
18:33:46.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.316073  7280 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } }
18:33:46.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:46.329569  7383 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:33:46.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:46.330015  7383 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:33:46.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.336946  7204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c: No bootstrap required, opened a new log
18:33:46.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.337236  7280 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b [sys.catalog]: configured and running, proceeding with master startup.
18:33:46.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.340247  7385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } } }
18:33:46.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.342294  7385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b [sys.catalog]: This master's current role is: FOLLOWER
18:33:46.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.312069  7282 master_runner.cc:187] Error getting master registration for 127.6.245.62:36853: OK, instance_id { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" instance_seqno: 1783535621486247 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:33:46.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.346897  7282 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:33:46.348 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:46.348 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:46.348 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:46.349 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:46.349 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:46.349 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:46.349 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:46.349 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:46.349 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:46.350 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:46.350 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:46.350 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:46.350 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:46.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:46.371958  7234 tablet.cc:2406] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:33:46.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.384970  7204 raft_consensus.cc:359] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } }
18:33:46.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.393237  7204 raft_consensus.cc:385] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:33:46.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.393730  7204 raft_consensus.cc:740] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49a9fbba28f94c37a34f0113f2cfdc5c, State: Initialized, Role: FOLLOWER
18:33:46.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.395151  7204 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } }
18:33:46.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:46.403738  7397 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:33:46.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:46.404048  7397 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:33:46.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.412235  7399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } } }
18:33:46.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.413157  7399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c [sys.catalog]: This master's current role is: FOLLOWER
18:33:46.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.385775  7206 master_runner.cc:187] Error getting master registration for 127.6.245.62:36853: OK, instance_id { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" instance_seqno: 1783535621486247 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:33:46.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.417295  7206 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:33:46.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.419942  7204 sys_catalog.cc:565] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c [sys.catalog]: configured and running, proceeding with master startup.
18:33:46.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:46.423933  7158 tablet.cc:2406] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:33:46.430 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:46.431 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:46.431 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:46.431 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:46.431 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:46.431 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:46.431 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:46.431 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:46.431 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:46.432 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:46.432 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:46.432 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:46.432 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:46.443 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:46.444 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:46.444 [DEBUG - pool-312-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:46.444 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:46.444 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:46.444 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:46.444 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:46.444 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:46.444 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:46.444 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:46.444 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:46.444 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:46.444 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:46.445 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26556), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [34ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [35ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [35ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [36ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [52ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [52ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [72ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [75ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [75ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [75ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [202ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [301ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [302ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [462ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [462ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [463ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [463ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [822ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [822ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [823ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [823ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1020ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1022ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2840ms] refreshing cache from master, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2841ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2841ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2841ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2841ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [5701ms] refreshing cache from master, [5701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [5701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [5701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [5702ms] too many traces: truncated at 100 traces, deferred=Deferred@1689986379(state=PENDING, result=null, callback=(continuation of Deferred@308550315 after retry RPC after error@392902948) -> (continuation of Deferred@1594787917 after retry RPC after error@1646423962) -> (continuation of Deferred@1344372791 after retry RPC after error@508375310) -> (continuation of Deferred@891981418 after retry RPC after error@1149598186) -> (continuation of Deferred@418998645 after retry RPC after error@1875635749) -> (continuation of Deferred@242447464 after retry RPC after error@1633031781) -> (continuation of Deferred@842492411 after retry RPC after error@37552990) -> (continuation of Deferred@393799493 after retry RPC after error@1179397873) -> (continuation of Deferred@1329459058 after retry RPC after error@636498488) -> (continuation of Deferred@1977789196 after retry RPC after error@1392388327) -> (continuation of Deferred@1914178485 after retry RPC after error@1448973884) -> (continuation of Deferred@906489136 after retry RPC after error@362631687) -> (continuation of Deferred@661300898 after retry RPC after error@490485765) -> (continuation of Deferred@349907199 after retry RPC after error@1806257417) -> (continuation of Deferred@428124520 after retry RPC after error@1694778957) -> (continuation of Deferred@676660930 after retry RPC after error@162912196) -> (continuation of Deferred@893837427 after retry RPC after error@1916268216) -> (continuation of Deferred@1918141738 after retry RPC after error@1433954131) -> (continuation of Deferred@1472151799 after retry RPC after error@447751830) -> (continuation of Deferred@1285262655 after retry RPC after error@1523529984) -> (continuation of Deferred@2010804822 after retry RPC after error@1824882349) -> (continuation of Deferred@2091381887 after retry RPC after error@1602475474), errback=(continuation of Deferred@308550315 after retry RPC after error@392902948) -> (continuation of Deferred@1594787917 after retry RPC after error@1646423962) -> (continuation of Deferred@1344372791 after retry RPC after error@508375310) -> (continuation of Deferred@891981418 after retry RPC after error@1149598186) -> (continuation of Deferred@418998645 after retry RPC after error@1875635749) -> (continuation of Deferred@242447464 after retry RPC after error@1633031781) -> (continuation of Deferred@842492411 after retry RPC after error@37552990) -> (continuation of Deferred@393799493 after retry RPC after error@1179397873) -> (continuation of Deferred@1329459058 after retry RPC after error@636498488) -> (continuation of Deferred@1977789196 after retry RPC after error@1392388327) -> (continuation of Deferred@1914178485 after retry RPC after error@1448973884) -> (continuation of Deferred@906489136 after retry RPC after error@362631687) -> (continuation of Deferred@661300898 after retry RPC after error@490485765) -> (continuation of Deferred@349907199 after retry RPC after error@1806257417) -> (continuation of Deferred@428124520 after retry RPC after error@1694778957) -> (continuation of Deferred@676660930 after retry RPC after error@162912196) -> (continuation of Deferred@893837427 after retry RPC after error@1916268216) -> (continuation of Deferred@1918141738 after retry RPC after error@1433954131) -> (continuation of Deferred@1472151799 after retry RPC after error@447751830) -> (continuation of Deferred@1285262655 after retry RPC after error@1523529984) -> (continuation of Deferred@2010804822 after retry RPC after error@1824882349) -> (continuation of Deferred@2091381887 after retry RPC after error@1602475474)))
18:33:46.446 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:33:46.446 [WARN - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26556), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [34ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [35ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [35ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [36ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [52ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [52ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [72ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [75ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [75ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [75ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [202ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [301ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [302ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [462ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [462ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [463ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [463ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [822ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [822ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [823ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [823ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1020ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1022ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2840ms] refreshing cache from master, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2841ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2841ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2841ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2841ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [5701ms] refreshing cache from master, [5701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [5701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [5701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [5702ms] too many traces: truncated at 100 traces, deferred=Deferred@1689986379(state=PENDING, result=null, callback=(continuation of Deferred@308550315 after retry RPC after error@392902948) -> (continuation of Deferred@1594787917 after retry RPC after error@1646423962) -> (continuation of Deferred@1344372791 after retry RPC after error@508375310) -> (continuation of Deferred@891981418 after retry RPC after error@1149598186) -> (continuation of Deferred@418998645 after retry RPC after error@1875635749) -> (continuation of Deferred@242447464 after retry RPC after error@1633031781) -> (continuation of Deferred@842492411 after retry RPC after error@37552990) -> (continuation of Deferred@393799493 after retry RPC after error@1179397873) -> (continuation of Deferred@1329459058 after retry RPC after error@636498488) -> (continuation of Deferred@1977789196 after retry RPC after error@1392388327) -> (continuation of Deferred@1914178485 after retry RPC after error@1448973884) -> (continuation of Deferred@906489136 after retry RPC after error@362631687) -> (continuation of Deferred@661300898 after retry RPC after error@490485765) -> (continuation of Deferred@349907199 after retry RPC after error@1806257417) -> (continuation of Deferred@428124520 after retry RPC after error@1694778957) -> (continuation of Deferred@676660930 after retry RPC after error@162912196) -> (continuation of Deferred@893837427 after retry RPC after error@1916268216) -> (continuation of Deferred@1918141738 after retry RPC after error@1433954131) -> (continuation of Deferred@1472151799 after retry RPC after error@447751830) -> (continuation of Deferred@1285262655 after retry RPC after error@1523529984) -> (continuation of Deferred@2010804822 after retry RPC after error@1824882349) -> (continuation of Deferred@2091381887 after retry RPC after error@1602475474), errback=(continuation of Deferred@308550315 after retry RPC after error@392902948) -> (continuation of Deferred@1594787917 after retry RPC after error@1646423962) -> (continuation of Deferred@1344372791 after retry RPC after error@508375310) -> (continuation of Deferred@891981418 after retry RPC after error@1149598186) -> (continuation of Deferred@418998645 after retry RPC after error@1875635749) -> (continuation of Deferred@242447464 after retry RPC after error@1633031781) -> (continuation of Deferred@842492411 after retry RPC after error@37552990) -> (continuation of Deferred@393799493 after retry RPC after error@1179397873) -> (continuation of Deferred@1329459058 after retry RPC after error@636498488) -> (continuation of Deferred@1977789196 after retry RPC after error@1392388327) -> (continuation of Deferred@1914178485 after retry RPC after error@1448973884) -> (continuation of Deferred@906489136 after retry RPC after error@362631687) -> (continuation of Deferred@661300898 after retry RPC after error@490485765) -> (continuation of Deferred@349907199 after retry RPC after error@1806257417) -> (continuation of Deferred@428124520 after retry RPC after error@1694778957) -> (continuation of Deferred@676660930 after retry RPC after error@162912196) -> (continuation of Deferred@893837427 after retry RPC after error@1916268216) -> (continuation of Deferred@1918141738 after retry RPC after error@1433954131) -> (continuation of Deferred@1472151799 after retry RPC after error@447751830) -> (continuation of Deferred@1285262655 after retry RPC after error@1523529984) -> (continuation of Deferred@2010804822 after retry RPC after error@1824882349) -> (continuation of Deferred@2091381887 after retry RPC after error@1602475474)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.43.188:36795
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:46.447 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
18:33:46.449 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
18:33:46.451 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED on b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26556), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [34ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [35ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [35ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [36ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [52ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [52ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [72ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [75ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [75ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [75ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [202ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [301ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [302ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [462ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [462ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [463ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [463ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [822ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [822ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [823ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [823ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1020ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1022ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2840ms] refreshing cache from master, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2841ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2841ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2841ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2841ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [5701ms] refreshing cache from master, [5701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [5701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [5701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [5702ms] too many traces: truncated at 100 traces, deferred=Deferred@1689986379(state=PENDING, result=null, callback=(continuation of Deferred@308550315 after retry RPC after error@392902948) -> (continuation of Deferred@1594787917 after retry RPC after error@1646423962) -> (continuation of Deferred@1344372791 after retry RPC after error@508375310) -> (continuation of Deferred@891981418 after retry RPC after error@1149598186) -> (continuation of Deferred@418998645 after retry RPC after error@1875635749) -> (continuation of Deferred@242447464 after retry RPC after error@1633031781) -> (continuation of Deferred@842492411 after retry RPC after error@37552990) -> (continuation of Deferred@393799493 after retry RPC after error@1179397873) -> (continuation of Deferred@1329459058 after retry RPC after error@636498488) -> (continuation of Deferred@1977789196 after retry RPC after error@1392388327) -> (continuation of Deferred@1914178485 after retry RPC after error@1448973884) -> (continuation of Deferred@906489136 after retry RPC after error@362631687) -> (continuation of Deferred@661300898 after retry RPC after error@490485765) -> (continuation of Deferred@349907199 after retry RPC after error@1806257417) -> (continuation of Deferred@428124520 after retry RPC after error@1694778957) -> (continuation of Deferred@676660930 after retry RPC after error@162912196) -> (continuation of Deferred@893837427 after retry RPC after error@1916268216) -> (continuation of Deferred@1918141738 after retry RPC after error@1433954131) -> (continuation of Deferred@1472151799 after retry RPC after error@447751830) -> (continuation of Deferred@1285262655 after retry RPC after error@1523529984) -> (continuation of Deferred@2010804822 after retry RPC after error@1824882349) -> (continuation of Deferred@2091381887 after retry RPC after error@1602475474), errback=(continuation of Deferred@308550315 after retry RPC after error@392902948) -> (continuation of Deferred@1594787917 after retry RPC after error@1646423962) -> (continuation of Deferred@1344372791 after retry RPC after error@508375310) -> (continuation of Deferred@891981418 after retry RPC after error@1149598186) -> (continuation of Deferred@418998645 after retry RPC after error@1875635749) -> (continuation of Deferred@242447464 after retry RPC after error@1633031781) -> (continuation of Deferred@842492411 after retry RPC after error@37552990) -> (continuation of Deferred@393799493 after retry RPC after error@1179397873) -> (continuation of Deferred@1329459058 after retry RPC after error@636498488) -> (continuation of Deferred@1977789196 after retry RPC after error@1392388327) -> (continuation of Deferred@1914178485 after retry RPC after error@1448973884) -> (continuation of Deferred@906489136 after retry RPC after error@362631687) -> (continuation of Deferred@661300898 after retry RPC after error@490485765) -> (continuation of Deferred@349907199 after retry RPC after error@1806257417) -> (continuation of Deferred@428124520 after retry RPC after error@1694778957) -> (continuation of Deferred@676660930 after retry RPC after error@162912196) -> (continuation of Deferred@893837427 after retry RPC after error@1916268216) -> (continuation of Deferred@1918141738 after retry RPC after error@1433954131) -> (continuation of Deferred@1472151799 after retry RPC after error@447751830) -> (continuation of Deferred@1285262655 after retry RPC after error@1523529984) -> (continuation of Deferred@2010804822 after retry RPC after error@1824882349) -> (continuation of Deferred@2091381887 after retry RPC after error@1602475474)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.43.188:36795
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:46.452 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:46.453 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
18:33:46.453 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
18:33:46.453 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (9de81db54be40687a2a82164db1dc50b) switched from state RUNNING to RESTARTING.
18:33:46.454 [WARN - flink-pekko.actor.default-dispatcher-7] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
18:33:46.474 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:46.474 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:46.474 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:46.474 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:46.474 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:46.475 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:46.475 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:46.475 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:46.475 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:46.474 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:46.475 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:46.475 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:46.475 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:46.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.492650  7370 raft_consensus.cc:493] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:33:46.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.493273  7370 raft_consensus.cc:515] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } }
18:33:46.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.507318  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" is_pre_election: true
18:33:46.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.508344  7179 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87fa3cf87af5433c8c0eeecae2dbf25e in term 0.
18:33:46.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.510309  7310 leader_election.cc:304] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49a9fbba28f94c37a34f0113f2cfdc5c, 87fa3cf87af5433c8c0eeecae2dbf25e; no voters: 
18:33:46.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.512737  7370 leader_election.cc:290] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49a9fbba28f94c37a34f0113f2cfdc5c (127.6.245.62:36853), 8578841b721446e1824b2561386baa9b (127.6.245.61:44495)
18:33:46.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.513293  7370 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [term 0 FOLLOWER]: Leader pre-election won for term 1
18:33:46.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.513659  7370 raft_consensus.cc:493] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:33:46.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.514053  7370 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [term 0 FOLLOWER]: Advancing to term 1
18:33:46.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.514354  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8578841b721446e1824b2561386baa9b" is_pre_election: true
18:33:46.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.515379  7255 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87fa3cf87af5433c8c0eeecae2dbf25e in term 0.
18:33:46.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.518941  7136 master_runner.cc:264] No leader master found from master 49a9fbba28f94c37a34f0113f2cfdc5c
18:33:46.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.519284  7136 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:33:46.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.537531  7370 raft_consensus.cc:515] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } }
18:33:46.543 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:46.543 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:46.543 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:46.543 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:46.543 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:46.543 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:46.543 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:46.543 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:46.544 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:46.543 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:46.544 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:46.544 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:46.544 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:46.545 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:46.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.551899  7370 leader_election.cc:290] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [CANDIDATE]: Term 1 election: Requested vote from peers 49a9fbba28f94c37a34f0113f2cfdc5c (127.6.245.62:36853), 8578841b721446e1824b2561386baa9b (127.6.245.61:44495)
18:33:46.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.553587  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8578841b721446e1824b2561386baa9b"
18:33:46.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.553716  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c"
18:33:46.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.554236  7255 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b [term 0 FOLLOWER]: Advancing to term 1
18:33:46.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.554309  7179 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c [term 0 FOLLOWER]: Advancing to term 1
18:33:46.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.563036  7255 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87fa3cf87af5433c8c0eeecae2dbf25e in term 1.
18:33:46.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.564743  7309 leader_election.cc:304] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8578841b721446e1824b2561386baa9b, 87fa3cf87af5433c8c0eeecae2dbf25e; no voters: 
18:33:46.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.566123  7370 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [term 1 FOLLOWER]: Leader election won for term 1
18:33:46.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.566955  7370 raft_consensus.cc:697] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [term 1 LEADER]: Becoming Leader. State: Replica: 87fa3cf87af5433c8c0eeecae2dbf25e, State: Running, Role: LEADER
18:33:46.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:46.566363  7410 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:33:46.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:46.567816  7410 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:33:46.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.568397  7370 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } }
18:33:46.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.568511  7179 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87fa3cf87af5433c8c0eeecae2dbf25e in term 1.
18:33:46.569 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:46.570 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:46.570 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:46.570 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:46.570 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:46.570 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:46.570 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:46.570 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:46.570 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:46.570 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:46.570 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:46.570 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:46.571 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:46.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.592689  7412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87fa3cf87af5433c8c0eeecae2dbf25e. Latest consensus state: current_term: 1 leader_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } } }
18:33:46.595 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:46.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.596625  7412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [sys.catalog]: This master's current role is: LEADER
18:33:46.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.611788  7414 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:33:46.616 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:46.616 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:46.616 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:46.617 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:46.617 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:46.617 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:46.617 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:46.617 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:46.617 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:46.618 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:46.618 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:46.618 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:46.618 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:46.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.636574  7414 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:33:46.646 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535626646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:46.658 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:33:46.659 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
18:33:46.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.676446  7255 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b [term 1 FOLLOWER]: Refusing update from remote peer 87fa3cf87af5433c8c0eeecae2dbf25e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:33:46.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.679469  7412 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:33:46.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.692991  7179 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c [term 1 FOLLOWER]: Refusing update from remote peer 87fa3cf87af5433c8c0eeecae2dbf25e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:33:46.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.694756  7412 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [LEADER]: Connected to new peer: Peer: permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:33:46.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.724540  7399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87fa3cf87af5433c8c0eeecae2dbf25e. Latest consensus state: current_term: 1 leader_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } } }
18:33:46.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.725245  7399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c [sys.catalog]: This master's current role is: FOLLOWER
18:33:46.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.726483  7385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87fa3cf87af5433c8c0eeecae2dbf25e. Latest consensus state: current_term: 1 leader_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } } }
18:33:46.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.727262  7385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b [sys.catalog]: This master's current role is: FOLLOWER
18:33:46.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.737370  7415 mvcc.cc:204] Tried to move back new op lower bound from 7305361926843154432 to 7305361926475976704. Current Snapshot: MvccSnapshot[applied={T|T < 7305361926843154432}]
18:33:46.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.743511  7416 mvcc.cc:204] Tried to move back new op lower bound from 7305361926843154432 to 7305361926475976704. Current Snapshot: MvccSnapshot[applied={T|T < 7305361926843154432}]
18:33:46.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.748286  7370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } } }
18:33:46.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.748394  7399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } } }
18:33:46.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.748988  7370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [sys.catalog]: This master's current role is: LEADER
18:33:46.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.749064  7399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c [sys.catalog]: This master's current role is: FOLLOWER
18:33:46.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.749652  7370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } } }
18:33:46.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.750278  7370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e [sys.catalog]: This master's current role is: LEADER
18:33:46.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.760088  7385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49a9fbba28f94c37a34f0113f2cfdc5c" member_type: VOTER last_known_addr { host: "127.6.245.62" port: 36853 } } peers { permanent_uuid: "8578841b721446e1824b2561386baa9b" member_type: VOTER last_known_addr { host: "127.6.245.61" port: 44495 } } peers { permanent_uuid: "87fa3cf87af5433c8c0eeecae2dbf25e" member_type: VOTER last_known_addr { host: "127.6.245.60" port: 46787 } } }
18:33:46.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.760885  7385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b [sys.catalog]: This master's current role is: FOLLOWER
18:33:46.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.780247  7414 catalog_manager.cc:1382] Generated new cluster ID: d9066e74d90a4597814200fa4a782ed0
18:33:46.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.780572  7414 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:33:46.784 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:46.784 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:46.784 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:46.784 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:46.784 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:46.784 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:46.784 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:46.785 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:46.785 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:46.785 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:46.785 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:46.785 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:46.785 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:46.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.840497  7414 catalog_manager.cc:1405] Generated new certificate authority record
18:33:46.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.842638  7414 catalog_manager.cc:1539] Loading token signing keys...
18:33:46.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.903330  7414 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 87fa3cf87af5433c8c0eeecae2dbf25e: Generated new TSK 0
18:33:46.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.904595  7414 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:33:46.915 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:46.915 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:46.915 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:46.915 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:46.915 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:46.915 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:46.916 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:46.916 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:46.916 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:46.916 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:46.916 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:46.916 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:46.916 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:46.953339  7124 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/wal
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/data
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/logs
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/data/info.pb
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:33:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.245.1:0
18:33:46.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.6.245.1
18:33:46.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.245.1
18:33:46.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:46.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.6.245.62:36853,127.6.245.61:44495,127.6.245.60:46787
18:33:46.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.245.20:33853
18:33:46.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:46.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:46.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:33:47.045 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:47.094 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:47.127 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:47.127 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:47.127 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:47.128 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:47.128 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:47.128 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:47.128 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:47.128 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:47.128 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:47.128 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:47.128 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:47.128 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:47.129 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:47.146 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535627146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:47.158 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:33:47.160 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
18:33:47.309 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:47.309 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:47.309 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:47.310 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:47.310 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:47.310 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:47.310 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:47.310 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:47.310 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:47.311 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:47.311 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:47.311 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:47.311 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:47.311 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:47.311 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:47.311 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:47.312 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:47.312 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:47.312 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:47.312 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:47.312 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:47.312 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:47.312 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:47.312 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:47.312 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:47.312 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:47.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:47.410939  7397 catalog_manager.cc:1294] Loaded cluster ID: d9066e74d90a4597814200fa4a782ed0
18:33:47.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:47.411551  7397 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b: loading cluster ID for follower catalog manager: success
18:33:47.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:47.428714  7397 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b: acquiring CA information for follower catalog manager: success
18:33:47.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:47.444074  7397 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 8578841b721446e1824b2561386baa9b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:33:47.545 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:47.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:47.574065  7410 catalog_manager.cc:1294] Loaded cluster ID: d9066e74d90a4597814200fa4a782ed0
18:33:47.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:47.574586  7410 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c: loading cluster ID for follower catalog manager: success
18:33:47.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:47.586740  7410 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c: acquiring CA information for follower catalog manager: success
18:33:47.594 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:47.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:47.606652  7410 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 49a9fbba28f94c37a34f0113f2cfdc5c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:33:47.646 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535627646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:47.656 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:33:47.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:47.676571  7424 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:33:47.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:47.677418  7424 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:33:47.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:47.679303  7424 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:33:47.692 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
18:33:47.715 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:47.716 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:47.716 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:47.717 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:47.717 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:47.717 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:47.717 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:47.717 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:47.717 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:47.718 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:47.718 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:47.718 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:47.718 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:47.725 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:47.725 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:47.725 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:47.725 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:47.725 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:47.725 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:47.726 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:47.726 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:47.726 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:47.726 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:47.726 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:47.726 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:47.726 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:47.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:47.748416  7424 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:33:47.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:47.749996  7424 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.245.1
18:33:47.799 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:47.799 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:47.799 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:47.800 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:47.800 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:47.800 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:47.800 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:47.800 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:47.800 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:47.800 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:47.800 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:47.800 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:47.800 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:47.825 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:47.825 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:47.825 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:47.825 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:47.825 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:47.825 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:47.825 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:47.825 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:47.825 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:47.826 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:47.826 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:47.826 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:47.826 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:47.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:47.827275  7424 tablet_server_runner.cc:78] Tablet server non-default flags:
18:33:47.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:47.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.245.20:33853
18:33:47.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:47.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:47.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/data
18:33:47.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/wal
18:33:47.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.245.1:0
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/data/info.pb
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.245.1
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.6.245.62:36853,127.6.245.61:44495,127.6.245.60:46787
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.6.245.1
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/logs
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:33:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:33:47.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:47.830382  7424 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:33:47.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:47.832856  7424 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:33:47.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:47.864269  7430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:47.913 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (9de81db54be40687a2a82164db1dc50b) switched from state RESTARTING to RUNNING.
18:33:47.914 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 9de81db54be40687a2a82164db1dc50b from Checkpoint 74 @ 1783535598621 for 9de81db54be40687a2a82164db1dc50b located at file:/tmp/junit13379242205642315453/checkpoints/9de81db54be40687a2a82164db1dc50b/chk-74.
18:33:47.915 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
18:33:47.915 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 74 for source Source: KuduSource to checkpoint.
18:33:47.915 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
18:33:47.917 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:33:47.918 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
18:33:47.918 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id e340c57f8743c3b4810a5f8fd9742fae
18:33:47.919 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot e340c57f8743c3b4810a5f8fd9742fae.
18:33:47.921 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id e340c57f8743c3b4810a5f8fd9742fae.
18:33:47.932 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
18:33:47.933 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
18:33:47.934 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4cc2a2b1
18:33:47.934 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:47.934 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:33:47.935 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
18:33:47.935 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
18:33:47.937 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7b0738f4
18:33:47.946 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:47.955 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:47.974 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:47.975 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:47.975 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:47.975 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:47.975 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:47.975 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:47.976 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:47.976 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:47.976 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:47.976 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:47.976 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:47.976 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:47.976 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:47.984 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:47.984 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:47.984 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:47.984 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:47.984 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:47.984 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:47.984 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:47.984 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:47.984 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:47.985 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:47.985 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:47.985 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:47.985 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:47.999 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:48.000 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.000 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.000 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.004 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:48.004 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.004 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.004 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.012 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.012 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.012 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.012 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:48.015 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:48.016 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:48.017 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.017 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.017 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.018 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:48.019 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.019 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.019 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.021 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.022 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.022 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.023 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:48.035 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:48.036 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:48.037 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.037 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.037 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.038 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:48.038 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.038 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.038 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.040 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.040 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.040 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.040 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:48.045 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:48.055 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:48.055 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:48.055 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:48.055 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.056 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.056 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.056 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.056 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.056 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.056 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.056 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.056 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.056 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:48.075 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:48.075 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:48.075 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:48.075 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.075 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.075 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.076 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.076 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.076 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.076 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.076 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.076 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.076 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:48.095 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:48.095 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:48.095 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:48.095 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:48.096 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.096 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.096 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.096 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.096 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.096 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.096 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.096 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.096 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.096 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:48.135 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:48.135 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:48.135 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:48.135 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.135 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.135 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.135 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.136 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.136 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.136 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.136 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.136 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.136 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:48.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535628146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:48.156 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:33:48.158 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
18:33:48.199 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:48.199 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:48.199 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:48.199 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:48.200 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:48.200 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:48.200 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:48.200 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:48.200 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:48.200 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:48.201 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:48.201 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:48.201 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:48.201 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:48.217 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:48.217 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:48.217 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:48.217 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.217 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.218 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.218 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.218 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.218 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.218 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.218 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.218 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.218 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:48.230 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:48.231 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:48.231 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:48.231 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:48.231 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:48.231 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:48.231 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:48.231 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:48.231 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:48.231 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:48.231 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:48.231 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:48.231 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:48.255 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:48.255 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:48.255 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:48.255 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.256 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.256 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.258 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.258 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.258 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.258 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.258 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.258 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.258 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:48.495 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:48.495 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:48.495 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:48.496 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.496 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.496 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.496 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.496 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.496 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.496 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.496 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.496 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.496 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:48.522 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:48.522 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:48.522 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:48.522 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:48.522 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:48.523 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:48.523 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:48.523 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:48.523 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:48.522 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:48.523 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:48.523 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:48.523 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:48.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:48.571 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:48.571 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:48.571 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:48.571 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:48.571 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:48.571 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:48.571 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:48.571 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:48.572 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:48.571 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:48.572 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:48.572 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:48.572 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:48.594 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:48.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535628646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:48.656 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:33:48.657 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
18:33:48.699 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:48.756 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:48.757 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:48.757 [DEBUG - pool-310-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:48.757 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.757 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.757 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.758 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.758 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.758 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.758 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.758 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.758 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.758 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:48.759 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28872), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [27ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [33ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [38ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [38ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [46ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [47ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [47ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [84ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [85ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [104ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [104ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [124ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [124ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [124ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [142ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [243ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [321ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [322ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [522ms] refreshing cache from master, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [527ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [528ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [528ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [528ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1500ms] refreshing cache from master, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1503ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2041ms] refreshing cache from master, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2042ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2042ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2043ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2043ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [3400ms] refreshing cache from master, [3400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [3401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [3401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [3402ms] too many traces: truncated at 100 traces, deferred=Deferred@28892244(state=PENDING, result=null, callback=(continuation of Deferred@1204572354 after retry RPC after error@1505163014) -> (continuation of Deferred@1072197497 after retry RPC after error@2020953772) -> (continuation of Deferred@1570396960 after retry RPC after error@872061266) -> (continuation of Deferred@1326820339 after retry RPC after error@491228307) -> (continuation of Deferred@311138112 after retry RPC after error@1969011786) -> (continuation of Deferred@401918753 after retry RPC after error@922152536) -> (continuation of Deferred@2013879889 after retry RPC after error@1747387382) -> (continuation of Deferred@1505456144 after retry RPC after error@1480507729) -> (continuation of Deferred@1794635729 after retry RPC after error@975135178) -> (continuation of Deferred@942058857 after retry RPC after error@373086069) -> (continuation of Deferred@1126228764 after retry RPC after error@49335171) -> (continuation of Deferred@263222097 after retry RPC after error@2143787693) -> (continuation of Deferred@1002155594 after retry RPC after error@1058264685) -> (continuation of Deferred@859111461 after retry RPC after error@1885660700) -> (continuation of Deferred@374071204 after retry RPC after error@927650750) -> (continuation of Deferred@753256794 after retry RPC after error@2078707420) -> (continuation of Deferred@865655035 after retry RPC after error@1378757141) -> (continuation of Deferred@1342412307 after retry RPC after error@526152353) -> (continuation of Deferred@1794518705 after retry RPC after error@1235996536) -> (continuation of Deferred@97807184 after retry RPC after error@2044844081) -> (continuation of Deferred@574218778 after retry RPC after error@897460522) -> (continuation of Deferred@324422206 after retry RPC after error@1686186037) -> (continuation of Deferred@163921805 after retry RPC after error@1295413478) -> (continuation of Deferred@1813042372 after retry RPC after error@29198835) -> (continuation of Deferred@564459294 after retry RPC after error@1600852620) -> (continuation of Deferred@901204817 after retry RPC after error@1479065093) -> (continuation of Deferred@1588772377 after retry RPC after error@1506424881), errback=(continuation of Deferred@1204572354 after retry RPC after error@1505163014) -> (continuation of Deferred@1072197497 after retry RPC after error@2020953772) -> (continuation of Deferred@1570396960 after retry RPC after error@872061266) -> (continuation of Deferred@1326820339 after retry RPC after error@491228307) -> (continuation of Deferred@311138112 after retry RPC after error@1969011786) -> (continuation of Deferred@401918753 after retry RPC after error@922152536) -> (continuation of Deferred@2013879889 after retry RPC after error@1747387382) -> (continuation of Deferred@1505456144 after retry RPC after error@1480507729) -> (continuation of Deferred@1794635729 after retry RPC after error@975135178) -> (continuation of Deferred@942058857 after retry RPC after error@373086069) -> (continuation of Deferred@1126228764 after retry RPC after error@49335171) -> (continuation of Deferred@263222097 after retry RPC after error@2143787693) -> (continuation of Deferred@1002155594 after retry RPC after error@1058264685) -> (continuation of Deferred@859111461 after retry RPC after error@1885660700) -> (continuation of Deferred@374071204 after retry RPC after error@927650750) -> (continuation of Deferred@753256794 after retry RPC after error@2078707420) -> (continuation of Deferred@865655035 after retry RPC after error@1378757141) -> (continuation of Deferred@1342412307 after retry RPC after error@526152353) -> (continuation of Deferred@1794518705 after retry RPC after error@1235996536) -> (continuation of Deferred@97807184 after retry RPC after error@2044844081) -> (continuation of Deferred@574218778 after retry RPC after error@897460522) -> (continuation of Deferred@324422206 after retry RPC after error@1686186037) -> (continuation of Deferred@163921805 after retry RPC after error@1295413478) -> (continuation of Deferred@1813042372 after retry RPC after error@29198835) -> (continuation of Deferred@564459294 after retry RPC after error@1600852620) -> (continuation of Deferred@901204817 after retry RPC after error@1479065093) -> (continuation of Deferred@1588772377 after retry RPC after error@1506424881)))
18:33:48.760 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:33:48.761 [WARN - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28872), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [27ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [33ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [38ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [38ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [46ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [47ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [47ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [84ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [85ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [104ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [104ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [124ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [124ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [124ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [142ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [243ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [321ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [322ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [522ms] refreshing cache from master, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [527ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [528ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [528ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [528ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1500ms] refreshing cache from master, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1503ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2041ms] refreshing cache from master, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2042ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2042ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2043ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2043ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [3400ms] refreshing cache from master, [3400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [3401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [3401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [3402ms] too many traces: truncated at 100 traces, deferred=Deferred@28892244(state=PENDING, result=null, callback=(continuation of Deferred@1204572354 after retry RPC after error@1505163014) -> (continuation of Deferred@1072197497 after retry RPC after error@2020953772) -> (continuation of Deferred@1570396960 after retry RPC after error@872061266) -> (continuation of Deferred@1326820339 after retry RPC after error@491228307) -> (continuation of Deferred@311138112 after retry RPC after error@1969011786) -> (continuation of Deferred@401918753 after retry RPC after error@922152536) -> (continuation of Deferred@2013879889 after retry RPC after error@1747387382) -> (continuation of Deferred@1505456144 after retry RPC after error@1480507729) -> (continuation of Deferred@1794635729 after retry RPC after error@975135178) -> (continuation of Deferred@942058857 after retry RPC after error@373086069) -> (continuation of Deferred@1126228764 after retry RPC after error@49335171) -> (continuation of Deferred@263222097 after retry RPC after error@2143787693) -> (continuation of Deferred@1002155594 after retry RPC after error@1058264685) -> (continuation of Deferred@859111461 after retry RPC after error@1885660700) -> (continuation of Deferred@374071204 after retry RPC after error@927650750) -> (continuation of Deferred@753256794 after retry RPC after error@2078707420) -> (continuation of Deferred@865655035 after retry RPC after error@1378757141) -> (continuation of Deferred@1342412307 after retry RPC after error@526152353) -> (continuation of Deferred@1794518705 after retry RPC after error@1235996536) -> (continuation of Deferred@97807184 after retry RPC after error@2044844081) -> (continuation of Deferred@574218778 after retry RPC after error@897460522) -> (continuation of Deferred@324422206 after retry RPC after error@1686186037) -> (continuation of Deferred@163921805 after retry RPC after error@1295413478) -> (continuation of Deferred@1813042372 after retry RPC after error@29198835) -> (continuation of Deferred@564459294 after retry RPC after error@1600852620) -> (continuation of Deferred@901204817 after retry RPC after error@1479065093) -> (continuation of Deferred@1588772377 after retry RPC after error@1506424881), errback=(continuation of Deferred@1204572354 after retry RPC after error@1505163014) -> (continuation of Deferred@1072197497 after retry RPC after error@2020953772) -> (continuation of Deferred@1570396960 after retry RPC after error@872061266) -> (continuation of Deferred@1326820339 after retry RPC after error@491228307) -> (continuation of Deferred@311138112 after retry RPC after error@1969011786) -> (continuation of Deferred@401918753 after retry RPC after error@922152536) -> (continuation of Deferred@2013879889 after retry RPC after error@1747387382) -> (continuation of Deferred@1505456144 after retry RPC after error@1480507729) -> (continuation of Deferred@1794635729 after retry RPC after error@975135178) -> (continuation of Deferred@942058857 after retry RPC after error@373086069) -> (continuation of Deferred@1126228764 after retry RPC after error@49335171) -> (continuation of Deferred@263222097 after retry RPC after error@2143787693) -> (continuation of Deferred@1002155594 after retry RPC after error@1058264685) -> (continuation of Deferred@859111461 after retry RPC after error@1885660700) -> (continuation of Deferred@374071204 after retry RPC after error@927650750) -> (continuation of Deferred@753256794 after retry RPC after error@2078707420) -> (continuation of Deferred@865655035 after retry RPC after error@1378757141) -> (continuation of Deferred@1342412307 after retry RPC after error@526152353) -> (continuation of Deferred@1794518705 after retry RPC after error@1235996536) -> (continuation of Deferred@97807184 after retry RPC after error@2044844081) -> (continuation of Deferred@574218778 after retry RPC after error@897460522) -> (continuation of Deferred@324422206 after retry RPC after error@1686186037) -> (continuation of Deferred@163921805 after retry RPC after error@1295413478) -> (continuation of Deferred@1813042372 after retry RPC after error@29198835) -> (continuation of Deferred@564459294 after retry RPC after error@1600852620) -> (continuation of Deferred@901204817 after retry RPC after error@1479065093) -> (continuation of Deferred@1588772377 after retry RPC after error@1506424881)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.43.190:40613
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:48.761 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
18:33:48.763 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
18:33:48.766 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED on b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28872), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [27ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [33ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [38ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [38ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [46ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [47ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [47ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [84ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [85ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [104ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [104ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [124ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [124ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [124ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [142ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [243ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [321ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [322ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [522ms] refreshing cache from master, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [527ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [528ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [528ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [528ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1500ms] refreshing cache from master, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1503ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2041ms] refreshing cache from master, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2042ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2042ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2043ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2043ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [3400ms] refreshing cache from master, [3400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [3401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [3401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [3402ms] too many traces: truncated at 100 traces, deferred=Deferred@28892244(state=PENDING, result=null, callback=(continuation of Deferred@1204572354 after retry RPC after error@1505163014) -> (continuation of Deferred@1072197497 after retry RPC after error@2020953772) -> (continuation of Deferred@1570396960 after retry RPC after error@872061266) -> (continuation of Deferred@1326820339 after retry RPC after error@491228307) -> (continuation of Deferred@311138112 after retry RPC after error@1969011786) -> (continuation of Deferred@401918753 after retry RPC after error@922152536) -> (continuation of Deferred@2013879889 after retry RPC after error@1747387382) -> (continuation of Deferred@1505456144 after retry RPC after error@1480507729) -> (continuation of Deferred@1794635729 after retry RPC after error@975135178) -> (continuation of Deferred@942058857 after retry RPC after error@373086069) -> (continuation of Deferred@1126228764 after retry RPC after error@49335171) -> (continuation of Deferred@263222097 after retry RPC after error@2143787693) -> (continuation of Deferred@1002155594 after retry RPC after error@1058264685) -> (continuation of Deferred@859111461 after retry RPC after error@1885660700) -> (continuation of Deferred@374071204 after retry RPC after error@927650750) -> (continuation of Deferred@753256794 after retry RPC after error@2078707420) -> (continuation of Deferred@865655035 after retry RPC after error@1378757141) -> (continuation of Deferred@1342412307 after retry RPC after error@526152353) -> (continuation of Deferred@1794518705 after retry RPC after error@1235996536) -> (continuation of Deferred@97807184 after retry RPC after error@2044844081) -> (continuation of Deferred@574218778 after retry RPC after error@897460522) -> (continuation of Deferred@324422206 after retry RPC after error@1686186037) -> (continuation of Deferred@163921805 after retry RPC after error@1295413478) -> (continuation of Deferred@1813042372 after retry RPC after error@29198835) -> (continuation of Deferred@564459294 after retry RPC after error@1600852620) -> (continuation of Deferred@901204817 after retry RPC after error@1479065093) -> (continuation of Deferred@1588772377 after retry RPC after error@1506424881), errback=(continuation of Deferred@1204572354 after retry RPC after error@1505163014) -> (continuation of Deferred@1072197497 after retry RPC after error@2020953772) -> (continuation of Deferred@1570396960 after retry RPC after error@872061266) -> (continuation of Deferred@1326820339 after retry RPC after error@491228307) -> (continuation of Deferred@311138112 after retry RPC after error@1969011786) -> (continuation of Deferred@401918753 after retry RPC after error@922152536) -> (continuation of Deferred@2013879889 after retry RPC after error@1747387382) -> (continuation of Deferred@1505456144 after retry RPC after error@1480507729) -> (continuation of Deferred@1794635729 after retry RPC after error@975135178) -> (continuation of Deferred@942058857 after retry RPC after error@373086069) -> (continuation of Deferred@1126228764 after retry RPC after error@49335171) -> (continuation of Deferred@263222097 after retry RPC after error@2143787693) -> (continuation of Deferred@1002155594 after retry RPC after error@1058264685) -> (continuation of Deferred@859111461 after retry RPC after error@1885660700) -> (continuation of Deferred@374071204 after retry RPC after error@927650750) -> (continuation of Deferred@753256794 after retry RPC after error@2078707420) -> (continuation of Deferred@865655035 after retry RPC after error@1378757141) -> (continuation of Deferred@1342412307 after retry RPC after error@526152353) -> (continuation of Deferred@1794518705 after retry RPC after error@1235996536) -> (continuation of Deferred@97807184 after retry RPC after error@2044844081) -> (continuation of Deferred@574218778 after retry RPC after error@897460522) -> (continuation of Deferred@324422206 after retry RPC after error@1686186037) -> (continuation of Deferred@163921805 after retry RPC after error@1295413478) -> (continuation of Deferred@1813042372 after retry RPC after error@29198835) -> (continuation of Deferred@564459294 after retry RPC after error@1600852620) -> (continuation of Deferred@901204817 after retry RPC after error@1479065093) -> (continuation of Deferred@1588772377 after retry RPC after error@1506424881)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.43.190:40613
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:48.767 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
18:33:48.767 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (9de81db54be40687a2a82164db1dc50b) switched from state RUNNING to RESTARTING.
18:33:48.767 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:48.768 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
18:33:48.775 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:48.775 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:48.776 [DEBUG - pool-316-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:48.776 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.776 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.776 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.776 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.777 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.777 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.777 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.777 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.777 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.777 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:48.778 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28876), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [18ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [18ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [30ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [30ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [59ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [66ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [66ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [88ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [88ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [91ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [91ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [142ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [202ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [323ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [323ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [782ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [782ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [783ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [783ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1520ms] refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1523ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2601ms] refreshing cache from master, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2602ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2602ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2603ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2603ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [3821ms] refreshing cache from master, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [3822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [3822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [3823ms] too many traces: truncated at 100 traces, deferred=Deferred@465206231(state=PENDING, result=null, callback=(continuation of Deferred@1579441423 after retry RPC after error@1988924057) -> (continuation of Deferred@1609147625 after retry RPC after error@390404096) -> (continuation of Deferred@1811280834 after retry RPC after error@2046803071) -> (continuation of Deferred@1805881669 after retry RPC after error@1410928937) -> (continuation of Deferred@280396683 after retry RPC after error@338614694) -> (continuation of Deferred@1676696543 after retry RPC after error@2138873553) -> (continuation of Deferred@1534255214 after retry RPC after error@963899727) -> (continuation of Deferred@1488747293 after retry RPC after error@1135475917) -> (continuation of Deferred@261100870 after retry RPC after error@701457522) -> (continuation of Deferred@311461573 after retry RPC after error@1056394190) -> (continuation of Deferred@826426227 after retry RPC after error@1669094877) -> (continuation of Deferred@1976322521 after retry RPC after error@1902232981) -> (continuation of Deferred@1377523985 after retry RPC after error@1401447482) -> (continuation of Deferred@1151171859 after retry RPC after error@992957816) -> (continuation of Deferred@871645405 after retry RPC after error@600656685) -> (continuation of Deferred@202891170 after retry RPC after error@1297276877) -> (continuation of Deferred@1555139602 after retry RPC after error@359411850) -> (continuation of Deferred@666113866 after retry RPC after error@2093156550) -> (continuation of Deferred@750967376 after retry RPC after error@1482577698) -> (continuation of Deferred@1607931172 after retry RPC after error@1001829152) -> (continuation of Deferred@27065948 after retry RPC after error@735141386), errback=(continuation of Deferred@1579441423 after retry RPC after error@1988924057) -> (continuation of Deferred@1609147625 after retry RPC after error@390404096) -> (continuation of Deferred@1811280834 after retry RPC after error@2046803071) -> (continuation of Deferred@1805881669 after retry RPC after error@1410928937) -> (continuation of Deferred@280396683 after retry RPC after error@338614694) -> (continuation of Deferred@1676696543 after retry RPC after error@2138873553) -> (continuation of Deferred@1534255214 after retry RPC after error@963899727) -> (continuation of Deferred@1488747293 after retry RPC after error@1135475917) -> (continuation of Deferred@261100870 after retry RPC after error@701457522) -> (continuation of Deferred@311461573 after retry RPC after error@1056394190) -> (continuation of Deferred@826426227 after retry RPC after error@1669094877) -> (continuation of Deferred@1976322521 after retry RPC after error@1902232981) -> (continuation of Deferred@1377523985 after retry RPC after error@1401447482) -> (continuation of Deferred@1151171859 after retry RPC after error@992957816) -> (continuation of Deferred@871645405 after retry RPC after error@600656685) -> (continuation of Deferred@202891170 after retry RPC after error@1297276877) -> (continuation of Deferred@1555139602 after retry RPC after error@359411850) -> (continuation of Deferred@666113866 after retry RPC after error@2093156550) -> (continuation of Deferred@750967376 after retry RPC after error@1482577698) -> (continuation of Deferred@1607931172 after retry RPC after error@1001829152) -> (continuation of Deferred@27065948 after retry RPC after error@735141386)))
18:33:48.782 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:33:48.783 [WARN - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28876), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [18ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [18ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [30ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [30ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [59ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [66ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [66ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [88ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [88ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [91ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [91ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [142ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [202ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [323ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [323ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [782ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [782ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [783ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [783ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1520ms] refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1523ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2601ms] refreshing cache from master, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2602ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2602ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2603ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2603ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [3821ms] refreshing cache from master, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [3822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [3822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [3823ms] too many traces: truncated at 100 traces, deferred=Deferred@465206231(state=PENDING, result=null, callback=(continuation of Deferred@1579441423 after retry RPC after error@1988924057) -> (continuation of Deferred@1609147625 after retry RPC after error@390404096) -> (continuation of Deferred@1811280834 after retry RPC after error@2046803071) -> (continuation of Deferred@1805881669 after retry RPC after error@1410928937) -> (continuation of Deferred@280396683 after retry RPC after error@338614694) -> (continuation of Deferred@1676696543 after retry RPC after error@2138873553) -> (continuation of Deferred@1534255214 after retry RPC after error@963899727) -> (continuation of Deferred@1488747293 after retry RPC after error@1135475917) -> (continuation of Deferred@261100870 after retry RPC after error@701457522) -> (continuation of Deferred@311461573 after retry RPC after error@1056394190) -> (continuation of Deferred@826426227 after retry RPC after error@1669094877) -> (continuation of Deferred@1976322521 after retry RPC after error@1902232981) -> (continuation of Deferred@1377523985 after retry RPC after error@1401447482) -> (continuation of Deferred@1151171859 after retry RPC after error@992957816) -> (continuation of Deferred@871645405 after retry RPC after error@600656685) -> (continuation of Deferred@202891170 after retry RPC after error@1297276877) -> (continuation of Deferred@1555139602 after retry RPC after error@359411850) -> (continuation of Deferred@666113866 after retry RPC after error@2093156550) -> (continuation of Deferred@750967376 after retry RPC after error@1482577698) -> (continuation of Deferred@1607931172 after retry RPC after error@1001829152) -> (continuation of Deferred@27065948 after retry RPC after error@735141386), errback=(continuation of Deferred@1579441423 after retry RPC after error@1988924057) -> (continuation of Deferred@1609147625 after retry RPC after error@390404096) -> (continuation of Deferred@1811280834 after retry RPC after error@2046803071) -> (continuation of Deferred@1805881669 after retry RPC after error@1410928937) -> (continuation of Deferred@280396683 after retry RPC after error@338614694) -> (continuation of Deferred@1676696543 after retry RPC after error@2138873553) -> (continuation of Deferred@1534255214 after retry RPC after error@963899727) -> (continuation of Deferred@1488747293 after retry RPC after error@1135475917) -> (continuation of Deferred@261100870 after retry RPC after error@701457522) -> (continuation of Deferred@311461573 after retry RPC after error@1056394190) -> (continuation of Deferred@826426227 after retry RPC after error@1669094877) -> (continuation of Deferred@1976322521 after retry RPC after error@1902232981) -> (continuation of Deferred@1377523985 after retry RPC after error@1401447482) -> (continuation of Deferred@1151171859 after retry RPC after error@992957816) -> (continuation of Deferred@871645405 after retry RPC after error@600656685) -> (continuation of Deferred@202891170 after retry RPC after error@1297276877) -> (continuation of Deferred@1555139602 after retry RPC after error@359411850) -> (continuation of Deferred@666113866 after retry RPC after error@2093156550) -> (continuation of Deferred@750967376 after retry RPC after error@1482577698) -> (continuation of Deferred@1607931172 after retry RPC after error@1001829152) -> (continuation of Deferred@27065948 after retry RPC after error@735141386)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.43.190:40613
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:48.783 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
18:33:48.785 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
18:33:48.787 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED on b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28876), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [18ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [18ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [30ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [30ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [59ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [66ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [66ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [88ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [88ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [91ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [91ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [142ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [202ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [323ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [323ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [782ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [782ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [783ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [783ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1520ms] refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1523ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2601ms] refreshing cache from master, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2602ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2602ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2603ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2603ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [3821ms] refreshing cache from master, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [3822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [3822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [3823ms] too many traces: truncated at 100 traces, deferred=Deferred@465206231(state=PENDING, result=null, callback=(continuation of Deferred@1579441423 after retry RPC after error@1988924057) -> (continuation of Deferred@1609147625 after retry RPC after error@390404096) -> (continuation of Deferred@1811280834 after retry RPC after error@2046803071) -> (continuation of Deferred@1805881669 after retry RPC after error@1410928937) -> (continuation of Deferred@280396683 after retry RPC after error@338614694) -> (continuation of Deferred@1676696543 after retry RPC after error@2138873553) -> (continuation of Deferred@1534255214 after retry RPC after error@963899727) -> (continuation of Deferred@1488747293 after retry RPC after error@1135475917) -> (continuation of Deferred@261100870 after retry RPC after error@701457522) -> (continuation of Deferred@311461573 after retry RPC after error@1056394190) -> (continuation of Deferred@826426227 after retry RPC after error@1669094877) -> (continuation of Deferred@1976322521 after retry RPC after error@1902232981) -> (continuation of Deferred@1377523985 after retry RPC after error@1401447482) -> (continuation of Deferred@1151171859 after retry RPC after error@992957816) -> (continuation of Deferred@871645405 after retry RPC after error@600656685) -> (continuation of Deferred@202891170 after retry RPC after error@1297276877) -> (continuation of Deferred@1555139602 after retry RPC after error@359411850) -> (continuation of Deferred@666113866 after retry RPC after error@2093156550) -> (continuation of Deferred@750967376 after retry RPC after error@1482577698) -> (continuation of Deferred@1607931172 after retry RPC after error@1001829152) -> (continuation of Deferred@27065948 after retry RPC after error@735141386), errback=(continuation of Deferred@1579441423 after retry RPC after error@1988924057) -> (continuation of Deferred@1609147625 after retry RPC after error@390404096) -> (continuation of Deferred@1811280834 after retry RPC after error@2046803071) -> (continuation of Deferred@1805881669 after retry RPC after error@1410928937) -> (continuation of Deferred@280396683 after retry RPC after error@338614694) -> (continuation of Deferred@1676696543 after retry RPC after error@2138873553) -> (continuation of Deferred@1534255214 after retry RPC after error@963899727) -> (continuation of Deferred@1488747293 after retry RPC after error@1135475917) -> (continuation of Deferred@261100870 after retry RPC after error@701457522) -> (continuation of Deferred@311461573 after retry RPC after error@1056394190) -> (continuation of Deferred@826426227 after retry RPC after error@1669094877) -> (continuation of Deferred@1976322521 after retry RPC after error@1902232981) -> (continuation of Deferred@1377523985 after retry RPC after error@1401447482) -> (continuation of Deferred@1151171859 after retry RPC after error@992957816) -> (continuation of Deferred@871645405 after retry RPC after error@600656685) -> (continuation of Deferred@202891170 after retry RPC after error@1297276877) -> (continuation of Deferred@1555139602 after retry RPC after error@359411850) -> (continuation of Deferred@666113866 after retry RPC after error@2093156550) -> (continuation of Deferred@750967376 after retry RPC after error@1482577698) -> (continuation of Deferred@1607931172 after retry RPC after error@1001829152) -> (continuation of Deferred@27065948 after retry RPC after error@735141386)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.43.190:40613
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:48.789 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:33:48.789 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
18:33:48.790 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
18:33:48.856 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:48.857 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:48.857 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:48.857 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:48.857 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:48.857 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:48.857 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:48.858 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:48.858 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:48.858 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:48.858 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:48.858 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:48.858 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:48.891 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:48.891 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:48.891 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:48.892 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:48.892 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:48.892 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:48.892 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:48.892 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:48.892 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:48.893 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:48.893 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:48.893 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:48.893 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:48.895 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:48.895 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:48.896 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:48.896 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.896 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.896 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.896 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.896 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.897 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.897 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.897 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.897 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.897 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:48.955 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:48.956 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:48.956 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:48.956 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.956 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.956 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:48.957 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.957 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.957 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:48.958 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.958 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.958 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:48.958 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:49.008 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:49.008 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:49.008 [DEBUG - pool-298-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:49.009 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:49.009 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:49.009 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:49.009 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:49.009 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:49.009 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:49.009 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:49.009 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:49.009 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:49.009 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:49.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:49.095 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:49.099 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:49.100 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:49.100 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:49.100 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:49.100 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:49.100 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:49.101 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:49.101 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:49.101 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:49.101 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:49.101 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:49.101 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:49.101 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:49.115 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:49.115 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:49.115 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:49.116 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:49.116 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:49.116 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:49.116 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:49.116 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:49.116 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:49.117 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:49.117 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:49.117 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:49.117 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:49.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535629146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:49.161 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
18:33:49.162 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
18:33:49.207 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:49.208 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:49.208 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:49.208 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:49.208 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:49.209 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:49.209 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:49.209 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:49.209 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:49.209 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:49.209 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:49.209 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:49.209 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:49.211 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:49.211 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:49.211 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:49.211 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:49.211 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:49.211 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:49.212 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:49.212 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:49.212 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:49.212 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:49.212 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:49.212 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:49.212 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:49.249 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:49.249 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:49.249 [DEBUG - pool-314-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:49.250 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:49.250 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:49.250 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:49.250 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:49.250 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:49.250 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:49.250 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:49.250 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:49.250 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:49.250 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:49.251 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29362), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [27ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [37ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [37ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [49ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [51ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [55ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [55ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [68ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [69ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [69ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [69ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [142ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [163ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [163ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [202ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [402ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [403ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [403ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [403ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [722ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [723ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [724ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [724ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [922ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [923ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [971ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [972ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2100ms] refreshing cache from master, [2100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2900ms] refreshing cache from master, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2901ms] too many traces: truncated at 100 traces, deferred=Deferred@1657545605(state=PENDING, result=null, callback=(continuation of Deferred@1315566355 after retry RPC after error@637043639) -> (continuation of Deferred@465577575 after retry RPC after error@412352145) -> (continuation of Deferred@434337787 after retry RPC after error@2028448331) -> (continuation of Deferred@1645107246 after retry RPC after error@1701729672) -> (continuation of Deferred@1731246705 after retry RPC after error@574677294) -> (continuation of Deferred@840893024 after retry RPC after error@625656766) -> (continuation of Deferred@1204491860 after retry RPC after error@1655162386) -> (continuation of Deferred@685884452 after retry RPC after error@1539679669) -> (continuation of Deferred@1151557935 after retry RPC after error@409512191) -> (continuation of Deferred@1049530162 after retry RPC after error@1209036123) -> (continuation of Deferred@400938863 after retry RPC after error@1251453500) -> (continuation of Deferred@2771779 after retry RPC after error@1268483240) -> (continuation of Deferred@1929145371 after retry RPC after error@97386034) -> (continuation of Deferred@1475337627 after retry RPC after error@1078373642) -> (continuation of Deferred@1372294573 after retry RPC after error@1000199624) -> (continuation of Deferred@314037285 after retry RPC after error@1743521156) -> (continuation of Deferred@1783056945 after retry RPC after error@1067573540) -> (continuation of Deferred@320543753 after retry RPC after error@350026699) -> (continuation of Deferred@1150954915 after retry RPC after error@1954696405) -> (continuation of Deferred@1068694808 after retry RPC after error@1279482758) -> (continuation of Deferred@1495367832 after retry RPC after error@1059294093) -> (continuation of Deferred@399637324 after retry RPC after error@1100483931) -> (continuation of Deferred@350777520 after retry RPC after error@926219843) -> (continuation of Deferred@799500402 after retry RPC after error@777280008), errback=(continuation of Deferred@1315566355 after retry RPC after error@637043639) -> (continuation of Deferred@465577575 after retry RPC after error@412352145) -> (continuation of Deferred@434337787 after retry RPC after error@2028448331) -> (continuation of Deferred@1645107246 after retry RPC after error@1701729672) -> (continuation of Deferred@1731246705 after retry RPC after error@574677294) -> (continuation of Deferred@840893024 after retry RPC after error@625656766) -> (continuation of Deferred@1204491860 after retry RPC after error@1655162386) -> (continuation of Deferred@685884452 after retry RPC after error@1539679669) -> (continuation of Deferred@1151557935 after retry RPC after error@409512191) -> (continuation of Deferred@1049530162 after retry RPC after error@1209036123) -> (continuation of Deferred@400938863 after retry RPC after error@1251453500) -> (continuation of Deferred@2771779 after retry RPC after error@1268483240) -> (continuation of Deferred@1929145371 after retry RPC after error@97386034) -> (continuation of Deferred@1475337627 after retry RPC after error@1078373642) -> (continuation of Deferred@1372294573 after retry RPC after error@1000199624) -> (continuation of Deferred@314037285 after retry RPC after error@1743521156) -> (continuation of Deferred@1783056945 after retry RPC after error@1067573540) -> (continuation of Deferred@320543753 after retry RPC after error@350026699) -> (continuation of Deferred@1150954915 after retry RPC after error@1954696405) -> (continuation of Deferred@1068694808 after retry RPC after error@1279482758) -> (continuation of Deferred@1495367832 after retry RPC after error@1059294093) -> (continuation of Deferred@399637324 after retry RPC after error@1100483931) -> (continuation of Deferred@350777520 after retry RPC after error@926219843) -> (continuation of Deferred@799500402 after retry RPC after error@777280008)))
18:33:49.251 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:33:49.252 [WARN - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29362), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [27ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [37ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [37ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [49ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [51ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [55ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [55ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [68ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [69ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [69ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [69ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [142ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [163ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [163ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [202ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [402ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [403ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [403ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [403ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [722ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [723ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [724ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [724ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [922ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [923ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [971ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [972ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2100ms] refreshing cache from master, [2100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2900ms] refreshing cache from master, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2901ms] too many traces: truncated at 100 traces, deferred=Deferred@1657545605(state=PENDING, result=null, callback=(continuation of Deferred@1315566355 after retry RPC after error@637043639) -> (continuation of Deferred@465577575 after retry RPC after error@412352145) -> (continuation of Deferred@434337787 after retry RPC after error@2028448331) -> (continuation of Deferred@1645107246 after retry RPC after error@1701729672) -> (continuation of Deferred@1731246705 after retry RPC after error@574677294) -> (continuation of Deferred@840893024 after retry RPC after error@625656766) -> (continuation of Deferred@1204491860 after retry RPC after error@1655162386) -> (continuation of Deferred@685884452 after retry RPC after error@1539679669) -> (continuation of Deferred@1151557935 after retry RPC after error@409512191) -> (continuation of Deferred@1049530162 after retry RPC after error@1209036123) -> (continuation of Deferred@400938863 after retry RPC after error@1251453500) -> (continuation of Deferred@2771779 after retry RPC after error@1268483240) -> (continuation of Deferred@1929145371 after retry RPC after error@97386034) -> (continuation of Deferred@1475337627 after retry RPC after error@1078373642) -> (continuation of Deferred@1372294573 after retry RPC after error@1000199624) -> (continuation of Deferred@314037285 after retry RPC after error@1743521156) -> (continuation of Deferred@1783056945 after retry RPC after error@1067573540) -> (continuation of Deferred@320543753 after retry RPC after error@350026699) -> (continuation of Deferred@1150954915 after retry RPC after error@1954696405) -> (continuation of Deferred@1068694808 after retry RPC after error@1279482758) -> (continuation of Deferred@1495367832 after retry RPC after error@1059294093) -> (continuation of Deferred@399637324 after retry RPC after error@1100483931) -> (continuation of Deferred@350777520 after retry RPC after error@926219843) -> (continuation of Deferred@799500402 after retry RPC after error@777280008), errback=(continuation of Deferred@1315566355 after retry RPC after error@637043639) -> (continuation of Deferred@465577575 after retry RPC after error@412352145) -> (continuation of Deferred@434337787 after retry RPC after error@2028448331) -> (continuation of Deferred@1645107246 after retry RPC after error@1701729672) -> (continuation of Deferred@1731246705 after retry RPC after error@574677294) -> (continuation of Deferred@840893024 after retry RPC after error@625656766) -> (continuation of Deferred@1204491860 after retry RPC after error@1655162386) -> (continuation of Deferred@685884452 after retry RPC after error@1539679669) -> (continuation of Deferred@1151557935 after retry RPC after error@409512191) -> (continuation of Deferred@1049530162 after retry RPC after error@1209036123) -> (continuation of Deferred@400938863 after retry RPC after error@1251453500) -> (continuation of Deferred@2771779 after retry RPC after error@1268483240) -> (continuation of Deferred@1929145371 after retry RPC after error@97386034) -> (continuation of Deferred@1475337627 after retry RPC after error@1078373642) -> (continuation of Deferred@1372294573 after retry RPC after error@1000199624) -> (continuation of Deferred@314037285 after retry RPC after error@1743521156) -> (continuation of Deferred@1783056945 after retry RPC after error@1067573540) -> (continuation of Deferred@320543753 after retry RPC after error@350026699) -> (continuation of Deferred@1150954915 after retry RPC after error@1954696405) -> (continuation of Deferred@1068694808 after retry RPC after error@1279482758) -> (continuation of Deferred@1495367832 after retry RPC after error@1059294093) -> (continuation of Deferred@399637324 after retry RPC after error@1100483931) -> (continuation of Deferred@350777520 after retry RPC after error@926219843) -> (continuation of Deferred@799500402 after retry RPC after error@777280008)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.43.188:36795
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:49.252 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
18:33:49.254 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:49.254 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:49.254 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:49.255 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:49.255 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:49.255 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:49.255 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:49.255 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:49.255 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:49.256 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:49.256 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:49.256 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:49.256 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:49.257 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
18:33:49.259 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED on b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29362), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [27ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [37ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [37ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [49ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [51ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [55ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [55ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [68ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [69ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [69ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [69ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [142ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [163ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [163ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [202ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [402ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [403ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [403ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [403ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [722ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [723ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [724ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [724ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [922ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [923ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [971ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [972ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2100ms] refreshing cache from master, [2100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2900ms] refreshing cache from master, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2901ms] too many traces: truncated at 100 traces, deferred=Deferred@1657545605(state=PENDING, result=null, callback=(continuation of Deferred@1315566355 after retry RPC after error@637043639) -> (continuation of Deferred@465577575 after retry RPC after error@412352145) -> (continuation of Deferred@434337787 after retry RPC after error@2028448331) -> (continuation of Deferred@1645107246 after retry RPC after error@1701729672) -> (continuation of Deferred@1731246705 after retry RPC after error@574677294) -> (continuation of Deferred@840893024 after retry RPC after error@625656766) -> (continuation of Deferred@1204491860 after retry RPC after error@1655162386) -> (continuation of Deferred@685884452 after retry RPC after error@1539679669) -> (continuation of Deferred@1151557935 after retry RPC after error@409512191) -> (continuation of Deferred@1049530162 after retry RPC after error@1209036123) -> (continuation of Deferred@400938863 after retry RPC after error@1251453500) -> (continuation of Deferred@2771779 after retry RPC after error@1268483240) -> (continuation of Deferred@1929145371 after retry RPC after error@97386034) -> (continuation of Deferred@1475337627 after retry RPC after error@1078373642) -> (continuation of Deferred@1372294573 after retry RPC after error@1000199624) -> (continuation of Deferred@314037285 after retry RPC after error@1743521156) -> (continuation of Deferred@1783056945 after retry RPC after error@1067573540) -> (continuation of Deferred@320543753 after retry RPC after error@350026699) -> (continuation of Deferred@1150954915 after retry RPC after error@1954696405) -> (continuation of Deferred@1068694808 after retry RPC after error@1279482758) -> (continuation of Deferred@1495367832 after retry RPC after error@1059294093) -> (continuation of Deferred@399637324 after retry RPC after error@1100483931) -> (continuation of Deferred@350777520 after retry RPC after error@926219843) -> (continuation of Deferred@799500402 after retry RPC after error@777280008), errback=(continuation of Deferred@1315566355 after retry RPC after error@637043639) -> (continuation of Deferred@465577575 after retry RPC after error@412352145) -> (continuation of Deferred@434337787 after retry RPC after error@2028448331) -> (continuation of Deferred@1645107246 after retry RPC after error@1701729672) -> (continuation of Deferred@1731246705 after retry RPC after error@574677294) -> (continuation of Deferred@840893024 after retry RPC after error@625656766) -> (continuation of Deferred@1204491860 after retry RPC after error@1655162386) -> (continuation of Deferred@685884452 after retry RPC after error@1539679669) -> (continuation of Deferred@1151557935 after retry RPC after error@409512191) -> (continuation of Deferred@1049530162 after retry RPC after error@1209036123) -> (continuation of Deferred@400938863 after retry RPC after error@1251453500) -> (continuation of Deferred@2771779 after retry RPC after error@1268483240) -> (continuation of Deferred@1929145371 after retry RPC after error@97386034) -> (continuation of Deferred@1475337627 after retry RPC after error@1078373642) -> (continuation of Deferred@1372294573 after retry RPC after error@1000199624) -> (continuation of Deferred@314037285 after retry RPC after error@1743521156) -> (continuation of Deferred@1783056945 after retry RPC after error@1067573540) -> (continuation of Deferred@320543753 after retry RPC after error@350026699) -> (continuation of Deferred@1150954915 after retry RPC after error@1954696405) -> (continuation of Deferred@1068694808 after retry RPC after error@1279482758) -> (continuation of Deferred@1495367832 after retry RPC after error@1059294093) -> (continuation of Deferred@399637324 after retry RPC after error@1100483931) -> (continuation of Deferred@350777520 after retry RPC after error@926219843) -> (continuation of Deferred@799500402 after retry RPC after error@777280008)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.43.188:36795
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:49.260 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:33:49.261 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
18:33:49.261 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
18:33:49.370 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:49.370 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:49.371 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:49.371 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:49.371 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:49.371 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:49.371 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:49.372 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:49.372 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:49.372 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:49.371 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:49.372 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:49.372 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:49.424 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:49.424 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:49.424 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:49.425 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:49.425 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:49.425 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:49.425 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:49.425 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:49.425 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:49.426 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:49.426 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:49.426 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:49.426 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:49.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:49.595 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:49.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535629646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:49.659 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:33:49.660 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
18:33:49.677 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:49.677 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:49.677 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:49.677 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.677 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.678 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.678 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.678 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.678 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.678 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.678 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.678 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.678 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:49.679 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29727), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [8ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [8ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [28ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [38ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [38ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [39ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [46ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [47ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [48ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [48ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [61ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [61ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [62ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [83ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [103ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [142ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [221ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [221ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [222ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [222ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [263ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [423ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [485ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [486ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [487ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [487ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [981ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [982ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [982ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [982ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1581ms] refreshing cache from master, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1583ms] too many traces: truncated at 100 traces, deferred=Deferred@251443499(state=PENDING, result=null, callback=(continuation of Deferred@1221020608 after retry RPC after error@1847240124) -> (continuation of Deferred@1287829481 after retry RPC after error@656173755) -> (continuation of Deferred@1433906387 after retry RPC after error@1861997700) -> (continuation of Deferred@937380685 after retry RPC after error@1943185087) -> (continuation of Deferred@455843106 after retry RPC after error@725890359) -> (continuation of Deferred@1720489521 after retry RPC after error@860929) -> (continuation of Deferred@1200123055 after retry RPC after error@1299121380) -> (continuation of Deferred@1330654822 after retry RPC after error@640424358) -> (continuation of Deferred@583394520 after retry RPC after error@397970496) -> (continuation of Deferred@1498788815 after retry RPC after error@535978090) -> (continuation of Deferred@303871080 after retry RPC after error@1091956967) -> (continuation of Deferred@900397249 after retry RPC after error@962019118) -> (continuation of Deferred@1319072664 after retry RPC after error@551755876) -> (continuation of Deferred@1122871369 after retry RPC after error@1120096629) -> (continuation of Deferred@2004216070 after retry RPC after error@1311512460) -> (continuation of Deferred@1630294496 after retry RPC after error@960298057) -> (continuation of Deferred@1633226673 after retry RPC after error@1340601441) -> (continuation of Deferred@1288118060 after retry RPC after error@306674761) -> (continuation of Deferred@994762039 after retry RPC after error@1274962627) -> (continuation of Deferred@1068776175 after retry RPC after error@372816996) -> (continuation of Deferred@2079746289 after retry RPC after error@1126622518) -> (continuation of Deferred@1566301439 after retry RPC after error@248742060) -> (continuation of Deferred@1177206887 after retry RPC after error@852591297) -> (continuation of Deferred@829299776 after retry RPC after error@598354977) -> (continuation of Deferred@856947147 after retry RPC after error@225092322) -> (continuation of Deferred@1286026003 after retry RPC after error@1042208130) -> (continuation of Deferred@317697579 after retry RPC after error@1254777638) -> (continuation of Deferred@1065418439 after retry RPC after error@2012909168), errback=(continuation of Deferred@1221020608 after retry RPC after error@1847240124) -> (continuation of Deferred@1287829481 after retry RPC after error@656173755) -> (continuation of Deferred@1433906387 after retry RPC after error@1861997700) -> (continuation of Deferred@937380685 after retry RPC after error@1943185087) -> (continuation of Deferred@455843106 after retry RPC after error@725890359) -> (continuation of Deferred@1720489521 after retry RPC after error@860929) -> (continuation of Deferred@1200123055 after retry RPC after error@1299121380) -> (continuation of Deferred@1330654822 after retry RPC after error@640424358) -> (continuation of Deferred@583394520 after retry RPC after error@397970496) -> (continuation of Deferred@1498788815 after retry RPC after error@535978090) -> (continuation of Deferred@303871080 after retry RPC after error@1091956967) -> (continuation of Deferred@900397249 after retry RPC after error@962019118) -> (continuation of Deferred@1319072664 after retry RPC after error@551755876) -> (continuation of Deferred@1122871369 after retry RPC after error@1120096629) -> (continuation of Deferred@2004216070 after retry RPC after error@1311512460) -> (continuation of Deferred@1630294496 after retry RPC after error@960298057) -> (continuation of Deferred@1633226673 after retry RPC after error@1340601441) -> (continuation of Deferred@1288118060 after retry RPC after error@306674761) -> (continuation of Deferred@994762039 after retry RPC after error@1274962627) -> (continuation of Deferred@1068776175 after retry RPC after error@372816996) -> (continuation of Deferred@2079746289 after retry RPC after error@1126622518) -> (continuation of Deferred@1566301439 after retry RPC after error@248742060) -> (continuation of Deferred@1177206887 after retry RPC after error@852591297) -> (continuation of Deferred@829299776 after retry RPC after error@598354977) -> (continuation of Deferred@856947147 after retry RPC after error@225092322) -> (continuation of Deferred@1286026003 after retry RPC after error@1042208130) -> (continuation of Deferred@317697579 after retry RPC after error@1254777638) -> (continuation of Deferred@1065418439 after retry RPC after error@2012909168)))
18:33:49.680 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:49.680 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:49.680 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:49.680 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29727), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [8ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [8ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [28ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [38ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [38ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [39ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [46ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [47ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [48ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [48ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [61ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [61ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [62ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [83ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [103ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [142ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [221ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [221ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [222ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [222ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [263ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [423ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [485ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [486ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [487ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [487ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [981ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [982ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [982ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [982ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1581ms] refreshing cache from master, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1583ms] too many traces: truncated at 100 traces, deferred=Deferred@251443499(state=PENDING, result=null, callback=(continuation of Deferred@1221020608 after retry RPC after error@1847240124) -> (continuation of Deferred@1287829481 after retry RPC after error@656173755) -> (continuation of Deferred@1433906387 after retry RPC after error@1861997700) -> (continuation of Deferred@937380685 after retry RPC after error@1943185087) -> (continuation of Deferred@455843106 after retry RPC after error@725890359) -> (continuation of Deferred@1720489521 after retry RPC after error@860929) -> (continuation of Deferred@1200123055 after retry RPC after error@1299121380) -> (continuation of Deferred@1330654822 after retry RPC after error@640424358) -> (continuation of Deferred@583394520 after retry RPC after error@397970496) -> (continuation of Deferred@1498788815 after retry RPC after error@535978090) -> (continuation of Deferred@303871080 after retry RPC after error@1091956967) -> (continuation of Deferred@900397249 after retry RPC after error@962019118) -> (continuation of Deferred@1319072664 after retry RPC after error@551755876) -> (continuation of Deferred@1122871369 after retry RPC after error@1120096629) -> (continuation of Deferred@2004216070 after retry RPC after error@1311512460) -> (continuation of Deferred@1630294496 after retry RPC after error@960298057) -> (continuation of Deferred@1633226673 after retry RPC after error@1340601441) -> (continuation of Deferred@1288118060 after retry RPC after error@306674761) -> (continuation of Deferred@994762039 after retry RPC after error@1274962627) -> (continuation of Deferred@1068776175 after retry RPC after error@372816996) -> (continuation of Deferred@2079746289 after retry RPC after error@1126622518) -> (continuation of Deferred@1566301439 after retry RPC after error@248742060) -> (continuation of Deferred@1177206887 after retry RPC after error@852591297) -> (continuation of Deferred@829299776 after retry RPC after error@598354977) -> (continuation of Deferred@856947147 after retry RPC after error@225092322) -> (continuation of Deferred@1286026003 after retry RPC after error@1042208130) -> (continuation of Deferred@317697579 after retry RPC after error@1254777638) -> (continuation of Deferred@1065418439 after retry RPC after error@2012909168), errback=(continuation of Deferred@1221020608 after retry RPC after error@1847240124) -> (continuation of Deferred@1287829481 after retry RPC after error@656173755) -> (continuation of Deferred@1433906387 after retry RPC after error@1861997700) -> (continuation of Deferred@937380685 after retry RPC after error@1943185087) -> (continuation of Deferred@455843106 after retry RPC after error@725890359) -> (continuation of Deferred@1720489521 after retry RPC after error@860929) -> (continuation of Deferred@1200123055 after retry RPC after error@1299121380) -> (continuation of Deferred@1330654822 after retry RPC after error@640424358) -> (continuation of Deferred@583394520 after retry RPC after error@397970496) -> (continuation of Deferred@1498788815 after retry RPC after error@535978090) -> (continuation of Deferred@303871080 after retry RPC after error@1091956967) -> (continuation of Deferred@900397249 after retry RPC after error@962019118) -> (continuation of Deferred@1319072664 after retry RPC after error@551755876) -> (continuation of Deferred@1122871369 after retry RPC after error@1120096629) -> (continuation of Deferred@2004216070 after retry RPC after error@1311512460) -> (continuation of Deferred@1630294496 after retry RPC after error@960298057) -> (continuation of Deferred@1633226673 after retry RPC after error@1340601441) -> (continuation of Deferred@1288118060 after retry RPC after error@306674761) -> (continuation of Deferred@994762039 after retry RPC after error@1274962627) -> (continuation of Deferred@1068776175 after retry RPC after error@372816996) -> (continuation of Deferred@2079746289 after retry RPC after error@1126622518) -> (continuation of Deferred@1566301439 after retry RPC after error@248742060) -> (continuation of Deferred@1177206887 after retry RPC after error@852591297) -> (continuation of Deferred@829299776 after retry RPC after error@598354977) -> (continuation of Deferred@856947147 after retry RPC after error@225092322) -> (continuation of Deferred@1286026003 after retry RPC after error@1042208130) -> (continuation of Deferred@317697579 after retry RPC after error@1254777638) -> (continuation of Deferred@1065418439 after retry RPC after error@2012909168)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29727), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [8ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [8ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [28ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [38ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [38ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [39ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [46ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [47ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [48ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [48ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [61ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [61ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [62ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [83ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [103ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [142ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [221ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [221ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [222ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [222ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [263ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [423ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [485ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [486ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [487ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [487ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [981ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [982ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [982ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [982ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1581ms] refreshing cache from master, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1583ms] too many traces: truncated at 100 traces, deferred=Deferred@251443499(state=PENDING, result=null, callback=(continuation of Deferred@1221020608 after retry RPC after error@1847240124) -> (continuation of Deferred@1287829481 after retry RPC after error@656173755) -> (continuation of Deferred@1433906387 after retry RPC after error@1861997700) -> (continuation of Deferred@937380685 after retry RPC after error@1943185087) -> (continuation of Deferred@455843106 after retry RPC after error@725890359) -> (continuation of Deferred@1720489521 after retry RPC after error@860929) -> (continuation of Deferred@1200123055 after retry RPC after error@1299121380) -> (continuation of Deferred@1330654822 after retry RPC after error@640424358) -> (continuation of Deferred@583394520 after retry RPC after error@397970496) -> (continuation of Deferred@1498788815 after retry RPC after error@535978090) -> (continuation of Deferred@303871080 after retry RPC after error@1091956967) -> (continuation of Deferred@900397249 after retry RPC after error@962019118) -> (continuation of Deferred@1319072664 after retry RPC after error@551755876) -> (continuation of Deferred@1122871369 after retry RPC after error@1120096629) -> (continuation of Deferred@2004216070 after retry RPC after error@1311512460) -> (continuation of Deferred@1630294496 after retry RPC after error@960298057) -> (continuation of Deferred@1633226673 after retry RPC after error@1340601441) -> (continuation of Deferred@1288118060 after retry RPC after error@306674761) -> (continuation of Deferred@994762039 after retry RPC after error@1274962627) -> (continuation of Deferred@1068776175 after retry RPC after error@372816996) -> (continuation of Deferred@2079746289 after retry RPC after error@1126622518) -> (continuation of Deferred@1566301439 after retry RPC after error@248742060) -> (continuation of Deferred@1177206887 after retry RPC after error@852591297) -> (continuation of Deferred@829299776 after retry RPC after error@598354977) -> (continuation of Deferred@856947147 after retry RPC after error@225092322) -> (continuation of Deferred@1286026003 after retry RPC after error@1042208130) -> (continuation of Deferred@317697579 after retry RPC after error@1254777638) -> (continuation of Deferred@1065418439 after retry RPC after error@2012909168), errback=(continuation of Deferred@1221020608 after retry RPC after error@1847240124) -> (continuation of Deferred@1287829481 after retry RPC after error@656173755) -> (continuation of Deferred@1433906387 after retry RPC after error@1861997700) -> (continuation of Deferred@937380685 after retry RPC after error@1943185087) -> (continuation of Deferred@455843106 after retry RPC after error@725890359) -> (continuation of Deferred@1720489521 after retry RPC after error@860929) -> (continuation of Deferred@1200123055 after retry RPC after error@1299121380) -> (continuation of Deferred@1330654822 after retry RPC after error@640424358) -> (continuation of Deferred@583394520 after retry RPC after error@397970496) -> (continuation of Deferred@1498788815 after retry RPC after error@535978090) -> (continuation of Deferred@303871080 after retry RPC after error@1091956967) -> (continuation of Deferred@900397249 after retry RPC after error@962019118) -> (continuation of Deferred@1319072664 after retry RPC after error@551755876) -> (continuation of Deferred@1122871369 after retry RPC after error@1120096629) -> (continuation of Deferred@2004216070 after retry RPC after error@1311512460) -> (continuation of Deferred@1630294496 after retry RPC after error@960298057) -> (continuation of Deferred@1633226673 after retry RPC after error@1340601441) -> (continuation of Deferred@1288118060 after retry RPC after error@306674761) -> (continuation of Deferred@994762039 after retry RPC after error@1274962627) -> (continuation of Deferred@1068776175 after retry RPC after error@372816996) -> (continuation of Deferred@2079746289 after retry RPC after error@1126622518) -> (continuation of Deferred@1566301439 after retry RPC after error@248742060) -> (continuation of Deferred@1177206887 after retry RPC after error@852591297) -> (continuation of Deferred@829299776 after retry RPC after error@598354977) -> (continuation of Deferred@856947147 after retry RPC after error@225092322) -> (continuation of Deferred@1286026003 after retry RPC after error@1042208130) -> (continuation of Deferred@317697579 after retry RPC after error@1254777638) -> (continuation of Deferred@1065418439 after retry RPC after error@2012909168)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.96.188:32989
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:49.681 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.681 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.681 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.681 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.681 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.681 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.682 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.682 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.682 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.682 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:49.686 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29727), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [8ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [8ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [28ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [38ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [38ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [39ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [46ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [47ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [48ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [48ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [61ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [61ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [62ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [83ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [103ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [142ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [221ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [221ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [222ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [222ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [263ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [423ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [485ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [486ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [487ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [487ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [981ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [982ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [982ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [982ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1581ms] refreshing cache from master, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1583ms] too many traces: truncated at 100 traces, deferred=Deferred@251443499(state=PENDING, result=null, callback=(continuation of Deferred@1221020608 after retry RPC after error@1847240124) -> (continuation of Deferred@1287829481 after retry RPC after error@656173755) -> (continuation of Deferred@1433906387 after retry RPC after error@1861997700) -> (continuation of Deferred@937380685 after retry RPC after error@1943185087) -> (continuation of Deferred@455843106 after retry RPC after error@725890359) -> (continuation of Deferred@1720489521 after retry RPC after error@860929) -> (continuation of Deferred@1200123055 after retry RPC after error@1299121380) -> (continuation of Deferred@1330654822 after retry RPC after error@640424358) -> (continuation of Deferred@583394520 after retry RPC after error@397970496) -> (continuation of Deferred@1498788815 after retry RPC after error@535978090) -> (continuation of Deferred@303871080 after retry RPC after error@1091956967) -> (continuation of Deferred@900397249 after retry RPC after error@962019118) -> (continuation of Deferred@1319072664 after retry RPC after error@551755876) -> (continuation of Deferred@1122871369 after retry RPC after error@1120096629) -> (continuation of Deferred@2004216070 after retry RPC after error@1311512460) -> (continuation of Deferred@1630294496 after retry RPC after error@960298057) -> (continuation of Deferred@1633226673 after retry RPC after error@1340601441) -> (continuation of Deferred@1288118060 after retry RPC after error@306674761) -> (continuation of Deferred@994762039 after retry RPC after error@1274962627) -> (continuation of Deferred@1068776175 after retry RPC after error@372816996) -> (continuation of Deferred@2079746289 after retry RPC after error@1126622518) -> (continuation of Deferred@1566301439 after retry RPC after error@248742060) -> (continuation of Deferred@1177206887 after retry RPC after error@852591297) -> (continuation of Deferred@829299776 after retry RPC after error@598354977) -> (continuation of Deferred@856947147 after retry RPC after error@225092322) -> (continuation of Deferred@1286026003 after retry RPC after error@1042208130) -> (continuation of Deferred@317697579 after retry RPC after error@1254777638) -> (continuation of Deferred@1065418439 after retry RPC after error@2012909168), errback=(continuation of Deferred@1221020608 after retry RPC after error@1847240124) -> (continuation of Deferred@1287829481 after retry RPC after error@656173755) -> (continuation of Deferred@1433906387 after retry RPC after error@1861997700) -> (continuation of Deferred@937380685 after retry RPC after error@1943185087) -> (continuation of Deferred@455843106 after retry RPC after error@725890359) -> (continuation of Deferred@1720489521 after retry RPC after error@860929) -> (continuation of Deferred@1200123055 after retry RPC after error@1299121380) -> (continuation of Deferred@1330654822 after retry RPC after error@640424358) -> (continuation of Deferred@583394520 after retry RPC after error@397970496) -> (continuation of Deferred@1498788815 after retry RPC after error@535978090) -> (continuation of Deferred@303871080 after retry RPC after error@1091956967) -> (continuation of Deferred@900397249 after retry RPC after error@962019118) -> (continuation of Deferred@1319072664 after retry RPC after error@551755876) -> (continuation of Deferred@1122871369 after retry RPC after error@1120096629) -> (continuation of Deferred@2004216070 after retry RPC after error@1311512460) -> (continuation of Deferred@1630294496 after retry RPC after error@960298057) -> (continuation of Deferred@1633226673 after retry RPC after error@1340601441) -> (continuation of Deferred@1288118060 after retry RPC after error@306674761) -> (continuation of Deferred@994762039 after retry RPC after error@1274962627) -> (continuation of Deferred@1068776175 after retry RPC after error@372816996) -> (continuation of Deferred@2079746289 after retry RPC after error@1126622518) -> (continuation of Deferred@1566301439 after retry RPC after error@248742060) -> (continuation of Deferred@1177206887 after retry RPC after error@852591297) -> (continuation of Deferred@829299776 after retry RPC after error@598354977) -> (continuation of Deferred@856947147 after retry RPC after error@225092322) -> (continuation of Deferred@1286026003 after retry RPC after error@1042208130) -> (continuation of Deferred@317697579 after retry RPC after error@1254777638) -> (continuation of Deferred@1065418439 after retry RPC after error@2012909168)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29727), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [4ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [8ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [8ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [28ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [38ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [38ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [39ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [46ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [47ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [48ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [48ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [61ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [61ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [62ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [83ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [103ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [142ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [221ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [221ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [222ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [222ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [263ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [422ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [423ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [485ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [486ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [487ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [487ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [981ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [982ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [982ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [982ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1581ms] refreshing cache from master, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1583ms] too many traces: truncated at 100 traces, deferred=Deferred@251443499(state=PENDING, result=null, callback=(continuation of Deferred@1221020608 after retry RPC after error@1847240124) -> (continuation of Deferred@1287829481 after retry RPC after error@656173755) -> (continuation of Deferred@1433906387 after retry RPC after error@1861997700) -> (continuation of Deferred@937380685 after retry RPC after error@1943185087) -> (continuation of Deferred@455843106 after retry RPC after error@725890359) -> (continuation of Deferred@1720489521 after retry RPC after error@860929) -> (continuation of Deferred@1200123055 after retry RPC after error@1299121380) -> (continuation of Deferred@1330654822 after retry RPC after error@640424358) -> (continuation of Deferred@583394520 after retry RPC after error@397970496) -> (continuation of Deferred@1498788815 after retry RPC after error@535978090) -> (continuation of Deferred@303871080 after retry RPC after error@1091956967) -> (continuation of Deferred@900397249 after retry RPC after error@962019118) -> (continuation of Deferred@1319072664 after retry RPC after error@551755876) -> (continuation of Deferred@1122871369 after retry RPC after error@1120096629) -> (continuation of Deferred@2004216070 after retry RPC after error@1311512460) -> (continuation of Deferred@1630294496 after retry RPC after error@960298057) -> (continuation of Deferred@1633226673 after retry RPC after error@1340601441) -> (continuation of Deferred@1288118060 after retry RPC after error@306674761) -> (continuation of Deferred@994762039 after retry RPC after error@1274962627) -> (continuation of Deferred@1068776175 after retry RPC after error@372816996) -> (continuation of Deferred@2079746289 after retry RPC after error@1126622518) -> (continuation of Deferred@1566301439 after retry RPC after error@248742060) -> (continuation of Deferred@1177206887 after retry RPC after error@852591297) -> (continuation of Deferred@829299776 after retry RPC after error@598354977) -> (continuation of Deferred@856947147 after retry RPC after error@225092322) -> (continuation of Deferred@1286026003 after retry RPC after error@1042208130) -> (continuation of Deferred@317697579 after retry RPC after error@1254777638) -> (continuation of Deferred@1065418439 after retry RPC after error@2012909168), errback=(continuation of Deferred@1221020608 after retry RPC after error@1847240124) -> (continuation of Deferred@1287829481 after retry RPC after error@656173755) -> (continuation of Deferred@1433906387 after retry RPC after error@1861997700) -> (continuation of Deferred@937380685 after retry RPC after error@1943185087) -> (continuation of Deferred@455843106 after retry RPC after error@725890359) -> (continuation of Deferred@1720489521 after retry RPC after error@860929) -> (continuation of Deferred@1200123055 after retry RPC after error@1299121380) -> (continuation of Deferred@1330654822 after retry RPC after error@640424358) -> (continuation of Deferred@583394520 after retry RPC after error@397970496) -> (continuation of Deferred@1498788815 after retry RPC after error@535978090) -> (continuation of Deferred@303871080 after retry RPC after error@1091956967) -> (continuation of Deferred@900397249 after retry RPC after error@962019118) -> (continuation of Deferred@1319072664 after retry RPC after error@551755876) -> (continuation of Deferred@1122871369 after retry RPC after error@1120096629) -> (continuation of Deferred@2004216070 after retry RPC after error@1311512460) -> (continuation of Deferred@1630294496 after retry RPC after error@960298057) -> (continuation of Deferred@1633226673 after retry RPC after error@1340601441) -> (continuation of Deferred@1288118060 after retry RPC after error@306674761) -> (continuation of Deferred@994762039 after retry RPC after error@1274962627) -> (continuation of Deferred@1068776175 after retry RPC after error@372816996) -> (continuation of Deferred@2079746289 after retry RPC after error@1126622518) -> (continuation of Deferred@1566301439 after retry RPC after error@248742060) -> (continuation of Deferred@1177206887 after retry RPC after error@852591297) -> (continuation of Deferred@829299776 after retry RPC after error@598354977) -> (continuation of Deferred@856947147 after retry RPC after error@225092322) -> (continuation of Deferred@1286026003 after retry RPC after error@1042208130) -> (continuation of Deferred@317697579 after retry RPC after error@1254777638) -> (continuation of Deferred@1065418439 after retry RPC after error@2012909168)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.96.188:32989
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:49.686 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:33:49.687 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
18:33:49.687 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
18:33:49.688 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
18:33:49.688 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
18:33:49.688 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
18:33:49.693 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:33:49.693 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
18:33:49.693 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
18:33:49.696 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:49.696 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:49.696 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:49.697 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.697 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.697 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.697 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.698 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.698 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.698 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.698 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.698 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.698 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:49.710 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
18:33:49.711 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
18:33:49.711 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 9de81db54be40687a2a82164db1dc50b
18:33:49.717 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:49.717 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:49.717 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:49.718 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.718 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.718 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.718 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.718 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.718 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.718 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.718 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.718 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.718 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:49.719 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:49.719 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:49.719 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:49.719 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:49.719 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:49.719 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:49.719 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:49.719 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:49.720 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:49.720 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:49.720 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:49.720 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:49.720 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:49.736 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:49.736 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:49.737 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:49.737 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.737 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.737 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.737 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.737 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.738 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.738 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.738 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.738 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.738 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:49.756 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:49.756 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:49.756 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:49.757 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.757 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.757 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.757 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.757 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.757 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.758 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.758 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.758 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.758 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:49.761 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:49.761 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:49.762 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:49.762 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:49.762 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:49.762 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:49.763 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:49.763 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:49.763 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:49.763 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:49.763 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:49.763 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:49.763 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:49.776 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:49.777 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:49.777 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:49.777 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.777 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.777 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.778 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.778 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.778 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.778 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.778 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.778 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.778 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:49.807 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:49.807 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:49.807 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:49.808 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:49.808 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:49.808 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:49.808 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:49.808 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:49.808 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:49.808 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:49.808 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:49.808 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:49.808 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:49.836 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:49.836 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:49.836 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:49.837 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.837 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.837 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.837 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.837 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.837 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.838 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.838 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.838 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.838 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:49.916 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:49.917 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:49.917 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:49.917 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.917 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.917 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:49.918 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.918 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.918 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:49.918 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.918 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.918 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:49.918 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:50.020 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:50.020 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:50.020 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:50.021 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.021 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.021 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.021 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.021 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.021 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.022 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.022 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.022 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.022 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:50.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:50.062 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:50.062 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:50.063 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:50.063 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.063 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.063 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.064 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.064 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.064 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.064 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.064 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.065 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.065 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:50.095 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:50.097 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:50.097 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:50.097 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:50.097 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:50.098 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:50.098 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:50.098 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:50.098 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:50.098 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:50.098 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:50.098 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:50.099 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:50.099 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:50.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535630146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:50.159 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:33:50.160 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
18:33:50.171 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:50.171 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:50.171 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:50.172 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.172 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.172 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.172 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.172 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.172 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.173 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.173 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.173 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.173 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:50.474 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:50.474 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:50.474 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:50.474 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:50.474 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:50.474 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:50.475 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:50.475 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:50.475 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:50.475 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:50.475 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:50.475 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:50.475 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:50.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:50.577 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:50.577 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:50.577 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:50.577 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:50.577 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:50.578 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:50.578 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:50.578 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:50.578 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:50.578 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:50.578 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:50.578 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:50.578 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:49.258414  7429 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 7424
18:33:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:47.869669  7431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:50.587728  7424 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.720s	user 0.547s	sys 0.920s
18:33:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:50.588219  7424 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.721s	user 0.547s	sys 0.920s
18:33:50.592 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:50.592 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:50.592 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:50.593 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.593 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.593 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.593 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.593 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.593 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.593 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.593 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.593 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.593 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:50.595 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:50.595 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:50.595 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:50.595 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:50.596 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.596 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.596 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.596 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.596 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.596 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.596 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.597 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.597 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.597 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:50.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:50.598357  7454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:50.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.598668  7424 server_base.cc:1061] running on GCE node
18:33:50.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.600162  7424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:33:50.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.602897  7424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:33:50.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.604316  7424 hybrid_clock.cc:648] HybridClock initialized: now 1783535630604210 us; error 99 us; skew 500 ppm
18:33:50.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.605669  7424 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:33:50.611 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:50.611 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:50.611 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:50.612 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:50.612 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:50.612 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:50.612 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:50.612 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:50.612 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:50.612 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:50.612 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:50.612 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:50.612 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:50.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.614719  7424 webserver.cc:534] Webserver started at http://127.6.245.1:34741/ using document root <none> and password file <none>
18:33:50.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.616139  7424 fs_manager.cc:362] Metadata directory not provided
18:33:50.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.616570  7424 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:33:50.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.617272  7424 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:33:50.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.624564  7424 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/data/instance:
18:33:50.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2b4d808b605e47d0a90dce37fd8ecb5f"
18:33:50.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:50 on dist-test-slave-dxnw"
18:33:50.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.626364  7424 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/wal/instance:
18:33:50.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2b4d808b605e47d0a90dce37fd8ecb5f"
18:33:50.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:50 on dist-test-slave-dxnw"
18:33:50.628 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state RESTARTING to RUNNING.
18:33:50.629 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job f6e63683f34d031c5da392b08baea20c from Checkpoint 74 @ 1783535501335 for f6e63683f34d031c5da392b08baea20c located at file:/tmp/junit4154231101817438778/checkpoints/f6e63683f34d031c5da392b08baea20c/chk-74.
18:33:50.629 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
18:33:50.630 [INFO - flink-pekko.actor.default-dispatcher-9] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:33:50.633 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to SCHEDULED.
18:33:50.633 [INFO - Thread-55] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:33:50.634 [DEBUG - Thread-55] (Connection.java:575) [peer master-127.30.11.253:35677(127.30.11.253:35677)] disconnecting while in state TERMINATED
18:33:50.634 [DEBUG - Thread-55] (Connection.java:575) [peer master-127.30.11.252:39405(127.30.11.252:39405)] disconnecting while in state TERMINATED
18:33:50.634 [DEBUG - Thread-55] (Connection.java:575) [peer master-127.30.11.254:41811(127.30.11.254:41811)] disconnecting while in state TERMINATED
18:33:50.634 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from SCHEDULED to DEPLOYING.
18:33:50.634 [DEBUG - Thread-55] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:50.634 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #5) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 13a0441c1420d35b57a28ebd584f9846
18:33:50.634 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to SCHEDULED.
18:33:50.635 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from SCHEDULED to DEPLOYING.
18:33:50.635 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #6) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id e5ed6e64fe4e0a504f52a2cb8573a359
18:33:50.635 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to SCHEDULED.
18:33:50.636 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from SCHEDULED to DEPLOYING.
18:33:50.636 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #6) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8c518d750e8767059e15b0e0577096dd
18:33:50.636 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to SCHEDULED.
18:33:50.636 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:50.636 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:50.636 [DEBUG - pool-308-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:50.636 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from SCHEDULED to DEPLOYING.
18:33:50.636 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #5) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8ff5a8fd5a1d7f8775f563b9a37bf60a
18:33:50.637 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:50.637 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:50.637 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:50.637 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:33:50.637 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:50.637 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:50.637 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:50.638 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:50.638 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:50.638 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:50.638 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:50.637 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:50.637 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:33:50.638 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:50.638 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:33:50.639 [INFO - Thread-55] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:33:50.639 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 13a0441c1420d35b57a28ebd584f9846.
18:33:50.639 [INFO - Thread-55] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:33:50.640 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_5), deploy into slot with allocation id 13a0441c1420d35b57a28ebd584f9846.
18:33:50.640 [DEBUG - Thread-55] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:50.641 [INFO - Thread-55] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:33:50.643 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot e5ed6e64fe4e0a504f52a2cb8573a359.
18:33:50.644 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_6), deploy into slot with allocation id e5ed6e64fe4e0a504f52a2cb8573a359.
18:33:50.645 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to DEPLOYING.
18:33:50.645 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_5) [DEPLOYING].
18:33:50.646 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535630646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:50.646 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@60a3bbc4
18:33:50.646 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:50.647 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:33:50.650 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
18:33:50.651 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
18:33:50.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.651247  7424 fs_manager.cc:696] Time spent creating directory manager: real 0.024s	user 0.010s	sys 0.006s
18:33:50.654 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
18:33:50.655 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
18:33:50.655 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@61db555b
18:33:50.657 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:50.662 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:50.662 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:50.662 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:50.662 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:50.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.663763  7463 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:33:50.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.666110  7424 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.004s	sys 0.000s
18:33:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.666687  7424 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/wal
18:33:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2b4d808b605e47d0a90dce37fd8ecb5f"
18:33:50.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:50 on dist-test-slave-dxnw"
18:33:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.667366  7424 fs_report.cc:389] FS layout report
18:33:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:33:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/wal
18:33:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/wal
18:33:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/data/data
18:33:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:33:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:33:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:33:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:33:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:33:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:33:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:33:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:33:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:33:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:33:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:33:50.670 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 8c518d750e8767059e15b0e0577096dd.
18:33:50.672 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_6), deploy into slot with allocation id 8c518d750e8767059e15b0e0577096dd.
18:33:50.672 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to DEPLOYING.
18:33:50.672 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_6) [DEPLOYING].
18:33:50.673 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@23bce6cb
18:33:50.673 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:50.673 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:33:50.673 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
18:33:50.674 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
18:33:50.680 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@633c01dc
18:33:50.680 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.693 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:33:50.694 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_5), deploy into slot with allocation id 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:33:50.694 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:50.695 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to DEPLOYING.
18:33:50.695 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_6) [DEPLOYING].
18:33:50.696 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@48224b79
18:33:50.696 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:50.696 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:33:50.696 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
18:33:50.696 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
18:33:50.698 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to DEPLOYING.
18:33:50.700 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_5) [DEPLOYING].
18:33:50.700 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3444b9c1
18:33:50.700 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:50.700 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:33:50.701 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
18:33:50.701 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
18:33:50.701 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@164f9fc1
18:33:50.703 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:50.714 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:50.718 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7fc01519
18:33:50.722 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:50.728 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.729 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.729 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.729 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.739 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.746 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.746 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:50.747 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.747 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.747 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.747 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:50.748 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.748 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.748 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.749 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.749 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.749 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.749 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:50.749 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.749 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.750 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.750 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.750 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.751 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.751 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.751 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.751636  7424 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:33:50.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.753811  7424 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:33:50.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.754419  7424 kserver.cc:163] Server-wide thread pool size limit: 3276
18:33:50.755 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.755 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:50.756 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.756 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.756 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.763597  7424 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:33:50.770 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.770 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.770226  7424 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:33:50.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.770524  7424 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:33:50.771 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.771 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.770911  7424 ts_tablet_manager.cc:616] Registered 0 tablets
18:33:50.771 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:50.771176  7424 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:33:50.771 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.771 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.771 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.779 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.779 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.779 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.779 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.780 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:50.780 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.780 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.780 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.780 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.780 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.781 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.781 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.781 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.781 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:50.782 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.782 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.782 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.782 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.782 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.782 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.783 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:50.794 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.794 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.794 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.794 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.795 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:50.797 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.798 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.798 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.798 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.800 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.801 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.802 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.802 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.802 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.806 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.811 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.811 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.811 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.811 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.813 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.814 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.814 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.814 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.814 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.814 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.815 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.815 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.815 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.816 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.816 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.816 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.816 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.817 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.817 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.818 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.818 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.818 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.819 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.819 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.819 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.819 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:50.819 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:50.820 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.820 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.820 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.820 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.820 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.820 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.821 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.821 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.821 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.821 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.822 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.822 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.822 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.822 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.822 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.822 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.822 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.822 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.822 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.822 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.823 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.823 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.823 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.823 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.823 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.823 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.823 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.823 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:50.823 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.823 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.823 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.823 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.824 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.824 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.824 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.824 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.824 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.826 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.823 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.831 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.831 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.831 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.831 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.831 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.831 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.831 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.824 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.831 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.831 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.833 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.833 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.833 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.833 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.834 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.834 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.834 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.834 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.834 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.835 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:50.835 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:50.835 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:50.835 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.835 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.835 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.835 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.835 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.835 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.836 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.836 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.836 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.836 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:50.837 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.838 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.838 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.838 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.839 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.839 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.839 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.840 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.840 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.840 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.840 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.840 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.840 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.840 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.840 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.840 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.840 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.840 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.840 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.840 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.840 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.841 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.841 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.840 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.841 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.841 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.841 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.841 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.841 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.841 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.841 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.841 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.841 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.841 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.847 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.847 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (9de81db54be40687a2a82164db1dc50b) switched from state RESTARTING to RUNNING.
18:33:50.847 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.847 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.847 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.847 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:50.847 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:50.847 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:50.847 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:50.847 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:50.847 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job 9de81db54be40687a2a82164db1dc50b from Checkpoint 74 @ 1783535598621 for 9de81db54be40687a2a82164db1dc50b located at file:/tmp/junit13379242205642315453/checkpoints/9de81db54be40687a2a82164db1dc50b/chk-74.
18:33:50.847 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:50.848 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
18:33:50.848 [INFO - flink-pekko.actor.default-dispatcher-5] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:33:50.848 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:50.849 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:50.849 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:50.849 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:50.849 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:50.849 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:50.849 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:50.853 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.855 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.855 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:50.855 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.855 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:50.855 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.855 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.855 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:50.855 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.855 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.855 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.855 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.855 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.856 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.855 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.856 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.856 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.856 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.856 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.856 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.856 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.856 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:50.858 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
18:33:50.859 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
18:33:50.859 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id 30d104af07ed84a5695abb40e9c4cdae
18:33:50.859 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
18:33:50.860 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
18:33:50.860 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id e340c57f8743c3b4810a5f8fd9742fae
18:33:50.860 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
18:33:50.861 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
18:33:50.861 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id afa7c94bd89aa521f7cc788a9467b76f
18:33:50.861 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
18:33:50.862 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:33:50.862 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:33:50.862 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:50.863 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.863 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.863 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.863 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.863 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.863 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.863 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 30d104af07ed84a5695abb40e9c4cdae.
18:33:50.863 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.863 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.864 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.864 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.864 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.864 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.864 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id 30d104af07ed84a5695abb40e9c4cdae.
18:33:50.865 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.865 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.865 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.865 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.865 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.865 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.865 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.865 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.865 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.866 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.866 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.866 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.866 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.866 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.866 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.866 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.866 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.866 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.866 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.866 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.867 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.867 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.867 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.867 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.867 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.867 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.867 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.868 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:33:50.868 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
18:33:50.868 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id 2d9055e68c7827d1c77d7c11ef4f5752
18:33:50.869 [INFO - Thread-56] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:33:50.869 [DEBUG - Thread-56] (Connection.java:575) [peer master-127.2.96.189:33339(127.2.96.189:33339)] disconnecting while in state TERMINATED
18:33:50.869 [DEBUG - Thread-56] (Connection.java:575) [peer master-127.2.96.188:32989(127.2.96.188:32989)] disconnecting while in state TERMINATED
18:33:50.869 [DEBUG - Thread-56] (Connection.java:575) [peer master-127.2.96.190:44161(127.2.96.190:44161)] disconnecting while in state TERMINATED
18:33:50.870 [DEBUG - Thread-56] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:33:50.871 [INFO - Thread-56] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:33:50.871 [INFO - Thread-56] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:33:50.873 [DEBUG - Thread-56] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:50.873 [INFO - Thread-56] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:33:50.873 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.874 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.874 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.874 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.875 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.875 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.875 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.875 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.875 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.876 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.876 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.876 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.877 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:50.877 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:50.877 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:50.877 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:33:50.878 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot e340c57f8743c3b4810a5f8fd9742fae.
18:33:50.879 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id e340c57f8743c3b4810a5f8fd9742fae.
18:33:50.879 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
18:33:50.879 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
18:33:50.880 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.880 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.881 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.881 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.881 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.881 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.881 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.881 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.881 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.882 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.882 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.882 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.882 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.883 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@23d9cf68
18:33:50.883 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:50.883 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:33:50.883 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
18:33:50.884 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
18:33:50.886 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot afa7c94bd89aa521f7cc788a9467b76f.
18:33:50.887 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.887 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id afa7c94bd89aa521f7cc788a9467b76f.
18:33:50.887 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.887 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.887 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.887 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.887 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.888 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.888 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.888 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.888 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.888 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.888 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.888 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.889 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
18:33:50.889 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
18:33:50.889 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2b29a2c0
18:33:50.889 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:50.890 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:33:50.890 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
18:33:50.890 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
18:33:50.890 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4fb6f079
18:33:50.893 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.893 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.893 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.893 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.893 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.893 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.893 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.894 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.894 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.894 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.894 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.894 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.894 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.894 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:50.894 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 2d9055e68c7827d1c77d7c11ef4f5752.
18:33:50.895 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:50.895 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:50.895 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:50.895 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.895 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.895 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.895 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.895 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.895 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.895 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id 2d9055e68c7827d1c77d7c11ef4f5752.
18:33:50.896 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.896 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.896 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.896 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:50.896 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
18:33:50.896 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
18:33:50.897 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7c1ca098
18:33:50.897 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:50.897 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:33:50.898 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
18:33:50.899 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
18:33:50.899 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@69ff648a
18:33:50.899 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.899 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.899 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.900 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.900 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.900 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.900 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.900 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.900 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.900 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.900 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.900 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.900 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.904 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
18:33:50.904 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
18:33:50.904 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@78dce6d0
18:33:50.904 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:33:50.905 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:33:50.906 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.906 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.906 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.905 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:50.906 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.906 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.906 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.906 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.905 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@46dfd734
18:33:50.906 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.906 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.906 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.906 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
18:33:50.906 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.906 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.907 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
18:33:50.907 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.910 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:50.912 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@63e77a67
18:33:50.913 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.913 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.913 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.914 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.914 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.914 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.914 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.914 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.914 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.914 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.914 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:50.914 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.915 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.915 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.916 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:50.922 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.922 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.922 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.923 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.923 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.923 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.923 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.923 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.923 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.923 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.923 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.923 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.923 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.923 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:50.931 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:50.933 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.933 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.933 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.933 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.933 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.933 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.933 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.933 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.933 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.933 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.934 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.934 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.934 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.935 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:50.935 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:50.935 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:50.935 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.936 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.936 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:50.936 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.936 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.936 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:50.936 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.936 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.936 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:50.936 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:50.938 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:50.940 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.940 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.940 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.941 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.941 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.941 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.941 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.941 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.941 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.941 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.941 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.941 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.941 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.944 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:50.946 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.946 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.946 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.947 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.947 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.947 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.947 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.947 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.947 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.948 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.948 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.948 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.948 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.953 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:50.960 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.960 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.960 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.960 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:50.960 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.960 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.960 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.961 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.961 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.961 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.961 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.961 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.961 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.961 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.961 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.961 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.961 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.961 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.961 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.962 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.962 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.962 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.962 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.962 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.962 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.962 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:50.963 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:50.963 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:50.963 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.963 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.963 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:50.963 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.963 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.963 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:50.963 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.963 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.963 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:50.963 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:50.964 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.964 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.964 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.964 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.964 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.965 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:50.966 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.966 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.966 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.966 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.967 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.967 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.967 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:50.967 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:50.967 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.967 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.967 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.975 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:50.976 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:50.977 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.977 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.977 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.979 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:50.979 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:50.979 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.979 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.979 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.979 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:50.980 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:50.980 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:50.981 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.981 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.981 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.981 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.981 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.981 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.981 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.981 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.981 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.982 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.982 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.982 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.982 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.984 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:50.984 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.984 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.985 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.985 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.985 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.985 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.985 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:50.985 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:50.986 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.986 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.986 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.986 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:50.987 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.987 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.987 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.988 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.988 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.988 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.988 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:50.991 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:50.991 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.991 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.991 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.992 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:50.993 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:50.993 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:50.993 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:50.993 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.993 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.993 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.993 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.993 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:50.993 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.993 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:50.993 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.994 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.994 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:50.994 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.994 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.994 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:50.994 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:50.995 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:50.995 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:50.995 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:50.995 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:50.996 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:50.996 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.996 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.996 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:50.996 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:50.996 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:50.996 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:50.996 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.996 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.996 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.996 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.997 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.997 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.996 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.997 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.997 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:50.997 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:50.997 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:50.998 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:50.998 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:50.998 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:50.998 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:50.999 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.999 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.999 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:50.999 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.000 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.000 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.000 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.000 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.001 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.002 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.002 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.002 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.003 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.003 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.003 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.003 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.003 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.004 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.004 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.004 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.004 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.005 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.005 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.005 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.005 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.005 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.005 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.005 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.005 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.010 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.010 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.010 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.010 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.010 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.011 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.011 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.011 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.012 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.012 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.012 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.012 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.012 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.013 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.013 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:51.013 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.013 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.013 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.013 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.014 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.014 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.014 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.014 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.014 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.014 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.014 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.014 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.014 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.014 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.013 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:51.015 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:51.015 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.015 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.015 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.015 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.015 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.015 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.015 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:51.014 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.017 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.017 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.017 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.017 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.017 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.017 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.017 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.017 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.017 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.017 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.018 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.018 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.018 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.019 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:51.022 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.025 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.027 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.027 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.027 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.027 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.028 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.028 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.028 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.029 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.029 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.029 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.029 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.029 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:51.030 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.030 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.030 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.030 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:51.031 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.031 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.031 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.031 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.031 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.031 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.031 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.031 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.031 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.032 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.032 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.032 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.032 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.032 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.032 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.032 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.033 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.033 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.033 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.033 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:51.034 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.035 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.036 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.036 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.036 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.036 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.036 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.036 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.036 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.037 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.037 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.037 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.037 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.037 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.037 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.037 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.037 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.037 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.037 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.037 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.037 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.037 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.038 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.038 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.038 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.038 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.038 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.039 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:51.039 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.039 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.040 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.040 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.040 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.040 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.040 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.040 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.040 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.040 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.040 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:51.040 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.040 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:51.041 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.041 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.041 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.041 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.041 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.041 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.041 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.041 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.042 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.042 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:51.045 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.045 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.045 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.045 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.045 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.045 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.045 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.045 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.045 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:51.045 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.045 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.045 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.045 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.045 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.052 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.052 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.052 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.052 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.052 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.052 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.053 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.053 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.053 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.053 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.053 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.053 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.053 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.054 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.054 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.054 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.054 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.054 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.054 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.054 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.054 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.055 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.055 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.055 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.055 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.055 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.055 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:51.055 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:51.055 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:51.055 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:51.055 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:51.055 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:51.056 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:51.056 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:51.056 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:51.056 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:51.056 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:51.056 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:51.056 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:51.057 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.057 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.057 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.057 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.057 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.057 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.057 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.057 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.057 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.057 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.057 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.057 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.057 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.059 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:51.059 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:51.059 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:51.059 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.059 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.059 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.059 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.059 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.059 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.059 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.059 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.059 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.060 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:51.064 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.064 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.064 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.065 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.065 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.065 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.065 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.065 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.065 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.065 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.065 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.065 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.065 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.066 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:51.066 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:51.066 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:51.067 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.067 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.067 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.067 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.067 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.067 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.067 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.067 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.067 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.067 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:51.071 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.071 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.071 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.071 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.071 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.072 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.072 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.072 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.072 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.072 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.072 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.072 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.072 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.073 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.073 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.073 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.074 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.074 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.074 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.074 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.074 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.074 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.074 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:51.074 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:51.074 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:51.075 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.075 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.075 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.075 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.075 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.075 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.075 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.075 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.075 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.075 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.075 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.076 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.076 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.076 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:51.078 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:51.078 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:51.078 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:51.079 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.079 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.079 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.079 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.079 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.079 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.079 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.079 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.079 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.079 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:51.084 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.085 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.085 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.085 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.085 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.085 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.085 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.085 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.085 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.085 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.085 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.085 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.085 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.091 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.092 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.092 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.092 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.092 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.092 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.092 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.092 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.092 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.093 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.093 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.093 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.093 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.094 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.094 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.094 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.094 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.094 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.094 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.094 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.094 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.094 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.094 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.094 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.094 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.094 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.095 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:51.096 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.096 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.097 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.097 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.097 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.097 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.098 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.098 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.098 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.098 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.098 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.098 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.098 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.114 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.114 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:51.114 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:51.115 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:51.115 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.115 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.115 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:51.115 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.115 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:51.115 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:51.115 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:51.115 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:51.115 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:51.116 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:51.116 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:51.116 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:51.116 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:51.114 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.116 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.116 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.117 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.117 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.117 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.117 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.117 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.117 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.119 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:51.119 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:51.119 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:51.119 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.119 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.119 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.119 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.119 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.119 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.120 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.120 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.120 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.120 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:51.134 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:51.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535631146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:51.156 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:33:51.156 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.156 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.156 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.157 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
18:33:51.157 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.157 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.157 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.157 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.157 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.157 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.157 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.157 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.157 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.157 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.164 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.165 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.165 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.165 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.165 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.165 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.165 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.165 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.165 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.166 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.166 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.166 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.166 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.166364  7424 rpc_server.cc:307] RPC server started. Bound to: 127.6.245.1:39053
18:33:51.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.166464  7678 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.245.1:39053 every 8 connection(s)
18:33:51.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.169656  7424 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/data/info.pb
18:33:51.171 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.171 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.172 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.172 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.172 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.172 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.172 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.172 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.172 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.172 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.172 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.172 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.173 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.177 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.177 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.177 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.177 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.177 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.177 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.178 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.178 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.178 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.180 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.180 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.180 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.180 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.176883  7124 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 7424
18:33:51.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.177613  7124 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-0/wal/instance
18:33:51.194 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.194 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.194 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.195 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.195 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.195 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.195 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.195 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.195 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.196 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.196 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.196 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.196 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.199 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:51.199 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:51.199 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:51.200 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.200 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.200 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.200 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.200 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.200 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.201 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.201 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.201 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.201 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:51.201 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:51.201 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:51.201 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:51.202 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.202 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.202 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.202 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.202 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.202 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.203 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.203 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.203 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.203 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:51.204 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.204 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.204 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.205 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.205 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.205 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.205 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.205 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.206 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.206 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.206 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.206 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.206 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.206 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:51.206 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:51.207 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.207 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.207 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.207 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.207 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.207 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.207 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:51.207 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.208 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.208 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.208 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.213925  7124 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/wal
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/data
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/logs
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/data/info.pb
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:33:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.245.2:0
18:33:51.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.6.245.2
18:33:51.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.245.2
18:33:51.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:51.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.6.245.62:36853,127.6.245.61:44495,127.6.245.60:46787
18:33:51.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.245.20:33853
18:33:51.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:51.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:51.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:33:51.215 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:51.215 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:51.215 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:51.216 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:51.216 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:51.216 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:51.216 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:51.216 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:51.216 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:51.216 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:51.216 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:51.216 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:51.217 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:51.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.239585  7679 heartbeater.cc:344] Connected to a master server at 127.6.245.60:46787
18:33:51.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.240195  7679 heartbeater.cc:461] Registering TS with master...
18:33:51.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.242072  7679 heartbeater.cc:507] Master 127.6.245.60:46787 requested a full tablet report, sending...
18:33:51.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.242305  7680 heartbeater.cc:344] Connected to a master server at 127.6.245.61:44495
18:33:51.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.242748  7680 heartbeater.cc:461] Registering TS with master...
18:33:51.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.243955  7680 heartbeater.cc:507] Master 127.6.245.61:44495 requested a full tablet report, sending...
18:33:51.245 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.245 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.245 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.245 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.245 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.245 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.245 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.245421  7325 ts_manager.cc:194] Registered new tserver with Master: 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053)
18:33:51.246 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.246 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.246 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.246 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.246 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.246 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.248459  7325 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.245.1:55789
18:33:51.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.249303  7245 ts_manager.cc:194] Registered new tserver with Master: 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053)
18:33:51.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.255625  7681 heartbeater.cc:344] Connected to a master server at 127.6.245.62:36853
18:33:51.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.255991  7681 heartbeater.cc:461] Registering TS with master...
18:33:51.256 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.257 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.257 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.257 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.257 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.257 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.256709  7681 heartbeater.cc:507] Master 127.6.245.62:36853 requested a full tablet report, sending...
18:33:51.257 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.257 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.257 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.257 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.258 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.258 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.258 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.259 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:51.259 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:51.259 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:51.259 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.259 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.259 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.260203  7169 ts_manager.cc:194] Registered new tserver with Master: 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053)
18:33:51.261 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.261 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.261 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.261 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.261 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.261 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.261 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:51.267 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:51.267 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:51.267 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:51.267 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.267 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.267 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.267 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.267 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.267 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.267 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.267 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.267 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.267 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:51.274 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.274 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.274 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.274 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.274 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.274 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.274 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.274 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.274 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.274 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.275 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.275 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.275 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.280 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:51.281 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:51.281 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:51.281 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.281 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.281 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.281 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.281 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.281 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.281 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.281 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.281 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.281 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:51.319 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:51.320 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:51.320 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:51.320 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.320 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.320 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.320 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.320 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.320 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.320 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.320 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.320 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.320 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:51.325 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.325 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.325 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.325 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.325 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.325 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.325 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.325 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.325 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.325 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.325 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.325 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.325 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.332 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.332 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.332 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.332 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.332 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.332 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.332 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.332 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.332 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.333 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.333 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.333 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.333 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.353 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:51.353 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:51.353 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:51.353 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.354 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.354 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.354 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.354 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.354 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.354 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.354 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.354 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.354 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:51.394 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:51.395 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:51.395 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:51.395 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:51.395 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:51.395 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:51.395 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:51.395 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:51.395 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:51.395 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:51.395 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:51.395 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:51.395 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:51.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:51.457 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:51.457 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:51.457 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:51.458 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:51.458 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:51.458 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:51.458 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:51.458 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:51.458 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:51.458 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:51.458 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:51.458 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:51.458 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:51.459 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=26505), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [40ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [42ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [43ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [43ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [75ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [75ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [76ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [76ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [86ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [86ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [87ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [87ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [101ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [101ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [102ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [121ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [122ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [141ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [142ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [161ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [161ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [161ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [161ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [301ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [301ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [302ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [462ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [462ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [761ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [762ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [762ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [763ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [803ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [803ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [803ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [804ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2301ms] refreshing cache from master, [2301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2302ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [4920ms] refreshing cache from master, [4920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [4921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [4921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [4921ms] too many traces: truncated at 100 traces, deferred=Deferred@731836248(state=PENDING, result=null, callback=(continuation of Deferred@1695750666 after retry RPC after error@2090186575) -> (continuation of Deferred@2069588946 after retry RPC after error@660848590) -> (continuation of Deferred@1524445794 after retry RPC after error@186898873) -> (continuation of Deferred@721827572 after retry RPC after error@295793045) -> (continuation of Deferred@576458721 after retry RPC after error@925365250) -> (continuation of Deferred@755811716 after retry RPC after error@935015529) -> (continuation of Deferred@1968834168 after retry RPC after error@2102750005) -> (continuation of Deferred@910078462 after retry RPC after error@1481163564) -> (continuation of Deferred@2105833371 after retry RPC after error@736016349) -> (continuation of Deferred@1747730969 after retry RPC after error@1994636691) -> (continuation of Deferred@679818363 after retry RPC after error@1983586025) -> (continuation of Deferred@2081269437 after retry RPC after error@401179530) -> (continuation of Deferred@374234080 after retry RPC after error@942457750) -> (continuation of Deferred@688235104 after retry RPC after error@1915457817) -> (continuation of Deferred@383669735 after retry RPC after error@1211110617) -> (continuation of Deferred@1285732637 after retry RPC after error@1647266505) -> (continuation of Deferred@112876038 after retry RPC after error@1315176660) -> (continuation of Deferred@391586388 after retry RPC after error@255216501) -> (continuation of Deferred@1527274239 after retry RPC after error@897876970) -> (continuation of Deferred@468664972 after retry RPC after error@650104679) -> (continuation of Deferred@1073329901 after retry RPC after error@779348267), errback=(continuation of Deferred@1695750666 after retry RPC after error@2090186575) -> (continuation of Deferred@2069588946 after retry RPC after error@660848590) -> (continuation of Deferred@1524445794 after retry RPC after error@186898873) -> (continuation of Deferred@721827572 after retry RPC after error@295793045) -> (continuation of Deferred@576458721 after retry RPC after error@925365250) -> (continuation of Deferred@755811716 after retry RPC after error@935015529) -> (continuation of Deferred@1968834168 after retry RPC after error@2102750005) -> (continuation of Deferred@910078462 after retry RPC after error@1481163564) -> (continuation of Deferred@2105833371 after retry RPC after error@736016349) -> (continuation of Deferred@1747730969 after retry RPC after error@1994636691) -> (continuation of Deferred@679818363 after retry RPC after error@1983586025) -> (continuation of Deferred@2081269437 after retry RPC after error@401179530) -> (continuation of Deferred@374234080 after retry RPC after error@942457750) -> (continuation of Deferred@688235104 after retry RPC after error@1915457817) -> (continuation of Deferred@383669735 after retry RPC after error@1211110617) -> (continuation of Deferred@1285732637 after retry RPC after error@1647266505) -> (continuation of Deferred@112876038 after retry RPC after error@1315176660) -> (continuation of Deferred@391586388 after retry RPC after error@255216501) -> (continuation of Deferred@1527274239 after retry RPC after error@897876970) -> (continuation of Deferred@468664972 after retry RPC after error@650104679) -> (continuation of Deferred@1073329901 after retry RPC after error@779348267)))
18:33:51.465 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.465 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.465 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.465 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.465 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.465 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.465 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.465 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.465 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.465 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.465 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.465 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.465 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.478 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:51.478 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:51.479 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:51.479 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.479 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.479 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.479 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.479 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.479 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.479 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.479 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.479 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.479 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:51.532 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:51.533 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:51.533 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:51.533 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:51.533 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:51.533 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:51.533 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:51.533 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:51.533 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:51.533 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:51.534 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:51.534 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:51.534 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:51.545 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:51.554 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.554 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.554 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.555 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.555 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.555 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.555 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.555 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.555 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.555 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.555 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.555 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.555 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.594 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:51.599 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:51.599 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:51.600 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:51.600 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.600 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.600 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.600 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.600 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.600 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.600 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.600 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.600 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.600 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:51.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:51.608217  7689 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:33:51.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:51.608722  7689 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:33:51.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:51.609249  7689 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:33:51.618 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:51.619 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:51.619 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:51.619 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.619 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.619 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.619 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.619 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.619 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.619 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.620 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.620 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.620 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:51.633 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:51.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:51.645162  7689 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:33:51.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:51.646045  7689 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.245.2
18:33:51.646 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535631646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:51.652 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.652 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.652 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.652 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.652 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.652 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.652 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.652 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.652 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.653 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.653 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.653 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.653 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.653 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
18:33:51.654 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.689994  7689 tablet_server_runner.cc:78] Tablet server non-default flags:
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.245.20:33853
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/data
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/wal
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.245.2:0
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/data/info.pb
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.245.2
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.6.245.62:36853,127.6.245.61:44495,127.6.245.60:46787
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:33:51.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:51.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.6.245.2
18:33:51.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/logs
18:33:51.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:51.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:33:51.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:33:51.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:33:51.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:33:51.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:33:51.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:33:51.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:33:51.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:33:51.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:33:51.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.691757  7689 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:33:51.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:51.693495  7689 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:33:51.704 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:51.704 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:51.705 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:51.705 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:51.705 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:51.705 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:51.705 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:51.705 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:51.705 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:51.705 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:51.705 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:51.705 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:51.705 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:51.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:51.708178  7695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:51.754 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:51.755 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:51.755 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:51.755 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:51.755 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:51.755 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:51.755 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:51.755 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:51.755 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:51.756 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:51.756 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:51.756 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:51.756 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:51.780 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:51.780 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:51.780 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:51.780 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.780 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.781 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.781 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.781 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.780 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.781 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.781 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.781 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.781 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:51.880 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:51.881 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:51.881 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:51.881 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.881 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.881 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:51.882 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.882 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.882 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:51.882 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.882 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.882 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:51.882 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:51.918 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:51.918 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:51.918 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:51.919 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.919 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.919 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.919 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.919 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:51.920 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.920 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.920 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:51.919 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:51.920 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:51.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:51.931 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:51.931 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:51.932 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:51.932 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.932 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.932 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.932 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.932 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:51.932 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:51.932 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.932 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.932 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:51.933 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:51.956 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:51.957 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:51.957 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:51.957 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:51.957 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:51.957 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:51.957 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:51.958 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:51.958 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:51.958 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:51.958 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:51.958 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:51.958 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:52.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:52.053 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:52.053 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:52.054 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:52.054 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:52.054 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:52.054 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:52.055 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:52.055 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:52.055 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:52.055 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:52.055 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:52.055 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:52.055 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:52.055 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:52.055 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:52.055 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:52.056 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:52.056 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:52.056 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:52.056 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:52.056 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:52.056 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:52.057 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:52.057 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:52.057 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:52.057 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:52.085 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:52.085 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:52.085 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:52.086 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:52.086 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:52.086 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:52.086 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:52.086 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:52.086 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:52.087 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:52.087 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:52.087 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:52.087 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:52.096 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:52.113 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:52.114 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:52.114 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:52.114 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:52.114 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:52.114 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:52.115 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:52.115 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:52.115 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:52.115 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:52.115 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:52.115 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:52.115 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:52.133 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:52.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535632146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:52.157 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:52.157 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:52.157 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:52.158 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:52.158 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:52.158 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:52.159 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:52.159 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:52.159 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:52.159 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:52.159 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:52.159 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:52.159 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:52.167 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
18:33:52.171 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
18:33:52.190 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:52.191 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:52.191 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:52.191 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:52.191 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:52.191 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:52.191 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:52.191 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:52.191 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:52.191 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:52.191 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:52.191 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:52.192 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:52.254105  7679 heartbeater.cc:499] Master 127.6.245.60:46787 was elected leader, sending a full tablet report...
18:33:52.267 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:52.267 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:52.267 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:52.267 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:52.267 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:52.267 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:52.267 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:52.268 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:52.268 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:52.268 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:52.268 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:52.268 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:52.268 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:52.270 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:52.270 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:52.270 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:52.270 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:52.270 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:52.270 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:52.270 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:52.271 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:52.271 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:52.271 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:52.271 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:52.271 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:52.271 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:52.298 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:52.299 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:52.299 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:52.299 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:52.299 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:52.299 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:52.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:52.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:52.300 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:52.300 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:52.300 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:52.300 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:52.300 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:52.380 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:52.380 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:52.380 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:52.381 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:52.381 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:52.381 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:52.381 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:52.381 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:52.381 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:52.381 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:52.381 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:52.381 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:52.381 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:52.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:52.473 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:52.473 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:52.473 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:52.474 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:52.474 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:52.474 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:52.474 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:52.474 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:52.474 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:52.474 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:52.475 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:52.475 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:52.475 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:52.504 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:52.504 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:52.504 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:52.504 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:52.504 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:52.504 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:52.504 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:52.505 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:52.505 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:52.504 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:52.505 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:52.505 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:52.505 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:52.521 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:52.521 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:52.521 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:52.522 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:52.522 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:52.522 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:52.523 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:52.523 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:52.523 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:52.523 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:52.523 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:52.523 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:52.523 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:52.536 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:52.537 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:52.537 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:52.537 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:52.538 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:52.538 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:52.538 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:52.538 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:52.538 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:52.539 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:52.539 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:52.539 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:52.539 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:52.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:52.595 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:52.616 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:52.616 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:52.616 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:52.617 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:52.617 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:52.617 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:52.617 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:52.617 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:52.617 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:52.617 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:52.617 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:52.617 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:52.618 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:52.634 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:52.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535632646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:52.657 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:33:52.659 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
18:33:52.744 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:52.744 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:52.745 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:52.745 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:52.745 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:52.745 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:52.745 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:52.745 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:52.745 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:52.746 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:52.746 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:52.746 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:52.746 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:52.796 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:52.796 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:52.797 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:52.797 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:52.797 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:52.797 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:52.798 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:52.798 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:52.798 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:52.798 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:52.798 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:52.798 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:52.798 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:52.814 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:52.814 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:52.814 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:52.814 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:52.814 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:52.814 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:52.815 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:52.815 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:52.815 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:52.815 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:52.815 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:52.815 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:52.815 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:52.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:52.953 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:52.954 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:52.954 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:52.954 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:52.954 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:52.954 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:52.954 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:52.954 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:52.954 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:52.954 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:52.954 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:52.954 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:52.954 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:53.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:53.095 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:53.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:51.713439  7698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:53.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:51.710765  7696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:53.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:53.129271  7697 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1415 milliseconds
18:33:53.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.129359  7689 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:33:53.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.130918  7689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:33:53.132 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:53.132 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:53.132 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:53.132 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:53.132 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:53.132 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:53.132 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:53.133 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:53.133 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:53.132 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:53.133 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:53.133 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:53.133 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:53.133 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:53.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.133785  7689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:33:53.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.135375  7689 hybrid_clock.cc:648] HybridClock initialized: now 1783535633135290 us; error 73 us; skew 500 ppm
18:33:53.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.136503  7689 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:33:53.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.143468  7689 webserver.cc:534] Webserver started at http://127.6.245.2:42033/ using document root <none> and password file <none>
18:33:53.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.144508  7689 fs_manager.cc:362] Metadata directory not provided
18:33:53.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.144754  7689 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:33:53.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.145268  7689 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:33:53.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535633146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:53.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.152961  7689 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/data/instance:
18:33:53.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2f76c37f74624d8aa5906e77684cad01"
18:33:53.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:53 on dist-test-slave-dxnw"
18:33:53.154 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
18:33:53.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.154397  7689 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/wal/instance:
18:33:53.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2f76c37f74624d8aa5906e77684cad01"
18:33:53.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:53 on dist-test-slave-dxnw"
18:33:53.154 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
18:33:53.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.167877  7689 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.001s
18:33:53.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.175407  7707 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:33:53.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.176762  7689 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.003s
18:33:53.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.177199  7689 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/wal
18:33:53.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2f76c37f74624d8aa5906e77684cad01"
18:33:53.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:53 on dist-test-slave-dxnw"
18:33:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.177580  7689 fs_report.cc:389] FS layout report
18:33:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:33:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/wal
18:33:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/wal
18:33:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/data/data
18:33:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:33:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:33:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:33:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:33:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:33:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:33:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:33:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:33:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:33:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:33:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:33:53.220 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:53.220 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:53.220 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:53.220 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:53.220 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:53.221 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:53.221 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:53.221 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:53.221 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:53.221 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:53.221 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:53.221 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:53.221 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:53.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.245190  7689 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:33:53.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.246846  7689 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:33:53.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.247339  7689 kserver.cc:163] Server-wide thread pool size limit: 3276
18:33:53.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.250236  7689 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:33:53.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.254727  7689 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:33:53.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.254982  7689 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
18:33:53.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.255295  7689 ts_tablet_manager.cc:616] Registered 0 tablets
18:33:53.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.255491  7689 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:33:53.295 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:53.295 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:53.295 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:53.295 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:53.295 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:53.295 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:53.295 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:53.295 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:53.296 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:53.295 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:53.296 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:53.296 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:53.296 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:53.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.418675  7689 rpc_server.cc:307] RPC server started. Bound to: 127.6.245.2:40933
18:33:53.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.418944  7819 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.245.2:40933 every 8 connection(s)
18:33:53.420 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:53.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.422147  7689 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/data/info.pb
18:33:53.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.423524  7124 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 7689
18:33:53.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.424049  7124 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-1/wal/instance
18:33:53.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.452015  7124 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:53.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:53.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/wal
18:33:53.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/data
18:33:53.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:33:53.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:33:53.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/logs
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/data/info.pb
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.245.3:0
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.6.245.3
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.245.3
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.6.245.62:36853,127.6.245.61:44495,127.6.245.60:46787
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.245.20:33853
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:33:53.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.501479  7820 heartbeater.cc:344] Connected to a master server at 127.6.245.60:46787
18:33:53.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.501793  7821 heartbeater.cc:344] Connected to a master server at 127.6.245.61:44495
18:33:53.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.502074  7820 heartbeater.cc:461] Registering TS with master...
18:33:53.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.502363  7821 heartbeater.cc:461] Registering TS with master...
18:33:53.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.503646  7820 heartbeater.cc:507] Master 127.6.245.60:46787 requested a full tablet report, sending...
18:33:53.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.503818  7821 heartbeater.cc:507] Master 127.6.245.61:44495 requested a full tablet report, sending...
18:33:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.506644  7325 ts_manager.cc:194] Registered new tserver with Master: 2f76c37f74624d8aa5906e77684cad01 (127.6.245.2:40933)
18:33:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.508010  7245 ts_manager.cc:194] Registered new tserver with Master: 2f76c37f74624d8aa5906e77684cad01 (127.6.245.2:40933)
18:33:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.508311  7325 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.245.2:51915
18:33:53.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.511365  7822 heartbeater.cc:344] Connected to a master server at 127.6.245.62:36853
18:33:53.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.511765  7822 heartbeater.cc:461] Registering TS with master...
18:33:53.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.512547  7822 heartbeater.cc:507] Master 127.6.245.62:36853 requested a full tablet report, sending...
18:33:53.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.515746  7169 ts_manager.cc:194] Registered new tserver with Master: 2f76c37f74624d8aa5906e77684cad01 (127.6.245.2:40933)
18:33:53.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:53.595 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:53.634 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:53.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535633646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:53.655 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:33:53.656 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
18:33:53.674 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:53.675 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:53.675 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:53.675 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:53.675 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:53.675 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:53.675 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:53.675 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:53.675 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:53.675 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:53.675 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:53.675 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:53.675 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:53.680 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:53.680 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:53.680 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:53.680 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:53.680 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:53.680 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:53.680 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:53.680 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:53.680 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:53.681 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:53.681 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:53.681 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:53.681 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:53.720 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:53.720 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:53.720 [DEBUG - pool-318-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:53.720 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:53.720 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:53.720 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:53.720 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:53.720 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:53.720 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:53.720 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:53.721 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:53.721 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:53.721 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:53.721 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28807), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [28ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [29ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [35ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [35ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [64ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [71ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [73ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [73ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [83ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [83ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [83ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [84ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [101ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [102ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [121ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [121ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [121ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [121ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [141ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [141ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [142ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [201ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [201ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [201ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [202ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [221ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [481ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [482ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [482ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [482ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [501ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [501ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [501ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [501ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1300ms] refreshing cache from master, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1302ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1341ms] refreshing cache from master, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1343ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1381ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1383ms] too many traces: truncated at 100 traces, deferred=Deferred@1242838509(state=PENDING, result=null, callback=(continuation of Deferred@1601415505 after retry RPC after error@2121045057) -> (continuation of Deferred@1999722781 after retry RPC after error@484553035) -> (continuation of Deferred@1587194535 after retry RPC after error@1154413481) -> (continuation of Deferred@969581468 after retry RPC after error@682632711) -> (continuation of Deferred@603225636 after retry RPC after error@269779528) -> (continuation of Deferred@2091783573 after retry RPC after error@1434944537) -> (continuation of Deferred@1434633683 after retry RPC after error@1630542825) -> (continuation of Deferred@1832823015 after retry RPC after error@74468885) -> (continuation of Deferred@1193258773 after retry RPC after error@638655308) -> (continuation of Deferred@1055975161 after retry RPC after error@955647956) -> (continuation of Deferred@36397272 after retry RPC after error@751747242) -> (continuation of Deferred@363871460 after retry RPC after error@502288673) -> (continuation of Deferred@1141166055 after retry RPC after error@504732765) -> (continuation of Deferred@181847143 after retry RPC after error@363914565) -> (continuation of Deferred@2007591907 after retry RPC after error@1164764735) -> (continuation of Deferred@2032527113 after retry RPC after error@1798156197) -> (continuation of Deferred@1474766672 after retry RPC after error@1972924045) -> (continuation of Deferred@592695960 after retry RPC after error@621089232) -> (continuation of Deferred@1270251399 after retry RPC after error@2112654458) -> (continuation of Deferred@1075205709 after retry RPC after error@1292911630) -> (continuation of Deferred@891441260 after retry RPC after error@750032366) -> (continuation of Deferred@1591876107 after retry RPC after error@295507437) -> (continuation of Deferred@916162178 after retry RPC after error@1049128538) -> (continuation of Deferred@1895041474 after retry RPC after error@155146316) -> (continuation of Deferred@1677353087 after retry RPC after error@519907556) -> (continuation of Deferred@1310169312 after retry RPC after error@1025066070), errback=(continuation of Deferred@1601415505 after retry RPC after error@2121045057) -> (continuation of Deferred@1999722781 after retry RPC after error@484553035) -> (continuation of Deferred@1587194535 after retry RPC after error@1154413481) -> (continuation of Deferred@969581468 after retry RPC after error@682632711) -> (continuation of Deferred@603225636 after retry RPC after error@269779528) -> (continuation of Deferred@2091783573 after retry RPC after error@1434944537) -> (continuation of Deferred@1434633683 after retry RPC after error@1630542825) -> (continuation of Deferred@1832823015 after retry RPC after error@74468885) -> (continuation of Deferred@1193258773 after retry RPC after error@638655308) -> (continuation of Deferred@1055975161 after retry RPC after error@955647956) -> (continuation of Deferred@36397272 after retry RPC after error@751747242) -> (continuation of Deferred@363871460 after retry RPC after error@502288673) -> (continuation of Deferred@1141166055 after retry RPC after error@504732765) -> (continuation of Deferred@181847143 after retry RPC after error@363914565) -> (continuation of Deferred@2007591907 after retry RPC after error@1164764735) -> (continuation of Deferred@2032527113 after retry RPC after error@1798156197) -> (continuation of Deferred@1474766672 after retry RPC after error@1972924045) -> (continuation of Deferred@592695960 after retry RPC after error@621089232) -> (continuation of Deferred@1270251399 after retry RPC after error@2112654458) -> (continuation of Deferred@1075205709 after retry RPC after error@1292911630) -> (continuation of Deferred@891441260 after retry RPC after error@750032366) -> (continuation of Deferred@1591876107 after retry RPC after error@295507437) -> (continuation of Deferred@916162178 after retry RPC after error@1049128538) -> (continuation of Deferred@1895041474 after retry RPC after error@155146316) -> (continuation of Deferred@1677353087 after retry RPC after error@519907556) -> (continuation of Deferred@1310169312 after retry RPC after error@1025066070)))
18:33:53.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:53.840318  7830 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:33:53.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:53.840902  7830 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:33:53.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:53.841449  7830 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:33:53.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:53.878425  7830 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:33:53.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:53.879436  7830 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.245.3
18:33:53.887 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:53.887 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:53.887 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:53.887 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:53.887 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:53.887 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:53.887 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:53.887 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:53.887 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:53.888 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:53.888 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:53.888 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:53.888 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:53.891 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:53.891 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:53.891 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:53.891 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:53.891 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:53.891 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:53.891 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:53.891 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:53.892 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:53.892 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:53.892 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:53.892 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:53.892 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:53.898 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:53.898 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:53.898 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:53.898 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:53.898 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:53.899 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:53.899 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:53.899 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:53.899 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:53.899 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:53.899 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:53.899 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:53.899 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:53.920 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.923059  7830 tablet_server_runner.cc:78] Tablet server non-default flags:
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.6.245.20:33853
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/data
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/wal
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.6.245.3:0
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/data/info.pb
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.6.245.3
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.6.245.62:36853,127.6.245.61:44495,127.6.245.60:46787
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.6.245.3
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/logs
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:33:53.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:33:53.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:33:53.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:33:53.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:33:53.924 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:53.924 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:53.924 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:53.924 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:53.924 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:53.925 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:53.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.924736  7830 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:33:53.925 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:53.925 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:53.925 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:53.925 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:53.925 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:53.925 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:53.925 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:53.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:53.926818  7830 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:33:53.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:53.940902  7836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:53.954 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:53.954 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:53.954 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:53.954 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:53.954 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:53.954 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:53.954 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:53.954 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:53.954 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:53.955 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:53.955 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:53.955 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:53.955 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:54.015 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:54.015 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:54.016 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:54.016 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:54.016 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:54.016 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:54.017 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:54.017 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:54.017 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:54.017 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:54.017 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:54.017 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:54.017 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:54.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:54.094 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:54.134 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:54.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535634146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:54.156 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:33:54.156 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
18:33:54.172 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:54.172 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:54.172 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:54.173 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.173 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.173 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.173 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.173 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.173 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.173 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.173 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.173 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.173 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:54.174 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29239), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [4ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [5ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [8ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [8ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [47ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [48ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [52ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [52ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [72ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [73ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [73ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [81ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [81ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [81ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [81ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [103ms] refreshing cache from master, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [104ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [104ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [104ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [104ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [121ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [123ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [161ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [161ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [162ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [303ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [462ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [462ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [462ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [661ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [662ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [662ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [662ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [682ms] refreshing cache from master, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [683ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [683ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [683ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [684ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1201ms] refreshing cache from master, [1202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1203ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1203ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1207ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1207ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2521ms] refreshing cache from master, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2522ms] too many traces: truncated at 100 traces, deferred=Deferred@1752670669(state=PENDING, result=null, callback=(continuation of Deferred@2004978742 after retry RPC after error@1491755865) -> (continuation of Deferred@1101464757 after retry RPC after error@344697989) -> (continuation of Deferred@1863344670 after retry RPC after error@1684743182) -> (continuation of Deferred@487589530 after retry RPC after error@1412857401) -> (continuation of Deferred@945481267 after retry RPC after error@86834786) -> (continuation of Deferred@404032651 after retry RPC after error@2134212102) -> (continuation of Deferred@280065197 after retry RPC after error@1913407287) -> (continuation of Deferred@1120758953 after retry RPC after error@375193528) -> (continuation of Deferred@231990722 after retry RPC after error@502673072) -> (continuation of Deferred@888643971 after retry RPC after error@1160194458) -> (continuation of Deferred@1464350985 after retry RPC after error@2070355710) -> (continuation of Deferred@1922384808 after retry RPC after error@235065241) -> (continuation of Deferred@412368673 after retry RPC after error@1539785251) -> (continuation of Deferred@51892976 after retry RPC after error@460438284) -> (continuation of Deferred@581300852 after retry RPC after error@1133673049) -> (continuation of Deferred@2117054601 after retry RPC after error@1754324379) -> (continuation of Deferred@1705747631 after retry RPC after error@901466865) -> (continuation of Deferred@915607351 after retry RPC after error@1484877947) -> (continuation of Deferred@1622616344 after retry RPC after error@255073085) -> (continuation of Deferred@561010523 after retry RPC after error@1914829222) -> (continuation of Deferred@730325267 after retry RPC after error@71695021) -> (continuation of Deferred@657244145 after retry RPC after error@1522372219) -> (continuation of Deferred@1311138630 after retry RPC after error@1704818877) -> (continuation of Deferred@663519432 after retry RPC after error@292822036) -> (continuation of Deferred@1823830319 after retry RPC after error@1659085972) -> (continuation of Deferred@556462784 after retry RPC after error@269471309), errback=(continuation of Deferred@2004978742 after retry RPC after error@1491755865) -> (continuation of Deferred@1101464757 after retry RPC after error@344697989) -> (continuation of Deferred@1863344670 after retry RPC after error@1684743182) -> (continuation of Deferred@487589530 after retry RPC after error@1412857401) -> (continuation of Deferred@945481267 after retry RPC after error@86834786) -> (continuation of Deferred@404032651 after retry RPC after error@2134212102) -> (continuation of Deferred@280065197 after retry RPC after error@1913407287) -> (continuation of Deferred@1120758953 after retry RPC after error@375193528) -> (continuation of Deferred@231990722 after retry RPC after error@502673072) -> (continuation of Deferred@888643971 after retry RPC after error@1160194458) -> (continuation of Deferred@1464350985 after retry RPC after error@2070355710) -> (continuation of Deferred@1922384808 after retry RPC after error@235065241) -> (continuation of Deferred@412368673 after retry RPC after error@1539785251) -> (continuation of Deferred@51892976 after retry RPC after error@460438284) -> (continuation of Deferred@581300852 after retry RPC after error@1133673049) -> (continuation of Deferred@2117054601 after retry RPC after error@1754324379) -> (continuation of Deferred@1705747631 after retry RPC after error@901466865) -> (continuation of Deferred@915607351 after retry RPC after error@1484877947) -> (continuation of Deferred@1622616344 after retry RPC after error@255073085) -> (continuation of Deferred@561010523 after retry RPC after error@1914829222) -> (continuation of Deferred@730325267 after retry RPC after error@71695021) -> (continuation of Deferred@657244145 after retry RPC after error@1522372219) -> (continuation of Deferred@1311138630 after retry RPC after error@1704818877) -> (continuation of Deferred@663519432 after retry RPC after error@292822036) -> (continuation of Deferred@1823830319 after retry RPC after error@1659085972) -> (continuation of Deferred@556462784 after retry RPC after error@269471309)))
18:33:54.181 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:54.181 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:54.182 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:54.182 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.182 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.182 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.182 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.182 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.182 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.182 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.182 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.182 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.182 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:54.245 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:54.245 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:54.245 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:54.245 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:54.245 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:54.246 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:54.246 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:54.246 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:54.246 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:54.246 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:54.246 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:54.246 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:54.246 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:54.248 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:54.248 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:54.248 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:54.248 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:54.248 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:54.248 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:54.248 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:54.248 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:54.248 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:54.248 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:54.249 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:54.249 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:54.249 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:54.339 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:54.339 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:54.339 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:54.340 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.340 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.340 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.341 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.341 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.341 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.341 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.341 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.341 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.341 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:54.375 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:54.375 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:54.375 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:54.376 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.376 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.376 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.376 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.376 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.376 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.376 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.376 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.376 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.376 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:54.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:54.439 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:54.440 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:54.440 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:54.440 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.440 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.441 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.441 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.441 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.441 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.441 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.441 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.441 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.442 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:54.490 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:54.490 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:54.491 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:54.491 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:54.491 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:54.491 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:54.491 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:54.491 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:54.491 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:54.492 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:54.492 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:54.492 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:54.492 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:54.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:54.513494  7820 heartbeater.cc:499] Master 127.6.245.60:46787 was elected leader, sending a full tablet report...
18:33:54.545 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:54.595 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:54.634 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:54.646 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535634646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:54.656 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:54.656 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:54.656 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:54.656 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:54.656 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:54.657 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:54.657 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:54.657 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:54.657 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:54.657 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:54.657 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:54.657 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:54.658 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:54.661 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:54.661 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:54.661 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:54.661 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
18:33:54.662 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.662 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.662 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.662 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.662 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.662 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.663 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
18:33:54.663 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.663 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.664 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.664 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:54.765 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:54.765 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:54.765 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:54.765 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:54.765 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:54.765 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:54.765 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:54.766 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:54.766 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:54.766 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:54.766 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:54.766 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:54.766 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:54.792 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:54.792 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:54.792 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:54.792 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:54.792 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:54.792 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:54.792 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:54.792 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:54.793 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:54.793 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:54.793 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:54.793 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:54.793 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:54.835 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:54.836 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:54.836 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:54.837 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.837 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.837 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:54.837 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.837 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.837 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:54.838 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.838 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.838 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:54.838 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:54.839 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29918), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [14ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [19ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [20ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [20ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [60ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [61ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [62ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [96ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [96ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [98ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [98ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [121ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [122ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [143ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [182ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [182ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [362ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [463ms] refreshing cache from master, [463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [464ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [464ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [465ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [465ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [701ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [702ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [702ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [702ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1204ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1204ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1261ms] refreshing cache from master, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1263ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1264ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1264ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [4880ms] refreshing cache from master, [4880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [4881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [4881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [4881ms] too many traces: truncated at 100 traces, deferred=Deferred@820780448(state=PENDING, result=null, callback=(continuation of Deferred@662661425 after retry RPC after error@223907090) -> (continuation of Deferred@2041637 after retry RPC after error@1347304347) -> (continuation of Deferred@212133442 after retry RPC after error@1172167385) -> (continuation of Deferred@1006824264 after retry RPC after error@498179504) -> (continuation of Deferred@915209906 after retry RPC after error@497873320) -> (continuation of Deferred@920588798 after retry RPC after error@655509128) -> (continuation of Deferred@1991923126 after retry RPC after error@207739768) -> (continuation of Deferred@1115646955 after retry RPC after error@2011972394) -> (continuation of Deferred@1407168388 after retry RPC after error@1365709980) -> (continuation of Deferred@1761484136 after retry RPC after error@2107569742) -> (continuation of Deferred@1393804790 after retry RPC after error@976873724) -> (continuation of Deferred@582264718 after retry RPC after error@680663312) -> (continuation of Deferred@1709393281 after retry RPC after error@275263433) -> (continuation of Deferred@401044125 after retry RPC after error@797291496) -> (continuation of Deferred@1354052820 after retry RPC after error@32661356) -> (continuation of Deferred@766355029 after retry RPC after error@800414459) -> (continuation of Deferred@1457506381 after retry RPC after error@1170597061) -> (continuation of Deferred@94006566 after retry RPC after error@16616940) -> (continuation of Deferred@675852318 after retry RPC after error@1111595550) -> (continuation of Deferred@342109229 after retry RPC after error@2014990752) -> (continuation of Deferred@364889853 after retry RPC after error@1541418814) -> (continuation of Deferred@1859151147 after retry RPC after error@1148038656) -> (continuation of Deferred@797835358 after retry RPC after error@1967997774) -> (continuation of Deferred@408521201 after retry RPC after error@829237588) -> (continuation of Deferred@1857962967 after retry RPC after error@1911962237), errback=(continuation of Deferred@662661425 after retry RPC after error@223907090) -> (continuation of Deferred@2041637 after retry RPC after error@1347304347) -> (continuation of Deferred@212133442 after retry RPC after error@1172167385) -> (continuation of Deferred@1006824264 after retry RPC after error@498179504) -> (continuation of Deferred@915209906 after retry RPC after error@497873320) -> (continuation of Deferred@920588798 after retry RPC after error@655509128) -> (continuation of Deferred@1991923126 after retry RPC after error@207739768) -> (continuation of Deferred@1115646955 after retry RPC after error@2011972394) -> (continuation of Deferred@1407168388 after retry RPC after error@1365709980) -> (continuation of Deferred@1761484136 after retry RPC after error@2107569742) -> (continuation of Deferred@1393804790 after retry RPC after error@976873724) -> (continuation of Deferred@582264718 after retry RPC after error@680663312) -> (continuation of Deferred@1709393281 after retry RPC after error@275263433) -> (continuation of Deferred@401044125 after retry RPC after error@797291496) -> (continuation of Deferred@1354052820 after retry RPC after error@32661356) -> (continuation of Deferred@766355029 after retry RPC after error@800414459) -> (continuation of Deferred@1457506381 after retry RPC after error@1170597061) -> (continuation of Deferred@94006566 after retry RPC after error@16616940) -> (continuation of Deferred@675852318 after retry RPC after error@1111595550) -> (continuation of Deferred@342109229 after retry RPC after error@2014990752) -> (continuation of Deferred@364889853 after retry RPC after error@1541418814) -> (continuation of Deferred@1859151147 after retry RPC after error@1148038656) -> (continuation of Deferred@797835358 after retry RPC after error@1967997774) -> (continuation of Deferred@408521201 after retry RPC after error@829237588) -> (continuation of Deferred@1857962967 after retry RPC after error@1911962237)))
18:33:54.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:54.938 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:54.939 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:54.939 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:54.939 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:54.939 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:54.939 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:54.939 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:54.939 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:54.939 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:54.940 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:54.940 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:54.940 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:54.940 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:55.000 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:55.001 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:55.001 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:55.002 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:55.002 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:55.002 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:55.003 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:55.003 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:55.003 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:55.006 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:55.006 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:55.006 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:55.006 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:55.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:55.095 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:55.126 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:55.126 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:55.126 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:55.127 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:55.127 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:55.127 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:55.127 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:55.128 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:55.128 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:55.128 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:55.128 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:55.128 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:55.128 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:55.134 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:55.146 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535635146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:55.158 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:33:55.160 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
18:33:55.232 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:55.232 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:55.232 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:55.232 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:55.232 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:55.233 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:55.233 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:55.233 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:55.233 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:55.233 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:55.233 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:55.233 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:55.233 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:55.235 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:55.235 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:55.235 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:55.235 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:55.235 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:55.235 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:55.235 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:55.235 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:55.236 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:55.236 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:55.236 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:55.236 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:55.236 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:55.256 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:55.256 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:55.256 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:55.257 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:55.257 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:55.257 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:55.257 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:55.257 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:55.257 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:55.257 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:55.257 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:55.258 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:55.258 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:55.264 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:55.264 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:55.265 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:55.265 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:55.265 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:55.265 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:55.265 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:55.265 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:55.265 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:55.266 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:55.266 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:55.266 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:55.266 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:55.284 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:55.284 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:55.284 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:55.284 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:55.285 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:55.285 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:55.285 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:55.285 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:55.285 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:55.285 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:55.285 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:55.286 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:55.286 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:55.290 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:55.291 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:55.291 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:55.291 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:55.291 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:55.291 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:55.291 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:55.291 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:55.291 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:55.292 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:55.292 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:55.292 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:55.292 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:55.364 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:55.365 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:55.365 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:55.365 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:55.365 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:55.365 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:55.366 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:55.366 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:55.366 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:55.366 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:55.366 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:55.366 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:55.366 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:55.367 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26617), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [41ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [57ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [57ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [58ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [108ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [114ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [117ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [172ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [177ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [182ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [201ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [202ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [243ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [243ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [281ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [281ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [281ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [281ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [421ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [421ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [421ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [421ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [482ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [482ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [483ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [483ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [841ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [842ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [842ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [842ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2120ms] refreshing cache from master, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2123ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [4582ms] refreshing cache from master, [4582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [4582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [4582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [4583ms] too many traces: truncated at 100 traces, deferred=Deferred@1524285975(state=PENDING, result=null, callback=(continuation of Deferred@1235148154 after retry RPC after error@1170825242) -> (continuation of Deferred@741456950 after retry RPC after error@553060829) -> (continuation of Deferred@532510132 after retry RPC after error@293212137) -> (continuation of Deferred@806081020 after retry RPC after error@673882049) -> (continuation of Deferred@1557028773 after retry RPC after error@487196306) -> (continuation of Deferred@1935716606 after retry RPC after error@264826308) -> (continuation of Deferred@559266031 after retry RPC after error@1814435009) -> (continuation of Deferred@439860987 after retry RPC after error@1381615284) -> (continuation of Deferred@1581752016 after retry RPC after error@43719109) -> (continuation of Deferred@628928267 after retry RPC after error@965521782) -> (continuation of Deferred@1541347721 after retry RPC after error@30434822) -> (continuation of Deferred@1100252608 after retry RPC after error@500145029) -> (continuation of Deferred@1056951012 after retry RPC after error@1008561003) -> (continuation of Deferred@1505903533 after retry RPC after error@942733475) -> (continuation of Deferred@2027470251 after retry RPC after error@801753064) -> (continuation of Deferred@1692219031 after retry RPC after error@1536638799) -> (continuation of Deferred@1713366131 after retry RPC after error@126388703) -> (continuation of Deferred@183270967 after retry RPC after error@1751336290) -> (continuation of Deferred@1900415073 after retry RPC after error@843297255) -> (continuation of Deferred@1538751582 after retry RPC after error@697133599) -> (continuation of Deferred@1758030415 after retry RPC after error@1202332216) -> (continuation of Deferred@656401183 after retry RPC after error@1702930545) -> (continuation of Deferred@1178086812 after retry RPC after error@1343585409) -> (continuation of Deferred@147487367 after retry RPC after error@1751750863), errback=(continuation of Deferred@1235148154 after retry RPC after error@1170825242) -> (continuation of Deferred@741456950 after retry RPC after error@553060829) -> (continuation of Deferred@532510132 after retry RPC after error@293212137) -> (continuation of Deferred@806081020 after retry RPC after error@673882049) -> (continuation of Deferred@1557028773 after retry RPC after error@487196306) -> (continuation of Deferred@1935716606 after retry RPC after error@264826308) -> (continuation of Deferred@559266031 after retry RPC after error@1814435009) -> (continuation of Deferred@439860987 after retry RPC after error@1381615284) -> (continuation of Deferred@1581752016 after retry RPC after error@43719109) -> (continuation of Deferred@628928267 after retry RPC after error@965521782) -> (continuation of Deferred@1541347721 after retry RPC after error@30434822) -> (continuation of Deferred@1100252608 after retry RPC after error@500145029) -> (continuation of Deferred@1056951012 after retry RPC after error@1008561003) -> (continuation of Deferred@1505903533 after retry RPC after error@942733475) -> (continuation of Deferred@2027470251 after retry RPC after error@801753064) -> (continuation of Deferred@1692219031 after retry RPC after error@1536638799) -> (continuation of Deferred@1713366131 after retry RPC after error@126388703) -> (continuation of Deferred@183270967 after retry RPC after error@1751336290) -> (continuation of Deferred@1900415073 after retry RPC after error@843297255) -> (continuation of Deferred@1538751582 after retry RPC after error@697133599) -> (continuation of Deferred@1758030415 after retry RPC after error@1202332216) -> (continuation of Deferred@656401183 after retry RPC after error@1702930545) -> (continuation of Deferred@1178086812 after retry RPC after error@1343585409) -> (continuation of Deferred@147487367 after retry RPC after error@1751750863)))
18:33:55.368 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
18:33:55.368 [WARN - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26617), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [41ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [57ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [57ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [58ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [108ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [114ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [117ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [172ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [177ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [182ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [201ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [202ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [243ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [243ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [281ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [281ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [281ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [281ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [421ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [421ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [421ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [421ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [482ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [482ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [483ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [483ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [841ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [842ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [842ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [842ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2120ms] refreshing cache from master, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2123ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [4582ms] refreshing cache from master, [4582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [4582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [4582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [4583ms] too many traces: truncated at 100 traces, deferred=Deferred@1524285975(state=PENDING, result=null, callback=(continuation of Deferred@1235148154 after retry RPC after error@1170825242) -> (continuation of Deferred@741456950 after retry RPC after error@553060829) -> (continuation of Deferred@532510132 after retry RPC after error@293212137) -> (continuation of Deferred@806081020 after retry RPC after error@673882049) -> (continuation of Deferred@1557028773 after retry RPC after error@487196306) -> (continuation of Deferred@1935716606 after retry RPC after error@264826308) -> (continuation of Deferred@559266031 after retry RPC after error@1814435009) -> (continuation of Deferred@439860987 after retry RPC after error@1381615284) -> (continuation of Deferred@1581752016 after retry RPC after error@43719109) -> (continuation of Deferred@628928267 after retry RPC after error@965521782) -> (continuation of Deferred@1541347721 after retry RPC after error@30434822) -> (continuation of Deferred@1100252608 after retry RPC after error@500145029) -> (continuation of Deferred@1056951012 after retry RPC after error@1008561003) -> (continuation of Deferred@1505903533 after retry RPC after error@942733475) -> (continuation of Deferred@2027470251 after retry RPC after error@801753064) -> (continuation of Deferred@1692219031 after retry RPC after error@1536638799) -> (continuation of Deferred@1713366131 after retry RPC after error@126388703) -> (continuation of Deferred@183270967 after retry RPC after error@1751336290) -> (continuation of Deferred@1900415073 after retry RPC after error@843297255) -> (continuation of Deferred@1538751582 after retry RPC after error@697133599) -> (continuation of Deferred@1758030415 after retry RPC after error@1202332216) -> (continuation of Deferred@656401183 after retry RPC after error@1702930545) -> (continuation of Deferred@1178086812 after retry RPC after error@1343585409) -> (continuation of Deferred@147487367 after retry RPC after error@1751750863), errback=(continuation of Deferred@1235148154 after retry RPC after error@1170825242) -> (continuation of Deferred@741456950 after retry RPC after error@553060829) -> (continuation of Deferred@532510132 after retry RPC after error@293212137) -> (continuation of Deferred@806081020 after retry RPC after error@673882049) -> (continuation of Deferred@1557028773 after retry RPC after error@487196306) -> (continuation of Deferred@1935716606 after retry RPC after error@264826308) -> (continuation of Deferred@559266031 after retry RPC after error@1814435009) -> (continuation of Deferred@439860987 after retry RPC after error@1381615284) -> (continuation of Deferred@1581752016 after retry RPC after error@43719109) -> (continuation of Deferred@628928267 after retry RPC after error@965521782) -> (continuation of Deferred@1541347721 after retry RPC after error@30434822) -> (continuation of Deferred@1100252608 after retry RPC after error@500145029) -> (continuation of Deferred@1056951012 after retry RPC after error@1008561003) -> (continuation of Deferred@1505903533 after retry RPC after error@942733475) -> (continuation of Deferred@2027470251 after retry RPC after error@801753064) -> (continuation of Deferred@1692219031 after retry RPC after error@1536638799) -> (continuation of Deferred@1713366131 after retry RPC after error@126388703) -> (continuation of Deferred@183270967 after retry RPC after error@1751336290) -> (continuation of Deferred@1900415073 after retry RPC after error@843297255) -> (continuation of Deferred@1538751582 after retry RPC after error@697133599) -> (continuation of Deferred@1758030415 after retry RPC after error@1202332216) -> (continuation of Deferred@656401183 after retry RPC after error@1702930545) -> (continuation of Deferred@1178086812 after retry RPC after error@1343585409) -> (continuation of Deferred@147487367 after retry RPC after error@1751750863)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:55.369 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
18:33:55.371 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#4 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
18:33:55.373 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED on 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26617), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [41ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [57ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [57ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [58ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [108ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [114ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [117ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [117ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [172ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [177ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [182ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [201ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [202ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [243ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [243ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [281ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [281ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [281ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [281ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [421ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [421ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [421ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [421ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [482ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [482ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [483ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [483ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [841ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [842ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [842ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [842ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1243ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2120ms] refreshing cache from master, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2123ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [4582ms] refreshing cache from master, [4582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [4582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [4582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [4583ms] too many traces: truncated at 100 traces, deferred=Deferred@1524285975(state=PENDING, result=null, callback=(continuation of Deferred@1235148154 after retry RPC after error@1170825242) -> (continuation of Deferred@741456950 after retry RPC after error@553060829) -> (continuation of Deferred@532510132 after retry RPC after error@293212137) -> (continuation of Deferred@806081020 after retry RPC after error@673882049) -> (continuation of Deferred@1557028773 after retry RPC after error@487196306) -> (continuation of Deferred@1935716606 after retry RPC after error@264826308) -> (continuation of Deferred@559266031 after retry RPC after error@1814435009) -> (continuation of Deferred@439860987 after retry RPC after error@1381615284) -> (continuation of Deferred@1581752016 after retry RPC after error@43719109) -> (continuation of Deferred@628928267 after retry RPC after error@965521782) -> (continuation of Deferred@1541347721 after retry RPC after error@30434822) -> (continuation of Deferred@1100252608 after retry RPC after error@500145029) -> (continuation of Deferred@1056951012 after retry RPC after error@1008561003) -> (continuation of Deferred@1505903533 after retry RPC after error@942733475) -> (continuation of Deferred@2027470251 after retry RPC after error@801753064) -> (continuation of Deferred@1692219031 after retry RPC after error@1536638799) -> (continuation of Deferred@1713366131 after retry RPC after error@126388703) -> (continuation of Deferred@183270967 after retry RPC after error@1751336290) -> (continuation of Deferred@1900415073 after retry RPC after error@843297255) -> (continuation of Deferred@1538751582 after retry RPC after error@697133599) -> (continuation of Deferred@1758030415 after retry RPC after error@1202332216) -> (continuation of Deferred@656401183 after retry RPC after error@1702930545) -> (continuation of Deferred@1178086812 after retry RPC after error@1343585409) -> (continuation of Deferred@147487367 after retry RPC after error@1751750863), errback=(continuation of Deferred@1235148154 after retry RPC after error@1170825242) -> (continuation of Deferred@741456950 after retry RPC after error@553060829) -> (continuation of Deferred@532510132 after retry RPC after error@293212137) -> (continuation of Deferred@806081020 after retry RPC after error@673882049) -> (continuation of Deferred@1557028773 after retry RPC after error@487196306) -> (continuation of Deferred@1935716606 after retry RPC after error@264826308) -> (continuation of Deferred@559266031 after retry RPC after error@1814435009) -> (continuation of Deferred@439860987 after retry RPC after error@1381615284) -> (continuation of Deferred@1581752016 after retry RPC after error@43719109) -> (continuation of Deferred@628928267 after retry RPC after error@965521782) -> (continuation of Deferred@1541347721 after retry RPC after error@30434822) -> (continuation of Deferred@1100252608 after retry RPC after error@500145029) -> (continuation of Deferred@1056951012 after retry RPC after error@1008561003) -> (continuation of Deferred@1505903533 after retry RPC after error@942733475) -> (continuation of Deferred@2027470251 after retry RPC after error@801753064) -> (continuation of Deferred@1692219031 after retry RPC after error@1536638799) -> (continuation of Deferred@1713366131 after retry RPC after error@126388703) -> (continuation of Deferred@183270967 after retry RPC after error@1751336290) -> (continuation of Deferred@1900415073 after retry RPC after error@843297255) -> (continuation of Deferred@1538751582 after retry RPC after error@697133599) -> (continuation of Deferred@1758030415 after retry RPC after error@1202332216) -> (continuation of Deferred@656401183 after retry RPC after error@1702930545) -> (continuation of Deferred@1178086812 after retry RPC after error@1343585409) -> (continuation of Deferred@147487367 after retry RPC after error@1751750863)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:55.374 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
18:33:55.374 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9) switched from state RUNNING to RESTARTING.
18:33:55.374 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:33:55.375 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#4) of source Source: KuduSource.
18:33:55.395 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:55.395 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:55.395 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:55.395 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:55.395 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:55.395 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:55.395 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:55.396 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:55.396 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:55.396 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:55.396 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:55.396 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:55.396 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:55.396 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:55.396 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:55.396 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:55.397 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:55.397 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:55.397 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:55.397 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:55.397 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:55.397 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:55.397 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:55.395 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:55.398 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:55.398 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:55.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:55.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:53.942698  7837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:55.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:55.428637  7839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:55.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:55.431062  7838 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1485 milliseconds
18:33:55.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.431175  7830 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:33:55.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.432714  7830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:33:55.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.435734  7830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:33:55.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.437294  7830 hybrid_clock.cc:648] HybridClock initialized: now 1783535635437258 us; error 67 us; skew 500 ppm
18:33:55.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.438623  7830 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:33:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.446069  7830 webserver.cc:534] Webserver started at http://127.6.245.3:35327/ using document root <none> and password file <none>
18:33:55.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.447139  7830 fs_manager.cc:362] Metadata directory not provided
18:33:55.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.447328  7830 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:33:55.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.447957  7830 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:33:55.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.452338  7830 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/data/instance:
18:33:55.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "82d9e0a8932940ac9e0041e68e8c7ff0"
18:33:55.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:55 on dist-test-slave-dxnw"
18:33:55.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.453680  7830 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/wal/instance:
18:33:55.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "82d9e0a8932940ac9e0041e68e8c7ff0"
18:33:55.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:55 on dist-test-slave-dxnw"
18:33:55.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.461766  7830 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.010s	sys 0.000s
18:33:55.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.468310  7847 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:33:55.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.469538  7830 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
18:33:55.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.469966  7830 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/wal
18:33:55.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "82d9e0a8932940ac9e0041e68e8c7ff0"
18:33:55.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:55 on dist-test-slave-dxnw"
18:33:55.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.470310  7830 fs_report.cc:389] FS layout report
18:33:55.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:33:55.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/wal
18:33:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/wal
18:33:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/data/data
18:33:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:33:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:33:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:33:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:33:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:33:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:33:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:33:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:33:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:33:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:33:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:33:55.475 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:55.475 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:55.475 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:55.476 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:55.476 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:55.476 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:55.476 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:55.476 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:55.476 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:55.477 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:55.477 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:55.477 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:55.477 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:55.494 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:55.495 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:55.495 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:55.495 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:55.495 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:55.495 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:55.495 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:55.495 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:55.495 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:55.495 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:55.495 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:55.495 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:55.495 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:55.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.532181  7830 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:33:55.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.534540  7830 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:33:55.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.535125  7830 kserver.cc:163] Server-wide thread pool size limit: 3276
18:33:55.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.538369  7830 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:33:55.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.543138  7830 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:33:55.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.543377  7830 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:33:55.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.543676  7830 ts_tablet_manager.cc:616] Registered 0 tablets
18:33:55.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.543867  7830 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:33:55.545 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:55.554 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:55.554 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:55.554 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:55.554 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:55.554 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:55.554 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:55.554 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:55.555 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:55.555 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:55.556 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:55.556 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:55.556 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:55.556 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:55.633 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:55.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535635646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:55.654 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
18:33:55.654 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
18:33:55.667 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:55.667 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:55.667 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:55.668 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:55.668 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:55.668 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:55.668 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:55.668 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:55.668 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:55.668 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:55.668 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:55.668 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:55.668 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:55.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.732820  7830 rpc_server.cc:307] RPC server started. Bound to: 127.6.245.3:45063
18:33:55.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.732928  7959 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.245.3:45063 every 8 connection(s)
18:33:55.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.735836  7830 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/data/info.pb
18:33:55.743 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:55.743 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:55.743 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:55.743 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:55.743 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:55.743 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:55.744 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:55.744 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:55.744 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:55.744 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:55.744 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:55.744 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:55.744 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:55.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.745215  7124 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 7830
18:33:55.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.745662  7124 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster3121577641178360910/ts-2/wal/instance
18:33:55.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.796865  7961 heartbeater.cc:344] Connected to a master server at 127.6.245.61:44495
18:33:55.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.797358  7961 heartbeater.cc:461] Registering TS with master...
18:33:55.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.798614  7961 heartbeater.cc:507] Master 127.6.245.61:44495 requested a full tablet report, sending...
18:33:55.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.800570  7962 heartbeater.cc:344] Connected to a master server at 127.6.245.62:36853
18:33:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.801229  7962 heartbeater.cc:461] Registering TS with master...
18:33:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.802217  7962 heartbeater.cc:507] Master 127.6.245.62:36853 requested a full tablet report, sending...
18:33:55.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.804987  7169 ts_manager.cc:194] Registered new tserver with Master: 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063)
18:33:55.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.807446  7960 heartbeater.cc:344] Connected to a master server at 127.6.245.60:46787
18:33:55.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.807854  7960 heartbeater.cc:461] Registering TS with master...
18:33:55.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.808538  7245 ts_manager.cc:194] Registered new tserver with Master: 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063)
18:33:55.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.808863  7960 heartbeater.cc:507] Master 127.6.245.60:46787 requested a full tablet report, sending...
18:33:55.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.811307  7325 ts_manager.cc:194] Registered new tserver with Master: 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063)
18:33:55.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.813186  7325 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.245.3:45497
18:33:55.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:55.828696  7124 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
18:33:55.841 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:33:55.842 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

18:33:55.843 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.6.245.62"
      port: 36853
    }
    bound_http_address {
      host: "127.6.245.62"
      port: 42501
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.6.245.61"
      port: 44495
    }
    bound_http_address {
      host: "127.6.245.61"
      port: 44463
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.6.245.60"
      port: 46787
    }
    bound_http_address {
      host: "127.6.245.60"
      port: 40801
    }
  }
}

18:33:55.843 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

18:33:55.844 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.6.245.1"
      port: 39053
    }
    bound_http_address {
      host: "127.6.245.1"
      port: 34741
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.6.245.2"
      port: 40933
    }
    bound_http_address {
      host: "127.6.245.2"
      port: 42033
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.6.245.3"
      port: 45063
    }
    bound_http_address {
      host: "127.6.245.3"
      port: 35327
    }
  }
}

18:33:55.844 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
18:33:55.845 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:33:55.845 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
18:33:55.846 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskSwO0Je/test-tmp
18:33:55.846 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
18:33:55.846 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskSwO0Je/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
18:33:55.852 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

18:33:55.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:56.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:56.133 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:56.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535636146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:56.154 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:33:56.155 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
18:33:56.162 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:56.162 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:56.162 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:56.162 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:56.162 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:56.162 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:56.162 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:56.167 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:56.167 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:56.167 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:56.162 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:56.167 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:56.167 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:56.227 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:56.228 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:56.228 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:56.228 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:56.228 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:56.228 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:56.228 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:56.228 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:56.228 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:56.228 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:56.228 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:56.228 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:56.228 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:56.270 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:56.270 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:56.270 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:56.270 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:56.271 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:56.271 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:56.271 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:56.271 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:56.271 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:56.271 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:56.271 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:56.271 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:56.271 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:56.272 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:33:56.272 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

18:33:56.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:56.275924  7970 mini_oidc.cc:150] Starting JWKS server
18:33:56.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:56.280021  7970 webserver.cc:534] Webserver started at http://127.0.0.1:40103/ using document root <none> and password file <none>
18:33:56.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:56.280616  7970 mini_oidc.cc:186] Starting OIDC Discovery server
18:33:56.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:56.282577  7970 webserver.cc:534] Webserver started at http://127.0.0.1:40465/ using document root <none> and password file <none>
18:33:56.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:33:56Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
18:33:56.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:33:56Z Disabled control of system clock
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:56.349252  7970 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/wal
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/data
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/logs
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/data/info.pb
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:33:56.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:33:56.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.200.190:40077
18:33:56.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.200.190
18:33:56.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:56.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.200.148:33865
18:33:56.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:56.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:56.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:56.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:33:56.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.7.200.190:40077,127.7.200.189:42349,127.7.200.188:38999
18:33:56.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:33:56.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40103/jwks.json with env {}
18:33:56.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:56.502 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:56.502 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:56.502 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:56.502 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:56.503 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:56.503 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:56.503 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:56.503 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:56.503 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:56.503 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:56.503 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:56.503 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:56.503 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:56.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:56.633 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:56.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535636646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:56.654 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:33:56.655 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
18:33:56.664 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:56.664 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:56.664 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:56.665 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:56.665 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:56.665 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:56.665 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:56.665 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:56.665 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:56.665 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:56.665 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:56.665 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:56.665 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:56.691 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:56.691 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:56.691 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:56.691 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:56.691 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:56.691 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:56.691 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:56.691 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:56.691 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:56.691 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:56.691 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:56.692 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:56.692 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:56.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:56.700654  7982 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:33:56.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:56.701401  7982 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:33:56.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:56.701960  7982 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:33:56.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:56.739238  7982 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:33:56.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:56.739547  7982 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:33:56.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:56.739847  7982 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:33:56.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:56.740084  7982 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:33:56.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:56.740378  7982 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:33:56.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:56.740619  7982 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40103/jwks.json
18:33:56.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:56.787370  7982 master_runner.cc:387] Master server non-default flags:
18:33:56.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.200.148:33865
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/data
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/wal
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.7.200.190:40077,127.7.200.189:42349,127.7.200.188:38999
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.200.190:40077
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40103/jwks.json
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/data/info.pb
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.200.190
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/logs
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:33:56.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:33:56.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:56.789214  7982 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:33:56.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:56.791162  7982 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:33:56.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:56.806005  7988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:56.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:56.819224  7960 heartbeater.cc:499] Master 127.6.245.60:46787 was elected leader, sending a full tablet report...
18:33:56.841 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:56.841 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:56.841 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:56.841 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:56.842 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:56.842 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:56.842 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:56.842 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:56.842 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:56.842 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:56.842 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:56.842 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:56.842 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:56.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:56.979 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:56.979 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:56.979 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:56.980 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:56.980 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:56.980 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:56.981 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:56.981 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:56.981 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:56.981 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:56.981 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:56.981 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:56.981 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:56.982 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28236), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [34ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [209ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [211ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [348ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [350ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [353ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [353ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [358ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [358ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [396ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [400ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [401ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [401ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [421ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [422ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [422ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [423ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [441ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [442ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [461ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [481ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [481ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [481ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [481ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [501ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [502ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [502ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [502ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [563ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [563ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [564ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [564ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [662ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [662ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [662ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [663ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [722ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [722ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [722ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [722ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1000ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1002ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [4960ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [4961ms] too many traces: truncated at 100 traces, deferred=Deferred@1413021295(state=PENDING, result=null, callback=(continuation of Deferred@1465584564 after retry RPC after error@1617577651) -> (continuation of Deferred@906723278 after retry RPC after error@626210022) -> (continuation of Deferred@710577491 after retry RPC after error@406264181) -> (continuation of Deferred@1974464690 after retry RPC after error@1231494885) -> (continuation of Deferred@925442703 after retry RPC after error@401963438) -> (continuation of Deferred@492118402 after retry RPC after error@1815381243) -> (continuation of Deferred@318242472 after retry RPC after error@787729745) -> (continuation of Deferred@438214716 after retry RPC after error@1380318424) -> (continuation of Deferred@2146065030 after retry RPC after error@1338214767) -> (continuation of Deferred@548655083 after retry RPC after error@1575830553) -> (continuation of Deferred@1895701320 after retry RPC after error@598043849) -> (continuation of Deferred@492250049 after retry RPC after error@716009982) -> (continuation of Deferred@705239992 after retry RPC after error@574814484) -> (continuation of Deferred@103780278 after retry RPC after error@1204567052) -> (continuation of Deferred@628767638 after retry RPC after error@273017972) -> (continuation of Deferred@1793954805 after retry RPC after error@1290268408) -> (continuation of Deferred@951437945 after retry RPC after error@120371031) -> (continuation of Deferred@22609532 after retry RPC after error@1924874369) -> (continuation of Deferred@1682680493 after retry RPC after error@113196924) -> (continuation of Deferred@1087539913 after retry RPC after error@1757766938) -> (continuation of Deferred@1373811821 after retry RPC after error@777594354) -> (continuation of Deferred@2055829042 after retry RPC after error@958869964) -> (continuation of Deferred@2099428185 after retry RPC after error@439576506) -> (continuation of Deferred@733653544 after retry RPC after error@731076546) -> (continuation of Deferred@1132710298 after retry RPC after error@1116502247), errback=(continuation of Deferred@1465584564 after retry RPC after error@1617577651) -> (continuation of Deferred@906723278 after retry RPC after error@626210022) -> (continuation of Deferred@710577491 after retry RPC after error@406264181) -> (continuation of Deferred@1974464690 after retry RPC after error@1231494885) -> (continuation of Deferred@925442703 after retry RPC after error@401963438) -> (continuation of Deferred@492118402 after retry RPC after error@1815381243) -> (continuation of Deferred@318242472 after retry RPC after error@787729745) -> (continuation of Deferred@438214716 after retry RPC after error@1380318424) -> (continuation of Deferred@2146065030 after retry RPC after error@1338214767) -> (continuation of Deferred@548655083 after retry RPC after error@1575830553) -> (continuation of Deferred@1895701320 after retry RPC after error@598043849) -> (continuation of Deferred@492250049 after retry RPC after error@716009982) -> (continuation of Deferred@705239992 after retry RPC after error@574814484) -> (continuation of Deferred@103780278 after retry RPC after error@1204567052) -> (continuation of Deferred@628767638 after retry RPC after error@273017972) -> (continuation of Deferred@1793954805 after retry RPC after error@1290268408) -> (continuation of Deferred@951437945 after retry RPC after error@120371031) -> (continuation of Deferred@22609532 after retry RPC after error@1924874369) -> (continuation of Deferred@1682680493 after retry RPC after error@113196924) -> (continuation of Deferred@1087539913 after retry RPC after error@1757766938) -> (continuation of Deferred@1373811821 after retry RPC after error@777594354) -> (continuation of Deferred@2055829042 after retry RPC after error@958869964) -> (continuation of Deferred@2099428185 after retry RPC after error@439576506) -> (continuation of Deferred@733653544 after retry RPC after error@731076546) -> (continuation of Deferred@1132710298 after retry RPC after error@1116502247)))
18:33:56.983 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
18:33:56.984 [WARN - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28236), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [34ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [209ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [211ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [348ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [350ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [353ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [353ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [358ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [358ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [396ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [400ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [401ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [401ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [421ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [422ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [422ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [423ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [441ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [442ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [461ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [481ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [481ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [481ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [481ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [501ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [502ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [502ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [502ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [563ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [563ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [564ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [564ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [662ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [662ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [662ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [663ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [722ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [722ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [722ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [722ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1000ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1002ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [4960ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [4961ms] too many traces: truncated at 100 traces, deferred=Deferred@1413021295(state=PENDING, result=null, callback=(continuation of Deferred@1465584564 after retry RPC after error@1617577651) -> (continuation of Deferred@906723278 after retry RPC after error@626210022) -> (continuation of Deferred@710577491 after retry RPC after error@406264181) -> (continuation of Deferred@1974464690 after retry RPC after error@1231494885) -> (continuation of Deferred@925442703 after retry RPC after error@401963438) -> (continuation of Deferred@492118402 after retry RPC after error@1815381243) -> (continuation of Deferred@318242472 after retry RPC after error@787729745) -> (continuation of Deferred@438214716 after retry RPC after error@1380318424) -> (continuation of Deferred@2146065030 after retry RPC after error@1338214767) -> (continuation of Deferred@548655083 after retry RPC after error@1575830553) -> (continuation of Deferred@1895701320 after retry RPC after error@598043849) -> (continuation of Deferred@492250049 after retry RPC after error@716009982) -> (continuation of Deferred@705239992 after retry RPC after error@574814484) -> (continuation of Deferred@103780278 after retry RPC after error@1204567052) -> (continuation of Deferred@628767638 after retry RPC after error@273017972) -> (continuation of Deferred@1793954805 after retry RPC after error@1290268408) -> (continuation of Deferred@951437945 after retry RPC after error@120371031) -> (continuation of Deferred@22609532 after retry RPC after error@1924874369) -> (continuation of Deferred@1682680493 after retry RPC after error@113196924) -> (continuation of Deferred@1087539913 after retry RPC after error@1757766938) -> (continuation of Deferred@1373811821 after retry RPC after error@777594354) -> (continuation of Deferred@2055829042 after retry RPC after error@958869964) -> (continuation of Deferred@2099428185 after retry RPC after error@439576506) -> (continuation of Deferred@733653544 after retry RPC after error@731076546) -> (continuation of Deferred@1132710298 after retry RPC after error@1116502247), errback=(continuation of Deferred@1465584564 after retry RPC after error@1617577651) -> (continuation of Deferred@906723278 after retry RPC after error@626210022) -> (continuation of Deferred@710577491 after retry RPC after error@406264181) -> (continuation of Deferred@1974464690 after retry RPC after error@1231494885) -> (continuation of Deferred@925442703 after retry RPC after error@401963438) -> (continuation of Deferred@492118402 after retry RPC after error@1815381243) -> (continuation of Deferred@318242472 after retry RPC after error@787729745) -> (continuation of Deferred@438214716 after retry RPC after error@1380318424) -> (continuation of Deferred@2146065030 after retry RPC after error@1338214767) -> (continuation of Deferred@548655083 after retry RPC after error@1575830553) -> (continuation of Deferred@1895701320 after retry RPC after error@598043849) -> (continuation of Deferred@492250049 after retry RPC after error@716009982) -> (continuation of Deferred@705239992 after retry RPC after error@574814484) -> (continuation of Deferred@103780278 after retry RPC after error@1204567052) -> (continuation of Deferred@628767638 after retry RPC after error@273017972) -> (continuation of Deferred@1793954805 after retry RPC after error@1290268408) -> (continuation of Deferred@951437945 after retry RPC after error@120371031) -> (continuation of Deferred@22609532 after retry RPC after error@1924874369) -> (continuation of Deferred@1682680493 after retry RPC after error@113196924) -> (continuation of Deferred@1087539913 after retry RPC after error@1757766938) -> (continuation of Deferred@1373811821 after retry RPC after error@777594354) -> (continuation of Deferred@2055829042 after retry RPC after error@958869964) -> (continuation of Deferred@2099428185 after retry RPC after error@439576506) -> (continuation of Deferred@733653544 after retry RPC after error@731076546) -> (continuation of Deferred@1132710298 after retry RPC after error@1116502247)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:56.984 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
18:33:56.986 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#4 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
18:33:56.989 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to FAILED on 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28236), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [34ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [209ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [211ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [348ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [350ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [353ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [353ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [358ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [358ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [396ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [400ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [401ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [401ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [421ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [422ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [422ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [423ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [441ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [442ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [461ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [481ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [481ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [481ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [481ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [501ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [502ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [502ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [502ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [563ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [563ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [564ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [564ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [662ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [662ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [662ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [663ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [722ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [722ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [722ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [722ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1000ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1002ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [4960ms] refreshing cache from master, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [4960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [4961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [4961ms] too many traces: truncated at 100 traces, deferred=Deferred@1413021295(state=PENDING, result=null, callback=(continuation of Deferred@1465584564 after retry RPC after error@1617577651) -> (continuation of Deferred@906723278 after retry RPC after error@626210022) -> (continuation of Deferred@710577491 after retry RPC after error@406264181) -> (continuation of Deferred@1974464690 after retry RPC after error@1231494885) -> (continuation of Deferred@925442703 after retry RPC after error@401963438) -> (continuation of Deferred@492118402 after retry RPC after error@1815381243) -> (continuation of Deferred@318242472 after retry RPC after error@787729745) -> (continuation of Deferred@438214716 after retry RPC after error@1380318424) -> (continuation of Deferred@2146065030 after retry RPC after error@1338214767) -> (continuation of Deferred@548655083 after retry RPC after error@1575830553) -> (continuation of Deferred@1895701320 after retry RPC after error@598043849) -> (continuation of Deferred@492250049 after retry RPC after error@716009982) -> (continuation of Deferred@705239992 after retry RPC after error@574814484) -> (continuation of Deferred@103780278 after retry RPC after error@1204567052) -> (continuation of Deferred@628767638 after retry RPC after error@273017972) -> (continuation of Deferred@1793954805 after retry RPC after error@1290268408) -> (continuation of Deferred@951437945 after retry RPC after error@120371031) -> (continuation of Deferred@22609532 after retry RPC after error@1924874369) -> (continuation of Deferred@1682680493 after retry RPC after error@113196924) -> (continuation of Deferred@1087539913 after retry RPC after error@1757766938) -> (continuation of Deferred@1373811821 after retry RPC after error@777594354) -> (continuation of Deferred@2055829042 after retry RPC after error@958869964) -> (continuation of Deferred@2099428185 after retry RPC after error@439576506) -> (continuation of Deferred@733653544 after retry RPC after error@731076546) -> (continuation of Deferred@1132710298 after retry RPC after error@1116502247), errback=(continuation of Deferred@1465584564 after retry RPC after error@1617577651) -> (continuation of Deferred@906723278 after retry RPC after error@626210022) -> (continuation of Deferred@710577491 after retry RPC after error@406264181) -> (continuation of Deferred@1974464690 after retry RPC after error@1231494885) -> (continuation of Deferred@925442703 after retry RPC after error@401963438) -> (continuation of Deferred@492118402 after retry RPC after error@1815381243) -> (continuation of Deferred@318242472 after retry RPC after error@787729745) -> (continuation of Deferred@438214716 after retry RPC after error@1380318424) -> (continuation of Deferred@2146065030 after retry RPC after error@1338214767) -> (continuation of Deferred@548655083 after retry RPC after error@1575830553) -> (continuation of Deferred@1895701320 after retry RPC after error@598043849) -> (continuation of Deferred@492250049 after retry RPC after error@716009982) -> (continuation of Deferred@705239992 after retry RPC after error@574814484) -> (continuation of Deferred@103780278 after retry RPC after error@1204567052) -> (continuation of Deferred@628767638 after retry RPC after error@273017972) -> (continuation of Deferred@1793954805 after retry RPC after error@1290268408) -> (continuation of Deferred@951437945 after retry RPC after error@120371031) -> (continuation of Deferred@22609532 after retry RPC after error@1924874369) -> (continuation of Deferred@1682680493 after retry RPC after error@113196924) -> (continuation of Deferred@1087539913 after retry RPC after error@1757766938) -> (continuation of Deferred@1373811821 after retry RPC after error@777594354) -> (continuation of Deferred@2055829042 after retry RPC after error@958869964) -> (continuation of Deferred@2099428185 after retry RPC after error@439576506) -> (continuation of Deferred@733653544 after retry RPC after error@731076546) -> (continuation of Deferred@1132710298 after retry RPC after error@1116502247)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:56.996 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:33:56.996 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#4) of source Source: KuduSource.
18:33:56.996 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
18:33:57.014 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:57.014 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:57.014 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:57.014 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:57.014 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:57.014 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:57.015 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:57.015 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:57.015 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:57.015 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:57.015 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:57.015 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:57.015 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:57.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:57.134 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:57.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535637146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:57.156 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:33:57.158 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
18:33:57.280 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:57.280 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:57.280 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:57.281 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:57.281 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:57.281 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:57.281 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:57.281 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:57.281 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:57.281 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:57.281 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:57.281 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:57.281 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:57.368 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:57.368 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:57.368 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:57.368 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:57.369 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:57.369 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:57.369 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:57.369 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:57.369 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:57.369 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:57.369 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:57.369 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:57.369 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:57.379 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:57.380 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:57.380 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:57.380 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:57.380 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:57.380 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:57.380 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:57.380 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:57.381 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:57.381 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:57.381 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:57.381 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:57.381 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:57.424 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:57.429 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:57.429 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:57.429 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:57.429 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:57.429 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:57.430 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:57.430 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:57.430 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:57.430 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:57.430 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:57.430 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:57.430 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:57.430 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:57.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:57.634 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:57.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535637646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:57.657 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:33:57.658 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
18:33:57.666 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:57.667 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:57.667 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:57.667 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:57.667 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:57.667 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:57.667 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:57.667 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:57.667 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:57.667 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:57.667 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:57.667 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:57.667 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:57.675 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:57.675 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:57.675 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:57.675 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:57.675 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:57.675 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:57.675 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:57.675 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:57.675 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:57.675 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:57.675 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:57.675 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:57.675 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:57.676 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:57.677 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:57.677 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:57.677 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:57.677 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:57.677 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:57.677 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:57.677 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:57.677 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:57.677 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:57.677 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:57.677 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:57.677 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:57.838 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:33:57.838 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:33:57.838 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:33:57.839 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:57.839 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:57.839 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:57.839 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:33:57.839 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:57.839 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:57.839 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:57.839 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:33:57.839 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:33:57.839 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:33:57.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:57.924 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:57.924 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:57.924 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:57.925 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:57.925 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:57.925 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:57.925 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:57.925 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:57.925 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:57.925 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:57.925 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:57.925 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:57.926 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:57.951 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:57.951 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:57.951 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:57.952 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:57.952 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:57.952 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:57.952 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:57.952 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:57.952 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:57.952 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:57.952 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:57.952 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:57.952 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:57.953 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29176), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [93ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [133ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [154ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [154ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [246ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [247ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [271ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [271ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [359ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [360ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [366ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [367ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [367ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [368ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [381ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [381ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [381ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [381ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [402ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [402ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [402ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [402ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [421ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [421ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [422ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [422ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [462ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [463ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [463ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [463ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [560ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [561ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [561ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [562ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [562ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [602ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [602ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [603ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [603ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [922ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [922ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [922ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [923ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1701ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1702ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2720ms] refreshing cache from master, [2720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2721ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2722ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2761ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2762ms] too many traces: truncated at 100 traces, deferred=Deferred@1014338256(state=PENDING, result=null, callback=(continuation of Deferred@724612497 after retry RPC after error@1638459948) -> (continuation of Deferred@1268310668 after retry RPC after error@1542130237) -> (continuation of Deferred@1977196780 after retry RPC after error@1401343473) -> (continuation of Deferred@1594280335 after retry RPC after error@1556060848) -> (continuation of Deferred@1683590923 after retry RPC after error@30748468) -> (continuation of Deferred@1761006640 after retry RPC after error@1211935108) -> (continuation of Deferred@1622492767 after retry RPC after error@1219586546) -> (continuation of Deferred@372798336 after retry RPC after error@996509770) -> (continuation of Deferred@1898493639 after retry RPC after error@848670697) -> (continuation of Deferred@1743023688 after retry RPC after error@1892982054) -> (continuation of Deferred@1157530485 after retry RPC after error@1527486180) -> (continuation of Deferred@534328803 after retry RPC after error@1261483667) -> (continuation of Deferred@2078634411 after retry RPC after error@2094953605) -> (continuation of Deferred@721301712 after retry RPC after error@1689554738) -> (continuation of Deferred@881639974 after retry RPC after error@1006232174) -> (continuation of Deferred@1624911217 after retry RPC after error@551023431) -> (continuation of Deferred@1914210441 after retry RPC after error@101117494) -> (continuation of Deferred@923204130 after retry RPC after error@676620878) -> (continuation of Deferred@507437837 after retry RPC after error@796449186) -> (continuation of Deferred@791671173 after retry RPC after error@606267444) -> (continuation of Deferred@1299005750 after retry RPC after error@615593200) -> (continuation of Deferred@1950501434 after retry RPC after error@1192390606) -> (continuation of Deferred@1615983339 after retry RPC after error@1307204773) -> (continuation of Deferred@731892920 after retry RPC after error@2133305882) -> (continuation of Deferred@269404607 after retry RPC after error@262053999), errback=(continuation of Deferred@724612497 after retry RPC after error@1638459948) -> (continuation of Deferred@1268310668 after retry RPC after error@1542130237) -> (continuation of Deferred@1977196780 after retry RPC after error@1401343473) -> (continuation of Deferred@1594280335 after retry RPC after error@1556060848) -> (continuation of Deferred@1683590923 after retry RPC after error@30748468) -> (continuation of Deferred@1761006640 after retry RPC after error@1211935108) -> (continuation of Deferred@1622492767 after retry RPC after error@1219586546) -> (continuation of Deferred@372798336 after retry RPC after error@996509770) -> (continuation of Deferred@1898493639 after retry RPC after error@848670697) -> (continuation of Deferred@1743023688 after retry RPC after error@1892982054) -> (continuation of Deferred@1157530485 after retry RPC after error@1527486180) -> (continuation of Deferred@534328803 after retry RPC after error@1261483667) -> (continuation of Deferred@2078634411 after retry RPC after error@2094953605) -> (continuation of Deferred@721301712 after retry RPC after error@1689554738) -> (continuation of Deferred@881639974 after retry RPC after error@1006232174) -> (continuation of Deferred@1624911217 after retry RPC after error@551023431) -> (continuation of Deferred@1914210441 after retry RPC after error@101117494) -> (continuation of Deferred@923204130 after retry RPC after error@676620878) -> (continuation of Deferred@507437837 after retry RPC after error@796449186) -> (continuation of Deferred@791671173 after retry RPC after error@606267444) -> (continuation of Deferred@1299005750 after retry RPC after error@615593200) -> (continuation of Deferred@1950501434 after retry RPC after error@1192390606) -> (continuation of Deferred@1615983339 after retry RPC after error@1307204773) -> (continuation of Deferred@731892920 after retry RPC after error@2133305882) -> (continuation of Deferred@269404607 after retry RPC after error@262053999)))
18:33:57.954 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:57.954 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:57.955 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:57.955 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:57.955 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:57.955 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:57.955 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29176), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [93ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [133ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [154ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [154ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [246ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [247ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [271ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [271ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [359ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [360ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [366ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [367ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [367ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [368ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [381ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [381ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [381ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [381ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [402ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [402ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [402ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [402ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [421ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [421ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [422ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [422ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [462ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [463ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [463ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [463ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [560ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [561ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [561ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [562ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [562ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [602ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [602ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [603ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [603ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [922ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [922ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [922ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [923ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1701ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1702ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2720ms] refreshing cache from master, [2720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2721ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2722ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2761ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2762ms] too many traces: truncated at 100 traces, deferred=Deferred@1014338256(state=PENDING, result=null, callback=(continuation of Deferred@724612497 after retry RPC after error@1638459948) -> (continuation of Deferred@1268310668 after retry RPC after error@1542130237) -> (continuation of Deferred@1977196780 after retry RPC after error@1401343473) -> (continuation of Deferred@1594280335 after retry RPC after error@1556060848) -> (continuation of Deferred@1683590923 after retry RPC after error@30748468) -> (continuation of Deferred@1761006640 after retry RPC after error@1211935108) -> (continuation of Deferred@1622492767 after retry RPC after error@1219586546) -> (continuation of Deferred@372798336 after retry RPC after error@996509770) -> (continuation of Deferred@1898493639 after retry RPC after error@848670697) -> (continuation of Deferred@1743023688 after retry RPC after error@1892982054) -> (continuation of Deferred@1157530485 after retry RPC after error@1527486180) -> (continuation of Deferred@534328803 after retry RPC after error@1261483667) -> (continuation of Deferred@2078634411 after retry RPC after error@2094953605) -> (continuation of Deferred@721301712 after retry RPC after error@1689554738) -> (continuation of Deferred@881639974 after retry RPC after error@1006232174) -> (continuation of Deferred@1624911217 after retry RPC after error@551023431) -> (continuation of Deferred@1914210441 after retry RPC after error@101117494) -> (continuation of Deferred@923204130 after retry RPC after error@676620878) -> (continuation of Deferred@507437837 after retry RPC after error@796449186) -> (continuation of Deferred@791671173 after retry RPC after error@606267444) -> (continuation of Deferred@1299005750 after retry RPC after error@615593200) -> (continuation of Deferred@1950501434 after retry RPC after error@1192390606) -> (continuation of Deferred@1615983339 after retry RPC after error@1307204773) -> (continuation of Deferred@731892920 after retry RPC after error@2133305882) -> (continuation of Deferred@269404607 after retry RPC after error@262053999), errback=(continuation of Deferred@724612497 after retry RPC after error@1638459948) -> (continuation of Deferred@1268310668 after retry RPC after error@1542130237) -> (continuation of Deferred@1977196780 after retry RPC after error@1401343473) -> (continuation of Deferred@1594280335 after retry RPC after error@1556060848) -> (continuation of Deferred@1683590923 after retry RPC after error@30748468) -> (continuation of Deferred@1761006640 after retry RPC after error@1211935108) -> (continuation of Deferred@1622492767 after retry RPC after error@1219586546) -> (continuation of Deferred@372798336 after retry RPC after error@996509770) -> (continuation of Deferred@1898493639 after retry RPC after error@848670697) -> (continuation of Deferred@1743023688 after retry RPC after error@1892982054) -> (continuation of Deferred@1157530485 after retry RPC after error@1527486180) -> (continuation of Deferred@534328803 after retry RPC after error@1261483667) -> (continuation of Deferred@2078634411 after retry RPC after error@2094953605) -> (continuation of Deferred@721301712 after retry RPC after error@1689554738) -> (continuation of Deferred@881639974 after retry RPC after error@1006232174) -> (continuation of Deferred@1624911217 after retry RPC after error@551023431) -> (continuation of Deferred@1914210441 after retry RPC after error@101117494) -> (continuation of Deferred@923204130 after retry RPC after error@676620878) -> (continuation of Deferred@507437837 after retry RPC after error@796449186) -> (continuation of Deferred@791671173 after retry RPC after error@606267444) -> (continuation of Deferred@1299005750 after retry RPC after error@615593200) -> (continuation of Deferred@1950501434 after retry RPC after error@1192390606) -> (continuation of Deferred@1615983339 after retry RPC after error@1307204773) -> (continuation of Deferred@731892920 after retry RPC after error@2133305882) -> (continuation of Deferred@269404607 after retry RPC after error@262053999)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29176), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [93ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [133ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [154ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [154ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [246ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [247ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [271ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [271ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [359ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [360ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [366ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [367ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [367ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [368ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [381ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [381ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [381ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [381ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [402ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [402ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [402ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [402ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [421ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [421ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [422ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [422ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [462ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [463ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [463ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [463ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [560ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [561ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [561ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [562ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [562ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [602ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [602ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [603ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [603ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [922ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [922ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [922ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [923ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1701ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1702ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2720ms] refreshing cache from master, [2720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2721ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2722ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2761ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2762ms] too many traces: truncated at 100 traces, deferred=Deferred@1014338256(state=PENDING, result=null, callback=(continuation of Deferred@724612497 after retry RPC after error@1638459948) -> (continuation of Deferred@1268310668 after retry RPC after error@1542130237) -> (continuation of Deferred@1977196780 after retry RPC after error@1401343473) -> (continuation of Deferred@1594280335 after retry RPC after error@1556060848) -> (continuation of Deferred@1683590923 after retry RPC after error@30748468) -> (continuation of Deferred@1761006640 after retry RPC after error@1211935108) -> (continuation of Deferred@1622492767 after retry RPC after error@1219586546) -> (continuation of Deferred@372798336 after retry RPC after error@996509770) -> (continuation of Deferred@1898493639 after retry RPC after error@848670697) -> (continuation of Deferred@1743023688 after retry RPC after error@1892982054) -> (continuation of Deferred@1157530485 after retry RPC after error@1527486180) -> (continuation of Deferred@534328803 after retry RPC after error@1261483667) -> (continuation of Deferred@2078634411 after retry RPC after error@2094953605) -> (continuation of Deferred@721301712 after retry RPC after error@1689554738) -> (continuation of Deferred@881639974 after retry RPC after error@1006232174) -> (continuation of Deferred@1624911217 after retry RPC after error@551023431) -> (continuation of Deferred@1914210441 after retry RPC after error@101117494) -> (continuation of Deferred@923204130 after retry RPC after error@676620878) -> (continuation of Deferred@507437837 after retry RPC after error@796449186) -> (continuation of Deferred@791671173 after retry RPC after error@606267444) -> (continuation of Deferred@1299005750 after retry RPC after error@615593200) -> (continuation of Deferred@1950501434 after retry RPC after error@1192390606) -> (continuation of Deferred@1615983339 after retry RPC after error@1307204773) -> (continuation of Deferred@731892920 after retry RPC after error@2133305882) -> (continuation of Deferred@269404607 after retry RPC after error@262053999), errback=(continuation of Deferred@724612497 after retry RPC after error@1638459948) -> (continuation of Deferred@1268310668 after retry RPC after error@1542130237) -> (continuation of Deferred@1977196780 after retry RPC after error@1401343473) -> (continuation of Deferred@1594280335 after retry RPC after error@1556060848) -> (continuation of Deferred@1683590923 after retry RPC after error@30748468) -> (continuation of Deferred@1761006640 after retry RPC after error@1211935108) -> (continuation of Deferred@1622492767 after retry RPC after error@1219586546) -> (continuation of Deferred@372798336 after retry RPC after error@996509770) -> (continuation of Deferred@1898493639 after retry RPC after error@848670697) -> (continuation of Deferred@1743023688 after retry RPC after error@1892982054) -> (continuation of Deferred@1157530485 after retry RPC after error@1527486180) -> (continuation of Deferred@534328803 after retry RPC after error@1261483667) -> (continuation of Deferred@2078634411 after retry RPC after error@2094953605) -> (continuation of Deferred@721301712 after retry RPC after error@1689554738) -> (continuation of Deferred@881639974 after retry RPC after error@1006232174) -> (continuation of Deferred@1624911217 after retry RPC after error@551023431) -> (continuation of Deferred@1914210441 after retry RPC after error@101117494) -> (continuation of Deferred@923204130 after retry RPC after error@676620878) -> (continuation of Deferred@507437837 after retry RPC after error@796449186) -> (continuation of Deferred@791671173 after retry RPC after error@606267444) -> (continuation of Deferred@1299005750 after retry RPC after error@615593200) -> (continuation of Deferred@1950501434 after retry RPC after error@1192390606) -> (continuation of Deferred@1615983339 after retry RPC after error@1307204773) -> (continuation of Deferred@731892920 after retry RPC after error@2133305882) -> (continuation of Deferred@269404607 after retry RPC after error@262053999)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.0.106.254:32967
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:57.956 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:57.956 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:57.956 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:57.956 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:57.957 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:57.957 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:57.957 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:57.961 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:57.961 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:57.961 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:57.961 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:57.961 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:57.962 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:57.962 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:57.962 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:57.962 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:57.962 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:57.962 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:57.962 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:57.962 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:57.965 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29176), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [93ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [133ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [154ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [154ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [246ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [247ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [271ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [271ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [359ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [360ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [366ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [367ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [367ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [368ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [381ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [381ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [381ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [381ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [402ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [402ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [402ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [402ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [421ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [421ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [422ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [422ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [462ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [463ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [463ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [463ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [560ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [561ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [561ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [562ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [562ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [602ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [602ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [603ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [603ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [922ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [922ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [922ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [923ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1701ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1702ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2720ms] refreshing cache from master, [2720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2721ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2722ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2761ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2762ms] too many traces: truncated at 100 traces, deferred=Deferred@1014338256(state=PENDING, result=null, callback=(continuation of Deferred@724612497 after retry RPC after error@1638459948) -> (continuation of Deferred@1268310668 after retry RPC after error@1542130237) -> (continuation of Deferred@1977196780 after retry RPC after error@1401343473) -> (continuation of Deferred@1594280335 after retry RPC after error@1556060848) -> (continuation of Deferred@1683590923 after retry RPC after error@30748468) -> (continuation of Deferred@1761006640 after retry RPC after error@1211935108) -> (continuation of Deferred@1622492767 after retry RPC after error@1219586546) -> (continuation of Deferred@372798336 after retry RPC after error@996509770) -> (continuation of Deferred@1898493639 after retry RPC after error@848670697) -> (continuation of Deferred@1743023688 after retry RPC after error@1892982054) -> (continuation of Deferred@1157530485 after retry RPC after error@1527486180) -> (continuation of Deferred@534328803 after retry RPC after error@1261483667) -> (continuation of Deferred@2078634411 after retry RPC after error@2094953605) -> (continuation of Deferred@721301712 after retry RPC after error@1689554738) -> (continuation of Deferred@881639974 after retry RPC after error@1006232174) -> (continuation of Deferred@1624911217 after retry RPC after error@551023431) -> (continuation of Deferred@1914210441 after retry RPC after error@101117494) -> (continuation of Deferred@923204130 after retry RPC after error@676620878) -> (continuation of Deferred@507437837 after retry RPC after error@796449186) -> (continuation of Deferred@791671173 after retry RPC after error@606267444) -> (continuation of Deferred@1299005750 after retry RPC after error@615593200) -> (continuation of Deferred@1950501434 after retry RPC after error@1192390606) -> (continuation of Deferred@1615983339 after retry RPC after error@1307204773) -> (continuation of Deferred@731892920 after retry RPC after error@2133305882) -> (continuation of Deferred@269404607 after retry RPC after error@262053999), errback=(continuation of Deferred@724612497 after retry RPC after error@1638459948) -> (continuation of Deferred@1268310668 after retry RPC after error@1542130237) -> (continuation of Deferred@1977196780 after retry RPC after error@1401343473) -> (continuation of Deferred@1594280335 after retry RPC after error@1556060848) -> (continuation of Deferred@1683590923 after retry RPC after error@30748468) -> (continuation of Deferred@1761006640 after retry RPC after error@1211935108) -> (continuation of Deferred@1622492767 after retry RPC after error@1219586546) -> (continuation of Deferred@372798336 after retry RPC after error@996509770) -> (continuation of Deferred@1898493639 after retry RPC after error@848670697) -> (continuation of Deferred@1743023688 after retry RPC after error@1892982054) -> (continuation of Deferred@1157530485 after retry RPC after error@1527486180) -> (continuation of Deferred@534328803 after retry RPC after error@1261483667) -> (continuation of Deferred@2078634411 after retry RPC after error@2094953605) -> (continuation of Deferred@721301712 after retry RPC after error@1689554738) -> (continuation of Deferred@881639974 after retry RPC after error@1006232174) -> (continuation of Deferred@1624911217 after retry RPC after error@551023431) -> (continuation of Deferred@1914210441 after retry RPC after error@101117494) -> (continuation of Deferred@923204130 after retry RPC after error@676620878) -> (continuation of Deferred@507437837 after retry RPC after error@796449186) -> (continuation of Deferred@791671173 after retry RPC after error@606267444) -> (continuation of Deferred@1299005750 after retry RPC after error@615593200) -> (continuation of Deferred@1950501434 after retry RPC after error@1192390606) -> (continuation of Deferred@1615983339 after retry RPC after error@1307204773) -> (continuation of Deferred@731892920 after retry RPC after error@2133305882) -> (continuation of Deferred@269404607 after retry RPC after error@262053999)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29176), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [93ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [133ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [154ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [154ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [246ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [247ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [271ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [271ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [359ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [360ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [366ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [367ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [367ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [368ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [381ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [381ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [381ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [381ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [402ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [402ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [402ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [402ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [421ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [421ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [422ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [422ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [462ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [463ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [463ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [463ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [560ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [561ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [561ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [562ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [562ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [602ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [602ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [603ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [603ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [922ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [922ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [922ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [923ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1701ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1702ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2720ms] refreshing cache from master, [2720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2721ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2722ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2761ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2762ms] too many traces: truncated at 100 traces, deferred=Deferred@1014338256(state=PENDING, result=null, callback=(continuation of Deferred@724612497 after retry RPC after error@1638459948) -> (continuation of Deferred@1268310668 after retry RPC after error@1542130237) -> (continuation of Deferred@1977196780 after retry RPC after error@1401343473) -> (continuation of Deferred@1594280335 after retry RPC after error@1556060848) -> (continuation of Deferred@1683590923 after retry RPC after error@30748468) -> (continuation of Deferred@1761006640 after retry RPC after error@1211935108) -> (continuation of Deferred@1622492767 after retry RPC after error@1219586546) -> (continuation of Deferred@372798336 after retry RPC after error@996509770) -> (continuation of Deferred@1898493639 after retry RPC after error@848670697) -> (continuation of Deferred@1743023688 after retry RPC after error@1892982054) -> (continuation of Deferred@1157530485 after retry RPC after error@1527486180) -> (continuation of Deferred@534328803 after retry RPC after error@1261483667) -> (continuation of Deferred@2078634411 after retry RPC after error@2094953605) -> (continuation of Deferred@721301712 after retry RPC after error@1689554738) -> (continuation of Deferred@881639974 after retry RPC after error@1006232174) -> (continuation of Deferred@1624911217 after retry RPC after error@551023431) -> (continuation of Deferred@1914210441 after retry RPC after error@101117494) -> (continuation of Deferred@923204130 after retry RPC after error@676620878) -> (continuation of Deferred@507437837 after retry RPC after error@796449186) -> (continuation of Deferred@791671173 after retry RPC after error@606267444) -> (continuation of Deferred@1299005750 after retry RPC after error@615593200) -> (continuation of Deferred@1950501434 after retry RPC after error@1192390606) -> (continuation of Deferred@1615983339 after retry RPC after error@1307204773) -> (continuation of Deferred@731892920 after retry RPC after error@2133305882) -> (continuation of Deferred@269404607 after retry RPC after error@262053999), errback=(continuation of Deferred@724612497 after retry RPC after error@1638459948) -> (continuation of Deferred@1268310668 after retry RPC after error@1542130237) -> (continuation of Deferred@1977196780 after retry RPC after error@1401343473) -> (continuation of Deferred@1594280335 after retry RPC after error@1556060848) -> (continuation of Deferred@1683590923 after retry RPC after error@30748468) -> (continuation of Deferred@1761006640 after retry RPC after error@1211935108) -> (continuation of Deferred@1622492767 after retry RPC after error@1219586546) -> (continuation of Deferred@372798336 after retry RPC after error@996509770) -> (continuation of Deferred@1898493639 after retry RPC after error@848670697) -> (continuation of Deferred@1743023688 after retry RPC after error@1892982054) -> (continuation of Deferred@1157530485 after retry RPC after error@1527486180) -> (continuation of Deferred@534328803 after retry RPC after error@1261483667) -> (continuation of Deferred@2078634411 after retry RPC after error@2094953605) -> (continuation of Deferred@721301712 after retry RPC after error@1689554738) -> (continuation of Deferred@881639974 after retry RPC after error@1006232174) -> (continuation of Deferred@1624911217 after retry RPC after error@551023431) -> (continuation of Deferred@1914210441 after retry RPC after error@101117494) -> (continuation of Deferred@923204130 after retry RPC after error@676620878) -> (continuation of Deferred@507437837 after retry RPC after error@796449186) -> (continuation of Deferred@791671173 after retry RPC after error@606267444) -> (continuation of Deferred@1299005750 after retry RPC after error@615593200) -> (continuation of Deferred@1950501434 after retry RPC after error@1192390606) -> (continuation of Deferred@1615983339 after retry RPC after error@1307204773) -> (continuation of Deferred@731892920 after retry RPC after error@2133305882) -> (continuation of Deferred@269404607 after retry RPC after error@262053999)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.0.106.254:32967
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:57.966 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:33:57.969 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#4) of source Source: KuduSource.
18:33:57.970 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to CANCELING.
18:33:57.970 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
18:33:57.970 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to CANCELING.
18:33:57.970 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
18:33:57.971 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:57.971 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:57.971 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:57.972 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:57.972 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:57.972 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:57.972 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:57.972 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:57.972 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:57.973 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
18:33:57.973 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:57.973 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:57.973 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:57.973 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CANCELING to CANCELED.
18:33:57.973 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:57.973 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
18:33:57.973 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#4) of source Source: KuduSource.
18:33:57.973 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to CANCELING.
18:33:57.982 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:57.982 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:57.982 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:57.982 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:57.982 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:57.983 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:57.983 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:57.983 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:57.983 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:57.982 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:57.983 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:57.983 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:57.983 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:57.984 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=30, TimeoutTracker(timeout=30000, elapsed=29201), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [45ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [49ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [54ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [54ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [104ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [110ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [111ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [166ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [166ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [288ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [289ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [293ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [293ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [296ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [296ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [302ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [321ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [322ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [361ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [381ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [382ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [382ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [382ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [462ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [462ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [542ms] refreshing cache from master, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [543ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [544ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [544ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [544ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [900ms] refreshing cache from master, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [901ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [901ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [901ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [901ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1120ms] refreshing cache from master, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1122ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1921ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1921ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1921ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1921ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2681ms] refreshing cache from master, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2683ms] too many traces: truncated at 100 traces, deferred=Deferred@841603384(state=PENDING, result=null, callback=(continuation of Deferred@1718828325 after retry RPC after error@1921749565) -> (continuation of Deferred@879174918 after retry RPC after error@1224465067) -> (continuation of Deferred@933125252 after retry RPC after error@430582320) -> (continuation of Deferred@350774038 after retry RPC after error@38854050) -> (continuation of Deferred@1198512912 after retry RPC after error@257720935) -> (continuation of Deferred@1484501065 after retry RPC after error@1547881257) -> (continuation of Deferred@1707883754 after retry RPC after error@250140046) -> (continuation of Deferred@194299362 after retry RPC after error@1095064634) -> (continuation of Deferred@1172964244 after retry RPC after error@224848386) -> (continuation of Deferred@544249241 after retry RPC after error@1262467361) -> (continuation of Deferred@1591539057 after retry RPC after error@1682973266) -> (continuation of Deferred@1076408092 after retry RPC after error@1994977417) -> (continuation of Deferred@1336337496 after retry RPC after error@704712012) -> (continuation of Deferred@802428767 after retry RPC after error@503961236) -> (continuation of Deferred@1718973737 after retry RPC after error@1144811462) -> (continuation of Deferred@1264449265 after retry RPC after error@464528504) -> (continuation of Deferred@1445058074 after retry RPC after error@1900335431) -> (continuation of Deferred@1435130848 after retry RPC after error@1325610701) -> (continuation of Deferred@390772785 after retry RPC after error@1079221622) -> (continuation of Deferred@1199672263 after retry RPC after error@300050596) -> (continuation of Deferred@1395376537 after retry RPC after error@265244327) -> (continuation of Deferred@1146827562 after retry RPC after error@1182712909) -> (continuation of Deferred@1272242706 after retry RPC after error@1050359737) -> (continuation of Deferred@591696163 after retry RPC after error@329803178) -> (continuation of Deferred@2130756031 after retry RPC after error@415303449) -> (continuation of Deferred@520831147 after retry RPC after error@1331622869) -> (continuation of Deferred@917167800 after retry RPC after error@641986235) -> (continuation of Deferred@1661533376 after retry RPC after error@1542482735) -> (continuation of Deferred@1003430391 after retry RPC after error@46147075), errback=(continuation of Deferred@1718828325 after retry RPC after error@1921749565) -> (continuation of Deferred@879174918 after retry RPC after error@1224465067) -> (continuation of Deferred@933125252 after retry RPC after error@430582320) -> (continuation of Deferred@350774038 after retry RPC after error@38854050) -> (continuation of Deferred@1198512912 after retry RPC after error@257720935) -> (continuation of Deferred@1484501065 after retry RPC after error@1547881257) -> (continuation of Deferred@1707883754 after retry RPC after error@250140046) -> (continuation of Deferred@194299362 after retry RPC after error@1095064634) -> (continuation of Deferred@1172964244 after retry RPC after error@224848386) -> (continuation of Deferred@544249241 after retry RPC after error@1262467361) -> (continuation of Deferred@1591539057 after retry RPC after error@1682973266) -> (continuation of Deferred@1076408092 after retry RPC after error@1994977417) -> (continuation of Deferred@1336337496 after retry RPC after error@704712012) -> (continuation of Deferred@802428767 after retry RPC after error@503961236) -> (continuation of Deferred@1718973737 after retry RPC after error@1144811462) -> (continuation of Deferred@1264449265 after retry RPC after error@464528504) -> (continuation of Deferred@1445058074 after retry RPC after error@1900335431) -> (continuation of Deferred@1435130848 after retry RPC after error@1325610701) -> (continuation of Deferred@390772785 after retry RPC after error@1079221622) -> (continuation of Deferred@1199672263 after retry RPC after error@300050596) -> (continuation of Deferred@1395376537 after retry RPC after error@265244327) -> (continuation of Deferred@1146827562 after retry RPC after error@1182712909) -> (continuation of Deferred@1272242706 after retry RPC after error@1050359737) -> (continuation of Deferred@591696163 after retry RPC after error@329803178) -> (continuation of Deferred@2130756031 after retry RPC after error@415303449) -> (continuation of Deferred@520831147 after retry RPC after error@1331622869) -> (continuation of Deferred@917167800 after retry RPC after error@641986235) -> (continuation of Deferred@1661533376 after retry RPC after error@1542482735) -> (continuation of Deferred@1003430391 after retry RPC after error@46147075)))
18:33:57.985 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
18:33:57.986 [WARN - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=30, TimeoutTracker(timeout=30000, elapsed=29201), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [45ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [49ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [54ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [54ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [104ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [110ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [111ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [166ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [166ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [288ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [289ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [293ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [293ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [296ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [296ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [302ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [321ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [322ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [361ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [361ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [381ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [382ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [382ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [382ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [461ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [462ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [462ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [542ms] refreshing cache from master, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [543ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [544ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [544ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [544ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [900ms] refreshing cache from master, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [901ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [901ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [901ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [901ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1120ms] refreshing cache from master, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1122ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1921ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1921ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1921ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1921ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2681ms] refreshing cache from master, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2683ms] too many traces: truncated at 100 traces, deferred=Deferred@841603384(state=PENDING, result=null, callback=(continuation of Deferred@1718828325 after retry RPC after error@1921749565) -> (continuation of Deferred@879174918 after retry RPC after error@1224465067) -> (continuation of Deferred@933125252 after retry RPC after error@430582320) -> (continuation of Deferred@350774038 after retry RPC after error@38854050) -> (continuation of Deferred@1198512912 after retry RPC after error@257720935) -> (continuation of Deferred@1484501065 after retry RPC after error@1547881257) -> (continuation of Deferred@1707883754 after retry RPC after error@250140046) -> (continuation of Deferred@194299362 after retry RPC after error@1095064634) -> (continuation of Deferred@1172964244 after retry RPC after error@224848386) -> (continuation of Deferred@544249241 after retry RPC after error@1262467361) -> (continuation of Deferred@1591539057 after retry RPC after error@1682973266) -> (continuation of Deferred@1076408092 after retry RPC after error@1994977417) -> (continuation of Deferred@1336337496 after retry RPC after error@704712012) -> (continuation of Deferred@802428767 after retry RPC after error@503961236) -> (continuation of Deferred@1718973737 after retry RPC after error@1144811462) -> (continuation of Deferred@1264449265 after retry RPC after error@464528504) -> (continuation of Deferred@1445058074 after retry RPC after error@1900335431) -> (continuation of Deferred@1435130848 after retry RPC after error@1325610701) -> (continuation of Deferred@390772785 after retry RPC after error@1079221622) -> (continuation of Deferred@1199672263 after retry RPC after error@300050596) -> (continuation of Deferred@1395376537 after retry RPC after error@265244327) -> (continuation of Deferred@1146827562 after retry RPC after error@1182712909) -> (continuation of Deferred@1272242706 after retry RPC after error@1050359737) -> (continuation of Deferred@591696163 after retry RPC after error@329803178) -> (continuation of Deferred@2130756031 after retry RPC after error@415303449) -> (continuation of Deferred@520831147 after retry RPC after error@1331622869) -> (continuation of Deferred@917167800 after retry RPC after error@641986235) -> (continuation of Deferred@1661533376 after retry RPC after error@1542482735) -> (continuation of Deferred@1003430391 after retry RPC after error@46147075), errback=(continuation of Deferred@1718828325 after retry RPC after error@1921749565) -> (continuation of Deferred@879174918 after retry RPC after error@1224465067) -> (continuation of Deferred@933125252 after retry RPC after error@430582320) -> (continuation of Deferred@350774038 after retry RPC after error@38854050) -> (continuation of Deferred@1198512912 after retry RPC after error@257720935) -> (continuation of Deferred@1484501065 after retry RPC after error@1547881257) -> (continuation of Deferred@1707883754 after retry RPC after error@250140046) -> (continuation of Deferred@194299362 after retry RPC after error@1095064634) -> (continuation of Deferred@1172964244 after retry RPC after error@224848386) -> (continuation of Deferred@544249241 after retry RPC after error@1262467361) -> (continuation of Deferred@1591539057 after retry RPC after error@1682973266) -> (continuation of Deferred@1076408092 after retry RPC after error@1994977417) -> (continuation of Deferred@1336337496 after retry RPC after error@704712012) -> (continuation of Deferred@802428767 after retry RPC after error@503961236) -> (continuation of Deferred@1718973737 after retry RPC after error@1144811462) -> (continuation of Deferred@1264449265 after retry RPC after error@464528504) -> (continuation of Deferred@1445058074 after retry RPC after error@1900335431) -> (continuation of Deferred@1435130848 after retry RPC after error@1325610701) -> (continuation of Deferred@390772785 after retry RPC after error@1079221622) -> (continuation of Deferred@1199672263 after retry RPC after error@300050596) -> (continuation of Deferred@1395376537 after retry RPC after error@265244327) -> (continuation of Deferred@1146827562 after retry RPC after error@1182712909) -> (continuation of Deferred@1272242706 after retry RPC after error@1050359737) -> (continuation of Deferred@591696163 after retry RPC after error@329803178) -> (continuation of Deferred@2130756031 after retry RPC after error@415303449) -> (continuation of Deferred@520831147 after retry RPC after error@1331622869) -> (continuation of Deferred@917167800 after retry RPC after error@641986235) -> (continuation of Deferred@1661533376 after retry RPC after error@1542482735) -> (continuation of Deferred@1003430391 after retry RPC after error@46147075)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.190:46863
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:33:57.986 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
18:33:57.991 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:57.991 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:57.991 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:57.992 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:57.992 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:57.992 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:57.992 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:57.992 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:57.992 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:57.992 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:57.994 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#4 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
18:33:57.994 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:57.994 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#4 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
18:33:57.994 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:57.994 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1190) Task Source: KuduSource -> Sink: Writer (3/4)#4 is already in state FAILED
18:33:57.995 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:57.995 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#4 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
18:33:57.996 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CANCELING to CANCELED.
18:33:57.997 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:33:57.997 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CANCELING to CANCELED.
18:33:57.999 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 4cd649562a0f5305571102b5c888c5a9
18:33:57.999 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1318) Discarding the results produced by task execution 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
18:33:58.011 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:58.011 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:58.011 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:58.011 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.011 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.011 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.012 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.012 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.012 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.011 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.012 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.012 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.012 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:58.030 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:58.030 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:58.031 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:58.031 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:58.031 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:58.031 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:58.031 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:58.031 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:58.031 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:58.031 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:58.031 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:58.031 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:58.031 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:58.032 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:58.032 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:58.032 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:58.033 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.033 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.033 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.033 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.033 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.033 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.033 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.034 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.034 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.034 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:58.035 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:58.035 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:58.035 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:58.035 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:58.035 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:58.035 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:58.035 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:58.035 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:58.035 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:58.036 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:58.036 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:58.036 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:58.036 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:58.045 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:58.051 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:58.051 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:58.051 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:58.051 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.051 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.051 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.051 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.051 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.051 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.052 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.052 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.052 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.052 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:58.071 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:58.071 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:58.072 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:58.072 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.072 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.072 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.072 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.072 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.072 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.072 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.072 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.073 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.073 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:58.134 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:58.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535638146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:58.155 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:33:58.157 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
18:33:58.192 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:58.192 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:58.192 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:58.192 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.192 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.192 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.192 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.192 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.192 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.193 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.193 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.193 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.193 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:58.194 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:58.194 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:58.195 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:58.195 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:58.195 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:58.195 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:58.195 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:58.195 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:58.195 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:58.195 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:58.195 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:58.195 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:58.195 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:58.231 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:58.232 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:58.232 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:58.232 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:58.232 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:58.232 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:58.232 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:58.232 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:58.232 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:58.232 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:58.232 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:58.232 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:58.232 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:58.271 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:58.271 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:58.271 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:58.271 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.271 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.271 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.272 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.272 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.272 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.272 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.271 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.272 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.272 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:58.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:58.206847  7987 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 7982
18:33:58.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:56.809908  7989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:58.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:58.373689  7982 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.566s	user 0.577s	sys 0.976s
18:33:58.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:58.374257  7982 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.567s	user 0.577s	sys 0.976s
18:33:58.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.383662  7982 server_base.cc:1061] running on GCE node
18:33:58.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:58.383641  7997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:58.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.385296  7982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:33:58.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.388382  7982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:33:58.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.389874  7982 hybrid_clock.cc:648] HybridClock initialized: now 1783535638389830 us; error 44 us; skew 500 ppm
18:33:58.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.390690  7982 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:33:58.395 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:58.395 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:58.395 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:58.395 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:58.395 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:58.396 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:58.396 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:58.396 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:58.396 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:58.396 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:58.396 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:58.396 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:58.396 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:58.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.401172  7982 webserver.cc:534] Webserver started at http://127.7.200.190:40467/ using document root <none> and password file <none>
18:33:58.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.402112  7982 fs_manager.cc:362] Metadata directory not provided
18:33:58.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.402349  7982 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:33:58.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.402740  7982 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:33:58.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.407595  7982 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/data/instance:
18:33:58.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e9aa715cae624ab694c9b1e8fb98c10e"
18:33:58.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:58 on dist-test-slave-dxnw"
18:33:58.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.408849  7982 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/wal/instance:
18:33:58.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e9aa715cae624ab694c9b1e8fb98c10e"
18:33:58.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:58 on dist-test-slave-dxnw"
18:33:58.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.418547  7982 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.009s	sys 0.001s
18:33:58.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:58.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.426371  8002 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:33:58.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.427874  7982 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.002s
18:33:58.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.428262  7982 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/wal
18:33:58.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e9aa715cae624ab694c9b1e8fb98c10e"
18:33:58.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:33:58 on dist-test-slave-dxnw"
18:33:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.428714  7982 fs_report.cc:389] FS layout report
18:33:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:33:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/wal
18:33:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/wal
18:33:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/data/data
18:33:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:33:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:33:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:33:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:33:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:33:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:33:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:33:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:33:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:33:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:33:58.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:33:58.451 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:58.451 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:58.452 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:58.452 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.452 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.452 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.452 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.452 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.452 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.452 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.452 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.452 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.452 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:58.453 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:58.453 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:58.453 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:58.454 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:58.454 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:58.454 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:58.454 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:58.454 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:58.454 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:58.454 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:58.454 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:58.454 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:58.454 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:58.475 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:58.475 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:58.475 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:58.476 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:58.476 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:58.476 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:58.476 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:58.476 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:58.476 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:58.477 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:58.477 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:58.477 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:58.477 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:58.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.506611  7982 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:33:58.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.508464  7982 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:33:58.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.508971  7982 kserver.cc:163] Server-wide thread pool size limit: 3276
18:33:58.547 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:58.551 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:58.552 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:58.552 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:58.552 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.552 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.552 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:58.552 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.553 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.553 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:58.553 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.553 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.553 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:58.553 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:58.556 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:33:58.556 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:33:58.556 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:33:58.556 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:58.556 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:58.556 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:58.556 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:58.556 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:33:58.556 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:33:58.557 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:58.557 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:58.557 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:33:58.557 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:33:58.557 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29751), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [124ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [134ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [154ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [154ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [204ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [205ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [269ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [270ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [288ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [289ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [294ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [294ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [295ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [295ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [322ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [341ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [342ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [342ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [342ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [362ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [362ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [362ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [362ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [402ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [522ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [522ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [522ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [522ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [742ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [742ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [742ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [742ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1041ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1043ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1442ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2502ms] refreshing cache from master, [2502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2503ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2504ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2507ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2507ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [5600ms] refreshing cache from master, [5600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [5601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [5601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [5601ms] too many traces: truncated at 100 traces, deferred=Deferred@89728230(state=PENDING, result=null, callback=(continuation of Deferred@537098547 after retry RPC after error@1796511141) -> (continuation of Deferred@1505701094 after retry RPC after error@353197347) -> (continuation of Deferred@779908176 after retry RPC after error@1628071303) -> (continuation of Deferred@1106423132 after retry RPC after error@1047069700) -> (continuation of Deferred@1945774445 after retry RPC after error@1106140360) -> (continuation of Deferred@362971620 after retry RPC after error@1671298672) -> (continuation of Deferred@1099829807 after retry RPC after error@1924468426) -> (continuation of Deferred@1939410137 after retry RPC after error@2147156644) -> (continuation of Deferred@1322608670 after retry RPC after error@348974160) -> (continuation of Deferred@789108180 after retry RPC after error@146873523) -> (continuation of Deferred@1831931949 after retry RPC after error@518840247) -> (continuation of Deferred@1998786507 after retry RPC after error@1996988696) -> (continuation of Deferred@307390381 after retry RPC after error@1782252343) -> (continuation of Deferred@84481260 after retry RPC after error@1330407988) -> (continuation of Deferred@1310856063 after retry RPC after error@2083689271) -> (continuation of Deferred@827414057 after retry RPC after error@501254141) -> (continuation of Deferred@1132971733 after retry RPC after error@725896889) -> (continuation of Deferred@270513638 after retry RPC after error@156833655) -> (continuation of Deferred@1955973607 after retry RPC after error@2108518474) -> (continuation of Deferred@275794588 after retry RPC after error@1364395338) -> (continuation of Deferred@190002294 after retry RPC after error@493501046), errback=(continuation of Deferred@537098547 after retry RPC after error@1796511141) -> (continuation of Deferred@1505701094 after retry RPC after error@353197347) -> (continuation of Deferred@779908176 after retry RPC after error@1628071303) -> (continuation of Deferred@1106423132 after retry RPC after error@1047069700) -> (continuation of Deferred@1945774445 after retry RPC after error@1106140360) -> (continuation of Deferred@362971620 after retry RPC after error@1671298672) -> (continuation of Deferred@1099829807 after retry RPC after error@1924468426) -> (continuation of Deferred@1939410137 after retry RPC after error@2147156644) -> (continuation of Deferred@1322608670 after retry RPC after error@348974160) -> (continuation of Deferred@789108180 after retry RPC after error@146873523) -> (continuation of Deferred@1831931949 after retry RPC after error@518840247) -> (continuation of Deferred@1998786507 after retry RPC after error@1996988696) -> (continuation of Deferred@307390381 after retry RPC after error@1782252343) -> (continuation of Deferred@84481260 after retry RPC after error@1330407988) -> (continuation of Deferred@1310856063 after retry RPC after error@2083689271) -> (continuation of Deferred@827414057 after retry RPC after error@501254141) -> (continuation of Deferred@1132971733 after retry RPC after error@725896889) -> (continuation of Deferred@270513638 after retry RPC after error@156833655) -> (continuation of Deferred@1955973607 after retry RPC after error@2108518474) -> (continuation of Deferred@275794588 after retry RPC after error@1364395338) -> (continuation of Deferred@190002294 after retry RPC after error@493501046)))
18:33:58.568 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:58.568 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:58.568 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:58.568 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:58.568 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:58.568 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:58.569 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:58.569 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:58.569 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:58.569 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:58.569 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:58.569 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:58.569 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:58.595 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:58.595 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:58.595 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:58.596 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:58.596 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:58.596 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:58.596 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:58.596 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:58.596 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:58.597 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:58.597 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:58.597 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:58.597 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:58.634 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:58.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535638646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:58.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.656647  7982 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.190:40077
18:33:58.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.656880  8053 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.200.190:40077 every 8 connection(s)
18:33:58.659 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:33:58.660 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
18:33:58.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.660893  7982 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/data/info.pb
18:33:58.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.664193  7970 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 7982
18:33:58.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.664777  7970 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-0/wal/instance
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.670790  7970 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/wal
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/data
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/logs
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/data/info.pb
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:33:58.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:33:58.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.200.189:42349
18:33:58.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.200.189
18:33:58.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:58.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.200.148:33865
18:33:58.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:58.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:58.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:58.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:33:58.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.7.200.190:40077,127.7.200.189:42349,127.7.200.188:38999
18:33:58.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:33:58.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40103/jwks.json with env {}
18:33:58.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.677794  8054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:33:58.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.700934  8054 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } has no permanent_uuid. Determining permanent_uuid...
18:33:58.715 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:58.715 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:58.715 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:58.715 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:58.715 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:58.715 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:58.715 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:58.715 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:58.715 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:58.716 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:58.716 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:58.716 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:58.716 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:58.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.741510  8054 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } has no permanent_uuid. Determining permanent_uuid...
18:33:58.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:58.745069  8003 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.200.189:42349: connect: Connection refused (error 111)
18:33:58.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:58.750433  8054 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.189:42349: Network error: Client connection negotiation failed: client connection to 127.7.200.189:42349: connect: Connection refused (error 111)
18:33:58.770 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:33:58.770 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:33:58.770 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:33:58.770 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:58.770 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:58.770 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:58.770 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:58.770 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:58.771 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:33:58.771 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:58.771 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:33:58.771 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:33:58.771 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:33:58.775 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:33:58.775 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:33:58.775 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:33:58.775 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:58.775 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:58.775 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:33:58.775 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:58.775 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:58.775 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:33:58.775 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:58.775 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:58.776 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:33:58.776 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:33:58.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.800113  8054 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } attempt: 1
18:33:58.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:58.804742  8054 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.189:42349: Network error: Client connection negotiation failed: client connection to 127.7.200.189:42349: connect: Connection refused (error 111)
18:33:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.873441  8054 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } attempt: 2
18:33:58.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:58.878750  8054 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.189:42349: Network error: Client connection negotiation failed: client connection to 127.7.200.189:42349: connect: Connection refused (error 111)
18:33:58.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:58.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:58.970395  8054 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } attempt: 3
18:33:58.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:58.975423  8054 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.189:42349: Network error: Client connection negotiation failed: client connection to 127.7.200.189:42349: connect: Connection refused (error 111)
18:33:59.045 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:59.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:59.064567  8056 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:33:59.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:59.065344  8056 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:33:59.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:59.065969  8056 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:33:59.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:59.110082  8056 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:33:59.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:59.110503  8056 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:33:59.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:59.110947  8056 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:33:59.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:59.111351  8056 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:33:59.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:59.111739  8056 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:33:59.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:59.112010  8056 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40103/jwks.json
18:33:59.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:59.118924  8054 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } attempt: 4
18:33:59.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:59.123847  8054 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.189:42349: Network error: Client connection negotiation failed: client connection to 127.7.200.189:42349: connect: Connection refused (error 111)
18:33:59.133 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:59.146 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535639146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:59.154 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:33:59.155 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:59.165592  8056 master_runner.cc:387] Master server non-default flags:
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.200.148:33865
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/data
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/wal
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.7.200.190:40077,127.7.200.189:42349,127.7.200.188:38999
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.200.189:42349
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40103/jwks.json
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/data/info.pb
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.200.189
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/logs
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:33:59.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:33:59.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:59.167196  8056 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:33:59.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:59.169098  8056 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:33:59.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:59.183300  8065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:33:59.415 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:33:59.415 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:33:59.415 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:33:59.415 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:59.415 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:59.415 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:59.415 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:33:59.415 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:59.416 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:59.415 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:59.416 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:33:59.416 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:33:59.416 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:33:59.420 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:59.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:59.423347  8054 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } attempt: 5
18:33:59.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:59.430364  8054 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.189:42349: Network error: Client connection negotiation failed: client connection to 127.7.200.189:42349: connect: Connection refused (error 111)
18:33:59.434 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:59.435 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:59.435 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:59.435 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:59.435 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:59.435 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:59.436 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:59.436 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:59.436 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:59.436 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:59.436 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:59.436 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:59.436 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:59.490 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:33:59.490 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:33:59.490 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:33:59.490 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:59.490 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:59.490 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:59.491 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:33:59.491 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:59.491 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:59.491 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:33:59.490 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:59.491 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:33:59.491 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:33:59.545 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:59.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:59.579262  7276 debug-util.cc:398] Leaking SignalData structure 0x7b08000ae8a0 after lost signal to thread 7210
18:33:59.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:59.580453  7276 debug-util.cc:398] Leaking SignalData structure 0x7b0800088880 after lost signal to thread 7279
18:33:59.633 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:59.634 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:59.634 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:59.635 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:59.635 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:59.635 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:59.635 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:59.635 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:59.635 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:59.635 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:59.635 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:59.635 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:59.635 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:59.635 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:59.646 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535639646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:33:59.657 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:33:59.658 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
18:33:59.700 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:59.700 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:59.701 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:59.701 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:59.701 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:59.701 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:59.701 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:59.701 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:59.701 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:59.702 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:59.702 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:59.702 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:59.702 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:59.753 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:59.753 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:59.753 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:59.754 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:59.754 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:59.754 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:59.754 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:59.754 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:59.754 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:59.755 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:59.755 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:59.755 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:59.755 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:59.775 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:59.775 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:59.775 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:59.775 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:59.775 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:59.775 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:59.775 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:59.775 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:59.776 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:59.776 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:59.776 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:59.776 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:59.776 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:59.805 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:33:59.805 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:33:59.805 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:33:59.806 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:59.806 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:59.806 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:33:59.806 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:59.806 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:59.807 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:33:59.807 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:59.807 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:59.807 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:33:59.807 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:33:59.820 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:33:59.820 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:33:59.821 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:33:59.822 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:59.822 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:59.822 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:59.822 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:33:59.822 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:59.822 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:33:59.823 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:59.823 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:59.823 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:33:59.823 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:33:59.851 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:33:59.851 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:33:59.851 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:33:59.852 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:59.852 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:59.852 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:33:59.852 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:59.852 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:59.852 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:33:59.852 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:59.852 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:59.852 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:33:59.852 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:33:59.920 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:33:59.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:33:59.977937  8054 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } attempt: 6
18:34:00.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:00.000204  8054 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.189:42349: Network error: Client connection negotiation failed: client connection to 127.7.200.189:42349: connect: Connection refused (error 111)
18:34:00.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:00.085 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:00.085 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:00.085 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:00.086 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:00.086 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:00.086 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:00.086 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:00.086 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:00.086 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:00.086 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:00.086 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:00.086 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:00.091 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:00.133 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:00.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535640146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:34:00.159 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:00.159 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:00.159 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:00.160 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:00.160 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:00.160 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:00.160 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:00.160 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:00.160 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:00.160 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:00.160 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:00.160 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:00.160 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:00.165 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
18:34:00.166 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
18:34:00.215 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:00.215 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:00.215 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:00.215 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:00.215 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:00.216 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:00.216 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:00.216 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:00.216 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:00.216 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:00.216 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:00.216 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:00.216 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:00.270 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:00.270 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:00.271 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:00.273 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:00.273 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:00.273 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:00.273 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:00.273 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:00.274 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:00.274 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:00.274 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:00.274 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:00.274 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:00.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:00.469 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9) switched from state RESTARTING to RUNNING.
18:34:00.470 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job 4cd649562a0f5305571102b5c888c5a9 from Checkpoint 65 @ 1783535546001 for 4cd649562a0f5305571102b5c888c5a9 located at file:/tmp/junit5514029058471043739/checkpoints/4cd649562a0f5305571102b5c888c5a9/chk-65.
18:34:00.471 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
18:34:00.471 [INFO - flink-pekko.actor.default-dispatcher-9] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:34:00.472 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to SCHEDULED.
18:34:00.473 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from SCHEDULED to DEPLOYING.
18:34:00.521 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #5) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id d0320e7b86362daa97e494337af6f333
18:34:00.522 [INFO - Thread-58] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:34:00.522 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to SCHEDULED.
18:34:00.522 [DEBUG - Thread-58] (Connection.java:575) [peer master-127.0.106.253:45189(127.0.106.253:45189)] disconnecting while in state TERMINATED
18:34:00.522 [DEBUG - Thread-58] (Connection.java:575) [peer master-127.0.106.254:32967(127.0.106.254:32967)] disconnecting while in state TERMINATED
18:34:00.522 [DEBUG - Thread-58] (Connection.java:575) [peer master-127.0.106.252:46705(127.0.106.252:46705)] disconnecting while in state TERMINATED
18:34:00.523 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:34:00.523 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:00.524 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot d0320e7b86362daa97e494337af6f333.
18:34:00.524 [INFO - Thread-58] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:34:00.525 [INFO - Thread-58] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:34:00.525 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_5), deploy into slot with allocation id d0320e7b86362daa97e494337af6f333.
18:34:00.527 [DEBUG - Thread-58] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:00.527 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from SCHEDULED to DEPLOYING.
18:34:00.527 [INFO - Thread-58] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:34:00.527 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #5) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id c230971fad26d6cfa2b63ff44e7a1af5
18:34:00.527 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to SCHEDULED.
18:34:00.528 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from SCHEDULED to DEPLOYING.
18:34:00.528 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #5) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id 0abd8d1f15ad274a5029e6ed83960f8c
18:34:00.528 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:34:00.529 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:00.530 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to SCHEDULED.
18:34:00.530 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:34:00.531 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from SCHEDULED to DEPLOYING.
18:34:00.531 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #5) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id 163e6d56962e3a45c0e4353eb3be3a9b
18:34:00.541 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:00.541 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:00.541 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:00.541 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:00.542 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot c230971fad26d6cfa2b63ff44e7a1af5.
18:34:00.544 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_5), deploy into slot with allocation id c230971fad26d6cfa2b63ff44e7a1af5.
18:34:00.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:00.546 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to DEPLOYING.
18:34:00.546 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_5) [DEPLOYING].
18:34:00.547 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7bd84ace
18:34:00.547 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:00.548 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:34:00.548 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
18:34:00.548 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
18:34:00.551 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@46216987
18:34:00.553 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:00.554 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:00.554 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:00.554 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:00.555 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:00.555 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:00.555 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:00.555 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:00.555 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:00.555 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:00.555 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:00.555 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:00.555 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:00.555 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:00.563 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 0abd8d1f15ad274a5029e6ed83960f8c.
18:34:00.564 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_5), deploy into slot with allocation id 0abd8d1f15ad274a5029e6ed83960f8c.
18:34:00.566 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to DEPLOYING.
18:34:00.566 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_5) [DEPLOYING].
18:34:00.568 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@298c1934
18:34:00.568 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:00.568 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:34:00.568 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
18:34:00.569 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
18:34:00.570 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 163e6d56962e3a45c0e4353eb3be3a9b.
18:34:00.571 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to DEPLOYING.
18:34:00.571 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_5) [DEPLOYING].
18:34:00.572 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3b63e314
18:34:00.572 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_5), deploy into slot with allocation id 163e6d56962e3a45c0e4353eb3be3a9b.
18:34:00.573 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:00.574 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:34:00.574 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
18:34:00.574 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
18:34:00.575 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@64cea40d
18:34:00.576 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:00.576 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:00.576 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:00.576 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:00.577 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:00.577 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:00.577 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:00.577 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:00.577 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:00.577 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:00.577 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:00.577 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:00.577 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:00.580 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1bf217e7
18:34:00.580 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:00.581 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.583 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:00.584 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:00.584 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to DEPLOYING.
18:34:00.585 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_5) [DEPLOYING].
18:34:00.585 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5c3c35f3
18:34:00.585 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:00.585 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:34:00.586 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
18:34:00.586 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
18:34:00.589 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@65dcbf8b
18:34:00.591 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:00.592 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.592 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.593 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.593 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.593 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.593 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.593 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.593 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.594 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.594 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.594 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.594 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.594 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:00.595 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.595 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.595 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.595 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:00.596 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.596 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.596 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.597 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.597 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.597 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.597 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:00.598 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:00.599 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.599 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.600 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.600 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.600 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.600 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.601 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.601 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.601 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.601 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.602 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.602 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.603 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.603 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.603 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.603 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.604 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.604 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.604 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.604 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.604 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:00.605 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.605 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.605 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.605 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.605 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.606 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.606 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.606 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.606 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.607 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.607 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.607 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.607 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.607 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.608 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.608 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.608 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.608 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.608 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.609 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.609 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.609 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.609 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.609 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.610 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.610 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.610 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.611 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.611 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.611 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.611 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.611 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:00.612 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.612 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.612 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.612 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:00.613 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.613 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.613 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.613 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.614 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.614 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.614 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:00.618 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.619 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.619 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.620 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.621 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.621 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.621 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.621 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.622 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.622 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.622 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.622 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.623 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.623 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.623 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.623 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.624 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.624 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.624 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.624 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:00.624 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.625 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.625 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.625 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.625 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.626 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.626 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.626 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.626 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.626 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.627 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.627 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.627 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.627 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.628 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.628 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.628 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.629 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.629 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.629 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.629 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.630 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.630 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.630 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.630 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.631 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.631 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.631 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.631 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.632 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.632 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.632 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.632 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.632 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:00.633 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.633 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.633 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.633 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:00.633 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:00.634 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.634 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.635 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.635 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.635 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.635 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.635 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:00.638 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.638 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.639 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.640 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.641 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.641 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.641 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.641 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.641 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.641 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.641 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.642 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.642 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.642 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.642 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.642 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.642 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.642 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.643 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.643 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.643 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.643 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.643 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.643 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.644 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.644 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.644 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.644 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.644 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.645 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:00.645 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:00.645 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:00.645 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.645 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.645 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.645 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.646 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.646 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.646 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.646 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.646 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.646 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:00.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535640646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:34:00.651 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.651 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.651 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.654 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:34:00.655 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.655 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.655 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.655 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.655 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.655 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
18:34:00.655 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.656 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.656 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.656 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.657 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.657 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.657 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.658 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.658 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.658 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.659 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.659 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.659 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.659 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.659 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.659 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.659 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.659 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.660 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.660 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.662 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.662 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.662 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.662 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.663 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.663 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.663 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.663 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.663 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.663 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.663 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.663 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.663 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.664 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:00.664 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:00.664 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:00.665 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.665 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.665 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.665 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.665 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.665 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.665 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.665 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.665 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.665 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:00.667 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.667 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.667 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.667 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.667 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.668 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.668 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.668 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.672 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:00.672 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:00.672 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:00.672 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:00.672 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:00.672 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:00.672 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:00.672 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:00.672 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:00.673 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:00.673 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:00.673 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:00.673 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:00.678 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.678 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.678 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.678 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.679 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.679 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.679 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.679 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.679 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.679 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.679 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.679 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.679 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.679 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.679 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.679 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.680 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.680 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.680 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.680 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.680 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.680 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.680 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.680 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.680 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.681 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.681 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.681 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.681 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.681 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.681 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.681 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.681 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.682 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.682 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.682 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.682 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.682 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.682 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.682 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.682 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.682 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.683 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.683 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.683 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.683 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.683 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.683 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.683 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.678 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.683 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.684 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.685 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:00.685 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:00.685 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:00.685 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.685 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.686 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.686 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.686 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.686 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.686 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.686 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.686 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.686 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:00.699 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.700 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.700 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.700 [DEBUG - pool-344-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30019), Traces: [0ms] sending RPC to server master-127.4.179.62:35121, [5ms] received response from server master-127.4.179.62:35121: OK, deferred=null) with no deferred attached!
18:34:00.700 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.700 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.700 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.701 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.701 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.701 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.701 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.701 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.701 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.701 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.701 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.702 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.702 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.702 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.702 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.702 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.702 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.702 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.702 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.703 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.703 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.703 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.703 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.718 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.719 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.719 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.719 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.719 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.719 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.720 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.720 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.720 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.720 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.720 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.720 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.720 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.720 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.720 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.720 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.721 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.721 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.721 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.721 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.721 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.721 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.721 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.721 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.721 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.721 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.721 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.722 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.722 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.722 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.722 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.722 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.722 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.722 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.722 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.723 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.723 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.723 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.723 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.723 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.723 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.723 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.724 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.724 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.724 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.724 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.724 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.724 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.725 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.725 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.725 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.725 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.725 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:00.725 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:00.725 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:00.725 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.725 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.725 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.725 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.725 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.725 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.726 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.726 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.726 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.726 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:00.742 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.742 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.742 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.742 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.742 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.742 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.743 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.743 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.743 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.743 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.743 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.743 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.743 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:33:59.185667  8066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:00.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:00.749565  8067 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
18:34:00.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:00.750313  8068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:00.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.750315  8056 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:34:00.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.757543  8056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:34:00.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.761461  8056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:34:00.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.763013  8056 hybrid_clock.cc:648] HybridClock initialized: now 1783535640762931 us; error 99 us; skew 500 ppm
18:34:00.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.764348  8056 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:34:00.764 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:00.765 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:00.765 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:00.765 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.765 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.765 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.765 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.765 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.765 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.766 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.766 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.766 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.766 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:00.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.773568  8056 webserver.cc:534] Webserver started at http://127.7.200.189:46223/ using document root <none> and password file <none>
18:34:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.775123  8056 fs_manager.cc:362] Metadata directory not provided
18:34:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.775439  8056 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:34:00.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.776227  8056 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:34:00.778 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.778 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.779 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.779 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.779 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.779 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.779 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.779 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.779 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.779 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.779 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.779 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.779 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.779 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.779 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.779 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.779 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.779 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.779 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.780 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.780 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.780 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.780 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.780 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.780 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.780 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.780 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.780 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.780 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.780 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.780 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.780 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.780 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.780 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.781 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.779 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.781 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.779 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.781 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.786638  8056 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/data/instance:
18:34:00.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5aab15a6037f48c290d9378bdeee2073"
18:34:00.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:00 on dist-test-slave-dxnw"
18:34:00.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.788688  8056 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/wal/instance:
18:34:00.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5aab15a6037f48c290d9378bdeee2073"
18:34:00.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:00 on dist-test-slave-dxnw"
18:34:00.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.799888  8056 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.010s	sys 0.000s
18:34:00.802 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.802 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.802 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.802 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.802 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.802 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.802 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.803 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.803 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.803 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.803 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.803 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.803 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.808933  8133 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:34:00.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.810387  8056 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.001s
18:34:00.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.810904  8056 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/wal
18:34:00.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5aab15a6037f48c290d9378bdeee2073"
18:34:00.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:00 on dist-test-slave-dxnw"
18:34:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.811447  8056 fs_report.cc:389] FS layout report
18:34:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:34:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/wal
18:34:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/wal
18:34:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/data/data
18:34:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:34:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:34:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:34:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:34:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:34:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:34:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:34:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:34:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:34:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:34:00.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:34:00.818 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.818 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.818 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.818 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.818 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.819 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.819 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.819 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.819 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.819 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.819 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.819 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.819 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.844 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:00.845 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:00.845 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:00.845 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.845 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.845 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.845 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.845 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.845 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.845 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.845 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.845 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.845 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:00.864 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:00.864 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:00.864 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:00.865 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.865 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.865 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:00.865 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.865 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.865 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:00.866 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.866 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.866 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:00.866 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:00.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.885310  8056 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:34:00.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.887394  8056 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:34:00.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.887989  8056 kserver.cc:163] Server-wide thread pool size limit: 3276
18:34:00.898 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.898 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.898 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.898 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.899 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.899 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.899 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.899 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.899 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.899 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.899 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.899 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.899 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.899 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.899 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.899 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.899 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.900 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.900 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.900 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.900 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.900 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.900 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.900 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.900 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.900 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.900 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.900 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.901 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.901 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.901 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.901 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.901 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.901 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.901 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.901 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.901 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.901 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.901 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.920 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:00.920 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:00.920 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:00.920 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.920 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.920 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:00.921 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.921 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.921 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:00.921 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.921 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.921 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:00.921 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:00.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:00.940 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:00.940 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:00.940 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:00.941 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:00.941 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:00.941 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:00.941 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:00.941 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:00.941 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:00.941 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:00.941 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:00.941 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:00.941 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:00.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.998661  8056 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.189:42349
18:34:00.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:00.998808  8184 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.200.189:42349 every 8 connection(s)
18:34:01.000 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:01.000 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:01.000 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:01.000 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.000 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.001 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.001 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.001 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.001 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.000 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.001 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.001 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.001 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:01.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.002800  8056 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/data/info.pb
18:34:01.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.008806  7970 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 8056
18:34:01.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.009337  7970 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-1/wal/instance
18:34:01.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.011777  8185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.012861  7970 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/wal
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/data
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/logs
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/data/info.pb
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.200.188:38999
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.200.188
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.200.148:33865
18:34:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:01.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:01.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:01.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:34:01.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.7.200.190:40077,127.7.200.189:42349,127.7.200.188:38999
18:34:01.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:34:01.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40103/jwks.json with env {}
18:34:01.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.031965  8185 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } has no permanent_uuid. Determining permanent_uuid...
18:34:01.036 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:01.037 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:01.037 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:01.037 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:01.037 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:01.037 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:01.037 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:01.037 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:01.037 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:01.038 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:01.038 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:01.038 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:01.038 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:01.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:01.060 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:01.060 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:01.060 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:01.060 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.060 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.061 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.061 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.061 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.061 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.061 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.061 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.061 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.061 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:01.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.061077  8054 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } attempt: 7
18:34:01.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.073352  8185 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } has no permanent_uuid. Determining permanent_uuid...
18:34:01.099 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:01.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.108521  8185 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } has no permanent_uuid. Determining permanent_uuid...
18:34:01.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.111958  8135 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:01.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.123232  8054 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } has no permanent_uuid. Determining permanent_uuid...
18:34:01.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.131207  8185 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.188:38999: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:01.133 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:01.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.137810  8054 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.188:38999: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:01.138 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:01.138 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:01.138 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:01.139 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.139 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.139 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.139 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.139 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.139 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.139 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.139 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.139 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.139 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:01.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535641146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:34:01.156 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:34:01.157 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
18:34:01.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.180831  8185 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } attempt: 1
18:34:01.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.187795  8185 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.188:38999: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:01.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.196270  8054 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } attempt: 1
18:34:01.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.202236  8054 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.188:38999: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:01.207 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:01.207 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:01.207 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:01.207 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:01.207 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:01.207 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:01.207 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:01.207 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:01.207 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:01.208 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:01.208 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:01.208 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:01.208 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:01.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.256522  8185 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } attempt: 2
18:34:01.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.267185  8185 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.188:38999: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:01.281 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:01.282 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:01.282 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:01.282 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.282 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.282 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.282 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.282 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.282 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.282 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.282 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.282 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.282 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:01.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.283741  8054 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } attempt: 2
18:34:01.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.289399  8054 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.188:38999: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:01.300 [DEBUG - pool-348-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.5.136.62:42905, [33ms] received response from server master-127.5.136.62:42905: OK, deferred=null) with no deferred attached!
18:34:01.300 [DEBUG - pool-348-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.5.136.62:42905, [36ms] received response from server master-127.5.136.62:42905: OK, deferred=null) with no deferred attached!
18:34:01.300 [DEBUG - pool-348-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.5.136.62:42905, [34ms] received response from server master-127.5.136.62:42905: OK, deferred=null) with no deferred attached!
18:34:01.300 [DEBUG - pool-348-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.5.136.62:42905, [34ms] received response from server master-127.5.136.62:42905: OK, deferred=null) with no deferred attached!
18:34:01.300 [DEBUG - pool-348-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.5.136.62:42905, [35ms] received response from server master-127.5.136.62:42905: OK, deferred=null) with no deferred attached!
18:34:01.300 [DEBUG - pool-348-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.5.136.62:42905, [79ms] received response from server master-127.5.136.62:42905: OK, deferred=null) with no deferred attached!
18:34:01.300 [DEBUG - pool-348-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.5.136.62:42905, [80ms] received response from server master-127.5.136.62:42905: OK, deferred=null) with no deferred attached!
18:34:01.300 [DEBUG - pool-348-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.5.136.62:42905, [78ms] received response from server master-127.5.136.62:42905: OK, deferred=null) with no deferred attached!
18:34:01.300 [DEBUG - pool-348-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.5.136.62:42905, [78ms] received response from server master-127.5.136.62:42905: OK, deferred=null) with no deferred attached!
18:34:01.300 [DEBUG - pool-348-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.5.136.62:42905, [96ms] received response from server master-127.5.136.62:42905: OK, deferred=null) with no deferred attached!
18:34:01.300 [DEBUG - pool-348-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.5.136.62:42905, [95ms] received response from server master-127.5.136.62:42905: OK, deferred=null) with no deferred attached!
18:34:01.300 [DEBUG - pool-348-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] sending RPC to server master-127.5.136.62:42905, [91ms] received response from server master-127.5.136.62:42905: OK, deferred=null) with no deferred attached!
18:34:01.300 [DEBUG - pool-348-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] sending RPC to server master-127.5.136.62:42905, [100ms] received response from server master-127.5.136.62:42905: OK, deferred=null) with no deferred attached!
18:34:01.300 [DEBUG - pool-348-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] sending RPC to server master-127.5.136.62:42905, [105ms] received response from server master-127.5.136.62:42905: OK, deferred=null) with no deferred attached!
18:34:01.300 [DEBUG - pool-348-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30004), Traces: [0ms] sending RPC to server master-127.5.136.62:42905, [103ms] received response from server master-127.5.136.62:42905: OK, deferred=null) with no deferred attached!
18:34:01.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.358938  8185 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } attempt: 3
18:34:01.359 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:01.360 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:01.360 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:01.360 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.360 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.360 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.360 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.360 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.360 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.360 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.360 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.361 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.361 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:01.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.365159  8185 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.188:38999: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:01.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.374886  8054 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } attempt: 3
18:34:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.380353  8054 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.188:38999: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:01.414 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:01.414 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:01.414 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:01.414 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:01.414 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:01.414 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:01.414 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:01.414 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:01.414 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:01.415 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:01.415 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:01.415 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:01.415 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:01.420 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:01.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.508579  8185 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } attempt: 4
18:34:01.514 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:01.514 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:01.515 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:01.515 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:01.515 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:01.515 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:01.515 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:01.515 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:01.515 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:01.515 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:01.515 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:01.515 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:01.515 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:01.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.516996  8185 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.188:38999: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:01.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.520783  8054 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } attempt: 4
18:34:01.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.526578  8054 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.188:38999: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:01.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:01.584 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:01.585 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:01.585 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:01.585 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:01.585 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:01.585 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:01.586 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:01.586 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:01.586 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:01.586 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:01.586 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:01.586 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:01.586 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:01.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.591882  8187 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:34:01.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.592746  8187 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:34:01.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.593649  8187 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:34:01.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:01.617 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:01.617 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:01.617 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:01.617 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:01.617 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:01.617 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:01.617 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:01.617 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:01.617 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:01.618 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:01.617 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:01.618 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:01.618 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:01.620 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:01.620 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:01.620 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:01.620 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.620 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.620 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.620 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.620 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.620 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.621 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.621 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.621 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.621 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:01.634 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:01.651 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535641646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:34:01.658 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:34:01.659 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
18:34:01.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.662643  8187 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:34:01.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.663116  8187 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:34:01.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.663511  8187 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:34:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.663887  8187 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:34:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.664283  8187 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:34:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.664561  8187 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40103/jwks.json
18:34:01.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.748267  8187 master_runner.cc:387] Master server non-default flags:
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.200.148:33865
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/data
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/wal
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.7.200.190:40077,127.7.200.189:42349,127.7.200.188:38999
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.200.188:38999
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40103/jwks.json
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/data/info.pb
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.200.188
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/logs
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:34:01.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:34:01.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.750231  8187 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:34:01.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.752674  8187 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:34:01.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.768292  8201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:01.798 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:01.799 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:01.799 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:01.799 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.799 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.799 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.799 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.799 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.799 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.799 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.799 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.799 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.799 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:01.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.810346  8054 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } attempt: 5
18:34:01.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:01.816498  8185 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } attempt: 5
18:34:01.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.824644  8185 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.188:38999: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:01.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.825541  8054 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.188:38999: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:01.842 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:01.842 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:01.842 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:01.842 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.843 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.843 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:01.843 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.843 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.843 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:01.843 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.843 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.843 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:01.843 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:01.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:01.995 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:01.995 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:01.995 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:01.995 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:01.996 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:01.996 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:01.996 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:01.996 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:01.996 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:01.996 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:01.996 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:01.997 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:01.997 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:02.034 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:02.035 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:02.035 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:02.035 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:02.035 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:02.035 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:02.036 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:02.036 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:02.036 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:02.036 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:02.036 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:02.036 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:02.036 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:02.039 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:02.039 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:02.039 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:02.039 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:02.039 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:02.040 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:02.040 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:02.040 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:02.040 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:02.040 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:02.040 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:02.040 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:02.041 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:02.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:02.099 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:02.134 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:02.146 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535642146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:34:02.157 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:34:02.158 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
18:34:02.185 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:02.185 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:02.185 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:02.185 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:02.185 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:02.185 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:02.185 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:02.185 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:02.185 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:02.185 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:02.186 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:02.185 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:02.186 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:02.214 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:02.215 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:02.215 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:02.215 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:02.215 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:02.215 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:02.216 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:02.216 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:02.216 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:02.216 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:02.216 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:02.217 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:02.217 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:02.218 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:02.218 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:02.218 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:02.218 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:02.218 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:02.218 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:02.218 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:02.219 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:02.219 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:02.219 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:02.219 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:02.219 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:02.219 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:02.270 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:34:02.270 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:34:02.270 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:34:02.271 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:34:02.271 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:34:02.271 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:34:02.271 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:34:02.272 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:34:02.272 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:34:02.272 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:34:02.272 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:34:02.272 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:34:02.272 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:34:02.310 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:02.310 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:02.310 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:02.311 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:02.311 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:02.311 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:02.311 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:02.311 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:02.311 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:02.312 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:02.312 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:02.312 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:02.312 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:02.348 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:34:02.348 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:34:02.348 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:34:02.349 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:34:02.349 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:34:02.349 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:34:02.350 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:34:02.350 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:34:02.350 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:34:02.350 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:34:02.350 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:34:02.350 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:34:02.350 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:34:02.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:02.372145  8185 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } attempt: 6
18:34:02.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:02.377986  8054 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } attempt: 6
18:34:02.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:02.401072  8054 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.188:38999: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:02.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:02.412484  8185 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.188:38999: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:02.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:02.465 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:02.465 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:02.465 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:02.465 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:02.465 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:02.465 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:02.465 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:02.465 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:02.465 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:02.466 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:02.466 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:02.466 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:02.466 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:02.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:02.598 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:02.599 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:02.599 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:02.599 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:02.599 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:02.599 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:02.599 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:02.599 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:02.599 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:02.599 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:02.599 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:02.601 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:02.601 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:02.601 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:02.616 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:02.616 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:02.617 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:02.618 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:02.618 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:02.618 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:02.618 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:02.618 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:02.618 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:02.618 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:02.619 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:02.619 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:02.619 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:02.634 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:02.649 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535642646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:34:02.658 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:34:02.660 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
18:34:02.847 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:02.847 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:02.847 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:02.847 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:02.848 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:02.848 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:02.848 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:02.848 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:02.848 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:02.848 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:02.849 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:02.849 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:02.849 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:02.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:02.979 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:02.979 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:02.979 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:02.980 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:02.980 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:02.980 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:02.980 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:02.980 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:02.980 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:02.982 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:02.982 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:02.982 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:02.982 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:03.045 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:03.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:03.134 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:03.139 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:03.140 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:03.140 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:03.140 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:03.140 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:03.140 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:03.140 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:03.140 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:03.140 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:03.141 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:03.141 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:03.141 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:03.141 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:03.147 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535643146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:34:03.154 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:34:03.155 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
18:34:03.222 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:03.222 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:03.222 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:03.223 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:03.223 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:03.223 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:03.223 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:03.224 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:03.224 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:03.224 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:03.224 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:03.224 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:03.224 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:03.224 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:03.224 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:03.224 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:03.225 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:03.225 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:03.225 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:03.225 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:03.225 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:03.225 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:03.225 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:03.225 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:03.225 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:03.225 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:03.355 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:03.356 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:03.356 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:03.356 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:03.357 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:03.357 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:03.357 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:03.357 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:03.357 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:03.358 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:03.358 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:03.358 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:03.358 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:03.370 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:03.370 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:03.370 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:03.371 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:03.371 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:03.371 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:03.371 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:03.371 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:03.371 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:03.372 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:03.372 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:03.372 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:03.372 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:03.378 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:03.378 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:03.378 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:03.379 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:03.379 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:03.379 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:03.379 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:03.379 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:03.380 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:03.380 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:03.380 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:03.380 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:03.380 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:03.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:03.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.434480  8054 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } attempt: 7
18:34:03.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:03.463219  8054 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.188:38999: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:03.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.473012  8185 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } attempt: 7
18:34:03.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:03.510270  8185 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.200.188:38999: Network error: Client connection negotiation failed: client connection to 127.7.200.188:38999: connect: Connection refused (error 111)
18:34:03.513 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:03.513 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:03.513 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:03.514 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:03.514 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:03.514 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:03.514 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:03.514 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:03.514 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:03.514 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:03.514 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:03.514 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:03.514 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:03.545 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:03.600 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:03.631 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:03.631 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:03.631 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:03.631 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:03.632 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:03.632 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:03.632 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:03.632 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:03.632 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:03.632 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:03.632 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:03.633 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:03.633 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:03.633 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:03.647 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535643646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:34:03.667 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
18:34:03.668 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
18:34:03.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:03.172078  8200 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 8187
18:34:03.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:03.711519  8200 kernel_stack_watchdog.cc:198] Thread 8187 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 399ms:
18:34:03.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:34:03.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:34:03.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:34:03.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:34:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:01.769588  8202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:03.712538  8187 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.943s	user 0.675s	sys 1.228s
18:34:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:03.712877  8187 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.943s	user 0.675s	sys 1.228s
18:34:03.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:03.715318  8204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:03.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:03.718585  8203 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1947 milliseconds
18:34:03.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.718605  8187 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:34:03.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.720490  8187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:34:03.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.723538  8187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:34:03.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.724989  8187 hybrid_clock.cc:648] HybridClock initialized: now 1783535643724942 us; error 71 us; skew 500 ppm
18:34:03.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.725806  8187 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:34:03.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.732753  8187 webserver.cc:534] Webserver started at http://127.7.200.188:43293/ using document root <none> and password file <none>
18:34:03.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.733748  8187 fs_manager.cc:362] Metadata directory not provided
18:34:03.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.733946  8187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:34:03.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.734355  8187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:34:03.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.739549  8187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/data/instance:
18:34:03.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6e915e7198c74e459ec80085267549b1"
18:34:03.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:03 on dist-test-slave-dxnw"
18:34:03.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.740983  8187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/wal/instance:
18:34:03.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6e915e7198c74e459ec80085267549b1"
18:34:03.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:03 on dist-test-slave-dxnw"
18:34:03.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.749929  8187 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.004s
18:34:03.753 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:03.754 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:03.754 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:03.754 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:03.754 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:03.754 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:03.755 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:03.755 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:03.755 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:03.755 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:03.755 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:03.755 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:03.755 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.757305  8220 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:34:03.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.759055  8187 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.006s	sys 0.000s
18:34:03.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.759542  8187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/wal
18:34:03.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6e915e7198c74e459ec80085267549b1"
18:34:03.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:03 on dist-test-slave-dxnw"
18:34:03.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.759974  8187 fs_report.cc:389] FS layout report
18:34:03.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:34:03.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/wal
18:34:03.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/wal
18:34:03.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/data/data
18:34:03.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:34:03.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:34:03.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:34:03.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:34:03.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:34:03.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:34:03.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:34:03.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:34:03.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:34:03.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:34:03.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:34:03.815 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:03.815 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:03.815 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:03.816 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:03.816 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:03.816 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:03.816 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:03.816 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:03.816 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:03.817 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:03.817 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:03.816 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:03.817 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:03.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.824757  8187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:34:03.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.827176  8187 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:34:03.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.827888  8187 kserver.cc:163] Server-wide thread pool size limit: 3276
18:34:03.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:03.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.924237  8187 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.188:38999
18:34:03.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.924304  8272 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.200.188:38999 every 8 connection(s)
18:34:03.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.927565  8187 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/data/info.pb
18:34:03.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.934739  8273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:03.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.935850  7970 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 8187
18:34:03.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.936367  7970 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/master-2/wal/instance
18:34:03.955 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:03.955 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:03.955 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:03.956 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:03.956 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:03.956 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:03.956 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:03.956 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:03.956 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:03.957 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:03.957 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:03.957 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:03.957 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:03.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.952034  8273 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } has no permanent_uuid. Determining permanent_uuid...
18:34:03.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:03.992697  8273 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } has no permanent_uuid. Determining permanent_uuid...
18:34:04.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.015588  8273 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } has no permanent_uuid. Determining permanent_uuid...
18:34:04.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.040544  8273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1: Bootstrap starting.
18:34:04.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:04.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.048444  8273 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1: Neither blocks nor log segments found. Creating new log.
18:34:04.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.050226  8273 log.cc:826] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1: Log is configured to *not* fsync() on all Append() calls
18:34:04.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.056845  8273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1: No bootstrap required, opened a new log
18:34:04.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.086067  8273 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } }
18:34:04.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.086942  8273 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:04.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.087316  8273 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e915e7198c74e459ec80085267549b1, State: Initialized, Role: FOLLOWER
18:34:04.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.088615  8273 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } }
18:34:04.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:04.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.106006  8282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } } }
18:34:04.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.107892  8273 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [sys.catalog]: configured and running, proceeding with master startup.
18:34:04.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.106984  8282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [sys.catalog]: This master's current role is: FOLLOWER
18:34:04.133 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:04.146 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535644146 for job 2f0efe0c81addbcaea565a6248e4a915.
18:34:04.156 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:34:04.157 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
18:34:04.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:04.193326  8293 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:34:04.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:04.193684  8293 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:34:04.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.173848  8187 master_runner.cc:187] Error getting master registration for 127.7.200.190:40077: OK, instance_id { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" instance_seqno: 1783535638619111 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:34:04.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.209965  8187 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:34:04.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.223181  8282 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:04.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.223909  8282 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } }
18:34:04.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:04.228717  8282 leader_election.cc:290] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9aa715cae624ab694c9b1e8fb98c10e (127.7.200.190:40077), 5aab15a6037f48c290d9378bdeee2073 (127.7.200.189:42349)
18:34:04.315 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:04.315 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:04.315 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:04.316 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:04.316 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:04.316 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:04.316 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:04.316 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:04.316 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:04.317 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:04.317 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:04.317 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:04.317 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:04.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:04.336637  8227 tablet.cc:2406] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:34:04.340 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:04.340 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:04.340 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:04.340 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:04.340 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:04.340 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:04.340 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:04.341 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:04.340 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:04.340 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:04.341 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:04.341 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:04.341 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:04.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:04.461 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:04.461 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:04.461 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:04.461 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:04.461 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:04.461 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:04.461 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:04.461 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:04.461 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:04.461 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:04.462 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:04.462 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:04.462 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:04.518 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:04.518 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:04.518 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:04.518 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:04.519 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:04.519 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:04.519 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:04.519 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:04.519 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:04.519 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:04.519 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:04.519 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:04.519 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:04.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:04.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:04.633 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:04.646 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535644646 for job 2f0efe0c81addbcaea565a6248e4a915.
18:34:04.661 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job 2f0efe0c81addbcaea565a6248e4a915 (2236 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
18:34:04.662 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
18:34:04.733 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:04.733 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:04.733 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:04.733 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:04.733 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:04.733 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:04.733 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:04.733 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:04.733 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:04.734 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:04.734 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:04.734 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:04.734 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:04.830 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:34:04.830 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:34:04.830 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:34:04.831 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:34:04.831 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:34:04.831 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:34:04.831 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:34:04.831 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:34:04.831 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:34:04.831 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:34:04.831 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:34:04.831 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:34:04.831 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:34:04.832 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=22, TimeoutTracker(timeout=29792, elapsed=28180), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [11ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733], [80ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679], [80ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733],org.apache.kudu.client.RecoverableException: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679], [99ms] refreshing cache from master, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [101ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [101ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [119ms] refreshing cache from master, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [119ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [120ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [138ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [139ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [160ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [160ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [161ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [161ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [200ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [240ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [339ms] refreshing cache from master, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [340ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [579ms] refreshing cache from master, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [579ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [580ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [580ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [580ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [979ms] refreshing cache from master, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [980ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1019ms] refreshing cache from master, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [1020ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [2378ms] refreshing cache from master, [2378ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [2379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [2379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [2379ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [2379ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [2380ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [2380ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [5698ms] refreshing cache from master, [5698ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [5699ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [5699ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [5699ms] too many traces: truncated at 100 traces, deferred=Deferred@1678392055(state=PENDING, result=null, callback=(continuation of Deferred@58929668 after retry RPC after error@1548436933) -> (continuation of Deferred@2064310911 after retry RPC after error@1323475563) -> (continuation of Deferred@1424734881 after retry RPC after error@1376299156) -> (continuation of Deferred@2126356912 after retry RPC after error@630699510) -> (continuation of Deferred@740310359 after retry RPC after error@997944399) -> (continuation of Deferred@685304497 after retry RPC after error@813220441) -> (continuation of Deferred@488606596 after retry RPC after error@2103874940) -> (continuation of Deferred@310666499 after retry RPC after error@1679300352) -> (continuation of Deferred@87749548 after retry RPC after error@1279150850) -> (continuation of Deferred@2099479547 after retry RPC after error@1495743304) -> (continuation of Deferred@189928531 after retry RPC after error@889858144) -> (continuation of Deferred@1415006561 after retry RPC after error@877315544) -> (continuation of Deferred@790736782 after retry RPC after error@1259129634) -> (continuation of Deferred@637443939 after retry RPC after error@1199106561) -> (continuation of Deferred@1694982335 after retry RPC after error@1216340710) -> (continuation of Deferred@422275341 after retry RPC after error@428056779) -> (continuation of Deferred@1205807580 after retry RPC after error@1879083795) -> (continuation of Deferred@841082655 after retry RPC after error@908106856) -> (continuation of Deferred@143643321 after retry RPC after error@2091092136) -> (continuation of Deferred@1099403580 after retry RPC after error@1945540280) -> (continuation of Deferred@85629029 after retry RPC after error@1696376486), errback=(continuation of Deferred@58929668 after retry RPC after error@1548436933) -> (continuation of Deferred@2064310911 after retry RPC after error@1323475563) -> (continuation of Deferred@1424734881 after retry RPC after error@1376299156) -> (continuation of Deferred@2126356912 after retry RPC after error@630699510) -> (continuation of Deferred@740310359 after retry RPC after error@997944399) -> (continuation of Deferred@685304497 after retry RPC after error@813220441) -> (continuation of Deferred@488606596 after retry RPC after error@2103874940) -> (continuation of Deferred@310666499 after retry RPC after error@1679300352) -> (continuation of Deferred@87749548 after retry RPC after error@1279150850) -> (continuation of Deferred@2099479547 after retry RPC after error@1495743304) -> (continuation of Deferred@189928531 after retry RPC after error@889858144) -> (continuation of Deferred@1415006561 after retry RPC after error@877315544) -> (continuation of Deferred@790736782 after retry RPC after error@1259129634) -> (continuation of Deferred@637443939 after retry RPC after error@1199106561) -> (continuation of Deferred@1694982335 after retry RPC after error@1216340710) -> (continuation of Deferred@422275341 after retry RPC after error@428056779) -> (continuation of Deferred@1205807580 after retry RPC after error@1879083795) -> (continuation of Deferred@841082655 after retry RPC after error@908106856) -> (continuation of Deferred@143643321 after retry RPC after error@2091092136) -> (continuation of Deferred@1099403580 after retry RPC after error@1945540280) -> (continuation of Deferred@85629029 after retry RPC after error@1696376486)))
18:34:04.833 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1523) Notify RPC ScanRequest(scannerId=null, state=OPENING, tablet=bf4e623aabd94032905e80f9a4dbc79e, attempt=4, KuduRpc(method=Scan, tablet=bf4e623aabd94032905e80f9a4dbc79e, attempt=4, TimeoutTracker(timeout=30000, elapsed=28390), Traces: [0ms] sending RPC to server 928ff5a5022c4c84be872c8cd7fd3581, [145ms] received response from server 928ff5a5022c4c84be872c8cd7fd3581: Network error: [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] unexpected exception from downstream on [id: 0x85e7707f, L:/127.0.0.1:47606 - R:/127.4.179.3:43889], [145ms] delaying RPC due to: Network error: [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] unexpected exception from downstream on [id: 0x85e7707f, L:/127.0.0.1:47606 - R:/127.4.179.3:43889], [161ms] sending RPC to server 5454fd94967f4e178a493e84ecdce8e2, [162ms] received response from server 5454fd94967f4e178a493e84ecdce8e2: Network error: Failed to connect to peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745): Connection refused: /127.4.179.2:33745, [162ms] delaying RPC due to: Network error: Failed to connect to peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745): Connection refused: /127.4.179.2:33745, [181ms] sending RPC to server 6008cdf76d9e456ca635ad5aeccc6c61, [183ms] received response from server 6008cdf76d9e456ca635ad5aeccc6c61: Network error: Failed to connect to peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253): Connection refused: /127.4.179.1:45253, [183ms] delaying RPC due to: Network error: Failed to connect to peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253): Connection refused: /127.4.179.1:45253, [202ms] refreshing cache from master, [202ms] Sub RPC GetTableLocations: refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [211ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [213ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733], [282ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679], [282ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733],org.apache.kudu.client.RecoverableException: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679], [301ms] Sub RPC GetTableLocations: refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [302ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [302ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [303ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [303ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [321ms] Sub RPC GetTableLocations: refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [321ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [322ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [322ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [322ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [340ms] Sub RPC GetTableLocations: refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [341ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [341ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [341ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [341ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [361ms] Sub RPC GetTableLocations: refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [362ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [362ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [363ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [363ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [401ms] Sub RPC GetTableLocations: refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [402ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [402ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [402ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [402ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [441ms] Sub RPC GetTableLocations: refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [442ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [442ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [442ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [442ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [541ms] Sub RPC GetTableLocations: refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [542ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [542ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [542ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [542ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [781ms] Sub RPC GetTableLocations: refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [781ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [782ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [782ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [782ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [1181ms] Sub RPC GetTableLocations: refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1182ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1221ms] Sub RPC GetTableLocations: refreshing cache from master, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [1222ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [2580ms] Sub RPC GetTableLocations: refreshing cache from master, [2580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [2581ms] too many traces: truncated at 100 traces, deferred=Deferred@418370888(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0))) after lookup exception
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=22, TimeoutTracker(timeout=29792, elapsed=28180), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [11ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733], [80ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679], [80ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733],org.apache.kudu.client.RecoverableException: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679], [99ms] refreshing cache from master, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [101ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [101ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [119ms] refreshing cache from master, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [119ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [120ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [138ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [139ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [160ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [160ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [161ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [161ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [200ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [240ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [339ms] refreshing cache from master, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [340ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [579ms] refreshing cache from master, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [579ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [580ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [580ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [580ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [979ms] refreshing cache from master, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [980ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1019ms] refreshing cache from master, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [1020ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [2378ms] refreshing cache from master, [2378ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [2379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [2379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [2379ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [2379ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [2380ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [2380ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [5698ms] refreshing cache from master, [5698ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [5699ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [5699ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [5699ms] too many traces: truncated at 100 traces, deferred=Deferred@1678392055(state=PENDING, result=null, callback=(continuation of Deferred@58929668 after retry RPC after error@1548436933) -> (continuation of Deferred@2064310911 after retry RPC after error@1323475563) -> (continuation of Deferred@1424734881 after retry RPC after error@1376299156) -> (continuation of Deferred@2126356912 after retry RPC after error@630699510) -> (continuation of Deferred@740310359 after retry RPC after error@997944399) -> (continuation of Deferred@685304497 after retry RPC after error@813220441) -> (continuation of Deferred@488606596 after retry RPC after error@2103874940) -> (continuation of Deferred@310666499 after retry RPC after error@1679300352) -> (continuation of Deferred@87749548 after retry RPC after error@1279150850) -> (continuation of Deferred@2099479547 after retry RPC after error@1495743304) -> (continuation of Deferred@189928531 after retry RPC after error@889858144) -> (continuation of Deferred@1415006561 after retry RPC after error@877315544) -> (continuation of Deferred@790736782 after retry RPC after error@1259129634) -> (continuation of Deferred@637443939 after retry RPC after error@1199106561) -> (continuation of Deferred@1694982335 after retry RPC after error@1216340710) -> (continuation of Deferred@422275341 after retry RPC after error@428056779) -> (continuation of Deferred@1205807580 after retry RPC after error@1879083795) -> (continuation of Deferred@841082655 after retry RPC after error@908106856) -> (continuation of Deferred@143643321 after retry RPC after error@2091092136) -> (continuation of Deferred@1099403580 after retry RPC after error@1945540280) -> (continuation of Deferred@85629029 after retry RPC after error@1696376486), errback=(continuation of Deferred@58929668 after retry RPC after error@1548436933) -> (continuation of Deferred@2064310911 after retry RPC after error@1323475563) -> (continuation of Deferred@1424734881 after retry RPC after error@1376299156) -> (continuation of Deferred@2126356912 after retry RPC after error@630699510) -> (continuation of Deferred@740310359 after retry RPC after error@997944399) -> (continuation of Deferred@685304497 after retry RPC after error@813220441) -> (continuation of Deferred@488606596 after retry RPC after error@2103874940) -> (continuation of Deferred@310666499 after retry RPC after error@1679300352) -> (continuation of Deferred@87749548 after retry RPC after error@1279150850) -> (continuation of Deferred@2099479547 after retry RPC after error@1495743304) -> (continuation of Deferred@189928531 after retry RPC after error@889858144) -> (continuation of Deferred@1415006561 after retry RPC after error@877315544) -> (continuation of Deferred@790736782 after retry RPC after error@1259129634) -> (continuation of Deferred@637443939 after retry RPC after error@1199106561) -> (continuation of Deferred@1694982335 after retry RPC after error@1216340710) -> (continuation of Deferred@422275341 after retry RPC after error@428056779) -> (continuation of Deferred@1205807580 after retry RPC after error@1879083795) -> (continuation of Deferred@841082655 after retry RPC after error@908106856) -> (continuation of Deferred@143643321 after retry RPC after error@2091092136) -> (continuation of Deferred@1099403580 after retry RPC after error@1945540280) -> (continuation of Deferred@85629029 after retry RPC after error@1696376486)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.179.61:44733
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:04.834 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:686) Can not open scanner
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=22, TimeoutTracker(timeout=29792, elapsed=28180), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [11ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733], [80ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679], [80ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733],org.apache.kudu.client.RecoverableException: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679], [99ms] refreshing cache from master, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [101ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [101ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [119ms] refreshing cache from master, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [119ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [120ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [138ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [139ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [160ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [160ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [161ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [161ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [200ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [240ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [339ms] refreshing cache from master, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [340ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [579ms] refreshing cache from master, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [579ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [580ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [580ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [580ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [979ms] refreshing cache from master, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [980ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1019ms] refreshing cache from master, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [1020ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [2378ms] refreshing cache from master, [2378ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [2379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [2379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [2379ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [2379ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [2380ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [2380ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [5698ms] refreshing cache from master, [5698ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [5699ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [5699ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [5699ms] too many traces: truncated at 100 traces, deferred=Deferred@1678392055(state=PENDING, result=null, callback=(continuation of Deferred@58929668 after retry RPC after error@1548436933) -> (continuation of Deferred@2064310911 after retry RPC after error@1323475563) -> (continuation of Deferred@1424734881 after retry RPC after error@1376299156) -> (continuation of Deferred@2126356912 after retry RPC after error@630699510) -> (continuation of Deferred@740310359 after retry RPC after error@997944399) -> (continuation of Deferred@685304497 after retry RPC after error@813220441) -> (continuation of Deferred@488606596 after retry RPC after error@2103874940) -> (continuation of Deferred@310666499 after retry RPC after error@1679300352) -> (continuation of Deferred@87749548 after retry RPC after error@1279150850) -> (continuation of Deferred@2099479547 after retry RPC after error@1495743304) -> (continuation of Deferred@189928531 after retry RPC after error@889858144) -> (continuation of Deferred@1415006561 after retry RPC after error@877315544) -> (continuation of Deferred@790736782 after retry RPC after error@1259129634) -> (continuation of Deferred@637443939 after retry RPC after error@1199106561) -> (continuation of Deferred@1694982335 after retry RPC after error@1216340710) -> (continuation of Deferred@422275341 after retry RPC after error@428056779) -> (continuation of Deferred@1205807580 after retry RPC after error@1879083795) -> (continuation of Deferred@841082655 after retry RPC after error@908106856) -> (continuation of Deferred@143643321 after retry RPC after error@2091092136) -> (continuation of Deferred@1099403580 after retry RPC after error@1945540280) -> (continuation of Deferred@85629029 after retry RPC after error@1696376486), errback=(continuation of Deferred@58929668 after retry RPC after error@1548436933) -> (continuation of Deferred@2064310911 after retry RPC after error@1323475563) -> (continuation of Deferred@1424734881 after retry RPC after error@1376299156) -> (continuation of Deferred@2126356912 after retry RPC after error@630699510) -> (continuation of Deferred@740310359 after retry RPC after error@997944399) -> (continuation of Deferred@685304497 after retry RPC after error@813220441) -> (continuation of Deferred@488606596 after retry RPC after error@2103874940) -> (continuation of Deferred@310666499 after retry RPC after error@1679300352) -> (continuation of Deferred@87749548 after retry RPC after error@1279150850) -> (continuation of Deferred@2099479547 after retry RPC after error@1495743304) -> (continuation of Deferred@189928531 after retry RPC after error@889858144) -> (continuation of Deferred@1415006561 after retry RPC after error@877315544) -> (continuation of Deferred@790736782 after retry RPC after error@1259129634) -> (continuation of Deferred@637443939 after retry RPC after error@1199106561) -> (continuation of Deferred@1694982335 after retry RPC after error@1216340710) -> (continuation of Deferred@422275341 after retry RPC after error@428056779) -> (continuation of Deferred@1205807580 after retry RPC after error@1879083795) -> (continuation of Deferred@841082655 after retry RPC after error@908106856) -> (continuation of Deferred@143643321 after retry RPC after error@2091092136) -> (continuation of Deferred@1099403580 after retry RPC after error@1945540280) -> (continuation of Deferred@85629029 after retry RPC after error@1696376486)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.179.61:44733
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:04.835 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduScanner.java:862) Scanner null closed on null
18:34:04.835 [ERROR - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:190) Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 2 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=22, TimeoutTracker(timeout=29792, elapsed=28180), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [11ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733], [80ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679], [80ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733],org.apache.kudu.client.RecoverableException: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679], [99ms] refreshing cache from master, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [101ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [101ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [119ms] refreshing cache from master, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [119ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [120ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [138ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [139ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [160ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [160ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [161ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [161ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [200ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [240ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [339ms] refreshing cache from master, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [340ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [579ms] refreshing cache from master, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [579ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [580ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [580ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [580ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [979ms] refreshing cache from master, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [980ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1019ms] refreshing cache from master, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [1020ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [2378ms] refreshing cache from master, [2378ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [2379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [2379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [2379ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [2379ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [2380ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [2380ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [5698ms] refreshing cache from master, [5698ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [5699ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [5699ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [5699ms] too many traces: truncated at 100 traces, deferred=Deferred@1678392055(state=PENDING, result=null, callback=(continuation of Deferred@58929668 after retry RPC after error@1548436933) -> (continuation of Deferred@2064310911 after retry RPC after error@1323475563) -> (continuation of Deferred@1424734881 after retry RPC after error@1376299156) -> (continuation of Deferred@2126356912 after retry RPC after error@630699510) -> (continuation of Deferred@740310359 after retry RPC after error@997944399) -> (continuation of Deferred@685304497 after retry RPC after error@813220441) -> (continuation of Deferred@488606596 after retry RPC after error@2103874940) -> (continuation of Deferred@310666499 after retry RPC after error@1679300352) -> (continuation of Deferred@87749548 after retry RPC after error@1279150850) -> (continuation of Deferred@2099479547 after retry RPC after error@1495743304) -> (continuation of Deferred@189928531 after retry RPC after error@889858144) -> (continuation of Deferred@1415006561 after retry RPC after error@877315544) -> (continuation of Deferred@790736782 after retry RPC after error@1259129634) -> (continuation of Deferred@637443939 after retry RPC after error@1199106561) -> (continuation of Deferred@1694982335 after retry RPC after error@1216340710) -> (continuation of Deferred@422275341 after retry RPC after error@428056779) -> (continuation of Deferred@1205807580 after retry RPC after error@1879083795) -> (continuation of Deferred@841082655 after retry RPC after error@908106856) -> (continuation of Deferred@143643321 after retry RPC after error@2091092136) -> (continuation of Deferred@1099403580 after retry RPC after error@1945540280) -> (continuation of Deferred@85629029 after retry RPC after error@1696376486), errback=(continuation of Deferred@58929668 after retry RPC after error@1548436933) -> (continuation of Deferred@2064310911 after retry RPC after error@1323475563) -> (continuation of Deferred@1424734881 after retry RPC after error@1376299156) -> (continuation of Deferred@2126356912 after retry RPC after error@630699510) -> (continuation of Deferred@740310359 after retry RPC after error@997944399) -> (continuation of Deferred@685304497 after retry RPC after error@813220441) -> (continuation of Deferred@488606596 after retry RPC after error@2103874940) -> (continuation of Deferred@310666499 after retry RPC after error@1679300352) -> (continuation of Deferred@87749548 after retry RPC after error@1279150850) -> (continuation of Deferred@2099479547 after retry RPC after error@1495743304) -> (continuation of Deferred@189928531 after retry RPC after error@889858144) -> (continuation of Deferred@1415006561 after retry RPC after error@877315544) -> (continuation of Deferred@790736782 after retry RPC after error@1259129634) -> (continuation of Deferred@637443939 after retry RPC after error@1199106561) -> (continuation of Deferred@1694982335 after retry RPC after error@1216340710) -> (continuation of Deferred@422275341 after retry RPC after error@428056779) -> (continuation of Deferred@1205807580 after retry RPC after error@1879083795) -> (continuation of Deferred@841082655 after retry RPC after error@908106856) -> (continuation of Deferred@143643321 after retry RPC after error@2091092136) -> (continuation of Deferred@1099403580 after retry RPC after error@1945540280) -> (continuation of Deferred@85629029 after retry RPC after error@1696376486)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.179.61:44733
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:04.836 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] disconnecting while in state TERMINATED
18:34:04.836 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)] disconnecting while in state TERMINATED
18:34:04.836 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)] disconnecting while in state TERMINATED
18:34:04.836 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.4.179.60:34679(127.4.179.60:34679)] disconnecting while in state TERMINATED
18:34:04.836 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.4.179.62:35121(127.4.179.62:35121)] disconnecting while in state TERMINATED
18:34:04.836 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.4.179.61:44733(127.4.179.61:44733)] disconnecting while in state TERMINATED
18:34:04.837 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:04.838 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-5
18:34:04.838 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 15 thread-local buffer(s) from thread: kudu-nio-0
18:34:04.839 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.5.136.61:43625(127.5.136.61:43625)] disconnecting while in state TERMINATED
18:34:04.839 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.5.136.62:42905(127.5.136.62:42905)] disconnecting while in state TERMINATED
18:34:04.839 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.5.136.60:39171(127.5.136.60:39171)] disconnecting while in state TERMINATED
18:34:04.839 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:04.840 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
18:34:04.841 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
18:34:04.841 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
18:34:04.842 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 15 thread-local buffer(s) from thread: kudu-nio-4
18:34:04.843 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
18:34:04.843 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:34:04.845 [WARN - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to FAILED with failure cause:
java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: SplitFetcher thread 2 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=22, TimeoutTracker(timeout=29792, elapsed=28180), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [11ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733], [80ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679], [80ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733],org.apache.kudu.client.RecoverableException: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679], [99ms] refreshing cache from master, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [101ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [101ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [119ms] refreshing cache from master, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [119ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [120ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [138ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [139ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [160ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [160ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [161ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [161ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [200ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [240ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [339ms] refreshing cache from master, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [340ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [579ms] refreshing cache from master, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [579ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [580ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [580ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [580ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [979ms] refreshing cache from master, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [980ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1019ms] refreshing cache from master, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [1020ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [2378ms] refreshing cache from master, [2378ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [2379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [2379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [2379ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [2379ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [2380ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [2380ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [5698ms] refreshing cache from master, [5698ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [5699ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [5699ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [5699ms] too many traces: truncated at 100 traces, deferred=Deferred@1678392055(state=PENDING, result=null, callback=(continuation of Deferred@58929668 after retry RPC after error@1548436933) -> (continuation of Deferred@2064310911 after retry RPC after error@1323475563) -> (continuation of Deferred@1424734881 after retry RPC after error@1376299156) -> (continuation of Deferred@2126356912 after retry RPC after error@630699510) -> (continuation of Deferred@740310359 after retry RPC after error@997944399) -> (continuation of Deferred@685304497 after retry RPC after error@813220441) -> (continuation of Deferred@488606596 after retry RPC after error@2103874940) -> (continuation of Deferred@310666499 after retry RPC after error@1679300352) -> (continuation of Deferred@87749548 after retry RPC after error@1279150850) -> (continuation of Deferred@2099479547 after retry RPC after error@1495743304) -> (continuation of Deferred@189928531 after retry RPC after error@889858144) -> (continuation of Deferred@1415006561 after retry RPC after error@877315544) -> (continuation of Deferred@790736782 after retry RPC after error@1259129634) -> (continuation of Deferred@637443939 after retry RPC after error@1199106561) -> (continuation of Deferred@1694982335 after retry RPC after error@1216340710) -> (continuation of Deferred@422275341 after retry RPC after error@428056779) -> (continuation of Deferred@1205807580 after retry RPC after error@1879083795) -> (continuation of Deferred@841082655 after retry RPC after error@908106856) -> (continuation of Deferred@143643321 after retry RPC after error@2091092136) -> (continuation of Deferred@1099403580 after retry RPC after error@1945540280) -> (continuation of Deferred@85629029 after retry RPC after error@1696376486), errback=(continuation of Deferred@58929668 after retry RPC after error@1548436933) -> (continuation of Deferred@2064310911 after retry RPC after error@1323475563) -> (continuation of Deferred@1424734881 after retry RPC after error@1376299156) -> (continuation of Deferred@2126356912 after retry RPC after error@630699510) -> (continuation of Deferred@740310359 after retry RPC after error@997944399) -> (continuation of Deferred@685304497 after retry RPC after error@813220441) -> (continuation of Deferred@488606596 after retry RPC after error@2103874940) -> (continuation of Deferred@310666499 after retry RPC after error@1679300352) -> (continuation of Deferred@87749548 after retry RPC after error@1279150850) -> (continuation of Deferred@2099479547 after retry RPC after error@1495743304) -> (continuation of Deferred@189928531 after retry RPC after error@889858144) -> (continuation of Deferred@1415006561 after retry RPC after error@877315544) -> (continuation of Deferred@790736782 after retry RPC after error@1259129634) -> (continuation of Deferred@637443939 after retry RPC after error@1199106561) -> (continuation of Deferred@1694982335 after retry RPC after error@1216340710) -> (continuation of Deferred@422275341 after retry RPC after error@428056779) -> (continuation of Deferred@1205807580 after retry RPC after error@1879083795) -> (continuation of Deferred@841082655 after retry RPC after error@908106856) -> (continuation of Deferred@143643321 after retry RPC after error@2091092136) -> (continuation of Deferred@1099403580 after retry RPC after error@1945540280) -> (continuation of Deferred@85629029 after retry RPC after error@1696376486)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.179.61:44733
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:04.845 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
18:34:04.854 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
18:34:04.858 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to FAILED on 1bed232f-62eb-42dc-858c-7139d8e062d6 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: SplitFetcher thread 2 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=22, TimeoutTracker(timeout=29792, elapsed=28180), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [11ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733], [80ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679], [80ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0x56696aac, L:/127.0.0.1:55732 - R:/127.4.179.61:44733],org.apache.kudu.client.RecoverableException: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x4d9c2bc5, L:/127.0.0.1:45964 - R:/127.4.179.60:34679], [99ms] refreshing cache from master, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [101ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [101ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [119ms] refreshing cache from master, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [119ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [120ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [138ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [139ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [159ms] refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [160ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [160ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [161ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [161ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [199ms] refreshing cache from master, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [199ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [200ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [200ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [239ms] refreshing cache from master, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [240ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [240ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [339ms] refreshing cache from master, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [340ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [340ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [579ms] refreshing cache from master, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [579ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [579ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [580ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [580ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [580ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [979ms] refreshing cache from master, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [979ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [980ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [980ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1019ms] refreshing cache from master, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [1019ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1020ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [1020ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [2378ms] refreshing cache from master, [2378ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [2379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [2379ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [2379ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [2379ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [2380ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [2380ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [5698ms] refreshing cache from master, [5698ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [5699ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [5699ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [5699ms] too many traces: truncated at 100 traces, deferred=Deferred@1678392055(state=PENDING, result=null, callback=(continuation of Deferred@58929668 after retry RPC after error@1548436933) -> (continuation of Deferred@2064310911 after retry RPC after error@1323475563) -> (continuation of Deferred@1424734881 after retry RPC after error@1376299156) -> (continuation of Deferred@2126356912 after retry RPC after error@630699510) -> (continuation of Deferred@740310359 after retry RPC after error@997944399) -> (continuation of Deferred@685304497 after retry RPC after error@813220441) -> (continuation of Deferred@488606596 after retry RPC after error@2103874940) -> (continuation of Deferred@310666499 after retry RPC after error@1679300352) -> (continuation of Deferred@87749548 after retry RPC after error@1279150850) -> (continuation of Deferred@2099479547 after retry RPC after error@1495743304) -> (continuation of Deferred@189928531 after retry RPC after error@889858144) -> (continuation of Deferred@1415006561 after retry RPC after error@877315544) -> (continuation of Deferred@790736782 after retry RPC after error@1259129634) -> (continuation of Deferred@637443939 after retry RPC after error@1199106561) -> (continuation of Deferred@1694982335 after retry RPC after error@1216340710) -> (continuation of Deferred@422275341 after retry RPC after error@428056779) -> (continuation of Deferred@1205807580 after retry RPC after error@1879083795) -> (continuation of Deferred@841082655 after retry RPC after error@908106856) -> (continuation of Deferred@143643321 after retry RPC after error@2091092136) -> (continuation of Deferred@1099403580 after retry RPC after error@1945540280) -> (continuation of Deferred@85629029 after retry RPC after error@1696376486), errback=(continuation of Deferred@58929668 after retry RPC after error@1548436933) -> (continuation of Deferred@2064310911 after retry RPC after error@1323475563) -> (continuation of Deferred@1424734881 after retry RPC after error@1376299156) -> (continuation of Deferred@2126356912 after retry RPC after error@630699510) -> (continuation of Deferred@740310359 after retry RPC after error@997944399) -> (continuation of Deferred@685304497 after retry RPC after error@813220441) -> (continuation of Deferred@488606596 after retry RPC after error@2103874940) -> (continuation of Deferred@310666499 after retry RPC after error@1679300352) -> (continuation of Deferred@87749548 after retry RPC after error@1279150850) -> (continuation of Deferred@2099479547 after retry RPC after error@1495743304) -> (continuation of Deferred@189928531 after retry RPC after error@889858144) -> (continuation of Deferred@1415006561 after retry RPC after error@877315544) -> (continuation of Deferred@790736782 after retry RPC after error@1259129634) -> (continuation of Deferred@637443939 after retry RPC after error@1199106561) -> (continuation of Deferred@1694982335 after retry RPC after error@1216340710) -> (continuation of Deferred@422275341 after retry RPC after error@428056779) -> (continuation of Deferred@1205807580 after retry RPC after error@1879083795) -> (continuation of Deferred@841082655 after retry RPC after error@908106856) -> (continuation of Deferred@143643321 after retry RPC after error@2091092136) -> (continuation of Deferred@1099403580 after retry RPC after error@1945540280) -> (continuation of Deferred@85629029 after retry RPC after error@1696376486)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.179.61:44733
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:04.859 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
18:34:04.859 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
18:34:04.859 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2f0efe0c81addbcaea565a6248e4a915) switched from state RUNNING to RESTARTING.
18:34:04.859 [WARN - flink-pekko.actor.default-dispatcher-6] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
18:34:04.860 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 2f0efe0c81addbcaea565a6248e4a915: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:04.860 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:04.860 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:04.860 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:04.861 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:04.861 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:04.861 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:04.861 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:04.861 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:04.861 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:04.862 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:04.862 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:04.862 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:04.862 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:04.920 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:04.942 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:04.943 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:04.943 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:04.943 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:04.943 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:04.943 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:04.943 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:04.943 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:04.944 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:04.945 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:04.945 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:04.945 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:04.945 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:05.046 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:05.058 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:05.058 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:05.058 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:05.058 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:05.058 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:05.058 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:05.059 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:05.059 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:05.059 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:05.059 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:05.058 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:05.059 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:05.059 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:05.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:05.133 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:05.176 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:05.176 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:05.177 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:05.177 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.177 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.177 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.177 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.177 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.177 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.177 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.178 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.178 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.178 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:05.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:05.197883  8293 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:34:05.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:05.198290  8293 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:34:05.234 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:05.234 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:05.235 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:05.235 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:05.235 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:05.235 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:05.235 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:05.235 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:05.235 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:05.235 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:05.235 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:05.235 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:05.235 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:05.315 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:05.315 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:05.315 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:05.316 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.316 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.316 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.316 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.316 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.316 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.316 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.316 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.316 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.316 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:05.355 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:05.355 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:05.355 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:05.356 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.356 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.356 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.356 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.356 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.356 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.356 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.356 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.356 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.356 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:05.396 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:05.396 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:05.396 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:05.396 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.397 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.397 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.397 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.397 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.397 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.398 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.398 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.398 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.398 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:05.418 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:05.418 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:05.418 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:05.419 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:05.419 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:05.419 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:05.419 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:05.419 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:05.419 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:05.419 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:05.419 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:05.419 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:05.419 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:05.420 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:05.460 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:05.460 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:05.460 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:05.460 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:05.460 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:05.460 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:05.460 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:05.460 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:05.460 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:05.461 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:05.461 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:05.461 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:05.461 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:05.500 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:05.500 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:05.500 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:05.501 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:05.501 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:05.501 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:05.501 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:05.501 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:05.501 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:05.501 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:05.501 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:05.501 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:05.501 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:05.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.524713  8054 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } attempt: 8
18:34:05.546 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:05.560 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:05.560 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:05.560 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:05.561 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:05.562 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:05.562 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:05.562 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:05.562 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:05.562 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:05.562 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:05.562 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:05.562 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:05.562 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:05.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.563803  8054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e: Bootstrap starting.
18:34:05.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.571619  8054 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e: Neither blocks nor log segments found. Creating new log.
18:34:05.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.574708  8054 log.cc:826] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e: Log is configured to *not* fsync() on all Append() calls
18:34:05.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.580786  8054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e: No bootstrap required, opened a new log
18:34:05.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:05.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.600696  8185 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } attempt: 8
18:34:05.605 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:05.605 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:05.605 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:05.605 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.605 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.606 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.606 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.606 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.606 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.606 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.606 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.606 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.606 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:05.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.613966  8054 raft_consensus.cc:359] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } }
18:34:05.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.614905  8054 raft_consensus.cc:385] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:05.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.615245  8054 raft_consensus.cc:740] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9aa715cae624ab694c9b1e8fb98c10e, State: Initialized, Role: FOLLOWER
18:34:05.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.616191  8054 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } }
18:34:05.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.624606  8304 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } } }
18:34:05.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.625357  8304 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e [sys.catalog]: This master's current role is: FOLLOWER
18:34:05.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.629607  8054 sys_catalog.cc:565] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e [sys.catalog]: configured and running, proceeding with master startup.
18:34:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.629796  8029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6e915e7198c74e459ec80085267549b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" is_pre_election: true
18:34:05.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.630666  8029 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e915e7198c74e459ec80085267549b1 in term 0.
18:34:05.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.631428  8029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48054 (request call id 2) took 1403 ms. Trace:
18:34:05.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.631847  8029 rpcz_store.cc:276] 0708 18:34:04.227762 (+     0us) service_pool.cc:167] Inserting onto call queue
18:34:05.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:34:04.227897 (+   135us) service_pool.cc:224] Handling call
18:34:05.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:34:05.631362 (+1403465us) inbound_call.cc:177] Queueing success response
18:34:05.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
18:34:05.638 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:05.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.642269  8222 leader_election.cc:304] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e915e7198c74e459ec80085267549b1, e9aa715cae624ab694c9b1e8fb98c10e; no voters: 
18:34:05.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.645236  8306 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:34:05.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.645625  8306 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:34:05.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.656497  8306 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [term 0 FOLLOWER]: Advancing to term 1
18:34:05.670 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:05.671 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:05.671 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:05.671 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:05.671 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:05.671 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:05.672 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:05.672 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:05.672 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:05.672 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:05.672 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:05.672 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:05.673 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:05.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.682209  8185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073: Bootstrap starting.
18:34:05.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.676039  8306 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } }
18:34:05.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.698108  8306 leader_election.cc:290] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [CANDIDATE]: Term 1 election: Requested vote from peers e9aa715cae624ab694c9b1e8fb98c10e (127.7.200.190:40077), 5aab15a6037f48c290d9378bdeee2073 (127.7.200.189:42349)
18:34:05.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.699350  8029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6e915e7198c74e459ec80085267549b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9aa715cae624ab694c9b1e8fb98c10e"
18:34:05.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.699935  8029 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e [term 0 FOLLOWER]: Advancing to term 1
18:34:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.703579  8185 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073: Neither blocks nor log segments found. Creating new log.
18:34:05.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.706063  8185 log.cc:826] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073: Log is configured to *not* fsync() on all Append() calls
18:34:05.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.710331  8029 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e915e7198c74e459ec80085267549b1 in term 1.
18:34:05.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.711663  8222 leader_election.cc:304] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e915e7198c74e459ec80085267549b1, e9aa715cae624ab694c9b1e8fb98c10e; no voters: 
18:34:05.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.712564  8306 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [term 1 FOLLOWER]: Leader election won for term 1
18:34:05.713 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:05.713 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:05.713 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:05.714 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:05.714 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:05.714 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:05.714 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:05.714 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:05.714 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:05.714 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:05.714 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:05.714 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:05.714 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:05.724 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:05.724 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:05.724 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:05.724 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:05.724 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:05.724 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:05.725 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:05.725 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:05.725 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:05.724 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:05.725 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:05.725 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:05.725 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.725538  8185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073: No bootstrap required, opened a new log
18:34:05.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.725708  8306 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [term 1 LEADER]: Becoming Leader. State: Replica: 6e915e7198c74e459ec80085267549b1, State: Running, Role: LEADER
18:34:05.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.726788  8306 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } }
18:34:05.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.766352  8312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e915e7198c74e459ec80085267549b1. Latest consensus state: current_term: 1 leader_uuid: "6e915e7198c74e459ec80085267549b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } } }
18:34:05.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.767515  8312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [sys.catalog]: This master's current role is: LEADER
18:34:05.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:05.773521  8008 tablet.cc:2406] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:34:05.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.775828  8316 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:34:05.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.782903  8316 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:34:05.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.789820  8185 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } }
18:34:05.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.791802  8185 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:05.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.792173  8185 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5aab15a6037f48c290d9378bdeee2073, State: Initialized, Role: FOLLOWER
18:34:05.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.793365  8185 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } }
18:34:05.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.806140  8185 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [sys.catalog]: configured and running, proceeding with master startup.
18:34:05.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.806318  8159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6e915e7198c74e459ec80085267549b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5aab15a6037f48c290d9378bdeee2073"
18:34:05.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.807092  8159 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [term 0 FOLLOWER]: Advancing to term 1
18:34:05.810 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.62:35121(127.4.179.62:35121)] connecting to peer
18:34:05.810 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.60:34679(127.4.179.60:34679)] connecting to peer
18:34:05.810 [DEBUG - pool-376-thread-1] (Connection.java:748) [peer master-127.4.179.61:44733(127.4.179.61:44733)] connecting to peer
18:34:05.811 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:34:05.811 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.4.179.60:34679(127.4.179.60:34679)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:34:05.811 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.60:34679: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679
18:34:05.811 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:34:05.811 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.4.179.61:44733(127.4.179.61:44733)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:34:05.811 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.61:44733: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733
18:34:05.811 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:34:05.811 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.179.62:35121(127.4.179.62:35121)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:34:05.811 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.179.62:35121: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
18:34:05.811 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733; will retry
18:34:05.812 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=26, TimeoutTracker(timeout=29796, elapsed=29161), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [2ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [33ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: OK, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733], [38ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733], [57ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [59ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [60ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [84ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679], [84ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679], [98ms] refreshing cache from master, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [98ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [99ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [99ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [99ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [117ms] refreshing cache from master, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [118ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [137ms] refreshing cache from master, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [138ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [177ms] refreshing cache from master, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [178ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [197ms] refreshing cache from master, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [198ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [198ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [199ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [297ms] refreshing cache from master, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [297ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [298ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [298ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [298ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [497ms] refreshing cache from master, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [498ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [498ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [499ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [499ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [557ms] refreshing cache from master, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [559ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [677ms] refreshing cache from master, [677ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [678ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [678ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [679ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [679ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1717ms] refreshing cache from master, [1717ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1718ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [1718ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [1719ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [5397ms] refreshing cache from master, [5397ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [5398ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [5398ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [5398ms] too many traces: truncated at 100 traces, deferred=Deferred@555092027(state=PENDING, result=null, callback=(continuation of Deferred@1461176241 after retry RPC after error@1316987053) -> (continuation of Deferred@1040974660 after retry RPC after error@793416558) -> (continuation of Deferred@1183441785 after retry RPC after error@1975540173) -> (continuation of Deferred@721969682 after retry RPC after error@1344423422) -> (continuation of Deferred@1505359528 after retry RPC after error@784384611) -> (continuation of Deferred@1177562459 after retry RPC after error@75468246) -> (continuation of Deferred@317007687 after retry RPC after error@975056034) -> (continuation of Deferred@2097382479 after retry RPC after error@90875652) -> (continuation of Deferred@1049520113 after retry RPC after error@1967007678) -> (continuation of Deferred@343860394 after retry RPC after error@1148986278) -> (continuation of Deferred@159409463 after retry RPC after error@226992238) -> (continuation of Deferred@1858035392 after retry RPC after error@1274753442) -> (continuation of Deferred@1104698423 after retry RPC after error@1911292082) -> (continuation of Deferred@1706101009 after retry RPC after error@2010464804) -> (continuation of Deferred@1953464589 after retry RPC after error@1696069282) -> (continuation of Deferred@142840464 after retry RPC after error@1427776966) -> (continuation of Deferred@1567994241 after retry RPC after error@126742123) -> (continuation of Deferred@319748888 after retry RPC after error@389994666) -> (continuation of Deferred@1740085877 after retry RPC after error@262266462) -> (continuation of Deferred@1796416137 after retry RPC after error@168381641) -> (continuation of Deferred@1370889167 after retry RPC after error@1348762761) -> (continuation of Deferred@571546470 after retry RPC after error@1648260329) -> (continuation of Deferred@53965570 after retry RPC after error@1891944409) -> (continuation of Deferred@1520707724 after retry RPC after error@1269601805) -> (continuation of Deferred@1941656345 after retry RPC after error@622311608), errback=(continuation of Deferred@1461176241 after retry RPC after error@1316987053) -> (continuation of Deferred@1040974660 after retry RPC after error@793416558) -> (continuation of Deferred@1183441785 after retry RPC after error@1975540173) -> (continuation of Deferred@721969682 after retry RPC after error@1344423422) -> (continuation of Deferred@1505359528 after retry RPC after error@784384611) -> (continuation of Deferred@1177562459 after retry RPC after error@75468246) -> (continuation of Deferred@317007687 after retry RPC after error@975056034) -> (continuation of Deferred@2097382479 after retry RPC after error@90875652) -> (continuation of Deferred@1049520113 after retry RPC after error@1967007678) -> (continuation of Deferred@343860394 after retry RPC after error@1148986278) -> (continuation of Deferred@159409463 after retry RPC after error@226992238) -> (continuation of Deferred@1858035392 after retry RPC after error@1274753442) -> (continuation of Deferred@1104698423 after retry RPC after error@1911292082) -> (continuation of Deferred@1706101009 after retry RPC after error@2010464804) -> (continuation of Deferred@1953464589 after retry RPC after error@1696069282) -> (continuation of Deferred@142840464 after retry RPC after error@1427776966) -> (continuation of Deferred@1567994241 after retry RPC after error@126742123) -> (continuation of Deferred@319748888 after retry RPC after error@389994666) -> (continuation of Deferred@1740085877 after retry RPC after error@262266462) -> (continuation of Deferred@1796416137 after retry RPC after error@168381641) -> (continuation of Deferred@1370889167 after retry RPC after error@1348762761) -> (continuation of Deferred@571546470 after retry RPC after error@1648260329) -> (continuation of Deferred@53965570 after retry RPC after error@1891944409) -> (continuation of Deferred@1520707724 after retry RPC after error@1269601805) -> (continuation of Deferred@1941656345 after retry RPC after error@622311608)))
18:34:05.813 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1523) Notify RPC ScanRequest(scannerId=null, state=OPENING, tablet=5ee352da413147d39a7f82bb88ff1dda, attempt=4, KuduRpc(method=Scan, tablet=5ee352da413147d39a7f82bb88ff1dda, attempt=4, TimeoutTracker(timeout=30000, elapsed=29366), Traces: [0ms] sending RPC to server 928ff5a5022c4c84be872c8cd7fd3581, [126ms] received response from server 928ff5a5022c4c84be872c8cd7fd3581: Network error: [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] unexpected exception from downstream on [id: 0xef851832, L:/127.0.0.1:47602 - R:/127.4.179.3:43889], [126ms] delaying RPC due to: Network error: [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] unexpected exception from downstream on [id: 0xef851832, L:/127.0.0.1:47602 - R:/127.4.179.3:43889], [141ms] sending RPC to server 5454fd94967f4e178a493e84ecdce8e2, [142ms] received response from server 5454fd94967f4e178a493e84ecdce8e2: Network error: Failed to connect to peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745): Connection refused: /127.4.179.2:33745, [142ms] delaying RPC due to: Network error: Failed to connect to peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745): Connection refused: /127.4.179.2:33745, [160ms] sending RPC to server 6008cdf76d9e456ca635ad5aeccc6c61, [161ms] received response from server 6008cdf76d9e456ca635ad5aeccc6c61: Network error: Failed to connect to peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253): Connection refused: /127.4.179.1:45253, [161ms] delaying RPC due to: Network error: Failed to connect to peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253): Connection refused: /127.4.179.1:45253, [183ms] refreshing cache from master, [183ms] Sub RPC GetTableLocations: refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [185ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [192ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [216ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: OK, [221ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733], [221ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733], [240ms] Sub RPC GetTableLocations: refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [242ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [243ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [267ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679], [267ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679], [281ms] Sub RPC GetTableLocations: refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [281ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [282ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [282ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [282ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [300ms] Sub RPC GetTableLocations: refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [301ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [301ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [301ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [301ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [320ms] Sub RPC GetTableLocations: refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [321ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [321ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [321ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [321ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [360ms] Sub RPC GetTableLocations: refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [361ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [361ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [361ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [361ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [380ms] Sub RPC GetTableLocations: refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [381ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [381ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [382ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [382ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [480ms] Sub RPC GetTableLocations: refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [480ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [481ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [481ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [481ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [680ms] Sub RPC GetTableLocations: refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [681ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [681ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [682ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [682ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [740ms] Sub RPC GetTableLocations: refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [741ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [741ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [741ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [742ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [860ms] Sub RPC GetTableLocations: refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [861ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [861ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [862ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [862ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1900ms] Sub RPC GetTableLocations: refreshing cache from master, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1901ms] too many traces: truncated at 100 traces, deferred=Deferred@1577845982(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0))) after lookup exception
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=26, TimeoutTracker(timeout=29796, elapsed=29161), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [2ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [33ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: OK, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733], [38ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733], [57ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [59ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [60ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [84ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679], [84ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679], [98ms] refreshing cache from master, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [98ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [99ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [99ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [99ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [117ms] refreshing cache from master, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [118ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [137ms] refreshing cache from master, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [138ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [177ms] refreshing cache from master, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [178ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [197ms] refreshing cache from master, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [198ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [198ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [199ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [297ms] refreshing cache from master, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [297ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [298ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [298ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [298ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [497ms] refreshing cache from master, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [498ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [498ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [499ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [499ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [557ms] refreshing cache from master, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [559ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [677ms] refreshing cache from master, [677ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [678ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [678ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [679ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [679ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1717ms] refreshing cache from master, [1717ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1718ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [1718ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [1719ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [5397ms] refreshing cache from master, [5397ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [5398ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [5398ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [5398ms] too many traces: truncated at 100 traces, deferred=Deferred@555092027(state=PENDING, result=null, callback=(continuation of Deferred@1461176241 after retry RPC after error@1316987053) -> (continuation of Deferred@1040974660 after retry RPC after error@793416558) -> (continuation of Deferred@1183441785 after retry RPC after error@1975540173) -> (continuation of Deferred@721969682 after retry RPC after error@1344423422) -> (continuation of Deferred@1505359528 after retry RPC after error@784384611) -> (continuation of Deferred@1177562459 after retry RPC after error@75468246) -> (continuation of Deferred@317007687 after retry RPC after error@975056034) -> (continuation of Deferred@2097382479 after retry RPC after error@90875652) -> (continuation of Deferred@1049520113 after retry RPC after error@1967007678) -> (continuation of Deferred@343860394 after retry RPC after error@1148986278) -> (continuation of Deferred@159409463 after retry RPC after error@226992238) -> (continuation of Deferred@1858035392 after retry RPC after error@1274753442) -> (continuation of Deferred@1104698423 after retry RPC after error@1911292082) -> (continuation of Deferred@1706101009 after retry RPC after error@2010464804) -> (continuation of Deferred@1953464589 after retry RPC after error@1696069282) -> (continuation of Deferred@142840464 after retry RPC after error@1427776966) -> (continuation of Deferred@1567994241 after retry RPC after error@126742123) -> (continuation of Deferred@319748888 after retry RPC after error@389994666) -> (continuation of Deferred@1740085877 after retry RPC after error@262266462) -> (continuation of Deferred@1796416137 after retry RPC after error@168381641) -> (continuation of Deferred@1370889167 after retry RPC after error@1348762761) -> (continuation of Deferred@571546470 after retry RPC after error@1648260329) -> (continuation of Deferred@53965570 after retry RPC after error@1891944409) -> (continuation of Deferred@1520707724 after retry RPC after error@1269601805) -> (continuation of Deferred@1941656345 after retry RPC after error@622311608), errback=(continuation of Deferred@1461176241 after retry RPC after error@1316987053) -> (continuation of Deferred@1040974660 after retry RPC after error@793416558) -> (continuation of Deferred@1183441785 after retry RPC after error@1975540173) -> (continuation of Deferred@721969682 after retry RPC after error@1344423422) -> (continuation of Deferred@1505359528 after retry RPC after error@784384611) -> (continuation of Deferred@1177562459 after retry RPC after error@75468246) -> (continuation of Deferred@317007687 after retry RPC after error@975056034) -> (continuation of Deferred@2097382479 after retry RPC after error@90875652) -> (continuation of Deferred@1049520113 after retry RPC after error@1967007678) -> (continuation of Deferred@343860394 after retry RPC after error@1148986278) -> (continuation of Deferred@159409463 after retry RPC after error@226992238) -> (continuation of Deferred@1858035392 after retry RPC after error@1274753442) -> (continuation of Deferred@1104698423 after retry RPC after error@1911292082) -> (continuation of Deferred@1706101009 after retry RPC after error@2010464804) -> (continuation of Deferred@1953464589 after retry RPC after error@1696069282) -> (continuation of Deferred@142840464 after retry RPC after error@1427776966) -> (continuation of Deferred@1567994241 after retry RPC after error@126742123) -> (continuation of Deferred@319748888 after retry RPC after error@389994666) -> (continuation of Deferred@1740085877 after retry RPC after error@262266462) -> (continuation of Deferred@1796416137 after retry RPC after error@168381641) -> (continuation of Deferred@1370889167 after retry RPC after error@1348762761) -> (continuation of Deferred@571546470 after retry RPC after error@1648260329) -> (continuation of Deferred@53965570 after retry RPC after error@1891944409) -> (continuation of Deferred@1520707724 after retry RPC after error@1269601805) -> (continuation of Deferred@1941656345 after retry RPC after error@622311608)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.179.62:35121
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:05.813 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:686) Can not open scanner
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=26, TimeoutTracker(timeout=29796, elapsed=29161), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [2ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [33ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: OK, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733], [38ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733], [57ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [59ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [60ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [84ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679], [84ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679], [98ms] refreshing cache from master, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [98ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [99ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [99ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [99ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [117ms] refreshing cache from master, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [118ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [137ms] refreshing cache from master, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [138ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [177ms] refreshing cache from master, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [178ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [197ms] refreshing cache from master, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [198ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [198ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [199ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [297ms] refreshing cache from master, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [297ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [298ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [298ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [298ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [497ms] refreshing cache from master, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [498ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [498ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [499ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [499ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [557ms] refreshing cache from master, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [559ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [677ms] refreshing cache from master, [677ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [678ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [678ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [679ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [679ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1717ms] refreshing cache from master, [1717ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1718ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [1718ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [1719ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [5397ms] refreshing cache from master, [5397ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [5398ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [5398ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [5398ms] too many traces: truncated at 100 traces, deferred=Deferred@555092027(state=PENDING, result=null, callback=(continuation of Deferred@1461176241 after retry RPC after error@1316987053) -> (continuation of Deferred@1040974660 after retry RPC after error@793416558) -> (continuation of Deferred@1183441785 after retry RPC after error@1975540173) -> (continuation of Deferred@721969682 after retry RPC after error@1344423422) -> (continuation of Deferred@1505359528 after retry RPC after error@784384611) -> (continuation of Deferred@1177562459 after retry RPC after error@75468246) -> (continuation of Deferred@317007687 after retry RPC after error@975056034) -> (continuation of Deferred@2097382479 after retry RPC after error@90875652) -> (continuation of Deferred@1049520113 after retry RPC after error@1967007678) -> (continuation of Deferred@343860394 after retry RPC after error@1148986278) -> (continuation of Deferred@159409463 after retry RPC after error@226992238) -> (continuation of Deferred@1858035392 after retry RPC after error@1274753442) -> (continuation of Deferred@1104698423 after retry RPC after error@1911292082) -> (continuation of Deferred@1706101009 after retry RPC after error@2010464804) -> (continuation of Deferred@1953464589 after retry RPC after error@1696069282) -> (continuation of Deferred@142840464 after retry RPC after error@1427776966) -> (continuation of Deferred@1567994241 after retry RPC after error@126742123) -> (continuation of Deferred@319748888 after retry RPC after error@389994666) -> (continuation of Deferred@1740085877 after retry RPC after error@262266462) -> (continuation of Deferred@1796416137 after retry RPC after error@168381641) -> (continuation of Deferred@1370889167 after retry RPC after error@1348762761) -> (continuation of Deferred@571546470 after retry RPC after error@1648260329) -> (continuation of Deferred@53965570 after retry RPC after error@1891944409) -> (continuation of Deferred@1520707724 after retry RPC after error@1269601805) -> (continuation of Deferred@1941656345 after retry RPC after error@622311608), errback=(continuation of Deferred@1461176241 after retry RPC after error@1316987053) -> (continuation of Deferred@1040974660 after retry RPC after error@793416558) -> (continuation of Deferred@1183441785 after retry RPC after error@1975540173) -> (continuation of Deferred@721969682 after retry RPC after error@1344423422) -> (continuation of Deferred@1505359528 after retry RPC after error@784384611) -> (continuation of Deferred@1177562459 after retry RPC after error@75468246) -> (continuation of Deferred@317007687 after retry RPC after error@975056034) -> (continuation of Deferred@2097382479 after retry RPC after error@90875652) -> (continuation of Deferred@1049520113 after retry RPC after error@1967007678) -> (continuation of Deferred@343860394 after retry RPC after error@1148986278) -> (continuation of Deferred@159409463 after retry RPC after error@226992238) -> (continuation of Deferred@1858035392 after retry RPC after error@1274753442) -> (continuation of Deferred@1104698423 after retry RPC after error@1911292082) -> (continuation of Deferred@1706101009 after retry RPC after error@2010464804) -> (continuation of Deferred@1953464589 after retry RPC after error@1696069282) -> (continuation of Deferred@142840464 after retry RPC after error@1427776966) -> (continuation of Deferred@1567994241 after retry RPC after error@126742123) -> (continuation of Deferred@319748888 after retry RPC after error@389994666) -> (continuation of Deferred@1740085877 after retry RPC after error@262266462) -> (continuation of Deferred@1796416137 after retry RPC after error@168381641) -> (continuation of Deferred@1370889167 after retry RPC after error@1348762761) -> (continuation of Deferred@571546470 after retry RPC after error@1648260329) -> (continuation of Deferred@53965570 after retry RPC after error@1891944409) -> (continuation of Deferred@1520707724 after retry RPC after error@1269601805) -> (continuation of Deferred@1941656345 after retry RPC after error@622311608)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.179.62:35121
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:05.814 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduScanner.java:862) Scanner null closed on null
18:34:05.814 [ERROR - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:190) Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 2 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=26, TimeoutTracker(timeout=29796, elapsed=29161), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [2ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [33ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: OK, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733], [38ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733], [57ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [59ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [60ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [84ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679], [84ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679], [98ms] refreshing cache from master, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [98ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [99ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [99ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [99ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [117ms] refreshing cache from master, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [118ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [137ms] refreshing cache from master, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [138ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [177ms] refreshing cache from master, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [178ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [197ms] refreshing cache from master, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [198ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [198ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [199ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [297ms] refreshing cache from master, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [297ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [298ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [298ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [298ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [497ms] refreshing cache from master, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [498ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [498ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [499ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [499ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [557ms] refreshing cache from master, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [559ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [677ms] refreshing cache from master, [677ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [678ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [678ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [679ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [679ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1717ms] refreshing cache from master, [1717ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1718ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [1718ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [1719ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [5397ms] refreshing cache from master, [5397ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [5398ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [5398ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [5398ms] too many traces: truncated at 100 traces, deferred=Deferred@555092027(state=PENDING, result=null, callback=(continuation of Deferred@1461176241 after retry RPC after error@1316987053) -> (continuation of Deferred@1040974660 after retry RPC after error@793416558) -> (continuation of Deferred@1183441785 after retry RPC after error@1975540173) -> (continuation of Deferred@721969682 after retry RPC after error@1344423422) -> (continuation of Deferred@1505359528 after retry RPC after error@784384611) -> (continuation of Deferred@1177562459 after retry RPC after error@75468246) -> (continuation of Deferred@317007687 after retry RPC after error@975056034) -> (continuation of Deferred@2097382479 after retry RPC after error@90875652) -> (continuation of Deferred@1049520113 after retry RPC after error@1967007678) -> (continuation of Deferred@343860394 after retry RPC after error@1148986278) -> (continuation of Deferred@159409463 after retry RPC after error@226992238) -> (continuation of Deferred@1858035392 after retry RPC after error@1274753442) -> (continuation of Deferred@1104698423 after retry RPC after error@1911292082) -> (continuation of Deferred@1706101009 after retry RPC after error@2010464804) -> (continuation of Deferred@1953464589 after retry RPC after error@1696069282) -> (continuation of Deferred@142840464 after retry RPC after error@1427776966) -> (continuation of Deferred@1567994241 after retry RPC after error@126742123) -> (continuation of Deferred@319748888 after retry RPC after error@389994666) -> (continuation of Deferred@1740085877 after retry RPC after error@262266462) -> (continuation of Deferred@1796416137 after retry RPC after error@168381641) -> (continuation of Deferred@1370889167 after retry RPC after error@1348762761) -> (continuation of Deferred@571546470 after retry RPC after error@1648260329) -> (continuation of Deferred@53965570 after retry RPC after error@1891944409) -> (continuation of Deferred@1520707724 after retry RPC after error@1269601805) -> (continuation of Deferred@1941656345 after retry RPC after error@622311608), errback=(continuation of Deferred@1461176241 after retry RPC after error@1316987053) -> (continuation of Deferred@1040974660 after retry RPC after error@793416558) -> (continuation of Deferred@1183441785 after retry RPC after error@1975540173) -> (continuation of Deferred@721969682 after retry RPC after error@1344423422) -> (continuation of Deferred@1505359528 after retry RPC after error@784384611) -> (continuation of Deferred@1177562459 after retry RPC after error@75468246) -> (continuation of Deferred@317007687 after retry RPC after error@975056034) -> (continuation of Deferred@2097382479 after retry RPC after error@90875652) -> (continuation of Deferred@1049520113 after retry RPC after error@1967007678) -> (continuation of Deferred@343860394 after retry RPC after error@1148986278) -> (continuation of Deferred@159409463 after retry RPC after error@226992238) -> (continuation of Deferred@1858035392 after retry RPC after error@1274753442) -> (continuation of Deferred@1104698423 after retry RPC after error@1911292082) -> (continuation of Deferred@1706101009 after retry RPC after error@2010464804) -> (continuation of Deferred@1953464589 after retry RPC after error@1696069282) -> (continuation of Deferred@142840464 after retry RPC after error@1427776966) -> (continuation of Deferred@1567994241 after retry RPC after error@126742123) -> (continuation of Deferred@319748888 after retry RPC after error@389994666) -> (continuation of Deferred@1740085877 after retry RPC after error@262266462) -> (continuation of Deferred@1796416137 after retry RPC after error@168381641) -> (continuation of Deferred@1370889167 after retry RPC after error@1348762761) -> (continuation of Deferred@571546470 after retry RPC after error@1648260329) -> (continuation of Deferred@53965570 after retry RPC after error@1891944409) -> (continuation of Deferred@1520707724 after retry RPC after error@1269601805) -> (continuation of Deferred@1941656345 after retry RPC after error@622311608)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.179.62:35121
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:05.814 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 928ff5a5022c4c84be872c8cd7fd3581(127.4.179.3:43889)] disconnecting while in state TERMINATED
18:34:05.815 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 6008cdf76d9e456ca635ad5aeccc6c61(127.4.179.1:45253)] disconnecting while in state TERMINATED
18:34:05.815 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 5454fd94967f4e178a493e84ecdce8e2(127.4.179.2:33745)] disconnecting while in state TERMINATED
18:34:05.815 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.4.179.60:34679(127.4.179.60:34679)] disconnecting while in state TERMINATED
18:34:05.815 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.4.179.62:35121(127.4.179.62:35121)] disconnecting while in state TERMINATED
18:34:05.815 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.4.179.61:44733(127.4.179.61:44733)] disconnecting while in state TERMINATED
18:34:05.816 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.5.136.61:43625(127.5.136.61:43625)] disconnecting while in state TERMINATED
18:34:05.816 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.5.136.62:42905(127.5.136.62:42905)] disconnecting while in state TERMINATED
18:34:05.816 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.5.136.60:39171(127.5.136.60:39171)] disconnecting while in state TERMINATED
18:34:05.816 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:05.817 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
18:34:05.817 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
18:34:05.818 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:05.818 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
18:34:05.818 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:34:05.818 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-5
18:34:05.818 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-4
18:34:05.821 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:05.821 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:05.821 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:05.821 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:05.821 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:05.821 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:05.822 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:05.822 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:05.822 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:05.822 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:05.822 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:05.822 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:05.822 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:05.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.825543  8029 raft_consensus.cc:1275] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e [term 1 FOLLOWER]: Refusing update from remote peer 6e915e7198c74e459ec80085267549b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:34:05.828 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
18:34:05.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.827751  8312 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:34:05.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.802316  8320 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } } }
18:34:05.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.830302  8320 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [sys.catalog]: This master's current role is: FOLLOWER
18:34:05.836 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:34:05.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.837121  8160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6e915e7198c74e459ec80085267549b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5aab15a6037f48c290d9378bdeee2073" is_pre_election: true
18:34:05.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.837541  8159 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e915e7198c74e459ec80085267549b1 in term 1.
18:34:05.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.838061  8320 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:05.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:05.838197  8160 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43852 (request call id 1) took 1609 ms (client timeout 2036 ms). Trace:
18:34:05.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.838491  8320 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } }
18:34:05.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:05.838598  8160 rpcz_store.cc:269] 0708 18:34:04.228523 (+     0us) service_pool.cc:167] Inserting onto call queue
18:34:05.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:34:04.228667 (+   144us) service_pool.cc:224] Handling call
18:34:05.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:34:05.838097 (+1609430us) inbound_call.cc:177] Queueing success response
18:34:05.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
18:34:05.839 [WARN - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to FAILED with failure cause:
java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: SplitFetcher thread 2 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=26, TimeoutTracker(timeout=29796, elapsed=29161), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [2ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [33ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: OK, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733], [38ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733], [57ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [59ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [60ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [84ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679], [84ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679], [98ms] refreshing cache from master, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [98ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [99ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [99ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [99ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [117ms] refreshing cache from master, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [118ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [137ms] refreshing cache from master, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [138ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [177ms] refreshing cache from master, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [178ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [197ms] refreshing cache from master, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [198ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [198ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [199ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [297ms] refreshing cache from master, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [297ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [298ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [298ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [298ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [497ms] refreshing cache from master, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [498ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [498ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [499ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [499ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [557ms] refreshing cache from master, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [559ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [677ms] refreshing cache from master, [677ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [678ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [678ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [679ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [679ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1717ms] refreshing cache from master, [1717ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1718ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [1718ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [1719ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [5397ms] refreshing cache from master, [5397ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [5398ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [5398ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [5398ms] too many traces: truncated at 100 traces, deferred=Deferred@555092027(state=PENDING, result=null, callback=(continuation of Deferred@1461176241 after retry RPC after error@1316987053) -> (continuation of Deferred@1040974660 after retry RPC after error@793416558) -> (continuation of Deferred@1183441785 after retry RPC after error@1975540173) -> (continuation of Deferred@721969682 after retry RPC after error@1344423422) -> (continuation of Deferred@1505359528 after retry RPC after error@784384611) -> (continuation of Deferred@1177562459 after retry RPC after error@75468246) -> (continuation of Deferred@317007687 after retry RPC after error@975056034) -> (continuation of Deferred@2097382479 after retry RPC after error@90875652) -> (continuation of Deferred@1049520113 after retry RPC after error@1967007678) -> (continuation of Deferred@343860394 after retry RPC after error@1148986278) -> (continuation of Deferred@159409463 after retry RPC after error@226992238) -> (continuation of Deferred@1858035392 after retry RPC after error@1274753442) -> (continuation of Deferred@1104698423 after retry RPC after error@1911292082) -> (continuation of Deferred@1706101009 after retry RPC after error@2010464804) -> (continuation of Deferred@1953464589 after retry RPC after error@1696069282) -> (continuation of Deferred@142840464 after retry RPC after error@1427776966) -> (continuation of Deferred@1567994241 after retry RPC after error@126742123) -> (continuation of Deferred@319748888 after retry RPC after error@389994666) -> (continuation of Deferred@1740085877 after retry RPC after error@262266462) -> (continuation of Deferred@1796416137 after retry RPC after error@168381641) -> (continuation of Deferred@1370889167 after retry RPC after error@1348762761) -> (continuation of Deferred@571546470 after retry RPC after error@1648260329) -> (continuation of Deferred@53965570 after retry RPC after error@1891944409) -> (continuation of Deferred@1520707724 after retry RPC after error@1269601805) -> (continuation of Deferred@1941656345 after retry RPC after error@622311608), errback=(continuation of Deferred@1461176241 after retry RPC after error@1316987053) -> (continuation of Deferred@1040974660 after retry RPC after error@793416558) -> (continuation of Deferred@1183441785 after retry RPC after error@1975540173) -> (continuation of Deferred@721969682 after retry RPC after error@1344423422) -> (continuation of Deferred@1505359528 after retry RPC after error@784384611) -> (continuation of Deferred@1177562459 after retry RPC after error@75468246) -> (continuation of Deferred@317007687 after retry RPC after error@975056034) -> (continuation of Deferred@2097382479 after retry RPC after error@90875652) -> (continuation of Deferred@1049520113 after retry RPC after error@1967007678) -> (continuation of Deferred@343860394 after retry RPC after error@1148986278) -> (continuation of Deferred@159409463 after retry RPC after error@226992238) -> (continuation of Deferred@1858035392 after retry RPC after error@1274753442) -> (continuation of Deferred@1104698423 after retry RPC after error@1911292082) -> (continuation of Deferred@1706101009 after retry RPC after error@2010464804) -> (continuation of Deferred@1953464589 after retry RPC after error@1696069282) -> (continuation of Deferred@142840464 after retry RPC after error@1427776966) -> (continuation of Deferred@1567994241 after retry RPC after error@126742123) -> (continuation of Deferred@319748888 after retry RPC after error@389994666) -> (continuation of Deferred@1740085877 after retry RPC after error@262266462) -> (continuation of Deferred@1796416137 after retry RPC after error@168381641) -> (continuation of Deferred@1370889167 after retry RPC after error@1348762761) -> (continuation of Deferred@571546470 after retry RPC after error@1648260329) -> (continuation of Deferred@53965570 after retry RPC after error@1891944409) -> (continuation of Deferred@1520707724 after retry RPC after error@1269601805) -> (continuation of Deferred@1941656345 after retry RPC after error@622311608)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.179.62:35121
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:05.841 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
18:34:05.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.847040  8320 leader_election.cc:290] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9aa715cae624ab694c9b1e8fb98c10e (127.7.200.190:40077), 6e915e7198c74e459ec80085267549b1 (127.7.200.188:38999)
18:34:05.850 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
18:34:05.854 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:05.854 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:05.855 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:05.855 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:05.855 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:05.855 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:05.855 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:05.855 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:05.855 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:05.856 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:05.856 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:05.856 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:05.856 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:05.859 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to FAILED on 1bed232f-62eb-42dc-858c-7139d8e062d6 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: SplitFetcher thread 2 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=26, TimeoutTracker(timeout=29796, elapsed=29161), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [2ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [33ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: OK, [38ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733], [38ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.61:44733(127.4.179.61:44733)] unexpected exception from downstream on [id: 0xa189cafb, L:/127.0.0.1:55722 - R:/127.4.179.61:44733], [57ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [59ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [60ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [84ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679], [84ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: [peer master-127.4.179.60:34679(127.4.179.60:34679)] unexpected exception from downstream on [id: 0x8d25006e, L:/127.0.0.1:45956 - R:/127.4.179.60:34679], [98ms] refreshing cache from master, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [98ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [99ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [99ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [99ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [117ms] refreshing cache from master, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [118ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [118ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [137ms] refreshing cache from master, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [138ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [138ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [177ms] refreshing cache from master, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [178ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [178ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [197ms] refreshing cache from master, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [198ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [198ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [199ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [297ms] refreshing cache from master, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [297ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [298ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [298ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [298ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [497ms] refreshing cache from master, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [497ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [498ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [498ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [499ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [499ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [557ms] refreshing cache from master, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [558ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [559ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [677ms] refreshing cache from master, [677ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [678ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [678ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [678ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [679ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [679ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1717ms] refreshing cache from master, [1717ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [1718ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [1718ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.62:35121: Network error: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.60:34679: Network error: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679, [1718ms] Sub RPC ConnectToMaster: received response from server master-127.4.179.61:44733: Network error: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [1719ms] delaying RPC due to: Service unavailable: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733, [5397ms] refreshing cache from master, [5397ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.62:35121, [5398ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.60:34679, [5398ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.179.61:44733, [5398ms] too many traces: truncated at 100 traces, deferred=Deferred@555092027(state=PENDING, result=null, callback=(continuation of Deferred@1461176241 after retry RPC after error@1316987053) -> (continuation of Deferred@1040974660 after retry RPC after error@793416558) -> (continuation of Deferred@1183441785 after retry RPC after error@1975540173) -> (continuation of Deferred@721969682 after retry RPC after error@1344423422) -> (continuation of Deferred@1505359528 after retry RPC after error@784384611) -> (continuation of Deferred@1177562459 after retry RPC after error@75468246) -> (continuation of Deferred@317007687 after retry RPC after error@975056034) -> (continuation of Deferred@2097382479 after retry RPC after error@90875652) -> (continuation of Deferred@1049520113 after retry RPC after error@1967007678) -> (continuation of Deferred@343860394 after retry RPC after error@1148986278) -> (continuation of Deferred@159409463 after retry RPC after error@226992238) -> (continuation of Deferred@1858035392 after retry RPC after error@1274753442) -> (continuation of Deferred@1104698423 after retry RPC after error@1911292082) -> (continuation of Deferred@1706101009 after retry RPC after error@2010464804) -> (continuation of Deferred@1953464589 after retry RPC after error@1696069282) -> (continuation of Deferred@142840464 after retry RPC after error@1427776966) -> (continuation of Deferred@1567994241 after retry RPC after error@126742123) -> (continuation of Deferred@319748888 after retry RPC after error@389994666) -> (continuation of Deferred@1740085877 after retry RPC after error@262266462) -> (continuation of Deferred@1796416137 after retry RPC after error@168381641) -> (continuation of Deferred@1370889167 after retry RPC after error@1348762761) -> (continuation of Deferred@571546470 after retry RPC after error@1648260329) -> (continuation of Deferred@53965570 after retry RPC after error@1891944409) -> (continuation of Deferred@1520707724 after retry RPC after error@1269601805) -> (continuation of Deferred@1941656345 after retry RPC after error@622311608), errback=(continuation of Deferred@1461176241 after retry RPC after error@1316987053) -> (continuation of Deferred@1040974660 after retry RPC after error@793416558) -> (continuation of Deferred@1183441785 after retry RPC after error@1975540173) -> (continuation of Deferred@721969682 after retry RPC after error@1344423422) -> (continuation of Deferred@1505359528 after retry RPC after error@784384611) -> (continuation of Deferred@1177562459 after retry RPC after error@75468246) -> (continuation of Deferred@317007687 after retry RPC after error@975056034) -> (continuation of Deferred@2097382479 after retry RPC after error@90875652) -> (continuation of Deferred@1049520113 after retry RPC after error@1967007678) -> (continuation of Deferred@343860394 after retry RPC after error@1148986278) -> (continuation of Deferred@159409463 after retry RPC after error@226992238) -> (continuation of Deferred@1858035392 after retry RPC after error@1274753442) -> (continuation of Deferred@1104698423 after retry RPC after error@1911292082) -> (continuation of Deferred@1706101009 after retry RPC after error@2010464804) -> (continuation of Deferred@1953464589 after retry RPC after error@1696069282) -> (continuation of Deferred@142840464 after retry RPC after error@1427776966) -> (continuation of Deferred@1567994241 after retry RPC after error@126742123) -> (continuation of Deferred@319748888 after retry RPC after error@389994666) -> (continuation of Deferred@1740085877 after retry RPC after error@262266462) -> (continuation of Deferred@1796416137 after retry RPC after error@168381641) -> (continuation of Deferred@1370889167 after retry RPC after error@1348762761) -> (continuation of Deferred@571546470 after retry RPC after error@1648260329) -> (continuation of Deferred@53965570 after retry RPC after error@1891944409) -> (continuation of Deferred@1520707724 after retry RPC after error@1269601805) -> (continuation of Deferred@1941656345 after retry RPC after error@622311608)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.4.179.62:35121,127.4.179.60:34679,127.4.179.61:44733) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.60:34679(127.4.179.60:34679): Connection refused: /127.4.179.60:34679,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.61:44733(127.4.179.61:44733): Connection refused: /127.4.179.61:44733,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.4.179.62:35121(127.4.179.62:35121): Connection refused: /127.4.179.62:35121
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.4.179.62:35121
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:05.860 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
18:34:05.861 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job 2f0efe0c81addbcaea565a6248e4a915 from Checkpoint 68 @ 1783535644646 for 2f0efe0c81addbcaea565a6248e4a915 located at file:/tmp/junit6432019912241751994/checkpoints/2f0efe0c81addbcaea565a6248e4a915/chk-68.
18:34:05.862 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
18:34:05.862 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
18:34:05.863 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 2f0efe0c81addbcaea565a6248e4a915: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:34:05.863 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
18:34:05.863 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 2 to checkpoint 68 for source Source: KuduSource to checkpoint.
18:34:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.854526  8028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5aab15a6037f48c290d9378bdeee2073" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" is_pre_election: true
18:34:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.854928  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5aab15a6037f48c290d9378bdeee2073" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e915e7198c74e459ec80085267549b1" is_pre_election: true
18:34:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.857656  8159 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [term 1 FOLLOWER]: Refusing update from remote peer 6e915e7198c74e459ec80085267549b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:34:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.857318  8135 leader_election.cc:304] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5aab15a6037f48c290d9378bdeee2073; no voters: 6e915e7198c74e459ec80085267549b1, e9aa715cae624ab694c9b1e8fb98c10e
18:34:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.860639  8312 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:34:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.862694  8321 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
18:34:05.869 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
18:34:05.869 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 1bed232f-62eb-42dc-858c-7139d8e062d6 @ 127.0.0.1 (dataPort=-1) with allocation id cac6830ea48c76d0f02fea2daf2d606e
18:34:05.869 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 2f0efe0c81addbcaea565a6248e4a915: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:05.869 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:391) Activate slot cac6830ea48c76d0f02fea2daf2d606e.
18:34:05.870 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id cac6830ea48c76d0f02fea2daf2d606e.
18:34:05.901 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
18:34:05.901 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
18:34:05.901 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@161ab330
18:34:05.901 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:05.902 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit6432019912241751994/checkpoints")
18:34:05.902 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
18:34:05.902 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
18:34:05.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:05.903033  8139 tablet.cc:2406] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:34:05.904 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:05.905 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:05.905 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:05.905 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.905 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.905 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.905 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.905 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:05.905 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:05.905 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.906 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.906 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:05.906 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:05.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:05.911427  8322 catalog_manager.cc:1593] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:34:05.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:05.911783  8322 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:34:05.920 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:05.923 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6c434783
18:34:05.935 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:05.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.833884  7982 master_runner.cc:187] Error getting master registration for 127.7.200.189:42349: OK, instance_id { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" instance_seqno: 1783535640973041 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:34:05.948 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:05.962 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.957118  8304 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e915e7198c74e459ec80085267549b1. Latest consensus state: current_term: 1 leader_uuid: "6e915e7198c74e459ec80085267549b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } } }
18:34:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.962309  8304 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e [sys.catalog]: This master's current role is: FOLLOWER
18:34:05.962 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:05.962 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:05.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.948114  7982 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:34:05.963 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:05.963 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:05.963 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:05.963 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:05.963 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:05.963 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:05.964 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:05.964 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:05.964 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:05.964 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:05.964 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:05.968 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:05.968 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:05.968 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:05.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.970597  8321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e915e7198c74e459ec80085267549b1. Latest consensus state: current_term: 1 leader_uuid: "6e915e7198c74e459ec80085267549b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } } }
18:34:05.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.971414  8321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [sys.catalog]: This master's current role is: FOLLOWER
18:34:05.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.972297  8323 mvcc.cc:204] Tried to move back new op lower bound from 7305362005259341824 to 7305362004954849280. Current Snapshot: MvccSnapshot[applied={T|T < 7305362005259341824}]
18:34:05.976 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:05.977 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:05.978 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:05.978 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.979208  8329 mvcc.cc:204] Tried to move back new op lower bound from 7305362005259341824 to 7305362004954849280. Current Snapshot: MvccSnapshot[applied={T|T < 7305362005259341824}]
18:34:05.986 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:05.986 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:05.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.987973  8306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6e915e7198c74e459ec80085267549b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } } }
18:34:05.988 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:05.988 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:05.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.988786  8306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [sys.catalog]: This master's current role is: LEADER
18:34:05.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.989780  8333 mvcc.cc:204] Tried to move back new op lower bound from 7305362005259341824 to 7305362004954849280. Current Snapshot: MvccSnapshot[applied={T|T < 7305362005259341824}]
18:34:05.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.990773  8316 catalog_manager.cc:1382] Generated new cluster ID: 836907829e5c4ce184a467b3e3ba6106
18:34:05.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.990484  8306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6e915e7198c74e459ec80085267549b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } } }
18:34:05.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.991066  8316 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:34:05.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.991235  8306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1 [sys.catalog]: This master's current role is: LEADER
18:34:05.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.992267  8321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6e915e7198c74e459ec80085267549b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } } }
18:34:05.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:05.993220  8321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073 [sys.catalog]: This master's current role is: FOLLOWER
18:34:06.009 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:06.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.007747  8304 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6e915e7198c74e459ec80085267549b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9aa715cae624ab694c9b1e8fb98c10e" member_type: VOTER last_known_addr { host: "127.7.200.190" port: 40077 } } peers { permanent_uuid: "5aab15a6037f48c290d9378bdeee2073" member_type: VOTER last_known_addr { host: "127.7.200.189" port: 42349 } } peers { permanent_uuid: "6e915e7198c74e459ec80085267549b1" member_type: VOTER last_known_addr { host: "127.7.200.188" port: 38999 } } }
18:34:06.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.008764  8304 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e [sys.catalog]: This master's current role is: FOLLOWER
18:34:06.013 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:06.013 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:06.013 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:06.014 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:06.014 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:06.014 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:06.014 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:06.014 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:06.014 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:06.014 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:06.014 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:06.014 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:06.014 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:06.022 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:06.023 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.023 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.025 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:06.025 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:06.025 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:06.025 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:06.025 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:06.025 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:06.026 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.026 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:06.027 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:06.027 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:06.027 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:06.027 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:06.027 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:06.027 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:06.030 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:06.030 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:06.030 [DEBUG - pool-380-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:06.031 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:06.031 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:06.031 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:06.031 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:06.031 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:06.031 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:06.031 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:06.031 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:06.031 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:06.031 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:06.032 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27972), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [9ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [10ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [24ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [24ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [26ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [26ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [42ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [81ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [121ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [201ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [320ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [320ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [320ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [320ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [501ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [562ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [641ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [641ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [642ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [642ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1900ms] refreshing cache from master, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1900ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1901ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5821ms] refreshing cache from master, [5821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5822ms] too many traces: truncated at 100 traces, deferred=Deferred@460334101(state=PENDING, result=null, callback=(continuation of Deferred@126734032 after retry RPC after error@1835667282) -> (continuation of Deferred@162470445 after retry RPC after error@325437313) -> (continuation of Deferred@2063032435 after retry RPC after error@1205530848) -> (continuation of Deferred@919987268 after retry RPC after error@187786448) -> (continuation of Deferred@1250191677 after retry RPC after error@1523174781) -> (continuation of Deferred@1126692260 after retry RPC after error@1135611636) -> (continuation of Deferred@705976894 after retry RPC after error@1050855460) -> (continuation of Deferred@1112834177 after retry RPC after error@30470545) -> (continuation of Deferred@152931903 after retry RPC after error@559322320) -> (continuation of Deferred@1197492467 after retry RPC after error@1094346231) -> (continuation of Deferred@607352729 after retry RPC after error@827758555) -> (continuation of Deferred@1949595346 after retry RPC after error@1723048062) -> (continuation of Deferred@1501797518 after retry RPC after error@1550721066) -> (continuation of Deferred@196829075 after retry RPC after error@1894821578) -> (continuation of Deferred@894577590 after retry RPC after error@412099142) -> (continuation of Deferred@1233559808 after retry RPC after error@1022742532) -> (continuation of Deferred@417223607 after retry RPC after error@29741304) -> (continuation of Deferred@2100821857 after retry RPC after error@1867543859) -> (continuation of Deferred@91869317 after retry RPC after error@705987266) -> (continuation of Deferred@1746582550 after retry RPC after error@68138443) -> (continuation of Deferred@1329180727 after retry RPC after error@1102395776) -> (continuation of Deferred@2087897004 after retry RPC after error@95060996) -> (continuation of Deferred@118502542 after retry RPC after error@1870755029) -> (continuation of Deferred@86278446 after retry RPC after error@1426042666), errback=(continuation of Deferred@126734032 after retry RPC after error@1835667282) -> (continuation of Deferred@162470445 after retry RPC after error@325437313) -> (continuation of Deferred@2063032435 after retry RPC after error@1205530848) -> (continuation of Deferred@919987268 after retry RPC after error@187786448) -> (continuation of Deferred@1250191677 after retry RPC after error@1523174781) -> (continuation of Deferred@1126692260 after retry RPC after error@1135611636) -> (continuation of Deferred@705976894 after retry RPC after error@1050855460) -> (continuation of Deferred@1112834177 after retry RPC after error@30470545) -> (continuation of Deferred@152931903 after retry RPC after error@559322320) -> (continuation of Deferred@1197492467 after retry RPC after error@1094346231) -> (continuation of Deferred@607352729 after retry RPC after error@827758555) -> (continuation of Deferred@1949595346 after retry RPC after error@1723048062) -> (continuation of Deferred@1501797518 after retry RPC after error@1550721066) -> (continuation of Deferred@196829075 after retry RPC after error@1894821578) -> (continuation of Deferred@894577590 after retry RPC after error@412099142) -> (continuation of Deferred@1233559808 after retry RPC after error@1022742532) -> (continuation of Deferred@417223607 after retry RPC after error@29741304) -> (continuation of Deferred@2100821857 after retry RPC after error@1867543859) -> (continuation of Deferred@91869317 after retry RPC after error@705987266) -> (continuation of Deferred@1746582550 after retry RPC after error@68138443) -> (continuation of Deferred@1329180727 after retry RPC after error@1102395776) -> (continuation of Deferred@2087897004 after retry RPC after error@95060996) -> (continuation of Deferred@118502542 after retry RPC after error@1870755029) -> (continuation of Deferred@86278446 after retry RPC after error@1426042666)))
18:34:06.035 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:06.036 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
18:34:06.036 [WARN - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27972), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [9ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [10ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [24ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [24ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [26ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [26ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [42ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [81ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [121ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [201ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [320ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [320ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [320ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [320ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [501ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [562ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [641ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [641ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [642ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [642ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1900ms] refreshing cache from master, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1900ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1901ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5821ms] refreshing cache from master, [5821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5822ms] too many traces: truncated at 100 traces, deferred=Deferred@460334101(state=PENDING, result=null, callback=(continuation of Deferred@126734032 after retry RPC after error@1835667282) -> (continuation of Deferred@162470445 after retry RPC after error@325437313) -> (continuation of Deferred@2063032435 after retry RPC after error@1205530848) -> (continuation of Deferred@919987268 after retry RPC after error@187786448) -> (continuation of Deferred@1250191677 after retry RPC after error@1523174781) -> (continuation of Deferred@1126692260 after retry RPC after error@1135611636) -> (continuation of Deferred@705976894 after retry RPC after error@1050855460) -> (continuation of Deferred@1112834177 after retry RPC after error@30470545) -> (continuation of Deferred@152931903 after retry RPC after error@559322320) -> (continuation of Deferred@1197492467 after retry RPC after error@1094346231) -> (continuation of Deferred@607352729 after retry RPC after error@827758555) -> (continuation of Deferred@1949595346 after retry RPC after error@1723048062) -> (continuation of Deferred@1501797518 after retry RPC after error@1550721066) -> (continuation of Deferred@196829075 after retry RPC after error@1894821578) -> (continuation of Deferred@894577590 after retry RPC after error@412099142) -> (continuation of Deferred@1233559808 after retry RPC after error@1022742532) -> (continuation of Deferred@417223607 after retry RPC after error@29741304) -> (continuation of Deferred@2100821857 after retry RPC after error@1867543859) -> (continuation of Deferred@91869317 after retry RPC after error@705987266) -> (continuation of Deferred@1746582550 after retry RPC after error@68138443) -> (continuation of Deferred@1329180727 after retry RPC after error@1102395776) -> (continuation of Deferred@2087897004 after retry RPC after error@95060996) -> (continuation of Deferred@118502542 after retry RPC after error@1870755029) -> (continuation of Deferred@86278446 after retry RPC after error@1426042666), errback=(continuation of Deferred@126734032 after retry RPC after error@1835667282) -> (continuation of Deferred@162470445 after retry RPC after error@325437313) -> (continuation of Deferred@2063032435 after retry RPC after error@1205530848) -> (continuation of Deferred@919987268 after retry RPC after error@187786448) -> (continuation of Deferred@1250191677 after retry RPC after error@1523174781) -> (continuation of Deferred@1126692260 after retry RPC after error@1135611636) -> (continuation of Deferred@705976894 after retry RPC after error@1050855460) -> (continuation of Deferred@1112834177 after retry RPC after error@30470545) -> (continuation of Deferred@152931903 after retry RPC after error@559322320) -> (continuation of Deferred@1197492467 after retry RPC after error@1094346231) -> (continuation of Deferred@607352729 after retry RPC after error@827758555) -> (continuation of Deferred@1949595346 after retry RPC after error@1723048062) -> (continuation of Deferred@1501797518 after retry RPC after error@1550721066) -> (continuation of Deferred@196829075 after retry RPC after error@1894821578) -> (continuation of Deferred@894577590 after retry RPC after error@412099142) -> (continuation of Deferred@1233559808 after retry RPC after error@1022742532) -> (continuation of Deferred@417223607 after retry RPC after error@29741304) -> (continuation of Deferred@2100821857 after retry RPC after error@1867543859) -> (continuation of Deferred@91869317 after retry RPC after error@705987266) -> (continuation of Deferred@1746582550 after retry RPC after error@68138443) -> (continuation of Deferred@1329180727 after retry RPC after error@1102395776) -> (continuation of Deferred@2087897004 after retry RPC after error@95060996) -> (continuation of Deferred@118502542 after retry RPC after error@1870755029) -> (continuation of Deferred@86278446 after retry RPC after error@1426042666)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:06.037 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_7).
18:34:06.037 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.037 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.037 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.039 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#7 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_7.
18:34:06.041 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27972), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [9ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [10ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [24ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [24ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [26ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [26ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [42ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [81ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [121ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [201ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [320ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [320ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [320ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [320ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [501ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [562ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [641ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [641ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [642ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [642ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1900ms] refreshing cache from master, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1900ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1901ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5821ms] refreshing cache from master, [5821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5822ms] too many traces: truncated at 100 traces, deferred=Deferred@460334101(state=PENDING, result=null, callback=(continuation of Deferred@126734032 after retry RPC after error@1835667282) -> (continuation of Deferred@162470445 after retry RPC after error@325437313) -> (continuation of Deferred@2063032435 after retry RPC after error@1205530848) -> (continuation of Deferred@919987268 after retry RPC after error@187786448) -> (continuation of Deferred@1250191677 after retry RPC after error@1523174781) -> (continuation of Deferred@1126692260 after retry RPC after error@1135611636) -> (continuation of Deferred@705976894 after retry RPC after error@1050855460) -> (continuation of Deferred@1112834177 after retry RPC after error@30470545) -> (continuation of Deferred@152931903 after retry RPC after error@559322320) -> (continuation of Deferred@1197492467 after retry RPC after error@1094346231) -> (continuation of Deferred@607352729 after retry RPC after error@827758555) -> (continuation of Deferred@1949595346 after retry RPC after error@1723048062) -> (continuation of Deferred@1501797518 after retry RPC after error@1550721066) -> (continuation of Deferred@196829075 after retry RPC after error@1894821578) -> (continuation of Deferred@894577590 after retry RPC after error@412099142) -> (continuation of Deferred@1233559808 after retry RPC after error@1022742532) -> (continuation of Deferred@417223607 after retry RPC after error@29741304) -> (continuation of Deferred@2100821857 after retry RPC after error@1867543859) -> (continuation of Deferred@91869317 after retry RPC after error@705987266) -> (continuation of Deferred@1746582550 after retry RPC after error@68138443) -> (continuation of Deferred@1329180727 after retry RPC after error@1102395776) -> (continuation of Deferred@2087897004 after retry RPC after error@95060996) -> (continuation of Deferred@118502542 after retry RPC after error@1870755029) -> (continuation of Deferred@86278446 after retry RPC after error@1426042666), errback=(continuation of Deferred@126734032 after retry RPC after error@1835667282) -> (continuation of Deferred@162470445 after retry RPC after error@325437313) -> (continuation of Deferred@2063032435 after retry RPC after error@1205530848) -> (continuation of Deferred@919987268 after retry RPC after error@187786448) -> (continuation of Deferred@1250191677 after retry RPC after error@1523174781) -> (continuation of Deferred@1126692260 after retry RPC after error@1135611636) -> (continuation of Deferred@705976894 after retry RPC after error@1050855460) -> (continuation of Deferred@1112834177 after retry RPC after error@30470545) -> (continuation of Deferred@152931903 after retry RPC after error@559322320) -> (continuation of Deferred@1197492467 after retry RPC after error@1094346231) -> (continuation of Deferred@607352729 after retry RPC after error@827758555) -> (continuation of Deferred@1949595346 after retry RPC after error@1723048062) -> (continuation of Deferred@1501797518 after retry RPC after error@1550721066) -> (continuation of Deferred@196829075 after retry RPC after error@1894821578) -> (continuation of Deferred@894577590 after retry RPC after error@412099142) -> (continuation of Deferred@1233559808 after retry RPC after error@1022742532) -> (continuation of Deferred@417223607 after retry RPC after error@29741304) -> (continuation of Deferred@2100821857 after retry RPC after error@1867543859) -> (continuation of Deferred@91869317 after retry RPC after error@705987266) -> (continuation of Deferred@1746582550 after retry RPC after error@68138443) -> (continuation of Deferred@1329180727 after retry RPC after error@1102395776) -> (continuation of Deferred@2087897004 after retry RPC after error@95060996) -> (continuation of Deferred@118502542 after retry RPC after error@1870755029) -> (continuation of Deferred@86278446 after retry RPC after error@1426042666)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:06.042 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:06.042 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#7) of source Source: KuduSource.
18:34:06.043 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_7.
18:34:06.043 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RUNNING to RESTARTING.
18:34:06.046 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.046 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.046 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.046 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:06.047 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:06.047 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:06.047 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:06.047 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:06.047 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:06.047 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:06.048 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:06.048 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:06.048 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:06.048 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:06.048 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:06.048 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:06.048 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:06.049 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:06.059 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:06.062 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.062 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.062 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.068 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:06.068 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.068 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.068 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.069 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.069 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.069 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.069 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:06.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.077375  8316 catalog_manager.cc:1405] Generated new certificate authority record
18:34:06.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.079638  8316 catalog_manager.cc:1539] Loading token signing keys...
18:34:06.089 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:06.089 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:06.089 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:06.090 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.090 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.090 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.090 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.090 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.090 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.091 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.091 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.091 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.091 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:06.099 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:06.109 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:06.109 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:06.109 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:06.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.109414  8354 catalog_manager.cc:1294] Loaded cluster ID: 836907829e5c4ce184a467b3e3ba6106
18:34:06.109 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.109 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.110 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.110 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.110 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.110 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.110 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.110 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.110 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.110 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:06.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.110950  8354 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073: loading cluster ID for follower catalog manager: success
18:34:06.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.125686  8354 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073: acquiring CA information for follower catalog manager: success
18:34:06.133 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:06.133 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:06.134 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:06.134 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:06.134 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:06.134 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:06.135 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:06.135 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:06.135 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:06.135 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:06.135 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:06.135 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:06.135 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:06.136 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:06.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:06.136478  8354 catalog_manager.cc:883] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
18:34:06.148 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:06.149 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:06.149 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:06.149 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.149 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.149 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.149 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.150 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.150 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.150 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.150 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.150 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.150 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:06.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.152806  8316 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 6e915e7198c74e459ec80085267549b1: Generated new TSK 0
18:34:06.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.153940  8316 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:34:06.158 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:06.159 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:06.159 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:06.159 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:06.159 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:06.159 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:06.159 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:06.159 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:06.159 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:06.159 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:06.159 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:06.160 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:06.160 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.183800  7970 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/wal
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/data
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/logs
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/data/info.pb
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.200.129:0
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.7.200.129
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.200.129
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.7.200.190:40077,127.7.200.189:42349,127.7.200.188:38999
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.200.148:33865
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:34:06.209 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:06.209 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:06.210 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:06.216 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.216 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.216 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.217 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.217 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.217 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.218 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.218 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.218 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.218 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:06.309 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:06.309 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:06.309 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:06.310 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.310 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.310 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.310 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.310 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.310 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.311 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.311 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.311 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.311 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:06.365 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:06.365 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:06.365 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:06.366 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:06.366 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:06.366 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:06.366 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:06.366 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:06.366 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:06.367 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:06.367 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:06.367 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:06.367 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:06.384 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:06.384 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:06.385 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:06.385 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:06.385 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:06.385 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:06.387 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:06.387 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:06.387 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:06.387 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:06.387 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:06.387 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:06.387 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:06.388 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28314), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [6ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [12ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [12ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [12ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [21ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [42ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [80ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [81ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [121ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [160ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [160ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [160ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [161ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [300ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [301ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [481ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1500ms] refreshing cache from master, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1501ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2460ms] refreshing cache from master, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2463ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2463ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [4520ms] refreshing cache from master, [4520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [4520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [4521ms] too many traces: truncated at 100 traces, deferred=Deferred@1660007011(state=PENDING, result=null, callback=(continuation of Deferred@688628233 after retry RPC after error@2134625006) -> (continuation of Deferred@837957040 after retry RPC after error@1585441607) -> (continuation of Deferred@714084715 after retry RPC after error@199086701) -> (continuation of Deferred@732047635 after retry RPC after error@170314483) -> (continuation of Deferred@538417557 after retry RPC after error@1161587008) -> (continuation of Deferred@2137799237 after retry RPC after error@1126237705) -> (continuation of Deferred@1600582857 after retry RPC after error@2042028044) -> (continuation of Deferred@1737905005 after retry RPC after error@743178456) -> (continuation of Deferred@1155819812 after retry RPC after error@169625396) -> (continuation of Deferred@1606705185 after retry RPC after error@323150273) -> (continuation of Deferred@1946687428 after retry RPC after error@474340246) -> (continuation of Deferred@1627157847 after retry RPC after error@1681185888) -> (continuation of Deferred@1354121493 after retry RPC after error@1646111230) -> (continuation of Deferred@1640508967 after retry RPC after error@593308066) -> (continuation of Deferred@1099004469 after retry RPC after error@1323071906) -> (continuation of Deferred@1850072904 after retry RPC after error@614464283) -> (continuation of Deferred@1854238063 after retry RPC after error@1127811188) -> (continuation of Deferred@63316164 after retry RPC after error@1490699396) -> (continuation of Deferred@502379749 after retry RPC after error@369128839) -> (continuation of Deferred@619886467 after retry RPC after error@780544509) -> (continuation of Deferred@1052833364 after retry RPC after error@729350214) -> (continuation of Deferred@445051909 after retry RPC after error@97582953) -> (continuation of Deferred@1008454609 after retry RPC after error@1594066724) -> (continuation of Deferred@1913157149 after retry RPC after error@1881269378) -> (continuation of Deferred@310832148 after retry RPC after error@1375691719) -> (continuation of Deferred@1618370427 after retry RPC after error@520925699) -> (continuation of Deferred@978258874 after retry RPC after error@277132911) -> (continuation of Deferred@1113308803 after retry RPC after error@943554657), errback=(continuation of Deferred@688628233 after retry RPC after error@2134625006) -> (continuation of Deferred@837957040 after retry RPC after error@1585441607) -> (continuation of Deferred@714084715 after retry RPC after error@199086701) -> (continuation of Deferred@732047635 after retry RPC after error@170314483) -> (continuation of Deferred@538417557 after retry RPC after error@1161587008) -> (continuation of Deferred@2137799237 after retry RPC after error@1126237705) -> (continuation of Deferred@1600582857 after retry RPC after error@2042028044) -> (continuation of Deferred@1737905005 after retry RPC after error@743178456) -> (continuation of Deferred@1155819812 after retry RPC after error@169625396) -> (continuation of Deferred@1606705185 after retry RPC after error@323150273) -> (continuation of Deferred@1946687428 after retry RPC after error@474340246) -> (continuation of Deferred@1627157847 after retry RPC after error@1681185888) -> (continuation of Deferred@1354121493 after retry RPC after error@1646111230) -> (continuation of Deferred@1640508967 after retry RPC after error@593308066) -> (continuation of Deferred@1099004469 after retry RPC after error@1323071906) -> (continuation of Deferred@1850072904 after retry RPC after error@614464283) -> (continuation of Deferred@1854238063 after retry RPC after error@1127811188) -> (continuation of Deferred@63316164 after retry RPC after error@1490699396) -> (continuation of Deferred@502379749 after retry RPC after error@369128839) -> (continuation of Deferred@619886467 after retry RPC after error@780544509) -> (continuation of Deferred@1052833364 after retry RPC after error@729350214) -> (continuation of Deferred@445051909 after retry RPC after error@97582953) -> (continuation of Deferred@1008454609 after retry RPC after error@1594066724) -> (continuation of Deferred@1913157149 after retry RPC after error@1881269378) -> (continuation of Deferred@310832148 after retry RPC after error@1375691719) -> (continuation of Deferred@1618370427 after retry RPC after error@520925699) -> (continuation of Deferred@978258874 after retry RPC after error@277132911) -> (continuation of Deferred@1113308803 after retry RPC after error@943554657)))
18:34:06.389 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
18:34:06.389 [WARN - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28314), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [6ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [12ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [12ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [12ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [21ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [42ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [80ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [81ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [121ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [160ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [160ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [160ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [161ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [300ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [301ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [481ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1500ms] refreshing cache from master, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1501ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2460ms] refreshing cache from master, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2463ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2463ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [4520ms] refreshing cache from master, [4520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [4520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [4521ms] too many traces: truncated at 100 traces, deferred=Deferred@1660007011(state=PENDING, result=null, callback=(continuation of Deferred@688628233 after retry RPC after error@2134625006) -> (continuation of Deferred@837957040 after retry RPC after error@1585441607) -> (continuation of Deferred@714084715 after retry RPC after error@199086701) -> (continuation of Deferred@732047635 after retry RPC after error@170314483) -> (continuation of Deferred@538417557 after retry RPC after error@1161587008) -> (continuation of Deferred@2137799237 after retry RPC after error@1126237705) -> (continuation of Deferred@1600582857 after retry RPC after error@2042028044) -> (continuation of Deferred@1737905005 after retry RPC after error@743178456) -> (continuation of Deferred@1155819812 after retry RPC after error@169625396) -> (continuation of Deferred@1606705185 after retry RPC after error@323150273) -> (continuation of Deferred@1946687428 after retry RPC after error@474340246) -> (continuation of Deferred@1627157847 after retry RPC after error@1681185888) -> (continuation of Deferred@1354121493 after retry RPC after error@1646111230) -> (continuation of Deferred@1640508967 after retry RPC after error@593308066) -> (continuation of Deferred@1099004469 after retry RPC after error@1323071906) -> (continuation of Deferred@1850072904 after retry RPC after error@614464283) -> (continuation of Deferred@1854238063 after retry RPC after error@1127811188) -> (continuation of Deferred@63316164 after retry RPC after error@1490699396) -> (continuation of Deferred@502379749 after retry RPC after error@369128839) -> (continuation of Deferred@619886467 after retry RPC after error@780544509) -> (continuation of Deferred@1052833364 after retry RPC after error@729350214) -> (continuation of Deferred@445051909 after retry RPC after error@97582953) -> (continuation of Deferred@1008454609 after retry RPC after error@1594066724) -> (continuation of Deferred@1913157149 after retry RPC after error@1881269378) -> (continuation of Deferred@310832148 after retry RPC after error@1375691719) -> (continuation of Deferred@1618370427 after retry RPC after error@520925699) -> (continuation of Deferred@978258874 after retry RPC after error@277132911) -> (continuation of Deferred@1113308803 after retry RPC after error@943554657), errback=(continuation of Deferred@688628233 after retry RPC after error@2134625006) -> (continuation of Deferred@837957040 after retry RPC after error@1585441607) -> (continuation of Deferred@714084715 after retry RPC after error@199086701) -> (continuation of Deferred@732047635 after retry RPC after error@170314483) -> (continuation of Deferred@538417557 after retry RPC after error@1161587008) -> (continuation of Deferred@2137799237 after retry RPC after error@1126237705) -> (continuation of Deferred@1600582857 after retry RPC after error@2042028044) -> (continuation of Deferred@1737905005 after retry RPC after error@743178456) -> (continuation of Deferred@1155819812 after retry RPC after error@169625396) -> (continuation of Deferred@1606705185 after retry RPC after error@323150273) -> (continuation of Deferred@1946687428 after retry RPC after error@474340246) -> (continuation of Deferred@1627157847 after retry RPC after error@1681185888) -> (continuation of Deferred@1354121493 after retry RPC after error@1646111230) -> (continuation of Deferred@1640508967 after retry RPC after error@593308066) -> (continuation of Deferred@1099004469 after retry RPC after error@1323071906) -> (continuation of Deferred@1850072904 after retry RPC after error@614464283) -> (continuation of Deferred@1854238063 after retry RPC after error@1127811188) -> (continuation of Deferred@63316164 after retry RPC after error@1490699396) -> (continuation of Deferred@502379749 after retry RPC after error@369128839) -> (continuation of Deferred@619886467 after retry RPC after error@780544509) -> (continuation of Deferred@1052833364 after retry RPC after error@729350214) -> (continuation of Deferred@445051909 after retry RPC after error@97582953) -> (continuation of Deferred@1008454609 after retry RPC after error@1594066724) -> (continuation of Deferred@1913157149 after retry RPC after error@1881269378) -> (continuation of Deferred@310832148 after retry RPC after error@1375691719) -> (continuation of Deferred@1618370427 after retry RPC after error@520925699) -> (continuation of Deferred@978258874 after retry RPC after error@277132911) -> (continuation of Deferred@1113308803 after retry RPC after error@943554657)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:06.389 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_7).
18:34:06.392 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#7 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_7.
18:34:06.394 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28314), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [6ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [12ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [12ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [12ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [21ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [41ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [42ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [80ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [81ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [121ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [160ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [160ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [160ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [161ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [300ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [301ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [481ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [481ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1500ms] refreshing cache from master, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1501ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2460ms] refreshing cache from master, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2463ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2463ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [4520ms] refreshing cache from master, [4520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [4520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [4521ms] too many traces: truncated at 100 traces, deferred=Deferred@1660007011(state=PENDING, result=null, callback=(continuation of Deferred@688628233 after retry RPC after error@2134625006) -> (continuation of Deferred@837957040 after retry RPC after error@1585441607) -> (continuation of Deferred@714084715 after retry RPC after error@199086701) -> (continuation of Deferred@732047635 after retry RPC after error@170314483) -> (continuation of Deferred@538417557 after retry RPC after error@1161587008) -> (continuation of Deferred@2137799237 after retry RPC after error@1126237705) -> (continuation of Deferred@1600582857 after retry RPC after error@2042028044) -> (continuation of Deferred@1737905005 after retry RPC after error@743178456) -> (continuation of Deferred@1155819812 after retry RPC after error@169625396) -> (continuation of Deferred@1606705185 after retry RPC after error@323150273) -> (continuation of Deferred@1946687428 after retry RPC after error@474340246) -> (continuation of Deferred@1627157847 after retry RPC after error@1681185888) -> (continuation of Deferred@1354121493 after retry RPC after error@1646111230) -> (continuation of Deferred@1640508967 after retry RPC after error@593308066) -> (continuation of Deferred@1099004469 after retry RPC after error@1323071906) -> (continuation of Deferred@1850072904 after retry RPC after error@614464283) -> (continuation of Deferred@1854238063 after retry RPC after error@1127811188) -> (continuation of Deferred@63316164 after retry RPC after error@1490699396) -> (continuation of Deferred@502379749 after retry RPC after error@369128839) -> (continuation of Deferred@619886467 after retry RPC after error@780544509) -> (continuation of Deferred@1052833364 after retry RPC after error@729350214) -> (continuation of Deferred@445051909 after retry RPC after error@97582953) -> (continuation of Deferred@1008454609 after retry RPC after error@1594066724) -> (continuation of Deferred@1913157149 after retry RPC after error@1881269378) -> (continuation of Deferred@310832148 after retry RPC after error@1375691719) -> (continuation of Deferred@1618370427 after retry RPC after error@520925699) -> (continuation of Deferred@978258874 after retry RPC after error@277132911) -> (continuation of Deferred@1113308803 after retry RPC after error@943554657), errback=(continuation of Deferred@688628233 after retry RPC after error@2134625006) -> (continuation of Deferred@837957040 after retry RPC after error@1585441607) -> (continuation of Deferred@714084715 after retry RPC after error@199086701) -> (continuation of Deferred@732047635 after retry RPC after error@170314483) -> (continuation of Deferred@538417557 after retry RPC after error@1161587008) -> (continuation of Deferred@2137799237 after retry RPC after error@1126237705) -> (continuation of Deferred@1600582857 after retry RPC after error@2042028044) -> (continuation of Deferred@1737905005 after retry RPC after error@743178456) -> (continuation of Deferred@1155819812 after retry RPC after error@169625396) -> (continuation of Deferred@1606705185 after retry RPC after error@323150273) -> (continuation of Deferred@1946687428 after retry RPC after error@474340246) -> (continuation of Deferred@1627157847 after retry RPC after error@1681185888) -> (continuation of Deferred@1354121493 after retry RPC after error@1646111230) -> (continuation of Deferred@1640508967 after retry RPC after error@593308066) -> (continuation of Deferred@1099004469 after retry RPC after error@1323071906) -> (continuation of Deferred@1850072904 after retry RPC after error@614464283) -> (continuation of Deferred@1854238063 after retry RPC after error@1127811188) -> (continuation of Deferred@63316164 after retry RPC after error@1490699396) -> (continuation of Deferred@502379749 after retry RPC after error@369128839) -> (continuation of Deferred@619886467 after retry RPC after error@780544509) -> (continuation of Deferred@1052833364 after retry RPC after error@729350214) -> (continuation of Deferred@445051909 after retry RPC after error@97582953) -> (continuation of Deferred@1008454609 after retry RPC after error@1594066724) -> (continuation of Deferred@1913157149 after retry RPC after error@1881269378) -> (continuation of Deferred@310832148 after retry RPC after error@1375691719) -> (continuation of Deferred@1618370427 after retry RPC after error@520925699) -> (continuation of Deferred@978258874 after retry RPC after error@277132911) -> (continuation of Deferred@1113308803 after retry RPC after error@943554657)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:06.395 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:34:06.396 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_7.
18:34:06.396 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#7) of source Source: KuduSource.
18:34:06.420 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:06.489 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:06.489 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:06.489 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:06.490 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.490 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.490 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.490 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.490 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.491 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.491 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.491 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.491 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.491 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:06.558 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:06.559 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:06.559 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:06.559 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:06.559 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:06.559 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:06.559 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:06.559 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:06.559 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:06.559 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:06.559 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:06.559 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:06.559 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:06.569 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:06.569 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:06.569 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:06.570 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.570 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.570 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:06.570 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.570 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.570 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:06.570 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.570 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.570 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:06.570 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:06.599 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:06.633 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:06.694 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:06.694 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:06.695 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:06.695 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:06.695 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:06.695 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:06.695 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:06.696 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:06.696 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:06.696 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:06.696 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:06.696 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:06.696 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:06.697 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28633), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [15ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [20ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [22ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [22ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [43ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [63ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [83ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [101ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [142ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [161ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [282ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [502ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [741ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [741ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [741ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [742ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1300ms] refreshing cache from master, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1302ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3140ms] refreshing cache from master, [3140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3142ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5681ms] refreshing cache from master, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5682ms] too many traces: truncated at 100 traces, deferred=Deferred@2107227435(state=PENDING, result=null, callback=(continuation of Deferred@1614619965 after retry RPC after error@1040709657) -> (continuation of Deferred@1080014192 after retry RPC after error@1889482933) -> (continuation of Deferred@2030235478 after retry RPC after error@2026112863) -> (continuation of Deferred@1158535426 after retry RPC after error@1289620358) -> (continuation of Deferred@575153428 after retry RPC after error@2054041853) -> (continuation of Deferred@1358967675 after retry RPC after error@1832816870) -> (continuation of Deferred@247298256 after retry RPC after error@90134562) -> (continuation of Deferred@1427388441 after retry RPC after error@1278487549) -> (continuation of Deferred@690663763 after retry RPC after error@1456173596) -> (continuation of Deferred@585845804 after retry RPC after error@1340989519) -> (continuation of Deferred@867262664 after retry RPC after error@1046986544) -> (continuation of Deferred@1184177916 after retry RPC after error@1717199353) -> (continuation of Deferred@1591081690 after retry RPC after error@1565020175) -> (continuation of Deferred@868534180 after retry RPC after error@103034252) -> (continuation of Deferred@2010514616 after retry RPC after error@1744960101) -> (continuation of Deferred@2104359206 after retry RPC after error@1510142794) -> (continuation of Deferred@498519926 after retry RPC after error@2055457911) -> (continuation of Deferred@1748352712 after retry RPC after error@635476007) -> (continuation of Deferred@243678866 after retry RPC after error@1786948417) -> (continuation of Deferred@788826919 after retry RPC after error@243539776) -> (continuation of Deferred@835306156 after retry RPC after error@1324269431) -> (continuation of Deferred@1161316414 after retry RPC after error@1801986502) -> (continuation of Deferred@348869285 after retry RPC after error@795165260) -> (continuation of Deferred@681285158 after retry RPC after error@47703266), errback=(continuation of Deferred@1614619965 after retry RPC after error@1040709657) -> (continuation of Deferred@1080014192 after retry RPC after error@1889482933) -> (continuation of Deferred@2030235478 after retry RPC after error@2026112863) -> (continuation of Deferred@1158535426 after retry RPC after error@1289620358) -> (continuation of Deferred@575153428 after retry RPC after error@2054041853) -> (continuation of Deferred@1358967675 after retry RPC after error@1832816870) -> (continuation of Deferred@247298256 after retry RPC after error@90134562) -> (continuation of Deferred@1427388441 after retry RPC after error@1278487549) -> (continuation of Deferred@690663763 after retry RPC after error@1456173596) -> (continuation of Deferred@585845804 after retry RPC after error@1340989519) -> (continuation of Deferred@867262664 after retry RPC after error@1046986544) -> (continuation of Deferred@1184177916 after retry RPC after error@1717199353) -> (continuation of Deferred@1591081690 after retry RPC after error@1565020175) -> (continuation of Deferred@868534180 after retry RPC after error@103034252) -> (continuation of Deferred@2010514616 after retry RPC after error@1744960101) -> (continuation of Deferred@2104359206 after retry RPC after error@1510142794) -> (continuation of Deferred@498519926 after retry RPC after error@2055457911) -> (continuation of Deferred@1748352712 after retry RPC after error@635476007) -> (continuation of Deferred@243678866 after retry RPC after error@1786948417) -> (continuation of Deferred@788826919 after retry RPC after error@243539776) -> (continuation of Deferred@835306156 after retry RPC after error@1324269431) -> (continuation of Deferred@1161316414 after retry RPC after error@1801986502) -> (continuation of Deferred@348869285 after retry RPC after error@795165260) -> (continuation of Deferred@681285158 after retry RPC after error@47703266)))
18:34:06.697 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
18:34:06.698 [WARN - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28633), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [15ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [20ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [22ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [22ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [43ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [63ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [83ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [101ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [142ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [161ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [282ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [502ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [741ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [741ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [741ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [742ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1300ms] refreshing cache from master, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1302ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3140ms] refreshing cache from master, [3140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3142ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5681ms] refreshing cache from master, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5682ms] too many traces: truncated at 100 traces, deferred=Deferred@2107227435(state=PENDING, result=null, callback=(continuation of Deferred@1614619965 after retry RPC after error@1040709657) -> (continuation of Deferred@1080014192 after retry RPC after error@1889482933) -> (continuation of Deferred@2030235478 after retry RPC after error@2026112863) -> (continuation of Deferred@1158535426 after retry RPC after error@1289620358) -> (continuation of Deferred@575153428 after retry RPC after error@2054041853) -> (continuation of Deferred@1358967675 after retry RPC after error@1832816870) -> (continuation of Deferred@247298256 after retry RPC after error@90134562) -> (continuation of Deferred@1427388441 after retry RPC after error@1278487549) -> (continuation of Deferred@690663763 after retry RPC after error@1456173596) -> (continuation of Deferred@585845804 after retry RPC after error@1340989519) -> (continuation of Deferred@867262664 after retry RPC after error@1046986544) -> (continuation of Deferred@1184177916 after retry RPC after error@1717199353) -> (continuation of Deferred@1591081690 after retry RPC after error@1565020175) -> (continuation of Deferred@868534180 after retry RPC after error@103034252) -> (continuation of Deferred@2010514616 after retry RPC after error@1744960101) -> (continuation of Deferred@2104359206 after retry RPC after error@1510142794) -> (continuation of Deferred@498519926 after retry RPC after error@2055457911) -> (continuation of Deferred@1748352712 after retry RPC after error@635476007) -> (continuation of Deferred@243678866 after retry RPC after error@1786948417) -> (continuation of Deferred@788826919 after retry RPC after error@243539776) -> (continuation of Deferred@835306156 after retry RPC after error@1324269431) -> (continuation of Deferred@1161316414 after retry RPC after error@1801986502) -> (continuation of Deferred@348869285 after retry RPC after error@795165260) -> (continuation of Deferred@681285158 after retry RPC after error@47703266), errback=(continuation of Deferred@1614619965 after retry RPC after error@1040709657) -> (continuation of Deferred@1080014192 after retry RPC after error@1889482933) -> (continuation of Deferred@2030235478 after retry RPC after error@2026112863) -> (continuation of Deferred@1158535426 after retry RPC after error@1289620358) -> (continuation of Deferred@575153428 after retry RPC after error@2054041853) -> (continuation of Deferred@1358967675 after retry RPC after error@1832816870) -> (continuation of Deferred@247298256 after retry RPC after error@90134562) -> (continuation of Deferred@1427388441 after retry RPC after error@1278487549) -> (continuation of Deferred@690663763 after retry RPC after error@1456173596) -> (continuation of Deferred@585845804 after retry RPC after error@1340989519) -> (continuation of Deferred@867262664 after retry RPC after error@1046986544) -> (continuation of Deferred@1184177916 after retry RPC after error@1717199353) -> (continuation of Deferred@1591081690 after retry RPC after error@1565020175) -> (continuation of Deferred@868534180 after retry RPC after error@103034252) -> (continuation of Deferred@2010514616 after retry RPC after error@1744960101) -> (continuation of Deferred@2104359206 after retry RPC after error@1510142794) -> (continuation of Deferred@498519926 after retry RPC after error@2055457911) -> (continuation of Deferred@1748352712 after retry RPC after error@635476007) -> (continuation of Deferred@243678866 after retry RPC after error@1786948417) -> (continuation of Deferred@788826919 after retry RPC after error@243539776) -> (continuation of Deferred@835306156 after retry RPC after error@1324269431) -> (continuation of Deferred@1161316414 after retry RPC after error@1801986502) -> (continuation of Deferred@348869285 after retry RPC after error@795165260) -> (continuation of Deferred@681285158 after retry RPC after error@47703266)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:06.698 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#6 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_6).
18:34:06.700 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#6 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_6.
18:34:06.702 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28633), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [15ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [20ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [22ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [22ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [43ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [63ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [83ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [101ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [142ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [161ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [281ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [282ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [501ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [502ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [741ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [741ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [741ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [742ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1300ms] refreshing cache from master, [1300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1302ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3140ms] refreshing cache from master, [3140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3142ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5681ms] refreshing cache from master, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5682ms] too many traces: truncated at 100 traces, deferred=Deferred@2107227435(state=PENDING, result=null, callback=(continuation of Deferred@1614619965 after retry RPC after error@1040709657) -> (continuation of Deferred@1080014192 after retry RPC after error@1889482933) -> (continuation of Deferred@2030235478 after retry RPC after error@2026112863) -> (continuation of Deferred@1158535426 after retry RPC after error@1289620358) -> (continuation of Deferred@575153428 after retry RPC after error@2054041853) -> (continuation of Deferred@1358967675 after retry RPC after error@1832816870) -> (continuation of Deferred@247298256 after retry RPC after error@90134562) -> (continuation of Deferred@1427388441 after retry RPC after error@1278487549) -> (continuation of Deferred@690663763 after retry RPC after error@1456173596) -> (continuation of Deferred@585845804 after retry RPC after error@1340989519) -> (continuation of Deferred@867262664 after retry RPC after error@1046986544) -> (continuation of Deferred@1184177916 after retry RPC after error@1717199353) -> (continuation of Deferred@1591081690 after retry RPC after error@1565020175) -> (continuation of Deferred@868534180 after retry RPC after error@103034252) -> (continuation of Deferred@2010514616 after retry RPC after error@1744960101) -> (continuation of Deferred@2104359206 after retry RPC after error@1510142794) -> (continuation of Deferred@498519926 after retry RPC after error@2055457911) -> (continuation of Deferred@1748352712 after retry RPC after error@635476007) -> (continuation of Deferred@243678866 after retry RPC after error@1786948417) -> (continuation of Deferred@788826919 after retry RPC after error@243539776) -> (continuation of Deferred@835306156 after retry RPC after error@1324269431) -> (continuation of Deferred@1161316414 after retry RPC after error@1801986502) -> (continuation of Deferred@348869285 after retry RPC after error@795165260) -> (continuation of Deferred@681285158 after retry RPC after error@47703266), errback=(continuation of Deferred@1614619965 after retry RPC after error@1040709657) -> (continuation of Deferred@1080014192 after retry RPC after error@1889482933) -> (continuation of Deferred@2030235478 after retry RPC after error@2026112863) -> (continuation of Deferred@1158535426 after retry RPC after error@1289620358) -> (continuation of Deferred@575153428 after retry RPC after error@2054041853) -> (continuation of Deferred@1358967675 after retry RPC after error@1832816870) -> (continuation of Deferred@247298256 after retry RPC after error@90134562) -> (continuation of Deferred@1427388441 after retry RPC after error@1278487549) -> (continuation of Deferred@690663763 after retry RPC after error@1456173596) -> (continuation of Deferred@585845804 after retry RPC after error@1340989519) -> (continuation of Deferred@867262664 after retry RPC after error@1046986544) -> (continuation of Deferred@1184177916 after retry RPC after error@1717199353) -> (continuation of Deferred@1591081690 after retry RPC after error@1565020175) -> (continuation of Deferred@868534180 after retry RPC after error@103034252) -> (continuation of Deferred@2010514616 after retry RPC after error@1744960101) -> (continuation of Deferred@2104359206 after retry RPC after error@1510142794) -> (continuation of Deferred@498519926 after retry RPC after error@2055457911) -> (continuation of Deferred@1748352712 after retry RPC after error@635476007) -> (continuation of Deferred@243678866 after retry RPC after error@1786948417) -> (continuation of Deferred@788826919 after retry RPC after error@243539776) -> (continuation of Deferred@835306156 after retry RPC after error@1324269431) -> (continuation of Deferred@1161316414 after retry RPC after error@1801986502) -> (continuation of Deferred@348869285 after retry RPC after error@795165260) -> (continuation of Deferred@681285158 after retry RPC after error@47703266)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:06.703 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#6) of source Source: KuduSource.
18:34:06.703 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:34:06.704 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_6.
18:34:06.739 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:06.739 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:06.739 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:06.740 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:06.740 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:06.740 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:06.740 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:06.740 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:06.740 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:06.740 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:06.740 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:06.741 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:06.741 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:06.755 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:06.755 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:06.756 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:06.756 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:06.756 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:06.756 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:06.756 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:06.756 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:06.756 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:06.757 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:06.757 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:06.757 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:06.757 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:06.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:06.802605  8358 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:34:06.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:06.803498  8358 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:34:06.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:06.804359  8358 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:34:06.853 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:06.853 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:06.853 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:06.854 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:06.854 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:06.854 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:06.855 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:06.855 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:06.855 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:06.855 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:06.855 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:06.855 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:06.855 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:06.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:06.870401  8358 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:34:06.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:06.871899  8358 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.129
18:34:06.920 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:06.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.920316  8322 catalog_manager.cc:1294] Loaded cluster ID: 836907829e5c4ce184a467b3e3ba6106
18:34:06.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.920655  8322 catalog_manager.cc:1587] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e: loading cluster ID for follower catalog manager: success
18:34:06.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.943051  8322 catalog_manager.cc:1609] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e: acquiring CA information for follower catalog manager: success
18:34:06.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.960563  8322 catalog_manager.cc:1637] T 00000000000000000000000000000000 P e9aa715cae624ab694c9b1e8fb98c10e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.971015  8358 tablet_server_runner.cc:78] Tablet server non-default flags:
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.200.148:33865
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/data
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/wal
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.200.129:0
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/data/info.pb
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.200.129
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.7.200.190:40077,127.7.200.189:42349,127.7.200.188:38999
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:34:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:34:06.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:06.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.7.200.129
18:34:06.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/logs
18:34:06.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:06.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:34:06.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:34:06.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:34:06.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:34:06.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:34:06.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:34:06.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:34:06.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:34:06.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:34:06.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.979363  8358 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:34:06.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:06.988300  8358 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:34:07.012 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:07.012 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:07.012 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:07.012 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:07.012 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:07.012 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:07.013 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:07.013 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:07.013 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:07.013 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:07.013 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:07.013 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:07.013 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:07.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:07.067741  8366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:07.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:07.121 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:07.121 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:07.121 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:07.121 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:07.121 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:07.121 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:07.122 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:07.122 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:07.122 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:07.122 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:07.122 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:07.122 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:07.122 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:07.133 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:07.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:07.144130  8354 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 5aab15a6037f48c290d9378bdeee2073: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:34:07.420 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2f0efe0c81addbcaea565a6248e4a915) switched from state RESTARTING to RUNNING.
18:34:07.420 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job 2f0efe0c81addbcaea565a6248e4a915 from Checkpoint 68 @ 1783535644646 for 2f0efe0c81addbcaea565a6248e4a915 located at file:/tmp/junit6432019912241751994/checkpoints/2f0efe0c81addbcaea565a6248e4a915/chk-68.
18:34:07.420 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:07.421 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
18:34:07.421 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
18:34:07.422 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:07.422 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
18:34:07.422 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 1bed232f-62eb-42dc-858c-7139d8e062d6 @ 127.0.0.1 (dataPort=-1) with allocation id 724a237c36a82d0d22572c72ade5813d
18:34:07.422 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:07.422 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:07.422 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:07.423 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:07.423 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:07.423 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:07.423 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:07.423 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:07.423 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:07.423 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:07.423 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:07.423 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:07.425 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:07.425 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:07.425 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:07.425 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:07.425 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:07.425 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:07.425 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:07.425 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:07.425 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:07.425 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:07.425 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:07.425 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:07.425 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:07.426 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 68 for source Source: KuduSource to checkpoint.
18:34:07.426 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 724a237c36a82d0d22572c72ade5813d.
18:34:07.427 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id 724a237c36a82d0d22572c72ade5813d.
18:34:07.427 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 2f0efe0c81addbcaea565a6248e4a915: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:34:07.439 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
18:34:07.439 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
18:34:07.440 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4601ea1d
18:34:07.440 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:07.440 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit6432019912241751994/checkpoints")
18:34:07.440 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
18:34:07.440 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
18:34:07.443 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1051d083
18:34:07.445 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:07.454 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:07.465 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:07.468 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.468 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.468 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.470 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:07.471 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.471 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.471 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.488 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.488 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.488 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.488 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:07.494 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:07.502 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:07.503 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.503 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.503 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.509 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:07.510 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:07.510 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:07.511 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.511 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.511 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.513 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.513 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.513 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.513 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.513 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.513 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.513 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:07.514 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:07.514 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:07.514 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:07.515 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:07.515 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:07.515 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:07.515 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:07.515 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:07.515 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:07.515 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:07.515 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:07.515 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:07.515 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:07.516 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29446), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [11ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [16ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [21ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [43ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [63ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [82ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [101ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [122ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [202ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [302ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [522ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [722ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [722ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [722ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [722ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1022ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2381ms] refreshing cache from master, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2383ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [5501ms] refreshing cache from master, [5501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5502ms] too many traces: truncated at 100 traces, deferred=Deferred@1806264292(state=PENDING, result=null, callback=(continuation of Deferred@2004683719 after retry RPC after error@376746862) -> (continuation of Deferred@1104048884 after retry RPC after error@1635302254) -> (continuation of Deferred@2118432693 after retry RPC after error@1293452496) -> (continuation of Deferred@2146633301 after retry RPC after error@1534357774) -> (continuation of Deferred@5672138 after retry RPC after error@165787156) -> (continuation of Deferred@1850198227 after retry RPC after error@381888532) -> (continuation of Deferred@575133402 after retry RPC after error@647140752) -> (continuation of Deferred@1984155841 after retry RPC after error@2035275157) -> (continuation of Deferred@1705131360 after retry RPC after error@1471023697) -> (continuation of Deferred@1057164733 after retry RPC after error@946308277) -> (continuation of Deferred@1289418724 after retry RPC after error@1803653292) -> (continuation of Deferred@1279792772 after retry RPC after error@1208902036) -> (continuation of Deferred@1399900838 after retry RPC after error@873669780) -> (continuation of Deferred@946075812 after retry RPC after error@64634109) -> (continuation of Deferred@1454044122 after retry RPC after error@2075154975) -> (continuation of Deferred@1546730261 after retry RPC after error@241093050) -> (continuation of Deferred@267112328 after retry RPC after error@1995574472) -> (continuation of Deferred@592345232 after retry RPC after error@1529181786) -> (continuation of Deferred@182674745 after retry RPC after error@1821490401) -> (continuation of Deferred@1011602203 after retry RPC after error@1286403438) -> (continuation of Deferred@1568115567 after retry RPC after error@1012945556) -> (continuation of Deferred@1582406920 after retry RPC after error@1979520041), errback=(continuation of Deferred@2004683719 after retry RPC after error@376746862) -> (continuation of Deferred@1104048884 after retry RPC after error@1635302254) -> (continuation of Deferred@2118432693 after retry RPC after error@1293452496) -> (continuation of Deferred@2146633301 after retry RPC after error@1534357774) -> (continuation of Deferred@5672138 after retry RPC after error@165787156) -> (continuation of Deferred@1850198227 after retry RPC after error@381888532) -> (continuation of Deferred@575133402 after retry RPC after error@647140752) -> (continuation of Deferred@1984155841 after retry RPC after error@2035275157) -> (continuation of Deferred@1705131360 after retry RPC after error@1471023697) -> (continuation of Deferred@1057164733 after retry RPC after error@946308277) -> (continuation of Deferred@1289418724 after retry RPC after error@1803653292) -> (continuation of Deferred@1279792772 after retry RPC after error@1208902036) -> (continuation of Deferred@1399900838 after retry RPC after error@873669780) -> (continuation of Deferred@946075812 after retry RPC after error@64634109) -> (continuation of Deferred@1454044122 after retry RPC after error@2075154975) -> (continuation of Deferred@1546730261 after retry RPC after error@241093050) -> (continuation of Deferred@267112328 after retry RPC after error@1995574472) -> (continuation of Deferred@592345232 after retry RPC after error@1529181786) -> (continuation of Deferred@182674745 after retry RPC after error@1821490401) -> (continuation of Deferred@1011602203 after retry RPC after error@1286403438) -> (continuation of Deferred@1568115567 after retry RPC after error@1012945556) -> (continuation of Deferred@1582406920 after retry RPC after error@1979520041)))
18:34:07.517 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
18:34:07.518 [WARN - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29446), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [11ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [16ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [21ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [43ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [63ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [82ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [101ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [122ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [202ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [302ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [522ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [722ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [722ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [722ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [722ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1022ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2381ms] refreshing cache from master, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2383ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [5501ms] refreshing cache from master, [5501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5502ms] too many traces: truncated at 100 traces, deferred=Deferred@1806264292(state=PENDING, result=null, callback=(continuation of Deferred@2004683719 after retry RPC after error@376746862) -> (continuation of Deferred@1104048884 after retry RPC after error@1635302254) -> (continuation of Deferred@2118432693 after retry RPC after error@1293452496) -> (continuation of Deferred@2146633301 after retry RPC after error@1534357774) -> (continuation of Deferred@5672138 after retry RPC after error@165787156) -> (continuation of Deferred@1850198227 after retry RPC after error@381888532) -> (continuation of Deferred@575133402 after retry RPC after error@647140752) -> (continuation of Deferred@1984155841 after retry RPC after error@2035275157) -> (continuation of Deferred@1705131360 after retry RPC after error@1471023697) -> (continuation of Deferred@1057164733 after retry RPC after error@946308277) -> (continuation of Deferred@1289418724 after retry RPC after error@1803653292) -> (continuation of Deferred@1279792772 after retry RPC after error@1208902036) -> (continuation of Deferred@1399900838 after retry RPC after error@873669780) -> (continuation of Deferred@946075812 after retry RPC after error@64634109) -> (continuation of Deferred@1454044122 after retry RPC after error@2075154975) -> (continuation of Deferred@1546730261 after retry RPC after error@241093050) -> (continuation of Deferred@267112328 after retry RPC after error@1995574472) -> (continuation of Deferred@592345232 after retry RPC after error@1529181786) -> (continuation of Deferred@182674745 after retry RPC after error@1821490401) -> (continuation of Deferred@1011602203 after retry RPC after error@1286403438) -> (continuation of Deferred@1568115567 after retry RPC after error@1012945556) -> (continuation of Deferred@1582406920 after retry RPC after error@1979520041), errback=(continuation of Deferred@2004683719 after retry RPC after error@376746862) -> (continuation of Deferred@1104048884 after retry RPC after error@1635302254) -> (continuation of Deferred@2118432693 after retry RPC after error@1293452496) -> (continuation of Deferred@2146633301 after retry RPC after error@1534357774) -> (continuation of Deferred@5672138 after retry RPC after error@165787156) -> (continuation of Deferred@1850198227 after retry RPC after error@381888532) -> (continuation of Deferred@575133402 after retry RPC after error@647140752) -> (continuation of Deferred@1984155841 after retry RPC after error@2035275157) -> (continuation of Deferred@1705131360 after retry RPC after error@1471023697) -> (continuation of Deferred@1057164733 after retry RPC after error@946308277) -> (continuation of Deferred@1289418724 after retry RPC after error@1803653292) -> (continuation of Deferred@1279792772 after retry RPC after error@1208902036) -> (continuation of Deferred@1399900838 after retry RPC after error@873669780) -> (continuation of Deferred@946075812 after retry RPC after error@64634109) -> (continuation of Deferred@1454044122 after retry RPC after error@2075154975) -> (continuation of Deferred@1546730261 after retry RPC after error@241093050) -> (continuation of Deferred@267112328 after retry RPC after error@1995574472) -> (continuation of Deferred@592345232 after retry RPC after error@1529181786) -> (continuation of Deferred@182674745 after retry RPC after error@1821490401) -> (continuation of Deferred@1011602203 after retry RPC after error@1286403438) -> (continuation of Deferred@1568115567 after retry RPC after error@1012945556) -> (continuation of Deferred@1582406920 after retry RPC after error@1979520041)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:07.518 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_7).
18:34:07.520 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#7 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_7.
18:34:07.522 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29446), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [11ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [16ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [21ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [43ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [63ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [82ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [101ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [121ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [122ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [201ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [202ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [301ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [302ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [522ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [722ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [722ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [722ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [722ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1022ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2381ms] refreshing cache from master, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2383ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [5501ms] refreshing cache from master, [5501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5502ms] too many traces: truncated at 100 traces, deferred=Deferred@1806264292(state=PENDING, result=null, callback=(continuation of Deferred@2004683719 after retry RPC after error@376746862) -> (continuation of Deferred@1104048884 after retry RPC after error@1635302254) -> (continuation of Deferred@2118432693 after retry RPC after error@1293452496) -> (continuation of Deferred@2146633301 after retry RPC after error@1534357774) -> (continuation of Deferred@5672138 after retry RPC after error@165787156) -> (continuation of Deferred@1850198227 after retry RPC after error@381888532) -> (continuation of Deferred@575133402 after retry RPC after error@647140752) -> (continuation of Deferred@1984155841 after retry RPC after error@2035275157) -> (continuation of Deferred@1705131360 after retry RPC after error@1471023697) -> (continuation of Deferred@1057164733 after retry RPC after error@946308277) -> (continuation of Deferred@1289418724 after retry RPC after error@1803653292) -> (continuation of Deferred@1279792772 after retry RPC after error@1208902036) -> (continuation of Deferred@1399900838 after retry RPC after error@873669780) -> (continuation of Deferred@946075812 after retry RPC after error@64634109) -> (continuation of Deferred@1454044122 after retry RPC after error@2075154975) -> (continuation of Deferred@1546730261 after retry RPC after error@241093050) -> (continuation of Deferred@267112328 after retry RPC after error@1995574472) -> (continuation of Deferred@592345232 after retry RPC after error@1529181786) -> (continuation of Deferred@182674745 after retry RPC after error@1821490401) -> (continuation of Deferred@1011602203 after retry RPC after error@1286403438) -> (continuation of Deferred@1568115567 after retry RPC after error@1012945556) -> (continuation of Deferred@1582406920 after retry RPC after error@1979520041), errback=(continuation of Deferred@2004683719 after retry RPC after error@376746862) -> (continuation of Deferred@1104048884 after retry RPC after error@1635302254) -> (continuation of Deferred@2118432693 after retry RPC after error@1293452496) -> (continuation of Deferred@2146633301 after retry RPC after error@1534357774) -> (continuation of Deferred@5672138 after retry RPC after error@165787156) -> (continuation of Deferred@1850198227 after retry RPC after error@381888532) -> (continuation of Deferred@575133402 after retry RPC after error@647140752) -> (continuation of Deferred@1984155841 after retry RPC after error@2035275157) -> (continuation of Deferred@1705131360 after retry RPC after error@1471023697) -> (continuation of Deferred@1057164733 after retry RPC after error@946308277) -> (continuation of Deferred@1289418724 after retry RPC after error@1803653292) -> (continuation of Deferred@1279792772 after retry RPC after error@1208902036) -> (continuation of Deferred@1399900838 after retry RPC after error@873669780) -> (continuation of Deferred@946075812 after retry RPC after error@64634109) -> (continuation of Deferred@1454044122 after retry RPC after error@2075154975) -> (continuation of Deferred@1546730261 after retry RPC after error@241093050) -> (continuation of Deferred@267112328 after retry RPC after error@1995574472) -> (continuation of Deferred@592345232 after retry RPC after error@1529181786) -> (continuation of Deferred@182674745 after retry RPC after error@1821490401) -> (continuation of Deferred@1011602203 after retry RPC after error@1286403438) -> (continuation of Deferred@1568115567 after retry RPC after error@1012945556) -> (continuation of Deferred@1582406920 after retry RPC after error@1979520041)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:07.523 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_7.
18:34:07.524 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job fa73e37017778341a79e5b3ef3d55eb9
18:34:07.524 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#7) of source Source: KuduSource.
18:34:07.531 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:07.532 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.532 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.532 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.534 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.534 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.534 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.534 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:07.555 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:07.563 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:07.563 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.563 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.564 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.572 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:07.573 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.573 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.573 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.573 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.573 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.573 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.573 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:07.595 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:07.595 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:07.595 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:07.595 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.596 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.596 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.596 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.596 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.596 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.596 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.597 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.597 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.597 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:07.599 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:07.615 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:07.615 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:07.615 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:07.615 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.615 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.615 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.616 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.616 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.616 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.616 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.616 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.616 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.616 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:07.634 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:07.636 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:07.636 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:07.637 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:07.637 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:07.637 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:07.637 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:07.638 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:07.638 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:07.638 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:07.638 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:07.638 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:07.638 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:07.638 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:07.655 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:07.655 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:07.655 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:07.657 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.657 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.657 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.657 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.657 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.657 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.657 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.657 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.657 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.658 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:07.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:07.695 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:07.695 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:07.695 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:07.695 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.695 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.695 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.696 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.696 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.696 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.696 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.696 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.696 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.696 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:07.719 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:07.719 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:07.719 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:07.720 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:07.720 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:07.720 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:07.720 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:07.720 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:07.720 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:07.720 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:07.720 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:07.720 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:07.720 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:07.754 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:07.755 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:07.755 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:07.755 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.755 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.755 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.755 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.756 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.756 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.756 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.756 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.756 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.756 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:07.835 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:07.835 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:07.835 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:07.836 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.836 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.836 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.836 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.836 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.836 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.836 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.837 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.837 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.837 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:07.837 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29769), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [13ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [17ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [21ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [44ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [62ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [84ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [101ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [161ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [181ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [902ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [902ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [902ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [902ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1501ms] refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1502ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2121ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2123ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2321ms] refreshing cache from master, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2322ms] too many traces: truncated at 100 traces, deferred=Deferred@843340702(state=PENDING, result=null, callback=(continuation of Deferred@877422190 after retry RPC after error@688556948) -> (continuation of Deferred@1909180425 after retry RPC after error@1640228101) -> (continuation of Deferred@913014853 after retry RPC after error@1270934327) -> (continuation of Deferred@1692723654 after retry RPC after error@443667346) -> (continuation of Deferred@1894908209 after retry RPC after error@1009239371) -> (continuation of Deferred@2135863760 after retry RPC after error@1807155432) -> (continuation of Deferred@195850022 after retry RPC after error@161742469) -> (continuation of Deferred@65605200 after retry RPC after error@1342893701) -> (continuation of Deferred@951549693 after retry RPC after error@787933368) -> (continuation of Deferred@1705437368 after retry RPC after error@1650416719) -> (continuation of Deferred@1629263471 after retry RPC after error@2025198044) -> (continuation of Deferred@705152346 after retry RPC after error@849496433) -> (continuation of Deferred@923279012 after retry RPC after error@2138620264) -> (continuation of Deferred@1807869640 after retry RPC after error@1267254016) -> (continuation of Deferred@1015159275 after retry RPC after error@97053842) -> (continuation of Deferred@1633402181 after retry RPC after error@1816584877) -> (continuation of Deferred@1076360079 after retry RPC after error@46742373) -> (continuation of Deferred@1053036524 after retry RPC after error@1699533075) -> (continuation of Deferred@436796862 after retry RPC after error@1372716937) -> (continuation of Deferred@1333014832 after retry RPC after error@1278453124) -> (continuation of Deferred@294339761 after retry RPC after error@1341709502) -> (continuation of Deferred@560699840 after retry RPC after error@1889863660) -> (continuation of Deferred@994081669 after retry RPC after error@852778367) -> (continuation of Deferred@1326212988 after retry RPC after error@391025430), errback=(continuation of Deferred@877422190 after retry RPC after error@688556948) -> (continuation of Deferred@1909180425 after retry RPC after error@1640228101) -> (continuation of Deferred@913014853 after retry RPC after error@1270934327) -> (continuation of Deferred@1692723654 after retry RPC after error@443667346) -> (continuation of Deferred@1894908209 after retry RPC after error@1009239371) -> (continuation of Deferred@2135863760 after retry RPC after error@1807155432) -> (continuation of Deferred@195850022 after retry RPC after error@161742469) -> (continuation of Deferred@65605200 after retry RPC after error@1342893701) -> (continuation of Deferred@951549693 after retry RPC after error@787933368) -> (continuation of Deferred@1705437368 after retry RPC after error@1650416719) -> (continuation of Deferred@1629263471 after retry RPC after error@2025198044) -> (continuation of Deferred@705152346 after retry RPC after error@849496433) -> (continuation of Deferred@923279012 after retry RPC after error@2138620264) -> (continuation of Deferred@1807869640 after retry RPC after error@1267254016) -> (continuation of Deferred@1015159275 after retry RPC after error@97053842) -> (continuation of Deferred@1633402181 after retry RPC after error@1816584877) -> (continuation of Deferred@1076360079 after retry RPC after error@46742373) -> (continuation of Deferred@1053036524 after retry RPC after error@1699533075) -> (continuation of Deferred@436796862 after retry RPC after error@1372716937) -> (continuation of Deferred@1333014832 after retry RPC after error@1278453124) -> (continuation of Deferred@294339761 after retry RPC after error@1341709502) -> (continuation of Deferred@560699840 after retry RPC after error@1889863660) -> (continuation of Deferred@994081669 after retry RPC after error@852778367) -> (continuation of Deferred@1326212988 after retry RPC after error@391025430)))
18:34:07.838 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:07.838 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:07.838 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:07.839 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29769), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [13ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [17ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [21ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [44ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [62ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [84ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [101ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [161ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [181ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [902ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [902ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [902ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [902ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1501ms] refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1502ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2121ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2123ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2321ms] refreshing cache from master, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2322ms] too many traces: truncated at 100 traces, deferred=Deferred@843340702(state=PENDING, result=null, callback=(continuation of Deferred@877422190 after retry RPC after error@688556948) -> (continuation of Deferred@1909180425 after retry RPC after error@1640228101) -> (continuation of Deferred@913014853 after retry RPC after error@1270934327) -> (continuation of Deferred@1692723654 after retry RPC after error@443667346) -> (continuation of Deferred@1894908209 after retry RPC after error@1009239371) -> (continuation of Deferred@2135863760 after retry RPC after error@1807155432) -> (continuation of Deferred@195850022 after retry RPC after error@161742469) -> (continuation of Deferred@65605200 after retry RPC after error@1342893701) -> (continuation of Deferred@951549693 after retry RPC after error@787933368) -> (continuation of Deferred@1705437368 after retry RPC after error@1650416719) -> (continuation of Deferred@1629263471 after retry RPC after error@2025198044) -> (continuation of Deferred@705152346 after retry RPC after error@849496433) -> (continuation of Deferred@923279012 after retry RPC after error@2138620264) -> (continuation of Deferred@1807869640 after retry RPC after error@1267254016) -> (continuation of Deferred@1015159275 after retry RPC after error@97053842) -> (continuation of Deferred@1633402181 after retry RPC after error@1816584877) -> (continuation of Deferred@1076360079 after retry RPC after error@46742373) -> (continuation of Deferred@1053036524 after retry RPC after error@1699533075) -> (continuation of Deferred@436796862 after retry RPC after error@1372716937) -> (continuation of Deferred@1333014832 after retry RPC after error@1278453124) -> (continuation of Deferred@294339761 after retry RPC after error@1341709502) -> (continuation of Deferred@560699840 after retry RPC after error@1889863660) -> (continuation of Deferred@994081669 after retry RPC after error@852778367) -> (continuation of Deferred@1326212988 after retry RPC after error@391025430), errback=(continuation of Deferred@877422190 after retry RPC after error@688556948) -> (continuation of Deferred@1909180425 after retry RPC after error@1640228101) -> (continuation of Deferred@913014853 after retry RPC after error@1270934327) -> (continuation of Deferred@1692723654 after retry RPC after error@443667346) -> (continuation of Deferred@1894908209 after retry RPC after error@1009239371) -> (continuation of Deferred@2135863760 after retry RPC after error@1807155432) -> (continuation of Deferred@195850022 after retry RPC after error@161742469) -> (continuation of Deferred@65605200 after retry RPC after error@1342893701) -> (continuation of Deferred@951549693 after retry RPC after error@787933368) -> (continuation of Deferred@1705437368 after retry RPC after error@1650416719) -> (continuation of Deferred@1629263471 after retry RPC after error@2025198044) -> (continuation of Deferred@705152346 after retry RPC after error@849496433) -> (continuation of Deferred@923279012 after retry RPC after error@2138620264) -> (continuation of Deferred@1807869640 after retry RPC after error@1267254016) -> (continuation of Deferred@1015159275 after retry RPC after error@97053842) -> (continuation of Deferred@1633402181 after retry RPC after error@1816584877) -> (continuation of Deferred@1076360079 after retry RPC after error@46742373) -> (continuation of Deferred@1053036524 after retry RPC after error@1699533075) -> (continuation of Deferred@436796862 after retry RPC after error@1372716937) -> (continuation of Deferred@1333014832 after retry RPC after error@1278453124) -> (continuation of Deferred@294339761 after retry RPC after error@1341709502) -> (continuation of Deferred@560699840 after retry RPC after error@1889863660) -> (continuation of Deferred@994081669 after retry RPC after error@852778367) -> (continuation of Deferred@1326212988 after retry RPC after error@391025430)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29769), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [13ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [17ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [21ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [44ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [62ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [84ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [101ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [161ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [181ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [902ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [902ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [902ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [902ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1501ms] refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1502ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2121ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2123ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2321ms] refreshing cache from master, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2322ms] too many traces: truncated at 100 traces, deferred=Deferred@843340702(state=PENDING, result=null, callback=(continuation of Deferred@877422190 after retry RPC after error@688556948) -> (continuation of Deferred@1909180425 after retry RPC after error@1640228101) -> (continuation of Deferred@913014853 after retry RPC after error@1270934327) -> (continuation of Deferred@1692723654 after retry RPC after error@443667346) -> (continuation of Deferred@1894908209 after retry RPC after error@1009239371) -> (continuation of Deferred@2135863760 after retry RPC after error@1807155432) -> (continuation of Deferred@195850022 after retry RPC after error@161742469) -> (continuation of Deferred@65605200 after retry RPC after error@1342893701) -> (continuation of Deferred@951549693 after retry RPC after error@787933368) -> (continuation of Deferred@1705437368 after retry RPC after error@1650416719) -> (continuation of Deferred@1629263471 after retry RPC after error@2025198044) -> (continuation of Deferred@705152346 after retry RPC after error@849496433) -> (continuation of Deferred@923279012 after retry RPC after error@2138620264) -> (continuation of Deferred@1807869640 after retry RPC after error@1267254016) -> (continuation of Deferred@1015159275 after retry RPC after error@97053842) -> (continuation of Deferred@1633402181 after retry RPC after error@1816584877) -> (continuation of Deferred@1076360079 after retry RPC after error@46742373) -> (continuation of Deferred@1053036524 after retry RPC after error@1699533075) -> (continuation of Deferred@436796862 after retry RPC after error@1372716937) -> (continuation of Deferred@1333014832 after retry RPC after error@1278453124) -> (continuation of Deferred@294339761 after retry RPC after error@1341709502) -> (continuation of Deferred@560699840 after retry RPC after error@1889863660) -> (continuation of Deferred@994081669 after retry RPC after error@852778367) -> (continuation of Deferred@1326212988 after retry RPC after error@391025430), errback=(continuation of Deferred@877422190 after retry RPC after error@688556948) -> (continuation of Deferred@1909180425 after retry RPC after error@1640228101) -> (continuation of Deferred@913014853 after retry RPC after error@1270934327) -> (continuation of Deferred@1692723654 after retry RPC after error@443667346) -> (continuation of Deferred@1894908209 after retry RPC after error@1009239371) -> (continuation of Deferred@2135863760 after retry RPC after error@1807155432) -> (continuation of Deferred@195850022 after retry RPC after error@161742469) -> (continuation of Deferred@65605200 after retry RPC after error@1342893701) -> (continuation of Deferred@951549693 after retry RPC after error@787933368) -> (continuation of Deferred@1705437368 after retry RPC after error@1650416719) -> (continuation of Deferred@1629263471 after retry RPC after error@2025198044) -> (continuation of Deferred@705152346 after retry RPC after error@849496433) -> (continuation of Deferred@923279012 after retry RPC after error@2138620264) -> (continuation of Deferred@1807869640 after retry RPC after error@1267254016) -> (continuation of Deferred@1015159275 after retry RPC after error@97053842) -> (continuation of Deferred@1633402181 after retry RPC after error@1816584877) -> (continuation of Deferred@1076360079 after retry RPC after error@46742373) -> (continuation of Deferred@1053036524 after retry RPC after error@1699533075) -> (continuation of Deferred@436796862 after retry RPC after error@1372716937) -> (continuation of Deferred@1333014832 after retry RPC after error@1278453124) -> (continuation of Deferred@294339761 after retry RPC after error@1341709502) -> (continuation of Deferred@560699840 after retry RPC after error@1889863660) -> (continuation of Deferred@994081669 after retry RPC after error@852778367) -> (continuation of Deferred@1326212988 after retry RPC after error@391025430)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.68.188:38393
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:07.840 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.840 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.840 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.840 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.840 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.840 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.841 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.841 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.841 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.841 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:07.846 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29769), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [13ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [17ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [21ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [44ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [62ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [84ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [101ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [161ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [181ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [902ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [902ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [902ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [902ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1501ms] refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1502ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2121ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2123ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2321ms] refreshing cache from master, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2322ms] too many traces: truncated at 100 traces, deferred=Deferred@843340702(state=PENDING, result=null, callback=(continuation of Deferred@877422190 after retry RPC after error@688556948) -> (continuation of Deferred@1909180425 after retry RPC after error@1640228101) -> (continuation of Deferred@913014853 after retry RPC after error@1270934327) -> (continuation of Deferred@1692723654 after retry RPC after error@443667346) -> (continuation of Deferred@1894908209 after retry RPC after error@1009239371) -> (continuation of Deferred@2135863760 after retry RPC after error@1807155432) -> (continuation of Deferred@195850022 after retry RPC after error@161742469) -> (continuation of Deferred@65605200 after retry RPC after error@1342893701) -> (continuation of Deferred@951549693 after retry RPC after error@787933368) -> (continuation of Deferred@1705437368 after retry RPC after error@1650416719) -> (continuation of Deferred@1629263471 after retry RPC after error@2025198044) -> (continuation of Deferred@705152346 after retry RPC after error@849496433) -> (continuation of Deferred@923279012 after retry RPC after error@2138620264) -> (continuation of Deferred@1807869640 after retry RPC after error@1267254016) -> (continuation of Deferred@1015159275 after retry RPC after error@97053842) -> (continuation of Deferred@1633402181 after retry RPC after error@1816584877) -> (continuation of Deferred@1076360079 after retry RPC after error@46742373) -> (continuation of Deferred@1053036524 after retry RPC after error@1699533075) -> (continuation of Deferred@436796862 after retry RPC after error@1372716937) -> (continuation of Deferred@1333014832 after retry RPC after error@1278453124) -> (continuation of Deferred@294339761 after retry RPC after error@1341709502) -> (continuation of Deferred@560699840 after retry RPC after error@1889863660) -> (continuation of Deferred@994081669 after retry RPC after error@852778367) -> (continuation of Deferred@1326212988 after retry RPC after error@391025430), errback=(continuation of Deferred@877422190 after retry RPC after error@688556948) -> (continuation of Deferred@1909180425 after retry RPC after error@1640228101) -> (continuation of Deferred@913014853 after retry RPC after error@1270934327) -> (continuation of Deferred@1692723654 after retry RPC after error@443667346) -> (continuation of Deferred@1894908209 after retry RPC after error@1009239371) -> (continuation of Deferred@2135863760 after retry RPC after error@1807155432) -> (continuation of Deferred@195850022 after retry RPC after error@161742469) -> (continuation of Deferred@65605200 after retry RPC after error@1342893701) -> (continuation of Deferred@951549693 after retry RPC after error@787933368) -> (continuation of Deferred@1705437368 after retry RPC after error@1650416719) -> (continuation of Deferred@1629263471 after retry RPC after error@2025198044) -> (continuation of Deferred@705152346 after retry RPC after error@849496433) -> (continuation of Deferred@923279012 after retry RPC after error@2138620264) -> (continuation of Deferred@1807869640 after retry RPC after error@1267254016) -> (continuation of Deferred@1015159275 after retry RPC after error@97053842) -> (continuation of Deferred@1633402181 after retry RPC after error@1816584877) -> (continuation of Deferred@1076360079 after retry RPC after error@46742373) -> (continuation of Deferred@1053036524 after retry RPC after error@1699533075) -> (continuation of Deferred@436796862 after retry RPC after error@1372716937) -> (continuation of Deferred@1333014832 after retry RPC after error@1278453124) -> (continuation of Deferred@294339761 after retry RPC after error@1341709502) -> (continuation of Deferred@560699840 after retry RPC after error@1889863660) -> (continuation of Deferred@994081669 after retry RPC after error@852778367) -> (continuation of Deferred@1326212988 after retry RPC after error@391025430)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29769), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [13ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [17ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [21ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [42ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [43ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [44ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [61ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [62ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [81ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [83ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [84ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [101ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [101ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [141ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [141ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [161ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [181ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [181ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [382ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [902ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [902ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [902ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [902ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1501ms] refreshing cache from master, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1501ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1502ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1502ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2121ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2123ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2321ms] refreshing cache from master, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2322ms] too many traces: truncated at 100 traces, deferred=Deferred@843340702(state=PENDING, result=null, callback=(continuation of Deferred@877422190 after retry RPC after error@688556948) -> (continuation of Deferred@1909180425 after retry RPC after error@1640228101) -> (continuation of Deferred@913014853 after retry RPC after error@1270934327) -> (continuation of Deferred@1692723654 after retry RPC after error@443667346) -> (continuation of Deferred@1894908209 after retry RPC after error@1009239371) -> (continuation of Deferred@2135863760 after retry RPC after error@1807155432) -> (continuation of Deferred@195850022 after retry RPC after error@161742469) -> (continuation of Deferred@65605200 after retry RPC after error@1342893701) -> (continuation of Deferred@951549693 after retry RPC after error@787933368) -> (continuation of Deferred@1705437368 after retry RPC after error@1650416719) -> (continuation of Deferred@1629263471 after retry RPC after error@2025198044) -> (continuation of Deferred@705152346 after retry RPC after error@849496433) -> (continuation of Deferred@923279012 after retry RPC after error@2138620264) -> (continuation of Deferred@1807869640 after retry RPC after error@1267254016) -> (continuation of Deferred@1015159275 after retry RPC after error@97053842) -> (continuation of Deferred@1633402181 after retry RPC after error@1816584877) -> (continuation of Deferred@1076360079 after retry RPC after error@46742373) -> (continuation of Deferred@1053036524 after retry RPC after error@1699533075) -> (continuation of Deferred@436796862 after retry RPC after error@1372716937) -> (continuation of Deferred@1333014832 after retry RPC after error@1278453124) -> (continuation of Deferred@294339761 after retry RPC after error@1341709502) -> (continuation of Deferred@560699840 after retry RPC after error@1889863660) -> (continuation of Deferred@994081669 after retry RPC after error@852778367) -> (continuation of Deferred@1326212988 after retry RPC after error@391025430), errback=(continuation of Deferred@877422190 after retry RPC after error@688556948) -> (continuation of Deferred@1909180425 after retry RPC after error@1640228101) -> (continuation of Deferred@913014853 after retry RPC after error@1270934327) -> (continuation of Deferred@1692723654 after retry RPC after error@443667346) -> (continuation of Deferred@1894908209 after retry RPC after error@1009239371) -> (continuation of Deferred@2135863760 after retry RPC after error@1807155432) -> (continuation of Deferred@195850022 after retry RPC after error@161742469) -> (continuation of Deferred@65605200 after retry RPC after error@1342893701) -> (continuation of Deferred@951549693 after retry RPC after error@787933368) -> (continuation of Deferred@1705437368 after retry RPC after error@1650416719) -> (continuation of Deferred@1629263471 after retry RPC after error@2025198044) -> (continuation of Deferred@705152346 after retry RPC after error@849496433) -> (continuation of Deferred@923279012 after retry RPC after error@2138620264) -> (continuation of Deferred@1807869640 after retry RPC after error@1267254016) -> (continuation of Deferred@1015159275 after retry RPC after error@97053842) -> (continuation of Deferred@1633402181 after retry RPC after error@1816584877) -> (continuation of Deferred@1076360079 after retry RPC after error@46742373) -> (continuation of Deferred@1053036524 after retry RPC after error@1699533075) -> (continuation of Deferred@436796862 after retry RPC after error@1372716937) -> (continuation of Deferred@1333014832 after retry RPC after error@1278453124) -> (continuation of Deferred@294339761 after retry RPC after error@1341709502) -> (continuation of Deferred@560699840 after retry RPC after error@1889863660) -> (continuation of Deferred@994081669 after retry RPC after error@852778367) -> (continuation of Deferred@1326212988 after retry RPC after error@391025430)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.68.188:38393
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:07.846 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:34:07.855 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:07.855 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:07.855 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:07.855 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.855 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.855 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.856 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.856 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.856 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.857 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.858 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.858 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.858 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:07.874 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:07.875 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:07.875 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:07.875 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.875 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.875 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.875 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.875 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.875 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.876 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.876 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.876 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.876 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:07.894 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:07.894 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:07.894 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:07.895 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.895 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.895 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.895 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.895 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.895 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.896 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.896 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.896 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.896 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:07.915 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:07.915 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:07.915 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:07.915 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.915 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.915 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.915 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.915 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.915 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.916 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.916 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.916 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.916 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:07.924 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:07.955 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:07.955 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:07.955 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:07.955 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.956 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.956 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:07.956 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.956 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.956 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:07.956 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.956 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.956 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:07.956 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:07.975 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:07.975 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:07.975 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:07.976 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.976 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.976 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.976 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.976 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:07.976 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.976 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:07.976 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.976 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:07.976 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:07.979 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:07.980 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:07.980 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:07.980 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:07.980 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:07.980 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:07.981 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:07.981 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:07.981 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:07.981 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:07.981 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:07.981 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:07.981 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:08.035 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:08.035 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:08.035 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:08.035 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:08.036 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:08.036 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:08.036 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:08.036 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:08.036 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:08.036 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:08.036 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:08.036 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:08.036 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:08.075 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:08.075 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:08.075 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:08.075 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:08.075 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:08.075 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:08.075 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:08.075 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:08.075 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:08.076 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:08.076 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:08.076 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:08.076 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:08.099 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:08.133 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:08.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:08.215 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:08.216 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:08.216 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:08.216 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:08.216 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:08.216 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:08.217 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:08.217 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:08.217 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:08.217 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:08.217 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:08.217 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:08.217 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:08.274 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:08.275 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:08.275 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:08.275 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:08.275 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:08.275 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:08.276 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:08.276 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:08.276 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:08.276 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:08.276 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:08.276 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:08.276 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:08.284 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:08.284 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:08.284 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:08.284 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:08.284 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:08.284 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:08.285 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:08.285 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:08.285 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:08.285 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:08.285 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:08.285 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:08.285 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:08.355 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:08.355 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:08.355 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:08.356 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:08.356 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:08.356 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:08.356 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:08.356 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:08.356 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:08.356 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:08.356 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:08.356 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:08.356 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:08.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:08.459 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:08.459 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:08.459 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:08.461 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:08.461 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:08.461 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:08.461 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:08.461 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:08.461 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:08.462 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:08.462 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:08.462 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:08.462 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:08.594 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:08.595 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:08.595 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:08.595 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:08.595 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:08.595 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:08.595 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:08.595 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:08.595 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:08.595 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:08.595 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:08.595 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:08.595 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:08.600 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:08.633 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:08.655 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:08.655 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:08.655 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:08.655 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:08.655 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:08.656 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:08.656 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:08.656 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:08.656 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:08.656 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:08.656 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:08.656 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:08.656 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:08.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:08.737 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:08.737 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:08.737 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:08.737 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:08.737 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:08.737 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:08.738 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:08.738 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:08.738 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:08.738 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:08.738 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:08.738 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:08.738 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:08.741 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:08.742 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:08.742 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:08.742 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:08.742 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:08.742 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:08.742 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:08.742 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:08.742 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:08.742 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:08.743 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:08.743 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:08.743 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:08.835 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:08.835 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:08.835 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:08.835 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:08.836 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:08.836 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:08.836 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:08.836 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:08.836 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:08.836 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:08.836 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:08.836 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:08.836 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:08.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:07.076485  8367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:08.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:08.901872  8368 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1850 milliseconds
18:34:08.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:08.902130  8358 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:34:08.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:07.071450  8370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:08.908324  8358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:34:08.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:08.912971  8358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:34:08.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:08.914624  8358 hybrid_clock.cc:648] HybridClock initialized: now 1783535648914598 us; error 47 us; skew 500 ppm
18:34:08.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:08.915663  8358 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:34:08.924 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:08.934 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:08.934 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:08.934 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:08.935 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:08.935 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:08.935 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:08.935 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:08.935 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:08.935 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:08.935 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:08.935 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:08.935 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:08.936 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:08.936 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:08.936 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:08.936 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:08.936 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:08.936 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:08.936 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:08.937 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:08.937 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:08.937 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:08.937 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:08.937 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:08.937 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:08.937 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:08.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:08.945278  8358 webserver.cc:534] Webserver started at http://127.7.200.129:44951/ using document root <none> and password file <none>
18:34:08.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:08.947101  8358 fs_manager.cc:362] Metadata directory not provided
18:34:08.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:08.947372  8358 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:34:08.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:08.948354  8358 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:34:08.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:08.959049  8358 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/data/instance:
18:34:08.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d916cabe36cb45ccb545d9fc771a4651"
18:34:08.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:08 on dist-test-slave-dxnw"
18:34:08.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:08.960899  8358 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/wal/instance:
18:34:08.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d916cabe36cb45ccb545d9fc771a4651"
18:34:08.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:08 on dist-test-slave-dxnw"
18:34:08.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:08.972669  8358 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.006s	sys 0.003s
18:34:08.980 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:08.980 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:08.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:08.980521  8387 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:34:08.980 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:08.981 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:08.981 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:08.981 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:08.981 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:08.981 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:08.981 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:08.981 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:08.981 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:08.982 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:08.982 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:08.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:08.983147  8358 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.001s	sys 0.003s
18:34:08.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:08.983520  8358 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/wal
18:34:08.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d916cabe36cb45ccb545d9fc771a4651"
18:34:08.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:08 on dist-test-slave-dxnw"
18:34:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:08.983947  8358 fs_report.cc:389] FS layout report
18:34:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:34:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/wal
18:34:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/wal
18:34:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/data/data
18:34:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:34:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:34:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:34:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:34:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:34:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:34:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:34:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:34:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:34:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:34:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:34:09.074 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:09.074 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:09.075 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:09.075 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:09.075 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:09.075 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:09.075 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:09.075 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:09.075 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:09.075 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:09.075 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:09.075 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:09.076 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:09.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.097038  8358 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:34:09.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.100363  8358 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:34:09.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.106456  8358 kserver.cc:163] Server-wide thread pool size limit: 3276
18:34:09.125 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:09.125 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:09.125 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:09.125 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:09.125 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:09.125 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:09.126 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:09.126 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:09.126 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:09.126 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:09.126 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:09.126 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:09.126 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:09.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.129478  8358 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:34:09.133 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:09.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.144745  8358 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:34:09.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.145255  8358 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
18:34:09.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.145709  8358 ts_tablet_manager.cc:616] Registered 0 tablets
18:34:09.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.146178  8358 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:34:09.152 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:09.152 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:09.152 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:09.153 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:09.153 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:09.153 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:09.153 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:09.153 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:09.153 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:09.153 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:09.153 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:09.153 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:09.153 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:09.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:09.245 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:09.245 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:09.245 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:09.245 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:09.245 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:09.245 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:09.245 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:09.245 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:09.245 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:09.245 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:09.245 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:09.245 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:09.245 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:09.258 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:09.259 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:09.259 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:09.259 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:09.259 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:09.259 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:09.260 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:09.260 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:09.260 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:09.260 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:09.260 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:09.260 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:09.260 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:09.309 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:09.309 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:09.309 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:09.310 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:09.310 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:09.310 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:09.310 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:09.310 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:09.310 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:09.310 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:09.311 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:09.311 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:09.311 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:09.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:09.556 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:09.556 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:09.556 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:09.556 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:09.556 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:09.556 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:09.556 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:09.556 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:09.556 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:09.557 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:09.557 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:09.557 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:09.557 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:09.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.589769  8358 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.129:33899
18:34:09.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.589900  8501 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.200.129:33899 every 8 connection(s)
18:34:09.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.593801  8358 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/data/info.pb
18:34:09.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:09.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.599612  7970 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 8358
18:34:09.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.600324  7970 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-0/wal/instance
18:34:09.633 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:09.634 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:09.634 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:09.634 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:09.634 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:09.634 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:09.634 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:09.634 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:09.634 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:09.634 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:09.635 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:09.635 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:09.635 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:09.635 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.636402  7970 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/wal
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/data
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/logs
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/data/info.pb
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.200.130:0
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.7.200.130
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.200.130
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.7.200.190:40077,127.7.200.189:42349,127.7.200.188:38999
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.200.148:33865
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:09.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:34:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.642902  8502 heartbeater.cc:344] Connected to a master server at 127.7.200.188:38999
18:34:09.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.643455  8502 heartbeater.cc:461] Registering TS with master...
18:34:09.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.645995  8502 heartbeater.cc:507] Master 127.7.200.188:38999 requested a full tablet report, sending...
18:34:09.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.651942  8237 ts_manager.cc:194] Registered new tserver with Master: d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899)
18:34:09.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.659646  8237 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.7.200.129:41547
18:34:09.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:09.735 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:09.735 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:09.735 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:09.735 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:09.735 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:09.735 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:09.735 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:09.736 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:09.736 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:09.736 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:09.736 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:09.736 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:09.736 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:09.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.742272  8503 heartbeater.cc:344] Connected to a master server at 127.7.200.189:42349
18:34:09.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.742684  8503 heartbeater.cc:461] Registering TS with master...
18:34:09.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.743382  8503 heartbeater.cc:507] Master 127.7.200.189:42349 requested a full tablet report, sending...
18:34:09.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.745024  8507 heartbeater.cc:344] Connected to a master server at 127.7.200.190:40077
18:34:09.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.745373  8507 heartbeater.cc:461] Registering TS with master...
18:34:09.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.746040  8507 heartbeater.cc:507] Master 127.7.200.190:40077 requested a full tablet report, sending...
18:34:09.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.749495  8019 ts_manager.cc:194] Registered new tserver with Master: d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899)
18:34:09.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:09.749881  8150 ts_manager.cc:194] Registered new tserver with Master: d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899)
18:34:09.918 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:09.919 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:09.919 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:09.919 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:09.919 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:09.919 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:09.919 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:09.919 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:09.919 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:09.919 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:09.919 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:09.919 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:09.920 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:09.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:10.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:10.107 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:10.107 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:10.107 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:10.108 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:10.108 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:10.108 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:10.108 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:10.108 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:10.108 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:10.108 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:10.109 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:10.109 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:10.109 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:10.134 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:10.138 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:10.138 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:10.138 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:10.138 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:10.138 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:10.138 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:10.139 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:10.139 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:10.139 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:10.138 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:10.139 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:10.139 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:10.139 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:10.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:10.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:10.202881  8506 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:34:10.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:10.203548  8506 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:34:10.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:10.204288  8506 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:34:10.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:10.265971  8506 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:34:10.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:10.267302  8506 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.130
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:10.319780  8506 tablet_server_runner.cc:78] Tablet server non-default flags:
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.200.148:33865
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/data
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/wal
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.200.130:0
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/data/info.pb
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.200.130
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.7.200.190:40077,127.7.200.189:42349,127.7.200.188:38999
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.7.200.130
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/logs
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:34:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:34:10.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:10.321173  8506 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:34:10.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:10.322829  8506 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:34:10.334 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:10.334 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:10.334 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:10.334 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:10.335 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:10.335 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:10.335 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:10.335 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:10.335 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:10.335 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:10.335 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:10.335 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:10.335 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:10.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:10.338001  8518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:10.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:10.521 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:10.521 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:10.521 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:10.521 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:10.521 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:10.521 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:10.522 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:10.522 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:10.522 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:10.522 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:10.522 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:10.522 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:10.522 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:10.599 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:10.635 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:10.642 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:10.642 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:10.642 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:10.642 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:10.642 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:10.642 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:10.642 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:10.643 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:10.643 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:10.643 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:10.643 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:10.643 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:10.643 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:10.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:10.666090  8502 heartbeater.cc:499] Master 127.7.200.188:38999 was elected leader, sending a full tablet report...
18:34:10.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:10.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:10.959 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:10.959 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:10.960 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:10.960 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:10.960 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:10.960 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:10.960 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:10.960 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:10.960 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:10.961 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:10.961 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:10.961 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:10.961 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:11.040 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:11.041 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:11.041 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:11.041 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:11.041 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:11.041 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:11.041 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:11.041 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:11.041 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:11.041 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:11.041 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:11.041 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:11.042 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:11.099 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:11.134 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:11.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:11.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:11.387545  7200 debug-util.cc:398] Leaking SignalData structure 0x7b08000a3da0 after lost signal to thread 7137
18:34:11.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:11.388402  7200 debug-util.cc:398] Leaking SignalData structure 0x7b08000a1a20 after lost signal to thread 7203
18:34:11.420 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:11.599 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:11.633 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:11.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:11.752 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:11.752 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:11.752 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:11.752 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:11.753 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:11.753 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:11.753 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:11.753 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:11.753 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:11.752 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:11.753 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:11.753 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:11.753 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:11.760 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:11.760 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:11.760 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:11.760 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:11.760 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:11.760 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:11.760 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:11.760 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:11.760 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:11.761 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:11.761 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:11.761 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:11.761 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:11.806 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:11.807 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:11.807 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:11.807 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:11.807 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:11.807 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:11.808 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:11.808 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:11.808 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:11.808 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:11.808 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:11.808 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:11.808 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:11.815 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:11.815 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:11.815 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:11.815 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:11.815 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:11.815 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:11.816 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:11.816 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:11.816 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:11.817 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:11.818 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:11.818 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:11.818 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:11.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:10.342691  8521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:11.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:10.338276  8519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:11.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:11.836944  8520 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
18:34:11.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.837754  8506 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:34:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.843161  8506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:34:11.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.848814  8506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:34:11.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.850613  8506 hybrid_clock.cc:648] HybridClock initialized: now 1783535651850540 us; error 73 us; skew 500 ppm
18:34:11.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.851857  8506 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:34:11.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.861171  8506 webserver.cc:534] Webserver started at http://127.7.200.130:36203/ using document root <none> and password file <none>
18:34:11.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.863633  8506 fs_manager.cc:362] Metadata directory not provided
18:34:11.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.863974  8506 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:34:11.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.864526  8506 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:34:11.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.871989  8506 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/data/instance:
18:34:11.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b47d36a83f4440eaac9ce006765394d3"
18:34:11.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:11 on dist-test-slave-dxnw"
18:34:11.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.873463  8506 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/wal/instance:
18:34:11.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b47d36a83f4440eaac9ce006765394d3"
18:34:11.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:11 on dist-test-slave-dxnw"
18:34:11.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.883680  8506 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.006s	sys 0.005s
18:34:11.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.893316  8531 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:34:11.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.899773  8506 fs_manager.cc:730] Time spent opening block manager: real 0.011s	user 0.001s	sys 0.003s
18:34:11.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.900656  8506 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/wal
18:34:11.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b47d36a83f4440eaac9ce006765394d3"
18:34:11.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:11 on dist-test-slave-dxnw"
18:34:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.901261  8506 fs_report.cc:389] FS layout report
18:34:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:34:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/wal
18:34:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/wal
18:34:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/data/data
18:34:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:34:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:34:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:34:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:34:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:34:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:34:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:34:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:34:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:34:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:34:11.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:34:11.920 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:11.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.990602  8506 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:34:11.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.992805  8506 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:34:11.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.993546  8506 kserver.cc:163] Server-wide thread pool size limit: 3276
18:34:11.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:11.997980  8506 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:34:12.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.004632  8506 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:34:12.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.004915  8506 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:34:12.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.005262  8506 ts_tablet_manager.cc:616] Registered 0 tablets
18:34:12.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.005465  8506 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:34:12.059 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:12.059 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:12.059 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:12.060 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:12.060 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:12.060 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:12.060 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:12.060 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:12.060 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:12.061 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:12.061 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:12.061 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:12.061 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:12.099 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:12.133 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:12.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:12.225 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:12.225 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:12.225 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:12.225 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:12.225 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:12.226 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:12.226 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:12.226 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:12.226 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:12.226 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:12.226 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:12.226 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:12.226 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:12.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.245278  8506 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.130:45405
18:34:12.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.245419  8644 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.200.130:45405 every 8 connection(s)
18:34:12.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.248245  8506 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/data/info.pb
18:34:12.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.250038  7970 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 8506
18:34:12.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.250579  7970 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-1/wal/instance
18:34:12.254 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:12.254 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:12.254 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:12.255 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:12.255 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:12.255 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:12.255 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:12.256 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:12.256 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:12.257 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:12.257 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:12.258 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:12.258 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:12.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.285006  7970 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:12.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:12.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/wal
18:34:12.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/data
18:34:12.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:34:12.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:34:12.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:34:12.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/logs
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/data/info.pb
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.200.131:0
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.7.200.131
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.200.131
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.7.200.190:40077,127.7.200.189:42349,127.7.200.188:38999
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.200.148:33865
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:34:12.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.311873  8646 heartbeater.cc:344] Connected to a master server at 127.7.200.189:42349
18:34:12.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.312412  8646 heartbeater.cc:461] Registering TS with master...
18:34:12.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.313228  8645 heartbeater.cc:344] Connected to a master server at 127.7.200.188:38999
18:34:12.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.313593  8645 heartbeater.cc:461] Registering TS with master...
18:34:12.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.313923  8646 heartbeater.cc:507] Master 127.7.200.189:42349 requested a full tablet report, sending...
18:34:12.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.314788  8645 heartbeater.cc:507] Master 127.7.200.188:38999 requested a full tablet report, sending...
18:34:12.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.317976  8237 ts_manager.cc:194] Registered new tserver with Master: b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405)
18:34:12.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.318974  8150 ts_manager.cc:194] Registered new tserver with Master: b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405)
18:34:12.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.320291  8237 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.7.200.130:34239
18:34:12.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.330459  8647 heartbeater.cc:344] Connected to a master server at 127.7.200.190:40077
18:34:12.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.330925  8647 heartbeater.cc:461] Registering TS with master...
18:34:12.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.331739  8647 heartbeater.cc:507] Master 127.7.200.190:40077 requested a full tablet report, sending...
18:34:12.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.334666  8019 ts_manager.cc:194] Registered new tserver with Master: b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405)
18:34:12.379 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:12.380 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:12.380 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:12.380 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:12.380 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:12.380 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:12.380 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:12.380 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:12.380 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:12.380 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:12.380 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:12.380 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:12.380 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:12.421 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:12.475 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:12.476 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:12.476 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:12.476 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:12.476 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:12.476 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:12.476 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:12.476 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:12.476 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:12.476 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:12.476 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:12.476 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:12.476 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:12.596 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:12.597 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:12.597 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:12.597 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:12.597 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:12.597 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:12.597 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:12.597 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:12.597 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:12.597 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:12.598 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:12.598 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:12.598 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:12.599 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:12.633 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:12.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:12.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:12.719746  8655 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:34:12.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:12.720430  8655 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:34:12.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:12.721024  8655 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:34:12.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:12.762701  8655 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:34:12.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:12.764168  8655 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.131
18:34:12.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.806169  8655 tablet_server_runner.cc:78] Tablet server non-default flags:
18:34:12.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:12.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.7.200.148:33865
18:34:12.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/data
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/wal
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.7.200.131:0
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/data/info.pb
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.7.200.131
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.7.200.190:40077,127.7.200.189:42349,127.7.200.188:38999
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.7.200.131
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/logs
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:34:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:34:12.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.807737  8655 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:34:12.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:12.809655  8655 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:34:12.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:12.824656  8661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:12.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:12.969 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:12.969 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:12.969 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:12.969 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:12.970 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:12.970 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:12.970 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:12.970 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:12.970 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:12.970 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:12.970 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:12.970 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:12.970 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:13.024 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:13.025 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:13.025 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:13.025 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:13.025 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:13.025 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:13.025 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:13.025 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:13.025 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:13.026 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:13.026 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:13.026 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:13.026 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:13.094 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:13.094 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:13.094 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:13.095 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:13.095 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:13.095 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:13.095 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:13.095 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:13.095 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:13.095 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:13.096 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:13.096 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:13.096 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:13.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:13.111 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:13.112 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:13.112 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:13.112 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:13.112 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:13.112 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:13.113 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:13.113 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:13.113 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:13.113 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:13.113 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:13.113 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:13.113 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:13.133 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:13.163 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:13.164 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:13.164 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:13.164 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:13.164 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:13.164 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:13.164 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:13.164 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:13.164 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:13.165 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:13.165 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:13.165 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:13.165 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:13.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:13.294 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:13.294 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:13.294 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:13.295 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:13.295 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:13.295 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:13.295 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:13.295 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:13.295 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:13.296 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:13.296 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:13.296 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:13.296 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:13.324769  8645 heartbeater.cc:499] Master 127.7.200.188:38999 was elected leader, sending a full tablet report...
18:34:13.394 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:13.394 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:13.394 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:13.395 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:13.395 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:13.395 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:13.395 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:13.395 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:13.395 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:13.396 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:13.396 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:13.396 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:13.396 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:13.424 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:13.564 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:13.565 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:13.565 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:13.566 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:13.566 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:13.566 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:13.566 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:13.566 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:13.566 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:13.567 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:13.567 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:13.567 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:13.567 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:13.575 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:13.575 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:13.575 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:13.576 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:13.576 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:13.576 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:13.576 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:13.577 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:13.577 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:13.577 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:13.577 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:13.577 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:13.577 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:13.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:13.600 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:13.600 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:13.600 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:13.601 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:13.601 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:13.601 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:13.601 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:13.601 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:13.601 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:13.602 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:13.602 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:13.602 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:13.602 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:13.634 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:13.654 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:13.655 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:13.655 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:13.655 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:13.655 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:13.655 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:13.656 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:13.656 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:13.656 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:13.656 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:13.656 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:13.656 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:13.656 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:13.658 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:13.658 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:13.658 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:13.658 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:13.659 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:13.659 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:13.659 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:13.659 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:13.659 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:13.659 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:13.659 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:13.659 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:13.659 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:13.678 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:13.678 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:13.678 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:13.679 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:13.679 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:13.679 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:13.679 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:13.679 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:13.679 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:13.679 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:13.679 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:13.679 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:13.679 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:13.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:13.921 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:13.921 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:13.921 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:13.921 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:13.921 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:13.922 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:13.922 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:13.922 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:13.922 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:13.922 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:13.922 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:13.922 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:13.922 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:13.923 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:14.062 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:14.062 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:14.062 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:14.063 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:14.064 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:14.064 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:14.064 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:14.064 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:14.064 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:14.065 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:14.065 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:14.065 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:14.065 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:14.074 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:14.074 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:14.074 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:14.075 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:14.075 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:14.075 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:14.075 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:14.075 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:14.075 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:14.075 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:14.075 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:14.075 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:14.075 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:14.075 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:14.075 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:14.075 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:14.076 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:14.076 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:14.076 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:14.076 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:14.076 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:14.076 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:14.077 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:14.077 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:14.077 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:14.077 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:14.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:14.133 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:14.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:14.216 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:14.217 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:14.217 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:14.217 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:14.217 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:14.217 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:14.217 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:14.217 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:14.217 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:14.218 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:14.218 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:14.218 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:14.218 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:14.423 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:14.459 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:14.460 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:14.460 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:14.461 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:14.461 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:14.461 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:14.462 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:14.462 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:14.462 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:14.462 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:14.462 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:14.462 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:14.462 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:14.581 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:14.581 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:14.581 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:14.581 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:14.581 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:14.581 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:14.582 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:14.582 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:14.582 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:14.582 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:14.582 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:14.582 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:14.582 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:14.596 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:14.596 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:14.597 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:14.597 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:14.597 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:14.597 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:14.597 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:14.597 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:14.597 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:14.597 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:14.597 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:14.597 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:14.597 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:14.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:14.637 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:14.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:14.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:14.228816  8660 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 8655
18:34:14.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:14.730896  8660 kernel_stack_watchdog.cc:198] Thread 8655 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
18:34:14.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:34:14.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:34:14.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:34:14.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:34:14.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:14.741101  8663 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1907 milliseconds
18:34:14.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:14.742589  8655 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.915s	user 0.654s	sys 1.151s
18:34:14.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:14.743400  8655 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.919s	user 0.655s	sys 1.151s
18:34:14.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:14.743294  8664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:14.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.743700  8655 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:34:14.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:12.827351  8662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.752640  8655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:34:14.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.755702  8655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:34:14.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.757308  8655 hybrid_clock.cc:648] HybridClock initialized: now 1783535654757238 us; error 64 us; skew 500 ppm
18:34:14.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.758332  8655 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:34:14.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.765657  8655 webserver.cc:534] Webserver started at http://127.7.200.131:43081/ using document root <none> and password file <none>
18:34:14.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.766651  8655 fs_manager.cc:362] Metadata directory not provided
18:34:14.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.766925  8655 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:34:14.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.767491  8655 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:34:14.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.772782  8655 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/data/instance:
18:34:14.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5e2eeb0ca41546d7bcaca3220385168e"
18:34:14.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:14 on dist-test-slave-dxnw"
18:34:14.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.774041  8655 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/wal/instance:
18:34:14.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5e2eeb0ca41546d7bcaca3220385168e"
18:34:14.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:14 on dist-test-slave-dxnw"
18:34:14.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.783537  8655 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.011s	sys 0.000s
18:34:14.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.791438  8673 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:34:14.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.792904  8655 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.001s	sys 0.002s
18:34:14.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.793458  8655 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/wal
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5e2eeb0ca41546d7bcaca3220385168e"
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:14 on dist-test-slave-dxnw"
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.793879  8655 fs_report.cc:389] FS layout report
18:34:14.794 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/wal
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/wal
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/data/data
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:34:14.794 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:34:14.794 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:34:14.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:34:14.795 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:14.795 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:14.795 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:14.795 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:14.795 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:14.795 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:14.795 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:14.795 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:14.795 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:14.795 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:14.814 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:14.815 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:14.815 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:14.815 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:14.815 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:14.815 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:14.815 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:14.815 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:14.815 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:14.815 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:14.815 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:14.815 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:14.815 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:14.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.850950  8655 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:34:14.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.852721  8655 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:34:14.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.853204  8655 kserver.cc:163] Server-wide thread pool size limit: 3276
18:34:14.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.856045  8655 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:34:14.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.861012  8655 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:34:14.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.861212  8655 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:34:14.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.861457  8655 ts_tablet_manager.cc:616] Registered 0 tablets
18:34:14.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:14.861641  8655 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:34:14.900 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:14.900 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:14.900 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:14.900 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:14.900 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:14.901 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:14.901 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:14.901 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:14.901 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:14.901 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:14.901 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:14.901 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:14.901 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:14.920 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:14.938 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:14.938 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:14.938 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:14.938 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:14.938 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:14.939 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:14.939 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:14.939 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:14.939 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:14.939 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:14.939 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:14.939 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:14.939 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:15.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.068827  8655 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.131:36157
18:34:15.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.068934  8785 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.200.131:36157 every 8 connection(s)
18:34:15.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.071936  8655 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/data/info.pb
18:34:15.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.080622  7970 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 8655
18:34:15.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.081224  7970 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster8813901772936423286/ts-2/wal/instance
18:34:15.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:15.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.133001  8786 heartbeater.cc:344] Connected to a master server at 127.7.200.188:38999
18:34:15.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.133694  8786 heartbeater.cc:461] Registering TS with master...
18:34:15.134 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:15.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.135156  8786 heartbeater.cc:507] Master 127.7.200.188:38999 requested a full tablet report, sending...
18:34:15.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.141067  8237 ts_manager.cc:194] Registered new tserver with Master: 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157)
18:34:15.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.142894  8237 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.7.200.131:56757
18:34:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.147841  8787 heartbeater.cc:344] Connected to a master server at 127.7.200.189:42349
18:34:15.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.148226  8787 heartbeater.cc:461] Registering TS with master...
18:34:15.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.149137  8787 heartbeater.cc:507] Master 127.7.200.189:42349 requested a full tablet report, sending...
18:34:15.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.152616  8150 ts_manager.cc:194] Registered new tserver with Master: 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157)
18:34:15.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.159344  8788 heartbeater.cc:344] Connected to a master server at 127.7.200.190:40077
18:34:15.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.159718  8788 heartbeater.cc:461] Registering TS with master...
18:34:15.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.160377  8788 heartbeater.cc:507] Master 127.7.200.190:40077 requested a full tablet report, sending...
18:34:15.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.163359  8019 ts_manager.cc:194] Registered new tserver with Master: 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157)
18:34:15.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.166121  7970 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
18:34:15.173 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:15.174 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:15.174 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:15.174 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:15.174 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:15.174 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:15.174 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:15.174 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:15.174 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:15.175 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:15.175 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:15.175 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:15.175 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:15.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:15.182 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:34:15.183 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

18:34:15.184 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.7.200.190"
      port: 40077
    }
    bound_http_address {
      host: "127.7.200.190"
      port: 40467
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.7.200.189"
      port: 42349
    }
    bound_http_address {
      host: "127.7.200.189"
      port: 46223
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.7.200.188"
      port: 38999
    }
    bound_http_address {
      host: "127.7.200.188"
      port: 43293
    }
  }
}

18:34:15.184 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

18:34:15.184 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.7.200.129"
      port: 33899
    }
    bound_http_address {
      host: "127.7.200.129"
      port: 44951
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.7.200.130"
      port: 45405
    }
    bound_http_address {
      host: "127.7.200.130"
      port: 36203
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.7.200.131"
      port: 36157
    }
    bound_http_address {
      host: "127.7.200.131"
      port: 43081
    }
  }
}

18:34:15.184 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
18:34:15.186 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:15.187 [DEBUG - main] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:15.188 [DEBUG - main] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:15.189 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.6.245.61:44495(127.6.245.61:44495)] Successfully connected to peer
18:34:15.189 [DEBUG - main] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:15.189 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.6.245.60:46787(127.6.245.60:46787)] Successfully connected to peer
18:34:15.193 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.6.245.62:36853(127.6.245.62:36853)] Successfully connected to peer
18:34:15.195 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.61
18:34:15.199 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.60
18:34:15.199 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.62
18:34:15.207 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:15.212 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:15.217 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:15.217 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc678cf5f, L:/127.0.0.1:56906 - R:/127.6.245.60:46787] using SASL/PLAIN
18:34:15.217 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x534b8be6, L:/127.0.0.1:53446 - R:/127.6.245.61:44495] using SASL/PLAIN
18:34:15.221 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x1e191d23, L:/127.0.0.1:41090 - R:/127.6.245.62:36853] using SASL/PLAIN
18:34:15.223 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:34:15.223 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=36), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [34ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: OK, [35ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: OK, deferred=null) after lookup
18:34:15.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.225550  7324 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56906:
18:34:15.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
18:34:15.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
18:34:15.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:34:15.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 3
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
18:34:15.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:34:15.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
18:34:15.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:34:15.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:34:15.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key3"
18:34:15.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:34:15.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
18:34:15.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 42
18:34:15.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:34:15.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
18:34:15.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:34:15.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:34:15.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:15.230382  7324 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
18:34:15.305 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:15.305 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:15.305 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:15.305 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:15.305 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:15.305 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:15.305 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:15.305 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:15.305 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:15.305 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:15.306 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:15.305 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:15.306 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:15.315 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table ffbf6c12abe4466485202b0208f6b095
18:34:15.335 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:15.335 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:15.335 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:15.335 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:15.335 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:15.335 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:15.335 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:15.336 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:15.336 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:15.336 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:15.335 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:15.336 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:15.336 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:15.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.407001  7754 tablet_service.cc:1511] Processing CreateTablet for tablet f77f28191ee54426a01bed4a9478ccd6 (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
18:34:15.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.407768  7750 tablet_service.cc:1511] Processing CreateTablet for tablet 2ffabd13bdc04d08879bc28dc62155f3 (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
18:34:15.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.408963  7754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77f28191ee54426a01bed4a9478ccd6. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.411051  7752 tablet_service.cc:1511] Processing CreateTablet for tablet a2bab9e2604a4a9597798acdaf04474c (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
18:34:15.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.411760  7751 tablet_service.cc:1511] Processing CreateTablet for tablet 109afb7829a5484a844e346132a776be (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
18:34:15.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.412349  7752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2bab9e2604a4a9597798acdaf04474c. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.405975  7753 tablet_service.cc:1511] Processing CreateTablet for tablet a84c5b3ea6b149718b3ae30a0ce84a17 (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
18:34:15.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.414637  7750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ffabd13bdc04d08879bc28dc62155f3. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.416492  7751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 109afb7829a5484a844e346132a776be. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.420 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:15.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.423996  7753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a84c5b3ea6b149718b3ae30a0ce84a17. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.426343  7755 tablet_service.cc:1511] Processing CreateTablet for tablet c39b66751cde487c94b99b60adc93d53 (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
18:34:15.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.428419  7755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c39b66751cde487c94b99b60adc93d53. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.463555  7585 tablet_service.cc:1511] Processing CreateTablet for tablet a2bab9e2604a4a9597798acdaf04474c (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
18:34:15.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.465505  7585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2bab9e2604a4a9597798acdaf04474c. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.467125  7592 tablet_service.cc:1511] Processing CreateTablet for tablet c39b66751cde487c94b99b60adc93d53 (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
18:34:15.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.468729  7592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c39b66751cde487c94b99b60adc93d53. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.471170  7587 tablet_service.cc:1511] Processing CreateTablet for tablet a84c5b3ea6b149718b3ae30a0ce84a17 (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
18:34:15.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.472579  7587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a84c5b3ea6b149718b3ae30a0ce84a17. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.475 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:15.475 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:15.475 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:15.476 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:15.476 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:15.476 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:15.476 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:15.476 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:15.476 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:15.476 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:15.476 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:15.476 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:15.477 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:15.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.474366  7589 tablet_service.cc:1511] Processing CreateTablet for tablet f77f28191ee54426a01bed4a9478ccd6 (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
18:34:15.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.479123  7589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77f28191ee54426a01bed4a9478ccd6. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.484302  7577 tablet_service.cc:1511] Processing CreateTablet for tablet 2ffabd13bdc04d08879bc28dc62155f3 (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
18:34:15.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.485417  7577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ffabd13bdc04d08879bc28dc62155f3. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.493348  7579 tablet_service.cc:1511] Processing CreateTablet for tablet 109afb7829a5484a844e346132a776be (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
18:34:15.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.494493  7579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 109afb7829a5484a844e346132a776be. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.499208  7890 tablet_service.cc:1511] Processing CreateTablet for tablet 2ffabd13bdc04d08879bc28dc62155f3 (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
18:34:15.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.501274  7890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ffabd13bdc04d08879bc28dc62155f3. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.502985  7893 tablet_service.cc:1511] Processing CreateTablet for tablet a84c5b3ea6b149718b3ae30a0ce84a17 (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
18:34:15.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.504411  7893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a84c5b3ea6b149718b3ae30a0ce84a17. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.506 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:15.506 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:15.506 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:15.507 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:15.507 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:15.507 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:15.507 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:15.507 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:15.507 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:15.507 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:15.507 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:15.507 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:15.507 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:15.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.505724  7892 tablet_service.cc:1511] Processing CreateTablet for tablet a2bab9e2604a4a9597798acdaf04474c (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
18:34:15.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.506737  7892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2bab9e2604a4a9597798acdaf04474c. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.508760  7894 tablet_service.cc:1511] Processing CreateTablet for tablet f77f28191ee54426a01bed4a9478ccd6 (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
18:34:15.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.509771  7894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77f28191ee54426a01bed4a9478ccd6. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.510594  7891 tablet_service.cc:1511] Processing CreateTablet for tablet 109afb7829a5484a844e346132a776be (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
18:34:15.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.511706  7891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 109afb7829a5484a844e346132a776be. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.512827  7895 tablet_service.cc:1511] Processing CreateTablet for tablet c39b66751cde487c94b99b60adc93d53 (DEFAULT_TABLE table=replication_test_table [id=ffbf6c12abe4466485202b0208f6b095]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
18:34:15.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.522572  7895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c39b66751cde487c94b99b60adc93d53. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:15.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.541210  8818 tablet_bootstrap.cc:492] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01: Bootstrap starting.
18:34:15.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.564613  8818 tablet_bootstrap.cc:654] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01: Neither blocks nor log segments found. Creating new log.
18:34:15.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.577211  8818 log.cc:826] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01: Log is configured to *not* fsync() on all Append() calls
18:34:15.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.594357  8818 tablet_bootstrap.cc:492] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01: No bootstrap required, opened a new log
18:34:15.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.595204  8818 ts_tablet_manager.cc:1403] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01: Time spent bootstrapping tablet: real 0.055s	user 0.022s	sys 0.004s
18:34:15.599 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:15.633 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:15.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.634822  8818 raft_consensus.cc:359] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.635865  8818 raft_consensus.cc:385] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:15.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.636067  8819 tablet_bootstrap.cc:492] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f: Bootstrap starting.
18:34:15.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.636178  8818 raft_consensus.cc:740] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f76c37f74624d8aa5906e77684cad01, State: Initialized, Role: FOLLOWER
18:34:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.640611  8818 consensus_queue.cc:260] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.664176  8819 tablet_bootstrap.cc:654] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f: Neither blocks nor log segments found. Creating new log.
18:34:15.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.669646  8822 tablet_bootstrap.cc:492] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0: Bootstrap starting.
18:34:15.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.671981  8819 log.cc:826] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f: Log is configured to *not* fsync() on all Append() calls
18:34:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.674265  8818 ts_tablet_manager.cc:1434] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01: Time spent starting tablet: real 0.079s	user 0.048s	sys 0.016s
18:34:15.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:15.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.680794  8818 tablet_bootstrap.cc:492] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01: Bootstrap starting.
18:34:15.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.688174  8818 tablet_bootstrap.cc:654] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01: Neither blocks nor log segments found. Creating new log.
18:34:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.693946  8822 tablet_bootstrap.cc:654] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0: Neither blocks nor log segments found. Creating new log.
18:34:15.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.703109  8819 tablet_bootstrap.cc:492] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f: No bootstrap required, opened a new log
18:34:15.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.703791  8819 ts_tablet_manager.cc:1403] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.005s
18:34:15.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.706036  8822 log.cc:826] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0: Log is configured to *not* fsync() on all Append() calls
18:34:15.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.717941  8818 tablet_bootstrap.cc:492] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01: No bootstrap required, opened a new log
18:34:15.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.718405  8818 ts_tablet_manager.cc:1403] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.019s
18:34:15.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.721657  8818 raft_consensus.cc:359] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.722157  8818 raft_consensus.cc:385] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:15.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.722374  8818 raft_consensus.cc:740] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f76c37f74624d8aa5906e77684cad01, State: Initialized, Role: FOLLOWER
18:34:15.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.723069  8818 consensus_queue.cc:260] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.725067  8818 ts_tablet_manager.cc:1434] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
18:34:15.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.725957  8818 tablet_bootstrap.cc:492] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01: Bootstrap starting.
18:34:15.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.733184  8818 tablet_bootstrap.cc:654] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01: Neither blocks nor log segments found. Creating new log.
18:34:15.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.734660  8822 tablet_bootstrap.cc:492] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0: No bootstrap required, opened a new log
18:34:15.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.735373  8822 ts_tablet_manager.cc:1403] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.005s
18:34:15.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:15.752650  7827 tablet.cc:2406] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:34:15.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.757304  8821 raft_consensus.cc:493] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:15.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.758124  8821 raft_consensus.cc:515] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.760 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:15.760 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:15.760 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:15.760 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:15.760 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:15.760 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:15.760 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:15.760 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:15.760 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:15.761 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:15.761 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:15.761 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:15.761 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:15.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.778810  8819 raft_consensus.cc:359] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.780704  8821 leader_election.cc:290] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053), 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063)
18:34:15.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.780539  8819 raft_consensus.cc:385] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:15.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.782243  8819 raft_consensus.cc:740] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4d808b605e47d0a90dce37fd8ecb5f, State: Initialized, Role: FOLLOWER
18:34:15.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.784363  8819 consensus_queue.cc:260] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.823629  8830 raft_consensus.cc:493] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:15.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.826436  8830 raft_consensus.cc:515] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.830051  8822 raft_consensus.cc:359] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.833730  8822 raft_consensus.cc:385] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:15.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.835958  8819 ts_tablet_manager.cc:1434] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f: Time spent starting tablet: real 0.132s	user 0.027s	sys 0.011s
18:34:15.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.850149  8819 tablet_bootstrap.cc:492] T a2bab9e2604a4a9597798acdaf04474c P 2b4d808b605e47d0a90dce37fd8ecb5f: Bootstrap starting.
18:34:15.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.851377  8822 raft_consensus.cc:740] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d9e0a8932940ac9e0041e68e8c7ff0, State: Initialized, Role: FOLLOWER
18:34:15.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.853318  8822 consensus_queue.cc:260] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.862944  8821 raft_consensus.cc:493] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:15.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.863493  8821 raft_consensus.cc:515] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.866003  8821 leader_election.cc:290] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053), 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063)
18:34:15.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.866715  8830 leader_election.cc:290] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f76c37f74624d8aa5906e77684cad01 (127.6.245.2:40933), 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063)
18:34:15.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.882179  8819 tablet_bootstrap.cc:654] T a2bab9e2604a4a9597798acdaf04474c P 2b4d808b605e47d0a90dce37fd8ecb5f: Neither blocks nor log segments found. Creating new log.
18:34:15.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.885782  8818 tablet_bootstrap.cc:492] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01: No bootstrap required, opened a new log
18:34:15.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.886269  8818 ts_tablet_manager.cc:1403] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01: Time spent bootstrapping tablet: real 0.160s	user 0.043s	sys 0.102s
18:34:15.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.889267  8818 raft_consensus.cc:359] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.889973  8818 raft_consensus.cc:385] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:15.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.890270  8818 raft_consensus.cc:740] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f76c37f74624d8aa5906e77684cad01, State: Initialized, Role: FOLLOWER
18:34:15.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.891050  8818 consensus_queue.cc:260] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.893208  8818 ts_tablet_manager.cc:1434] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
18:34:15.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.894055  8818 tablet_bootstrap.cc:492] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01: Bootstrap starting.
18:34:15.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.901018  8818 tablet_bootstrap.cc:654] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01: Neither blocks nor log segments found. Creating new log.
18:34:15.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.914171  8818 tablet_bootstrap.cc:492] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01: No bootstrap required, opened a new log
18:34:15.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.914628  8818 ts_tablet_manager.cc:1403] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.002s
18:34:15.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.917659  8818 raft_consensus.cc:359] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.918536  8818 raft_consensus.cc:385] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:15.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.919006  8818 raft_consensus.cc:740] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f76c37f74624d8aa5906e77684cad01, State: Initialized, Role: FOLLOWER
18:34:15.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.919840  8821 raft_consensus.cc:493] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:15.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.919863  8818 consensus_queue.cc:260] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.920 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:15.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.920326  8821 raft_consensus.cc:515] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.930012  8818 ts_tablet_manager.cc:1434] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.009s
18:34:15.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.930989  8818 tablet_bootstrap.cc:492] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01: Bootstrap starting.
18:34:15.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.938832  8818 tablet_bootstrap.cc:654] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01: Neither blocks nor log segments found. Creating new log.
18:34:15.950 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:15.950 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:15.950 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:15.950 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:15.950 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:15.950 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:15.950 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:15.950 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:15.950 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:15.951 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:15.951 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:15.951 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:15.951 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:15.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.934342  8821 leader_election.cc:290] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053), 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063)
18:34:15.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.962178  8819 tablet_bootstrap.cc:492] T a2bab9e2604a4a9597798acdaf04474c P 2b4d808b605e47d0a90dce37fd8ecb5f: No bootstrap required, opened a new log
18:34:15.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.968331  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c5b3ea6b149718b3ae30a0ce84a17" candidate_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f76c37f74624d8aa5906e77684cad01" is_pre_election: true
18:34:15.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:15.971148  7475 leader_election.cc:343] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f76c37f74624d8aa5906e77684cad01 (127.6.245.2:40933): Illegal state: must be running to vote when last-logged opid is not known
18:34:15.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.972509  8819 ts_tablet_manager.cc:1403] T a2bab9e2604a4a9597798acdaf04474c P 2b4d808b605e47d0a90dce37fd8ecb5f: Time spent bootstrapping tablet: real 0.124s	user 0.009s	sys 0.005s
18:34:15.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.981228  8819 raft_consensus.cc:359] T a2bab9e2604a4a9597798acdaf04474c P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:15.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.989280  8819 raft_consensus.cc:385] T a2bab9e2604a4a9597798acdaf04474c P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:15.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.991293  7634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2bab9e2604a4a9597798acdaf04474c" candidate_uuid: "2f76c37f74624d8aa5906e77684cad01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" is_pre_election: true
18:34:15.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.992408  8819 raft_consensus.cc:740] T a2bab9e2604a4a9597798acdaf04474c P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4d808b605e47d0a90dce37fd8ecb5f, State: Initialized, Role: FOLLOWER
18:34:15.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.993855  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ffabd13bdc04d08879bc28dc62155f3" candidate_uuid: "2f76c37f74624d8aa5906e77684cad01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" is_pre_election: true
18:34:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.992354  7633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109afb7829a5484a844e346132a776be" candidate_uuid: "2f76c37f74624d8aa5906e77684cad01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" is_pre_election: true
18:34:16.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.001569  7711 leader_election.cc:343] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053): Illegal state: must be running to vote when last-logged opid is not known
18:34:16.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.004065  7711 leader_election.cc:343] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053): Illegal state: must be running to vote when last-logged opid is not known
18:34:16.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:15.999873  8819 consensus_queue.cc:260] T a2bab9e2604a4a9597798acdaf04474c P 2b4d808b605e47d0a90dce37fd8ecb5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.005573  7634 raft_consensus.cc:2468] T a2bab9e2604a4a9597798acdaf04474c P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f76c37f74624d8aa5906e77684cad01 in term 0.
18:34:16.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.010900  7711 leader_election.cc:304] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4d808b605e47d0a90dce37fd8ecb5f, 2f76c37f74624d8aa5906e77684cad01; no voters: 
18:34:16.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.012463  8821 raft_consensus.cc:2804] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:34:16.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.012940  8821 raft_consensus.cc:493] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:34:16.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.013425  8821 raft_consensus.cc:3060] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Advancing to term 1
18:34:16.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.016870  7682 tablet.cc:2406] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:34:16.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.030438  7915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c5b3ea6b149718b3ae30a0ce84a17" candidate_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" is_pre_election: true
18:34:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.034755  7474 leader_election.cc:343] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063): Illegal state: must be running to vote when last-logged opid is not known
18:34:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.035300  7474 leader_election.cc:304] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4d808b605e47d0a90dce37fd8ecb5f; no voters: 2f76c37f74624d8aa5906e77684cad01, 82d9e0a8932940ac9e0041e68e8c7ff0
18:34:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.036867  8830 raft_consensus.cc:2749] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:34:16.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.038885  8819 ts_tablet_manager.cc:1434] T a2bab9e2604a4a9597798acdaf04474c P 2b4d808b605e47d0a90dce37fd8ecb5f: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.001s
18:34:16.044 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:16.044 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:16.044 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:16.045 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:16.045 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:16.045 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:16.045 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:16.045 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:16.045 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:16.046 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:16.046 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:16.046 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:16.046 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:16.052 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:16.052 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:16.052 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:16.053 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:16.053 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:16.053 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:16.053 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:16.053 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:16.053 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:16.054 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:16.054 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:16.054 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:16.054 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:16.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.059201  8839 raft_consensus.cc:493] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:16.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.060263  8839 raft_consensus.cc:515] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.068130  8819 tablet_bootstrap.cc:492] T 2ffabd13bdc04d08879bc28dc62155f3 P 2b4d808b605e47d0a90dce37fd8ecb5f: Bootstrap starting.
18:34:16.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.081727  8819 tablet_bootstrap.cc:654] T 2ffabd13bdc04d08879bc28dc62155f3 P 2b4d808b605e47d0a90dce37fd8ecb5f: Neither blocks nor log segments found. Creating new log.
18:34:16.099 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:16.100 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:16.100 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:16.101 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:16.101 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:16.101 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:16.101 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:16.101 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:16.101 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:16.101 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:16.101 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:16.101 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:16.101 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:16.102 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:16.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.103121  7915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2bab9e2604a4a9597798acdaf04474c" candidate_uuid: "2f76c37f74624d8aa5906e77684cad01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" is_pre_election: true
18:34:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.104592  7914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109afb7829a5484a844e346132a776be" candidate_uuid: "2f76c37f74624d8aa5906e77684cad01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" is_pre_election: true
18:34:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.108992  8822 ts_tablet_manager.cc:1434] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0: Time spent starting tablet: real 0.373s	user 0.035s	sys 0.021s
18:34:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.109820  7913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ffabd13bdc04d08879bc28dc62155f3" candidate_uuid: "2f76c37f74624d8aa5906e77684cad01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" is_pre_election: true
18:34:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.110754  7913 raft_consensus.cc:2468] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f76c37f74624d8aa5906e77684cad01 in term 0.
18:34:16.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.117120  8822 tablet_bootstrap.cc:492] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0: Bootstrap starting.
18:34:16.133 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:16.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.133687  8822 tablet_bootstrap.cc:654] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0: Neither blocks nor log segments found. Creating new log.
18:34:16.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.107898  7710 leader_election.cc:343] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063): Illegal state: must be running to vote when last-logged opid is not known
18:34:16.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.144586  7710 leader_election.cc:343] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063): Illegal state: must be running to vote when last-logged opid is not known
18:34:16.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.145071  7710 leader_election.cc:304] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f76c37f74624d8aa5906e77684cad01; no voters: 2b4d808b605e47d0a90dce37fd8ecb5f, 82d9e0a8932940ac9e0041e68e8c7ff0
18:34:16.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.145953  8819 tablet_bootstrap.cc:492] T 2ffabd13bdc04d08879bc28dc62155f3 P 2b4d808b605e47d0a90dce37fd8ecb5f: No bootstrap required, opened a new log
18:34:16.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.146402  8836 raft_consensus.cc:2749] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:34:16.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.146721  8819 ts_tablet_manager.cc:1403] T 2ffabd13bdc04d08879bc28dc62155f3 P 2b4d808b605e47d0a90dce37fd8ecb5f: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.004s
18:34:16.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.146642  7710 leader_election.cc:304] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f76c37f74624d8aa5906e77684cad01, 82d9e0a8932940ac9e0041e68e8c7ff0; no voters: 2b4d808b605e47d0a90dce37fd8ecb5f
18:34:16.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.148325  8836 raft_consensus.cc:2804] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:34:16.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.148664  8836 raft_consensus.cc:493] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:34:16.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.149005  8836 raft_consensus.cc:3060] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Advancing to term 1
18:34:16.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.090989  8821 raft_consensus.cc:515] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.153275  8786 heartbeater.cc:499] Master 127.7.200.188:38999 was elected leader, sending a full tablet report...
18:34:16.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.149649  8819 raft_consensus.cc:359] T 2ffabd13bdc04d08879bc28dc62155f3 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.156396  8819 raft_consensus.cc:385] T 2ffabd13bdc04d08879bc28dc62155f3 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:16.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.157336  8819 raft_consensus.cc:740] T 2ffabd13bdc04d08879bc28dc62155f3 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4d808b605e47d0a90dce37fd8ecb5f, State: Initialized, Role: FOLLOWER
18:34:16.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.152475  8839 leader_election.cc:290] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053), 2f76c37f74624d8aa5906e77684cad01 (127.6.245.2:40933)
18:34:16.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.161080  8836 raft_consensus.cc:515] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:16.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.158072  8819 consensus_queue.cc:260] T 2ffabd13bdc04d08879bc28dc62155f3 P 2b4d808b605e47d0a90dce37fd8ecb5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.163272  8836 leader_election.cc:290] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053), 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063)
18:34:16.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.164527  7634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ffabd13bdc04d08879bc28dc62155f3" candidate_uuid: "2f76c37f74624d8aa5906e77684cad01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f"
18:34:16.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.165151  7634 raft_consensus.cc:3060] T 2ffabd13bdc04d08879bc28dc62155f3 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Advancing to term 1
18:34:16.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.166311  8818 tablet_bootstrap.cc:492] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01: No bootstrap required, opened a new log
18:34:16.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.166926  8818 ts_tablet_manager.cc:1403] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01: Time spent bootstrapping tablet: real 0.236s	user 0.084s	sys 0.119s
18:34:16.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.168197  8819 ts_tablet_manager.cc:1434] T 2ffabd13bdc04d08879bc28dc62155f3 P 2b4d808b605e47d0a90dce37fd8ecb5f: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
18:34:16.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.164362  7913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ffabd13bdc04d08879bc28dc62155f3" candidate_uuid: "2f76c37f74624d8aa5906e77684cad01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0"
18:34:16.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.170099  7913 raft_consensus.cc:3060] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Advancing to term 1
18:34:16.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.169654  8818 raft_consensus.cc:359] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.170498  8818 raft_consensus.cc:385] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:16.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.170776  8818 raft_consensus.cc:740] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f76c37f74624d8aa5906e77684cad01, State: Initialized, Role: FOLLOWER
18:34:16.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.171515  8818 consensus_queue.cc:260] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.174134  8818 ts_tablet_manager.cc:1434] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
18:34:16.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.175062  8818 tablet_bootstrap.cc:492] T f77f28191ee54426a01bed4a9478ccd6 P 2f76c37f74624d8aa5906e77684cad01: Bootstrap starting.
18:34:16.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.178443  8822 tablet_bootstrap.cc:492] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0: No bootstrap required, opened a new log
18:34:16.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.178916  8822 ts_tablet_manager.cc:1403] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.002s
18:34:16.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.182447  7913 raft_consensus.cc:2468] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f76c37f74624d8aa5906e77684cad01 in term 1.
18:34:16.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.182649  8818 tablet_bootstrap.cc:654] T f77f28191ee54426a01bed4a9478ccd6 P 2f76c37f74624d8aa5906e77684cad01: Neither blocks nor log segments found. Creating new log.
18:34:16.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.183902  7710 leader_election.cc:304] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f76c37f74624d8aa5906e77684cad01, 82d9e0a8932940ac9e0041e68e8c7ff0; no voters: 
18:34:16.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.184873  8836 raft_consensus.cc:2804] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [term 1 FOLLOWER]: Leader election won for term 1
18:34:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.183739  8819 tablet_bootstrap.cc:492] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f: Bootstrap starting.
18:34:16.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.192911  7633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2bab9e2604a4a9597798acdaf04474c" candidate_uuid: "2f76c37f74624d8aa5906e77684cad01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f"
18:34:16.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.193439  7633 raft_consensus.cc:3060] T a2bab9e2604a4a9597798acdaf04474c P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Advancing to term 1
18:34:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.200948  7913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2bab9e2604a4a9597798acdaf04474c" candidate_uuid: "2f76c37f74624d8aa5906e77684cad01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0"
18:34:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.201359  7633 raft_consensus.cc:2468] T a2bab9e2604a4a9597798acdaf04474c P 2b4d808b605e47d0a90dce37fd8ecb5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f76c37f74624d8aa5906e77684cad01 in term 1.
18:34:16.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.182555  8822 raft_consensus.cc:359] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.202425  7711 leader_election.cc:304] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4d808b605e47d0a90dce37fd8ecb5f, 2f76c37f74624d8aa5906e77684cad01; no voters: 
18:34:16.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.202705  8822 raft_consensus.cc:385] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:16.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.203050  7710 leader_election.cc:343] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063): Illegal state: must be running to vote when last-logged opid is not known
18:34:16.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.202996  8822 raft_consensus.cc:740] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d9e0a8932940ac9e0041e68e8c7ff0, State: Initialized, Role: FOLLOWER
18:34:16.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.205660  8822 consensus_queue.cc:260] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.209362  8822 ts_tablet_manager.cc:1434] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
18:34:16.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.204779  8821 leader_election.cc:290] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053), 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063)
18:34:16.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.213747  8836 raft_consensus.cc:697] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [term 1 LEADER]: Becoming Leader. State: Replica: 2f76c37f74624d8aa5906e77684cad01, State: Running, Role: LEADER
18:34:16.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.214804  8836 consensus_queue.cc:237] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.214432  7634 raft_consensus.cc:2468] T 2ffabd13bdc04d08879bc28dc62155f3 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f76c37f74624d8aa5906e77684cad01 in term 1.
18:34:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.216670  8821 raft_consensus.cc:2804] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [term 1 FOLLOWER]: Leader election won for term 1
18:34:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.219357  8819 tablet_bootstrap.cc:654] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f: Neither blocks nor log segments found. Creating new log.
18:34:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.222731  8822 tablet_bootstrap.cc:492] T f77f28191ee54426a01bed4a9478ccd6 P 82d9e0a8932940ac9e0041e68e8c7ff0: Bootstrap starting.
18:34:16.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.218998  8818 tablet_bootstrap.cc:492] T f77f28191ee54426a01bed4a9478ccd6 P 2f76c37f74624d8aa5906e77684cad01: No bootstrap required, opened a new log
18:34:16.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.241083  8818 ts_tablet_manager.cc:1403] T f77f28191ee54426a01bed4a9478ccd6 P 2f76c37f74624d8aa5906e77684cad01: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.000s
18:34:16.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.217437  8821 raft_consensus.cc:697] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [term 1 LEADER]: Becoming Leader. State: Replica: 2f76c37f74624d8aa5906e77684cad01, State: Running, Role: LEADER
18:34:16.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.244277  8818 raft_consensus.cc:359] T f77f28191ee54426a01bed4a9478ccd6 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.245101  8818 raft_consensus.cc:385] T f77f28191ee54426a01bed4a9478ccd6 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:16.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.245402  8818 raft_consensus.cc:740] T f77f28191ee54426a01bed4a9478ccd6 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f76c37f74624d8aa5906e77684cad01, State: Initialized, Role: FOLLOWER
18:34:16.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.246361  8818 consensus_queue.cc:260] T f77f28191ee54426a01bed4a9478ccd6 P 2f76c37f74624d8aa5906e77684cad01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.245561  8821 consensus_queue.cc:237] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.249280  8818 ts_tablet_manager.cc:1434] T f77f28191ee54426a01bed4a9478ccd6 P 2f76c37f74624d8aa5906e77684cad01: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
18:34:16.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.252441  8819 tablet_bootstrap.cc:492] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f: No bootstrap required, opened a new log
18:34:16.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.252883  8819 ts_tablet_manager.cc:1403] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.004s
18:34:16.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.258900  8819 raft_consensus.cc:359] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.259757  8819 raft_consensus.cc:385] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:16.260 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:16.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.260053  8819 raft_consensus.cc:740] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4d808b605e47d0a90dce37fd8ecb5f, State: Initialized, Role: FOLLOWER
18:34:16.260 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:16.260 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:16.261 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:16.261 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:16.261 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:16.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.260869  8819 consensus_queue.cc:260] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.261 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:16.261 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:16.261 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:16.262 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:16.262 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:16.262 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:16.262 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:16.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.262974  8819 ts_tablet_manager.cc:1434] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
18:34:16.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.263866  8819 tablet_bootstrap.cc:492] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f: Bootstrap starting.
18:34:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.283224  8830 raft_consensus.cc:493] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.283754  8830 raft_consensus.cc:515] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.288645  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77f28191ee54426a01bed4a9478ccd6" candidate_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f76c37f74624d8aa5906e77684cad01" is_pre_election: true
18:34:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.289286  7775 raft_consensus.cc:2468] T f77f28191ee54426a01bed4a9478ccd6 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4d808b605e47d0a90dce37fd8ecb5f in term 0.
18:34:16.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.290608  8819 tablet_bootstrap.cc:654] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f: Neither blocks nor log segments found. Creating new log.
18:34:16.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.294020  8839 raft_consensus.cc:493] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:16.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.296643  7913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77f28191ee54426a01bed4a9478ccd6" candidate_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" is_pre_election: true
18:34:16.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.295181  8839 raft_consensus.cc:515] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.303603  8839 leader_election.cc:290] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053), 2f76c37f74624d8aa5906e77684cad01 (127.6.245.2:40933)
18:34:16.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.291636  7475 leader_election.cc:304] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4d808b605e47d0a90dce37fd8ecb5f, 2f76c37f74624d8aa5906e77684cad01; no voters: 
18:34:16.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.305326  7474 leader_election.cc:343] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063): Illegal state: must be running to vote when last-logged opid is not known
18:34:16.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.306357  8829 raft_consensus.cc:2804] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Leader pre-election won for term 1
18:34:16.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.306758  8829 raft_consensus.cc:493] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:34:16.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.307103  8829 raft_consensus.cc:3060] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Advancing to term 1
18:34:16.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.291774  8830 leader_election.cc:290] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f76c37f74624d8aa5906e77684cad01 (127.6.245.2:40933), 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063)
18:34:16.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.318621  7966 tablet.cc:2406] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:34:16.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.324695  8829 raft_consensus.cc:515] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.328495  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77f28191ee54426a01bed4a9478ccd6" candidate_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f76c37f74624d8aa5906e77684cad01"
18:34:16.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.329098  7775 raft_consensus.cc:3060] T f77f28191ee54426a01bed4a9478ccd6 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Advancing to term 1
18:34:16.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.342120  7775 raft_consensus.cc:2468] T f77f28191ee54426a01bed4a9478ccd6 P 2f76c37f74624d8aa5906e77684cad01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4d808b605e47d0a90dce37fd8ecb5f in term 1.
18:34:16.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.343823  7475 leader_election.cc:304] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4d808b605e47d0a90dce37fd8ecb5f, 2f76c37f74624d8aa5906e77684cad01; no voters: 
18:34:16.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.345638  8830 raft_consensus.cc:2804] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 1 FOLLOWER]: Leader election won for term 1
18:34:16.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.355239  7711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.245.1:39053, user_credentials={real_user=slave}} blocked reactor thread for 152708us
18:34:16.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.354382  8830 raft_consensus.cc:697] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 1 LEADER]: Becoming Leader. State: Replica: 2b4d808b605e47d0a90dce37fd8ecb5f, State: Running, Role: LEADER
18:34:16.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.358134  8830 consensus_queue.cc:237] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.361169  8846 raft_consensus.cc:493] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.361562  8836 raft_consensus.cc:493] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.361678  8846 raft_consensus.cc:515] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.361989  8836 raft_consensus.cc:515] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.363888  8836 leader_election.cc:290] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053), 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063)
18:34:16.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.366472  7914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b66751cde487c94b99b60adc93d53" candidate_uuid: "2f76c37f74624d8aa5906e77684cad01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" is_pre_election: true
18:34:16.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.367412  8846 leader_election.cc:290] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053), 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063)
18:34:16.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.369220  7710 leader_election.cc:343] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063): Illegal state: must be running to vote when last-logged opid is not known
18:34:16.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.369546  7913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c5b3ea6b149718b3ae30a0ce84a17" candidate_uuid: "2f76c37f74624d8aa5906e77684cad01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" is_pre_election: true
18:34:16.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.371063  7710 leader_election.cc:343] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063): Illegal state: must be running to vote when last-logged opid is not known
18:34:16.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.373976  7633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b66751cde487c94b99b60adc93d53" candidate_uuid: "2f76c37f74624d8aa5906e77684cad01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" is_pre_election: true
18:34:16.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.374975  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ffabd13bdc04d08879bc28dc62155f3" candidate_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f76c37f74624d8aa5906e77684cad01" is_pre_election: true
18:34:16.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.379587  7634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c5b3ea6b149718b3ae30a0ce84a17" candidate_uuid: "2f76c37f74624d8aa5906e77684cad01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" is_pre_election: true
18:34:16.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.380074  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109afb7829a5484a844e346132a776be" candidate_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f76c37f74624d8aa5906e77684cad01" is_pre_election: true
18:34:16.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.380368  7711 leader_election.cc:343] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053): Illegal state: must be running to vote when last-logged opid is not known
18:34:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.380369  7634 raft_consensus.cc:2468] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f76c37f74624d8aa5906e77684cad01 in term 0.
18:34:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.380774  7773 raft_consensus.cc:2468] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82d9e0a8932940ac9e0041e68e8c7ff0 in term 0.
18:34:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.380837  7711 leader_election.cc:304] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f76c37f74624d8aa5906e77684cad01; no voters: 2b4d808b605e47d0a90dce37fd8ecb5f, 82d9e0a8932940ac9e0041e68e8c7ff0
18:34:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.384197  8821 raft_consensus.cc:2749] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:34:16.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.387326  7323 catalog_manager.cc:5696] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f76c37f74624d8aa5906e77684cad01 (127.6.245.2). New cstate: current_term: 1 leader_uuid: "2f76c37f74624d8aa5906e77684cad01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } health_report { overall_health: UNKNOWN } } }
18:34:16.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.390107  7323 catalog_manager.cc:5696] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f76c37f74624d8aa5906e77684cad01 (127.6.245.2). New cstate: current_term: 1 leader_uuid: "2f76c37f74624d8aa5906e77684cad01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } health_report { overall_health: UNKNOWN } } }
18:34:16.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.397585  8829 leader_election.cc:290] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [CANDIDATE]: Term 1 election: Requested vote from peers 2f76c37f74624d8aa5906e77684cad01 (127.6.245.2:40933), 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063)
18:34:16.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.398746  8822 tablet_bootstrap.cc:654] T f77f28191ee54426a01bed4a9478ccd6 P 82d9e0a8932940ac9e0041e68e8c7ff0: Neither blocks nor log segments found. Creating new log.
18:34:16.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.399176  7711 leader_election.cc:304] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4d808b605e47d0a90dce37fd8ecb5f, 2f76c37f74624d8aa5906e77684cad01; no voters: 82d9e0a8932940ac9e0041e68e8c7ff0
18:34:16.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.398561  7851 leader_election.cc:304] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f76c37f74624d8aa5906e77684cad01, 82d9e0a8932940ac9e0041e68e8c7ff0; no voters: 
18:34:16.407 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:16.407 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:16.408 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:16.408 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:16.408 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:16.408 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:16.409 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:16.409 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:16.409 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:16.409 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:16.409 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:16.410 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:16.410 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:16.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.401767  7913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77f28191ee54426a01bed4a9478ccd6" candidate_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0"
18:34:16.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.402690  8846 raft_consensus.cc:2804] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:34:16.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.404243  8846 raft_consensus.cc:493] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:34:16.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.404536  8846 raft_consensus.cc:3060] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Advancing to term 1
18:34:16.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.408017  8819 tablet_bootstrap.cc:492] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f: No bootstrap required, opened a new log
18:34:16.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.408483  8819 ts_tablet_manager.cc:1403] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f: Time spent bootstrapping tablet: real 0.145s	user 0.005s	sys 0.008s
18:34:16.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.414487  7474 leader_election.cc:343] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063): Illegal state: must be running to vote when last-logged opid is not known
18:34:16.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.415830  8819 raft_consensus.cc:359] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.418530  8819 raft_consensus.cc:385] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:16.419 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:16.419 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:16.419 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:16.420 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:16.423 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:16.423 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:16.423 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:16.423 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:16.423 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:16.423 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:16.423 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:16.423 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:16.423 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:16.424 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:16.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.418870  8819 raft_consensus.cc:740] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4d808b605e47d0a90dce37fd8ecb5f, State: Initialized, Role: FOLLOWER
18:34:16.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.419701  8819 consensus_queue.cc:260] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.436784  8819 ts_tablet_manager.cc:1434] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
18:34:16.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.438022  8846 raft_consensus.cc:515] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.440816  8839 raft_consensus.cc:2804] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:34:16.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.441171  8839 raft_consensus.cc:493] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:34:16.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.441454  8839 raft_consensus.cc:3060] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Advancing to term 1
18:34:16.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.443300  8819 tablet_bootstrap.cc:492] T 109afb7829a5484a844e346132a776be P 2b4d808b605e47d0a90dce37fd8ecb5f: Bootstrap starting.
18:34:16.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.450299  8819 tablet_bootstrap.cc:654] T 109afb7829a5484a844e346132a776be P 2b4d808b605e47d0a90dce37fd8ecb5f: Neither blocks nor log segments found. Creating new log.
18:34:16.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.458704  8839 raft_consensus.cc:515] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.463739  8819 tablet_bootstrap.cc:492] T 109afb7829a5484a844e346132a776be P 2b4d808b605e47d0a90dce37fd8ecb5f: No bootstrap required, opened a new log
18:34:16.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.464337  8819 ts_tablet_manager.cc:1403] T 109afb7829a5484a844e346132a776be P 2b4d808b605e47d0a90dce37fd8ecb5f: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
18:34:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.466315  7634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c5b3ea6b149718b3ae30a0ce84a17" candidate_uuid: "2f76c37f74624d8aa5906e77684cad01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f"
18:34:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.466877  7634 raft_consensus.cc:3060] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Advancing to term 1
18:34:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.467777  8819 raft_consensus.cc:359] T 109afb7829a5484a844e346132a776be P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.468554  8819 raft_consensus.cc:385] T 109afb7829a5484a844e346132a776be P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.468830  8819 raft_consensus.cc:740] T 109afb7829a5484a844e346132a776be P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4d808b605e47d0a90dce37fd8ecb5f, State: Initialized, Role: FOLLOWER
18:34:16.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.469606  8819 consensus_queue.cc:260] T 109afb7829a5484a844e346132a776be P 2b4d808b605e47d0a90dce37fd8ecb5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.478675  7634 raft_consensus.cc:2468] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f76c37f74624d8aa5906e77684cad01 in term 1.
18:34:16.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.480443  7711 leader_election.cc:304] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4d808b605e47d0a90dce37fd8ecb5f, 2f76c37f74624d8aa5906e77684cad01; no voters: 
18:34:16.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.480758  8819 ts_tablet_manager.cc:1434] T 109afb7829a5484a844e346132a776be P 2b4d808b605e47d0a90dce37fd8ecb5f: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
18:34:16.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.481199  8836 raft_consensus.cc:2804] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [term 1 FOLLOWER]: Leader election won for term 1
18:34:16.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.481657  8836 raft_consensus.cc:697] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [term 1 LEADER]: Becoming Leader. State: Replica: 2f76c37f74624d8aa5906e77684cad01, State: Running, Role: LEADER
18:34:16.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.482405  8836 consensus_queue.cc:237] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.486562  8846 leader_election.cc:290] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053), 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063)
18:34:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.460981  8839 leader_election.cc:290] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053), 2f76c37f74624d8aa5906e77684cad01 (127.6.245.2:40933)
18:34:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.461371  7851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.245.2:40933, user_credentials={real_user=slave}} blocked reactor thread for 63046.7us
18:34:16.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.488143  7913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a84c5b3ea6b149718b3ae30a0ce84a17" candidate_uuid: "2f76c37f74624d8aa5906e77684cad01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0"
18:34:16.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.493165  7710 leader_election.cc:343] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063): Illegal state: must be running to vote when last-logged opid is not known
18:34:16.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.503048  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109afb7829a5484a844e346132a776be" candidate_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f76c37f74624d8aa5906e77684cad01"
18:34:16.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.503216  7634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ffabd13bdc04d08879bc28dc62155f3" candidate_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" is_pre_election: true
18:34:16.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.503631  7775 raft_consensus.cc:3060] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Advancing to term 1
18:34:16.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.503971  7634 raft_consensus.cc:2393] T 2ffabd13bdc04d08879bc28dc62155f3 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82d9e0a8932940ac9e0041e68e8c7ff0 in current term 1: Already voted for candidate 2f76c37f74624d8aa5906e77684cad01 in this term.
18:34:16.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.503732  7633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109afb7829a5484a844e346132a776be" candidate_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" is_pre_election: true
18:34:16.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.504141  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109afb7829a5484a844e346132a776be" candidate_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f"
18:34:16.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.504377  7633 raft_consensus.cc:2468] T 109afb7829a5484a844e346132a776be P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82d9e0a8932940ac9e0041e68e8c7ff0 in term 0.
18:34:16.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.507063  7851 leader_election.cc:304] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82d9e0a8932940ac9e0041e68e8c7ff0; no voters: 2b4d808b605e47d0a90dce37fd8ecb5f, 2f76c37f74624d8aa5906e77684cad01
18:34:16.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.509408  8839 raft_consensus.cc:2749] T 2ffabd13bdc04d08879bc28dc62155f3 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:34:16.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.511843  7775 raft_consensus.cc:2468] T 109afb7829a5484a844e346132a776be P 2f76c37f74624d8aa5906e77684cad01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d9e0a8932940ac9e0041e68e8c7ff0 in term 1.
18:34:16.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.515129  7851 leader_election.cc:304] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f76c37f74624d8aa5906e77684cad01, 82d9e0a8932940ac9e0041e68e8c7ff0; no voters: 2b4d808b605e47d0a90dce37fd8ecb5f
18:34:16.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.516429  8839 raft_consensus.cc:2804] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 1 FOLLOWER]: Leader election won for term 1
18:34:16.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.516919  8839 raft_consensus.cc:697] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 1 LEADER]: Becoming Leader. State: Replica: 82d9e0a8932940ac9e0041e68e8c7ff0, State: Running, Role: LEADER
18:34:16.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.517464  8822 tablet_bootstrap.cc:492] T f77f28191ee54426a01bed4a9478ccd6 P 82d9e0a8932940ac9e0041e68e8c7ff0: No bootstrap required, opened a new log
18:34:16.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.518569  8822 ts_tablet_manager.cc:1403] T f77f28191ee54426a01bed4a9478ccd6 P 82d9e0a8932940ac9e0041e68e8c7ff0: Time spent bootstrapping tablet: real 0.296s	user 0.021s	sys 0.020s
18:34:16.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.518054  8839 consensus_queue.cc:237] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.524842  8822 raft_consensus.cc:359] T f77f28191ee54426a01bed4a9478ccd6 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.525612  8822 raft_consensus.cc:385] T f77f28191ee54426a01bed4a9478ccd6 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.525908  8822 raft_consensus.cc:740] T f77f28191ee54426a01bed4a9478ccd6 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d9e0a8932940ac9e0041e68e8c7ff0, State: Initialized, Role: FOLLOWER
18:34:16.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.527012  8822 consensus_queue.cc:260] T f77f28191ee54426a01bed4a9478ccd6 P 82d9e0a8932940ac9e0041e68e8c7ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.530694  8822 ts_tablet_manager.cc:1434] T f77f28191ee54426a01bed4a9478ccd6 P 82d9e0a8932940ac9e0041e68e8c7ff0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
18:34:16.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.537482  8822 tablet_bootstrap.cc:492] T a84c5b3ea6b149718b3ae30a0ce84a17 P 82d9e0a8932940ac9e0041e68e8c7ff0: Bootstrap starting.
18:34:16.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.551044  8822 tablet_bootstrap.cc:654] T a84c5b3ea6b149718b3ae30a0ce84a17 P 82d9e0a8932940ac9e0041e68e8c7ff0: Neither blocks nor log segments found. Creating new log.
18:34:16.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.561635  8822 tablet_bootstrap.cc:492] T a84c5b3ea6b149718b3ae30a0ce84a17 P 82d9e0a8932940ac9e0041e68e8c7ff0: No bootstrap required, opened a new log
18:34:16.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.562089  8822 ts_tablet_manager.cc:1403] T a84c5b3ea6b149718b3ae30a0ce84a17 P 82d9e0a8932940ac9e0041e68e8c7ff0: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.002s
18:34:16.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.564265  8831 raft_consensus.cc:493] T f77f28191ee54426a01bed4a9478ccd6 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:16.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.564778  8831 raft_consensus.cc:515] T f77f28191ee54426a01bed4a9478ccd6 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.568835  7632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77f28191ee54426a01bed4a9478ccd6" candidate_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" is_pre_election: true
18:34:16.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.570524  8831 leader_election.cc:290] T f77f28191ee54426a01bed4a9478ccd6 P 82d9e0a8932940ac9e0041e68e8c7ff0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053), 2f76c37f74624d8aa5906e77684cad01 (127.6.245.2:40933)
18:34:16.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.571655  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77f28191ee54426a01bed4a9478ccd6" candidate_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f76c37f74624d8aa5906e77684cad01" is_pre_election: true
18:34:16.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.572413  7775 raft_consensus.cc:2393] T f77f28191ee54426a01bed4a9478ccd6 P 2f76c37f74624d8aa5906e77684cad01 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82d9e0a8932940ac9e0041e68e8c7ff0 in current term 1: Already voted for candidate 2b4d808b605e47d0a90dce37fd8ecb5f in this term.
18:34:16.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.573565  7851 leader_election.cc:304] T f77f28191ee54426a01bed4a9478ccd6 P 82d9e0a8932940ac9e0041e68e8c7ff0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82d9e0a8932940ac9e0041e68e8c7ff0; no voters: 2b4d808b605e47d0a90dce37fd8ecb5f, 2f76c37f74624d8aa5906e77684cad01
18:34:16.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.574678  8831 raft_consensus.cc:3060] T f77f28191ee54426a01bed4a9478ccd6 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Advancing to term 1
18:34:16.591 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:16.591 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:16.591 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:16.592 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:16.592 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:16.592 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:16.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.591495  8822 raft_consensus.cc:359] T a84c5b3ea6b149718b3ae30a0ce84a17 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.592 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:16.592 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:16.592 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:16.592 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:16.592 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:16.592 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:16.592 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:16.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.592659  8822 raft_consensus.cc:385] T a84c5b3ea6b149718b3ae30a0ce84a17 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:16.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.594736  8831 raft_consensus.cc:2749] T f77f28191ee54426a01bed4a9478ccd6 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:34:16.602 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:16.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.593138  8822 raft_consensus.cc:740] T a84c5b3ea6b149718b3ae30a0ce84a17 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d9e0a8932940ac9e0041e68e8c7ff0, State: Initialized, Role: FOLLOWER
18:34:16.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.604291  8822 consensus_queue.cc:260] T a84c5b3ea6b149718b3ae30a0ce84a17 P 82d9e0a8932940ac9e0041e68e8c7ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.617179  8822 ts_tablet_manager.cc:1434] T a84c5b3ea6b149718b3ae30a0ce84a17 P 82d9e0a8932940ac9e0041e68e8c7ff0: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.005s
18:34:16.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.622936  8822 tablet_bootstrap.cc:492] T c39b66751cde487c94b99b60adc93d53 P 82d9e0a8932940ac9e0041e68e8c7ff0: Bootstrap starting.
18:34:16.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.628324  8836 consensus_queue.cc:1048] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:34:16.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.631544  8822 tablet_bootstrap.cc:654] T c39b66751cde487c94b99b60adc93d53 P 82d9e0a8932940ac9e0041e68e8c7ff0: Neither blocks nor log segments found. Creating new log.
18:34:16.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.627535  7325 catalog_manager.cc:5696] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1). New cstate: current_term: 1 leader_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } health_report { overall_health: UNKNOWN } } }
18:34:16.633 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:16.644 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:16.644 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:16.644 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:16.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.644593  8822 tablet_bootstrap.cc:492] T c39b66751cde487c94b99b60adc93d53 P 82d9e0a8932940ac9e0041e68e8c7ff0: No bootstrap required, opened a new log
18:34:16.645 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:16.645 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:16.645 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:16.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.645232  8822 ts_tablet_manager.cc:1403] T c39b66751cde487c94b99b60adc93d53 P 82d9e0a8932940ac9e0041e68e8c7ff0: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
18:34:16.645 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:16.645 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:16.645 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:16.646 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:16.646 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:16.646 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:16.646 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:16.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.648324  8822 raft_consensus.cc:359] T c39b66751cde487c94b99b60adc93d53 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.658993  8822 raft_consensus.cc:385] T c39b66751cde487c94b99b60adc93d53 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:16.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.660169  8822 raft_consensus.cc:740] T c39b66751cde487c94b99b60adc93d53 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d9e0a8932940ac9e0041e68e8c7ff0, State: Initialized, Role: FOLLOWER
18:34:16.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.664572  8822 consensus_queue.cc:260] T c39b66751cde487c94b99b60adc93d53 P 82d9e0a8932940ac9e0041e68e8c7ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:16.667943  7309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.245.61:44495, user_credentials={real_user=slave}} blocked reactor thread for 63182us
18:34:16.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.673291  8846 consensus_queue.cc:1048] T 2ffabd13bdc04d08879bc28dc62155f3 P 2f76c37f74624d8aa5906e77684cad01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:34:16.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.678808  8822 ts_tablet_manager.cc:1434] T c39b66751cde487c94b99b60adc93d53 P 82d9e0a8932940ac9e0041e68e8c7ff0: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
18:34:16.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:16.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.684839  8822 tablet_bootstrap.cc:492] T a2bab9e2604a4a9597798acdaf04474c P 82d9e0a8932940ac9e0041e68e8c7ff0: Bootstrap starting.
18:34:16.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.687531  7324 catalog_manager.cc:5696] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3). New cstate: current_term: 1 leader_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } health_report { overall_health: HEALTHY } } }
18:34:16.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.691260  8822 tablet_bootstrap.cc:654] T a2bab9e2604a4a9597798acdaf04474c P 82d9e0a8932940ac9e0041e68e8c7ff0: Neither blocks nor log segments found. Creating new log.
18:34:16.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.692373  7322 catalog_manager.cc:5696] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f76c37f74624d8aa5906e77684cad01 (127.6.245.2). New cstate: current_term: 1 leader_uuid: "2f76c37f74624d8aa5906e77684cad01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } health_report { overall_health: UNKNOWN } } }
18:34:16.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.704452  8822 tablet_bootstrap.cc:492] T a2bab9e2604a4a9597798acdaf04474c P 82d9e0a8932940ac9e0041e68e8c7ff0: No bootstrap required, opened a new log
18:34:16.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.705132  8822 ts_tablet_manager.cc:1403] T a2bab9e2604a4a9597798acdaf04474c P 82d9e0a8932940ac9e0041e68e8c7ff0: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
18:34:16.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.708441  8822 raft_consensus.cc:359] T a2bab9e2604a4a9597798acdaf04474c P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.710218  8822 raft_consensus.cc:385] T a2bab9e2604a4a9597798acdaf04474c P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:16.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.711079  8822 raft_consensus.cc:740] T a2bab9e2604a4a9597798acdaf04474c P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d9e0a8932940ac9e0041e68e8c7ff0, State: Initialized, Role: FOLLOWER
18:34:16.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.712360  8822 consensus_queue.cc:260] T a2bab9e2604a4a9597798acdaf04474c P 82d9e0a8932940ac9e0041e68e8c7ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.715171  8822 ts_tablet_manager.cc:1434] T a2bab9e2604a4a9597798acdaf04474c P 82d9e0a8932940ac9e0041e68e8c7ff0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
18:34:16.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.729646  8846 consensus_queue.cc:1048] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:34:16.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.772059  8830 consensus_queue.cc:1048] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:34:16.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.811100  7914 raft_consensus.cc:3060] T a2bab9e2604a4a9597798acdaf04474c P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Advancing to term 1
18:34:16.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.824959  8846 consensus_queue.cc:1048] T a2bab9e2604a4a9597798acdaf04474c P 2f76c37f74624d8aa5906e77684cad01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:34:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.841359  8851 consensus_queue.cc:1048] T f77f28191ee54426a01bed4a9478ccd6 P 2b4d808b605e47d0a90dce37fd8ecb5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:34:16.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.883749  8851 raft_consensus.cc:493] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:16.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.884346  8851 raft_consensus.cc:515] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.889331  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b66751cde487c94b99b60adc93d53" candidate_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f76c37f74624d8aa5906e77684cad01" is_pre_election: true
18:34:16.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.890133  7775 raft_consensus.cc:2468] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4d808b605e47d0a90dce37fd8ecb5f in term 0.
18:34:16.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.893092  7475 leader_election.cc:304] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4d808b605e47d0a90dce37fd8ecb5f, 2f76c37f74624d8aa5906e77684cad01; no voters: 
18:34:16.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.895171  8829 raft_consensus.cc:2804] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Leader pre-election won for term 1
18:34:16.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.888908  8851 leader_election.cc:290] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f76c37f74624d8aa5906e77684cad01 (127.6.245.2:40933), 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063)
18:34:16.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.895651  8829 raft_consensus.cc:493] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:34:16.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.896090  8829 raft_consensus.cc:3060] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Advancing to term 1
18:34:16.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:16.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.944967  8829 raft_consensus.cc:515] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.948388  7775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b66751cde487c94b99b60adc93d53" candidate_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f76c37f74624d8aa5906e77684cad01"
18:34:16.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.948948  7775 raft_consensus.cc:3060] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01 [term 0 FOLLOWER]: Advancing to term 1
18:34:16.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.949040  7913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b66751cde487c94b99b60adc93d53" candidate_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" is_pre_election: true
18:34:16.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.950098  7913 raft_consensus.cc:2468] T c39b66751cde487c94b99b60adc93d53 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4d808b605e47d0a90dce37fd8ecb5f in term 0.
18:34:16.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.955714  7775 raft_consensus.cc:2468] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4d808b605e47d0a90dce37fd8ecb5f in term 1.
18:34:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.956913  7475 leader_election.cc:304] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4d808b605e47d0a90dce37fd8ecb5f, 2f76c37f74624d8aa5906e77684cad01; no voters: 
18:34:16.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.957753  8851 raft_consensus.cc:2804] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 1 FOLLOWER]: Leader election won for term 1
18:34:16.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.958211  8851 raft_consensus.cc:697] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [term 1 LEADER]: Becoming Leader. State: Replica: 2b4d808b605e47d0a90dce37fd8ecb5f, State: Running, Role: LEADER
18:34:16.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.958415  8839 consensus_queue.cc:1048] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:34:16.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.959179  8829 leader_election.cc:290] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [CANDIDATE]: Term 1 election: Requested vote from peers 2f76c37f74624d8aa5906e77684cad01 (127.6.245.2:40933), 82d9e0a8932940ac9e0041e68e8c7ff0 (127.6.245.3:45063)
18:34:16.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.959022  8851 consensus_queue.cc:237] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } } peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } }
18:34:16.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.969703  7915 raft_consensus.cc:3060] T a84c5b3ea6b149718b3ae30a0ce84a17 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Advancing to term 1
18:34:16.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.971629  7912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b66751cde487c94b99b60adc93d53" candidate_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0"
18:34:16.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:16.972532  7912 raft_consensus.cc:3060] T c39b66751cde487c94b99b60adc93d53 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 0 FOLLOWER]: Advancing to term 1
18:34:17.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:17.029613  7912 raft_consensus.cc:2468] T c39b66751cde487c94b99b60adc93d53 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4d808b605e47d0a90dce37fd8ecb5f in term 1.
18:34:17.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:17.038198  8846 consensus_queue.cc:1048] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:34:17.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:17.058840  7324 catalog_manager.cc:5696] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1). New cstate: current_term: 1 leader_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 } health_report { overall_health: UNKNOWN } } }
18:34:17.073 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:17.073 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:17.074 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:17.074 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:17.074 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:17.074 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:17.074 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:17.074 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:17.074 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:17.074 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:17.074 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:17.075 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:17.075 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:17.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:17.075523  8836 consensus_queue.cc:1048] T a84c5b3ea6b149718b3ae30a0ce84a17 P 2f76c37f74624d8aa5906e77684cad01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:34:17.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:17.083453  7632 raft_consensus.cc:3060] T 109afb7829a5484a844e346132a776be P 2b4d808b605e47d0a90dce37fd8ecb5f [term 0 FOLLOWER]: Advancing to term 1
18:34:17.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:17.134 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:17.146 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table ffbf6c12abe4466485202b0208f6b095
18:34:17.152 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c39b66751cde487c94b99b60adc93d53 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
18:34:17.153 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f77f28191ee54426a01bed4a9478ccd6 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
18:34:17.153 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a84c5b3ea6b149718b3ae30a0ce84a17 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
18:34:17.153 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a2bab9e2604a4a9597798acdaf04474c for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:17.153 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 109afb7829a5484a844e346132a776be for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:17.153 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2ffabd13bdc04d08879bc28dc62155f3 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:17.159 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=c39b66751cde487c94b99b60adc93d53@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299994, tablet=f77f28191ee54426a01bed4a9478ccd6@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299994}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299994, tablet=a84c5b3ea6b149718b3ae30a0ce84a17@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299994, tablet=a2bab9e2604a4a9597798acdaf04474c@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299994}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299994, tablet=109afb7829a5484a844e346132a776be@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299994, tablet=2ffabd13bdc04d08879bc28dc62155f3@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299994}]
18:34:17.159 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=12), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.6.245.60:46787, [6ms] Sub RPC GetTableLocations: received response from server master-127.6.245.60:46787: OK, deferred=null) after lookup
18:34:17.165 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:17.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:17.175794  8839 consensus_queue.cc:1048] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4d808b605e47d0a90dce37fd8ecb5f" member_type: VOTER last_known_addr { host: "127.6.245.1" port: 39053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:34:17.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:17.194 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:17.194 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:17.194 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:17.194 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:17.194 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:17.194 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:17.194 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:17.194 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:17.194 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:17.195 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:17.195 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:17.195 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:17.195 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:17.211 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:17.240 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:17.251 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xc1b7fbe0, L:/127.0.0.1:41236 - R:/127.6.245.1:39053] using TOKEN/null
18:34:17.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:17.270304  7775 raft_consensus.cc:1275] T c39b66751cde487c94b99b60adc93d53 P 2f76c37f74624d8aa5906e77684cad01 [term 1 FOLLOWER]: Refusing update from remote peer 2b4d808b605e47d0a90dce37fd8ecb5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:34:17.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:17.270570  7912 raft_consensus.cc:1275] T c39b66751cde487c94b99b60adc93d53 P 82d9e0a8932940ac9e0041e68e8c7ff0 [term 1 FOLLOWER]: Refusing update from remote peer 2b4d808b605e47d0a90dce37fd8ecb5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:34:17.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:17.272142  8830 consensus_queue.cc:1048] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f76c37f74624d8aa5906e77684cad01" member_type: VOTER last_known_addr { host: "127.6.245.2" port: 40933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:34:17.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:17.272894  8851 consensus_queue.cc:1048] T c39b66751cde487c94b99b60adc93d53 P 2b4d808b605e47d0a90dce37fd8ecb5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d9e0a8932940ac9e0041e68e8c7ff0" member_type: VOTER last_known_addr { host: "127.6.245.3" port: 45063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:34:17.292 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:17.292 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:17.292 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:17.292 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:17.292 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:17.292 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:17.293 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:17.293 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:17.293 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:17.293 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:17.293 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:17.293 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:17.293 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:17.299 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:17.299 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:17.300 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:17.300 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:17.300 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:17.300 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:17.300 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:17.300 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:17.300 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:17.301 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:17.301 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:17.301 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:17.301 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:17.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:17.326474  8880 mvcc.cc:204] Tried to move back new op lower bound from 7305362052155150336 to 7305362050915057664. Current Snapshot: MvccSnapshot[applied={T|T < 7305362052155150336}]
18:34:17.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:17.336849  8875 mvcc.cc:204] Tried to move back new op lower bound from 7305362052155150336 to 7305362050915057664. Current Snapshot: MvccSnapshot[applied={T|T < 7305362052155150336}]
18:34:17.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:17.345273  8879 mvcc.cc:204] Tried to move back new op lower bound from 7305362052155150336 to 7305362050915057664. Current Snapshot: MvccSnapshot[applied={T|T < 7305362052155150336}]
18:34:17.380 [DEBUG - main] (Connection.java:748) [peer 2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)] connecting to peer
18:34:17.391 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)] Successfully connected to peer
18:34:17.416 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:17.417 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:17.417 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:17.419 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:17.419 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:17.419 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:17.419 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:17.419 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:17.419 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.419 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.419 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:17.419 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.419 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:17.420 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:17.419 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:17.419 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:17.426 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:17.426 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:17.426 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:17.426 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.426 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.426 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.426 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.426 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.426 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.426 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:17.427 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=26516), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [42ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [58ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [60ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [60ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [92ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [93ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [95ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [95ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [104ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [104ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [122ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [141ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [182ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [182ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [263ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [263ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [321ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [323ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [323ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [323ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [541ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [541ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [541ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [542ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [681ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [681ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [682ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [682ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [981ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [981ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [982ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [982ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1360ms] refreshing cache from master, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [1363ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2960ms] refreshing cache from master, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [2960ms] too many traces: truncated at 100 traces, deferred=Deferred@1857040562(state=PENDING, result=null, callback=(continuation of Deferred@1237422504 after retry RPC after error@1947266878) -> (continuation of Deferred@1827402499 after retry RPC after error@53570444) -> (continuation of Deferred@1178134163 after retry RPC after error@891455605) -> (continuation of Deferred@107087417 after retry RPC after error@235368562) -> (continuation of Deferred@252318559 after retry RPC after error@785007595) -> (continuation of Deferred@940563397 after retry RPC after error@222210134) -> (continuation of Deferred@1383191109 after retry RPC after error@785909499) -> (continuation of Deferred@1758408982 after retry RPC after error@273373249) -> (continuation of Deferred@1291080695 after retry RPC after error@578124620) -> (continuation of Deferred@857975189 after retry RPC after error@2036360928) -> (continuation of Deferred@392554960 after retry RPC after error@516120427) -> (continuation of Deferred@805450279 after retry RPC after error@1244599713) -> (continuation of Deferred@1916554845 after retry RPC after error@1979740022) -> (continuation of Deferred@1462954139 after retry RPC after error@1694662081) -> (continuation of Deferred@1968998810 after retry RPC after error@13775768) -> (continuation of Deferred@1080325417 after retry RPC after error@914289809) -> (continuation of Deferred@662682525 after retry RPC after error@916455961) -> (continuation of Deferred@1435428057 after retry RPC after error@345327749) -> (continuation of Deferred@1324133081 after retry RPC after error@2028657111) -> (continuation of Deferred@1516257855 after retry RPC after error@1687152790) -> (continuation of Deferred@1327377596 after retry RPC after error@1637118185) -> (continuation of Deferred@960345950 after retry RPC after error@577582007) -> (continuation of Deferred@472416394 after retry RPC after error@1593419998) -> (continuation of Deferred@170554136 after retry RPC after error@1100028257) -> (continuation of Deferred@434502921 after retry RPC after error@172558771) -> (continuation of Deferred@1394743633 after retry RPC after error@439441477), errback=(continuation of Deferred@1237422504 after retry RPC after error@1947266878) -> (continuation of Deferred@1827402499 after retry RPC after error@53570444) -> (continuation of Deferred@1178134163 after retry RPC after error@891455605) -> (continuation of Deferred@107087417 after retry RPC after error@235368562) -> (continuation of Deferred@252318559 after retry RPC after error@785007595) -> (continuation of Deferred@940563397 after retry RPC after error@222210134) -> (continuation of Deferred@1383191109 after retry RPC after error@785909499) -> (continuation of Deferred@1758408982 after retry RPC after error@273373249) -> (continuation of Deferred@1291080695 after retry RPC after error@578124620) -> (continuation of Deferred@857975189 after retry RPC after error@2036360928) -> (continuation of Deferred@392554960 after retry RPC after error@516120427) -> (continuation of Deferred@805450279 after retry RPC after error@1244599713) -> (continuation of Deferred@1916554845 after retry RPC after error@1979740022) -> (continuation of Deferred@1462954139 after retry RPC after error@1694662081) -> (continuation of Deferred@1968998810 after retry RPC after error@13775768) -> (continuation of Deferred@1080325417 after retry RPC after error@914289809) -> (continuation of Deferred@662682525 after retry RPC after error@916455961) -> (continuation of Deferred@1435428057 after retry RPC after error@345327749) -> (continuation of Deferred@1324133081 after retry RPC after error@2028657111) -> (continuation of Deferred@1516257855 after retry RPC after error@1687152790) -> (continuation of Deferred@1327377596 after retry RPC after error@1637118185) -> (continuation of Deferred@960345950 after retry RPC after error@577582007) -> (continuation of Deferred@472416394 after retry RPC after error@1593419998) -> (continuation of Deferred@170554136 after retry RPC after error@1100028257) -> (continuation of Deferred@434502921 after retry RPC after error@172558771) -> (continuation of Deferred@1394743633 after retry RPC after error@439441477)))
18:34:17.428 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:17.428 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:17.428 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:17.428 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=26516), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [42ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [58ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [60ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [60ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [92ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [93ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [95ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [95ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [104ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [104ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [122ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [141ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [182ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [182ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [263ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [263ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [321ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [323ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [323ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [323ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [541ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [541ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [541ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [542ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [681ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [681ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [682ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [682ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [981ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [981ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [982ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [982ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1360ms] refreshing cache from master, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [1363ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2960ms] refreshing cache from master, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [2960ms] too many traces: truncated at 100 traces, deferred=Deferred@1857040562(state=PENDING, result=null, callback=(continuation of Deferred@1237422504 after retry RPC after error@1947266878) -> (continuation of Deferred@1827402499 after retry RPC after error@53570444) -> (continuation of Deferred@1178134163 after retry RPC after error@891455605) -> (continuation of Deferred@107087417 after retry RPC after error@235368562) -> (continuation of Deferred@252318559 after retry RPC after error@785007595) -> (continuation of Deferred@940563397 after retry RPC after error@222210134) -> (continuation of Deferred@1383191109 after retry RPC after error@785909499) -> (continuation of Deferred@1758408982 after retry RPC after error@273373249) -> (continuation of Deferred@1291080695 after retry RPC after error@578124620) -> (continuation of Deferred@857975189 after retry RPC after error@2036360928) -> (continuation of Deferred@392554960 after retry RPC after error@516120427) -> (continuation of Deferred@805450279 after retry RPC after error@1244599713) -> (continuation of Deferred@1916554845 after retry RPC after error@1979740022) -> (continuation of Deferred@1462954139 after retry RPC after error@1694662081) -> (continuation of Deferred@1968998810 after retry RPC after error@13775768) -> (continuation of Deferred@1080325417 after retry RPC after error@914289809) -> (continuation of Deferred@662682525 after retry RPC after error@916455961) -> (continuation of Deferred@1435428057 after retry RPC after error@345327749) -> (continuation of Deferred@1324133081 after retry RPC after error@2028657111) -> (continuation of Deferred@1516257855 after retry RPC after error@1687152790) -> (continuation of Deferred@1327377596 after retry RPC after error@1637118185) -> (continuation of Deferred@960345950 after retry RPC after error@577582007) -> (continuation of Deferred@472416394 after retry RPC after error@1593419998) -> (continuation of Deferred@170554136 after retry RPC after error@1100028257) -> (continuation of Deferred@434502921 after retry RPC after error@172558771) -> (continuation of Deferred@1394743633 after retry RPC after error@439441477), errback=(continuation of Deferred@1237422504 after retry RPC after error@1947266878) -> (continuation of Deferred@1827402499 after retry RPC after error@53570444) -> (continuation of Deferred@1178134163 after retry RPC after error@891455605) -> (continuation of Deferred@107087417 after retry RPC after error@235368562) -> (continuation of Deferred@252318559 after retry RPC after error@785007595) -> (continuation of Deferred@940563397 after retry RPC after error@222210134) -> (continuation of Deferred@1383191109 after retry RPC after error@785909499) -> (continuation of Deferred@1758408982 after retry RPC after error@273373249) -> (continuation of Deferred@1291080695 after retry RPC after error@578124620) -> (continuation of Deferred@857975189 after retry RPC after error@2036360928) -> (continuation of Deferred@392554960 after retry RPC after error@516120427) -> (continuation of Deferred@805450279 after retry RPC after error@1244599713) -> (continuation of Deferred@1916554845 after retry RPC after error@1979740022) -> (continuation of Deferred@1462954139 after retry RPC after error@1694662081) -> (continuation of Deferred@1968998810 after retry RPC after error@13775768) -> (continuation of Deferred@1080325417 after retry RPC after error@914289809) -> (continuation of Deferred@662682525 after retry RPC after error@916455961) -> (continuation of Deferred@1435428057 after retry RPC after error@345327749) -> (continuation of Deferred@1324133081 after retry RPC after error@2028657111) -> (continuation of Deferred@1516257855 after retry RPC after error@1687152790) -> (continuation of Deferred@1327377596 after retry RPC after error@1637118185) -> (continuation of Deferred@960345950 after retry RPC after error@577582007) -> (continuation of Deferred@472416394 after retry RPC after error@1593419998) -> (continuation of Deferred@170554136 after retry RPC after error@1100028257) -> (continuation of Deferred@434502921 after retry RPC after error@172558771) -> (continuation of Deferred@1394743633 after retry RPC after error@439441477)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=26516), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [42ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [58ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [60ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [60ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [92ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [93ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [95ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [95ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [104ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [104ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [122ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [141ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [182ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [182ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [263ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [263ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [321ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [323ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [323ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [323ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [541ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [541ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [541ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [542ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [681ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [681ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [682ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [682ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [981ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [981ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [982ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [982ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1360ms] refreshing cache from master, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [1363ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2960ms] refreshing cache from master, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [2960ms] too many traces: truncated at 100 traces, deferred=Deferred@1857040562(state=PENDING, result=null, callback=(continuation of Deferred@1237422504 after retry RPC after error@1947266878) -> (continuation of Deferred@1827402499 after retry RPC after error@53570444) -> (continuation of Deferred@1178134163 after retry RPC after error@891455605) -> (continuation of Deferred@107087417 after retry RPC after error@235368562) -> (continuation of Deferred@252318559 after retry RPC after error@785007595) -> (continuation of Deferred@940563397 after retry RPC after error@222210134) -> (continuation of Deferred@1383191109 after retry RPC after error@785909499) -> (continuation of Deferred@1758408982 after retry RPC after error@273373249) -> (continuation of Deferred@1291080695 after retry RPC after error@578124620) -> (continuation of Deferred@857975189 after retry RPC after error@2036360928) -> (continuation of Deferred@392554960 after retry RPC after error@516120427) -> (continuation of Deferred@805450279 after retry RPC after error@1244599713) -> (continuation of Deferred@1916554845 after retry RPC after error@1979740022) -> (continuation of Deferred@1462954139 after retry RPC after error@1694662081) -> (continuation of Deferred@1968998810 after retry RPC after error@13775768) -> (continuation of Deferred@1080325417 after retry RPC after error@914289809) -> (continuation of Deferred@662682525 after retry RPC after error@916455961) -> (continuation of Deferred@1435428057 after retry RPC after error@345327749) -> (continuation of Deferred@1324133081 after retry RPC after error@2028657111) -> (continuation of Deferred@1516257855 after retry RPC after error@1687152790) -> (continuation of Deferred@1327377596 after retry RPC after error@1637118185) -> (continuation of Deferred@960345950 after retry RPC after error@577582007) -> (continuation of Deferred@472416394 after retry RPC after error@1593419998) -> (continuation of Deferred@170554136 after retry RPC after error@1100028257) -> (continuation of Deferred@434502921 after retry RPC after error@172558771) -> (continuation of Deferred@1394743633 after retry RPC after error@439441477), errback=(continuation of Deferred@1237422504 after retry RPC after error@1947266878) -> (continuation of Deferred@1827402499 after retry RPC after error@53570444) -> (continuation of Deferred@1178134163 after retry RPC after error@891455605) -> (continuation of Deferred@107087417 after retry RPC after error@235368562) -> (continuation of Deferred@252318559 after retry RPC after error@785007595) -> (continuation of Deferred@940563397 after retry RPC after error@222210134) -> (continuation of Deferred@1383191109 after retry RPC after error@785909499) -> (continuation of Deferred@1758408982 after retry RPC after error@273373249) -> (continuation of Deferred@1291080695 after retry RPC after error@578124620) -> (continuation of Deferred@857975189 after retry RPC after error@2036360928) -> (continuation of Deferred@392554960 after retry RPC after error@516120427) -> (continuation of Deferred@805450279 after retry RPC after error@1244599713) -> (continuation of Deferred@1916554845 after retry RPC after error@1979740022) -> (continuation of Deferred@1462954139 after retry RPC after error@1694662081) -> (continuation of Deferred@1968998810 after retry RPC after error@13775768) -> (continuation of Deferred@1080325417 after retry RPC after error@914289809) -> (continuation of Deferred@662682525 after retry RPC after error@916455961) -> (continuation of Deferred@1435428057 after retry RPC after error@345327749) -> (continuation of Deferred@1324133081 after retry RPC after error@2028657111) -> (continuation of Deferred@1516257855 after retry RPC after error@1687152790) -> (continuation of Deferred@1327377596 after retry RPC after error@1637118185) -> (continuation of Deferred@960345950 after retry RPC after error@577582007) -> (continuation of Deferred@472416394 after retry RPC after error@1593419998) -> (continuation of Deferred@170554136 after retry RPC after error@1100028257) -> (continuation of Deferred@434502921 after retry RPC after error@172558771) -> (continuation of Deferred@1394743633 after retry RPC after error@439441477)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.96.189:33339
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:17.428 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.428 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.428 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.428 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.428 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.428 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.428 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.428 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.429 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.429 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:17.431 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=26516), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [42ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [58ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [60ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [60ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [92ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [93ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [95ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [95ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [104ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [104ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [122ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [141ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [182ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [182ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [263ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [263ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [321ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [323ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [323ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [323ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [541ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [541ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [541ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [542ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [681ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [681ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [682ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [682ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [981ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [981ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [982ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [982ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1360ms] refreshing cache from master, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [1363ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2960ms] refreshing cache from master, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [2960ms] too many traces: truncated at 100 traces, deferred=Deferred@1857040562(state=PENDING, result=null, callback=(continuation of Deferred@1237422504 after retry RPC after error@1947266878) -> (continuation of Deferred@1827402499 after retry RPC after error@53570444) -> (continuation of Deferred@1178134163 after retry RPC after error@891455605) -> (continuation of Deferred@107087417 after retry RPC after error@235368562) -> (continuation of Deferred@252318559 after retry RPC after error@785007595) -> (continuation of Deferred@940563397 after retry RPC after error@222210134) -> (continuation of Deferred@1383191109 after retry RPC after error@785909499) -> (continuation of Deferred@1758408982 after retry RPC after error@273373249) -> (continuation of Deferred@1291080695 after retry RPC after error@578124620) -> (continuation of Deferred@857975189 after retry RPC after error@2036360928) -> (continuation of Deferred@392554960 after retry RPC after error@516120427) -> (continuation of Deferred@805450279 after retry RPC after error@1244599713) -> (continuation of Deferred@1916554845 after retry RPC after error@1979740022) -> (continuation of Deferred@1462954139 after retry RPC after error@1694662081) -> (continuation of Deferred@1968998810 after retry RPC after error@13775768) -> (continuation of Deferred@1080325417 after retry RPC after error@914289809) -> (continuation of Deferred@662682525 after retry RPC after error@916455961) -> (continuation of Deferred@1435428057 after retry RPC after error@345327749) -> (continuation of Deferred@1324133081 after retry RPC after error@2028657111) -> (continuation of Deferred@1516257855 after retry RPC after error@1687152790) -> (continuation of Deferred@1327377596 after retry RPC after error@1637118185) -> (continuation of Deferred@960345950 after retry RPC after error@577582007) -> (continuation of Deferred@472416394 after retry RPC after error@1593419998) -> (continuation of Deferred@170554136 after retry RPC after error@1100028257) -> (continuation of Deferred@434502921 after retry RPC after error@172558771) -> (continuation of Deferred@1394743633 after retry RPC after error@439441477), errback=(continuation of Deferred@1237422504 after retry RPC after error@1947266878) -> (continuation of Deferred@1827402499 after retry RPC after error@53570444) -> (continuation of Deferred@1178134163 after retry RPC after error@891455605) -> (continuation of Deferred@107087417 after retry RPC after error@235368562) -> (continuation of Deferred@252318559 after retry RPC after error@785007595) -> (continuation of Deferred@940563397 after retry RPC after error@222210134) -> (continuation of Deferred@1383191109 after retry RPC after error@785909499) -> (continuation of Deferred@1758408982 after retry RPC after error@273373249) -> (continuation of Deferred@1291080695 after retry RPC after error@578124620) -> (continuation of Deferred@857975189 after retry RPC after error@2036360928) -> (continuation of Deferred@392554960 after retry RPC after error@516120427) -> (continuation of Deferred@805450279 after retry RPC after error@1244599713) -> (continuation of Deferred@1916554845 after retry RPC after error@1979740022) -> (continuation of Deferred@1462954139 after retry RPC after error@1694662081) -> (continuation of Deferred@1968998810 after retry RPC after error@13775768) -> (continuation of Deferred@1080325417 after retry RPC after error@914289809) -> (continuation of Deferred@662682525 after retry RPC after error@916455961) -> (continuation of Deferred@1435428057 after retry RPC after error@345327749) -> (continuation of Deferred@1324133081 after retry RPC after error@2028657111) -> (continuation of Deferred@1516257855 after retry RPC after error@1687152790) -> (continuation of Deferred@1327377596 after retry RPC after error@1637118185) -> (continuation of Deferred@960345950 after retry RPC after error@577582007) -> (continuation of Deferred@472416394 after retry RPC after error@1593419998) -> (continuation of Deferred@170554136 after retry RPC after error@1100028257) -> (continuation of Deferred@434502921 after retry RPC after error@172558771) -> (continuation of Deferred@1394743633 after retry RPC after error@439441477)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=26516), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [42ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [58ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [60ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [60ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [92ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [93ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [95ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [95ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [103ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [104ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [104ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [122ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [141ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [182ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [182ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [262ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [263ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [263ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [321ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [323ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [323ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [323ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [541ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [541ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [541ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [542ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [681ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [681ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [682ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [682ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [981ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [981ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [982ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [982ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1360ms] refreshing cache from master, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [1363ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2960ms] refreshing cache from master, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [2960ms] too many traces: truncated at 100 traces, deferred=Deferred@1857040562(state=PENDING, result=null, callback=(continuation of Deferred@1237422504 after retry RPC after error@1947266878) -> (continuation of Deferred@1827402499 after retry RPC after error@53570444) -> (continuation of Deferred@1178134163 after retry RPC after error@891455605) -> (continuation of Deferred@107087417 after retry RPC after error@235368562) -> (continuation of Deferred@252318559 after retry RPC after error@785007595) -> (continuation of Deferred@940563397 after retry RPC after error@222210134) -> (continuation of Deferred@1383191109 after retry RPC after error@785909499) -> (continuation of Deferred@1758408982 after retry RPC after error@273373249) -> (continuation of Deferred@1291080695 after retry RPC after error@578124620) -> (continuation of Deferred@857975189 after retry RPC after error@2036360928) -> (continuation of Deferred@392554960 after retry RPC after error@516120427) -> (continuation of Deferred@805450279 after retry RPC after error@1244599713) -> (continuation of Deferred@1916554845 after retry RPC after error@1979740022) -> (continuation of Deferred@1462954139 after retry RPC after error@1694662081) -> (continuation of Deferred@1968998810 after retry RPC after error@13775768) -> (continuation of Deferred@1080325417 after retry RPC after error@914289809) -> (continuation of Deferred@662682525 after retry RPC after error@916455961) -> (continuation of Deferred@1435428057 after retry RPC after error@345327749) -> (continuation of Deferred@1324133081 after retry RPC after error@2028657111) -> (continuation of Deferred@1516257855 after retry RPC after error@1687152790) -> (continuation of Deferred@1327377596 after retry RPC after error@1637118185) -> (continuation of Deferred@960345950 after retry RPC after error@577582007) -> (continuation of Deferred@472416394 after retry RPC after error@1593419998) -> (continuation of Deferred@170554136 after retry RPC after error@1100028257) -> (continuation of Deferred@434502921 after retry RPC after error@172558771) -> (continuation of Deferred@1394743633 after retry RPC after error@439441477), errback=(continuation of Deferred@1237422504 after retry RPC after error@1947266878) -> (continuation of Deferred@1827402499 after retry RPC after error@53570444) -> (continuation of Deferred@1178134163 after retry RPC after error@891455605) -> (continuation of Deferred@107087417 after retry RPC after error@235368562) -> (continuation of Deferred@252318559 after retry RPC after error@785007595) -> (continuation of Deferred@940563397 after retry RPC after error@222210134) -> (continuation of Deferred@1383191109 after retry RPC after error@785909499) -> (continuation of Deferred@1758408982 after retry RPC after error@273373249) -> (continuation of Deferred@1291080695 after retry RPC after error@578124620) -> (continuation of Deferred@857975189 after retry RPC after error@2036360928) -> (continuation of Deferred@392554960 after retry RPC after error@516120427) -> (continuation of Deferred@805450279 after retry RPC after error@1244599713) -> (continuation of Deferred@1916554845 after retry RPC after error@1979740022) -> (continuation of Deferred@1462954139 after retry RPC after error@1694662081) -> (continuation of Deferred@1968998810 after retry RPC after error@13775768) -> (continuation of Deferred@1080325417 after retry RPC after error@914289809) -> (continuation of Deferred@662682525 after retry RPC after error@916455961) -> (continuation of Deferred@1435428057 after retry RPC after error@345327749) -> (continuation of Deferred@1324133081 after retry RPC after error@2028657111) -> (continuation of Deferred@1516257855 after retry RPC after error@1687152790) -> (continuation of Deferred@1327377596 after retry RPC after error@1637118185) -> (continuation of Deferred@960345950 after retry RPC after error@577582007) -> (continuation of Deferred@472416394 after retry RPC after error@1593419998) -> (continuation of Deferred@170554136 after retry RPC after error@1100028257) -> (continuation of Deferred@434502921 after retry RPC after error@172558771) -> (continuation of Deferred@1394743633 after retry RPC after error@439441477)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.96.189:33339
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:17.432 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:34:17.432 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (9de81db54be40687a2a82164db1dc50b) switched from state RUNNING to RESTARTING.
18:34:17.435 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#2) of source Source: KuduSource.
18:34:17.435 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to CANCELING.
18:34:17.435 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:17.436 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
18:34:17.436 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
18:34:17.436 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
18:34:17.436 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#3) of source Source: KuduSource.
18:34:17.436 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
18:34:17.436 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to CANCELING.
18:34:17.436 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
18:34:17.436 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
18:34:17.436 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
18:34:17.438 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:17.438 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:17.438 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:17.439 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.439 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.439 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.439 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.439 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.439 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.440 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.440 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.440 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.440 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:17.440 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x9547e46b, L:/127.0.0.1:42286 - R:/127.6.245.2:40933] using TOKEN/null
18:34:17.441 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:17.458 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:34:17.458 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CANCELING to CANCELED.
18:34:17.458 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
18:34:17.460 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:17.460 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:17.460 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:17.461 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.461 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.461 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.461 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.461 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.461 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.461 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.461 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.461 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.461 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:17.481 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:17.481 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:17.481 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:17.482 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.482 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.482 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.482 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.482 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.482 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.482 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.483 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.483 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.483 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:17.490 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
18:34:17.493 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
18:34:17.493 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
18:34:17.494 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:34:17.494 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
18:34:17.494 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
18:34:17.494 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
18:34:17.494 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
18:34:17.494 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
18:34:17.496 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
18:34:17.496 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
18:34:17.496 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
18:34:17.497 [DEBUG - main] (Connection.java:748) [peer 82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)] connecting to peer
18:34:17.499 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:17.499 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:17.499 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:17.499 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.499 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.499 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.500 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.500 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.500 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.500 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.500 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.500 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.500 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:17.500 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
18:34:17.500 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
18:34:17.500 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
18:34:17.510 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:34:17.510 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
18:34:17.510 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
18:34:17.511 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#2 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
18:34:17.512 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
18:34:17.512 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#3 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
18:34:17.512 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
18:34:17.513 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CANCELING to CANCELED.
18:34:17.514 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
18:34:17.514 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:17.515 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:17.515 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:17.515 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:17.515 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:17.515 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:17.515 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:17.515 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:34:17.516 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:17.516 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:17.516 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:17.516 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
18:34:17.516 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:17.516 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:17.516 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:17.516 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:17.517 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:34:17.517 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
18:34:17.518 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 9de81db54be40687a2a82164db1dc50b
18:34:17.522 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)] Successfully connected to peer
18:34:17.524 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:17.525 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:17.525 [DEBUG - pool-406-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:17.525 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:17.525 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:17.525 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:17.527 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:17.527 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:17.527 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:17.528 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:17.528 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:17.528 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:17.528 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:17.529 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26617), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [53ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [55ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [55ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [66ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [67ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [68ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [68ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [92ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [93ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [93ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [93ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [101ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [121ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [141ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [221ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [221ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [222ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [222ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [261ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [262ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [262ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [262ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [301ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [302ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [381ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [381ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [381ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [381ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [521ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [521ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [521ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [521ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1800ms] refreshing cache from master, [1800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1801ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1801ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1802ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [3301ms] refreshing cache from master, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [3301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [3302ms] too many traces: truncated at 100 traces, deferred=Deferred@1247268022(state=PENDING, result=null, callback=(continuation of Deferred@239001560 after retry RPC after error@2111120597) -> (continuation of Deferred@26106884 after retry RPC after error@1976042239) -> (continuation of Deferred@233882497 after retry RPC after error@1507310950) -> (continuation of Deferred@709538852 after retry RPC after error@522228840) -> (continuation of Deferred@340238534 after retry RPC after error@1881084837) -> (continuation of Deferred@260792854 after retry RPC after error@345191515) -> (continuation of Deferred@1039923103 after retry RPC after error@905009598) -> (continuation of Deferred@1631459012 after retry RPC after error@1812121428) -> (continuation of Deferred@237470276 after retry RPC after error@832837271) -> (continuation of Deferred@549305937 after retry RPC after error@1526719861) -> (continuation of Deferred@1761114572 after retry RPC after error@2038024938) -> (continuation of Deferred@888908962 after retry RPC after error@294269701) -> (continuation of Deferred@974589665 after retry RPC after error@219069907) -> (continuation of Deferred@1685692012 after retry RPC after error@615222269) -> (continuation of Deferred@642378127 after retry RPC after error@1590769840) -> (continuation of Deferred@1987270648 after retry RPC after error@251649704) -> (continuation of Deferred@1729321833 after retry RPC after error@810613635) -> (continuation of Deferred@1559275238 after retry RPC after error@747256142) -> (continuation of Deferred@1371531173 after retry RPC after error@1719964402) -> (continuation of Deferred@1067110226 after retry RPC after error@1118294438) -> (continuation of Deferred@1812694168 after retry RPC after error@777685225) -> (continuation of Deferred@1205019183 after retry RPC after error@990245266) -> (continuation of Deferred@194682158 after retry RPC after error@1912426868), errback=(continuation of Deferred@239001560 after retry RPC after error@2111120597) -> (continuation of Deferred@26106884 after retry RPC after error@1976042239) -> (continuation of Deferred@233882497 after retry RPC after error@1507310950) -> (continuation of Deferred@709538852 after retry RPC after error@522228840) -> (continuation of Deferred@340238534 after retry RPC after error@1881084837) -> (continuation of Deferred@260792854 after retry RPC after error@345191515) -> (continuation of Deferred@1039923103 after retry RPC after error@905009598) -> (continuation of Deferred@1631459012 after retry RPC after error@1812121428) -> (continuation of Deferred@237470276 after retry RPC after error@832837271) -> (continuation of Deferred@549305937 after retry RPC after error@1526719861) -> (continuation of Deferred@1761114572 after retry RPC after error@2038024938) -> (continuation of Deferred@888908962 after retry RPC after error@294269701) -> (continuation of Deferred@974589665 after retry RPC after error@219069907) -> (continuation of Deferred@1685692012 after retry RPC after error@615222269) -> (continuation of Deferred@642378127 after retry RPC after error@1590769840) -> (continuation of Deferred@1987270648 after retry RPC after error@251649704) -> (continuation of Deferred@1729321833 after retry RPC after error@810613635) -> (continuation of Deferred@1559275238 after retry RPC after error@747256142) -> (continuation of Deferred@1371531173 after retry RPC after error@1719964402) -> (continuation of Deferred@1067110226 after retry RPC after error@1118294438) -> (continuation of Deferred@1812694168 after retry RPC after error@777685225) -> (continuation of Deferred@1205019183 after retry RPC after error@990245266) -> (continuation of Deferred@194682158 after retry RPC after error@1912426868)))
18:34:17.538 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:17.539 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:17.539 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:17.539 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.540 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.540 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.540 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.540 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.540 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.540 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.540 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.540 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.540 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:17.544 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:17.544 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:17.545 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:17.545 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:17.545 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:17.545 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:17.545 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:17.545 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:17.545 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:17.546 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:17.547 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:17.547 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:17.547 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:17.552 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:17.558 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x4b5af8d0, L:/127.0.0.1:57056 - R:/127.6.245.3:45063] using TOKEN/null
18:34:17.589 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:17.589 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:17.589 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:17.589 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:17.590 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:17.590 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:17.590 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:17.590 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:17.590 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:17.590 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:17.590 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:17.590 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:17.590 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:17.598 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:17.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:17.599 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:17.599 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:17.599 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.599 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.599 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.600 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.600 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.600 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.600 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.600 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.600 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.600 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:17.620 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:17.620 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:17.620 [DEBUG - pool-392-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:17.622 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:17.622 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:17.622 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:17.622 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:17.623 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:17.623 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:17.623 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:17.623 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:17.623 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:17.623 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:17.624 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26966), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [49ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [91ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [99ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [99ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [118ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [131ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [131ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [144ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [151ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [153ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [154ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [160ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [161ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [183ms] refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [184ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [184ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [186ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [186ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [202ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [243ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [284ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [284ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [301ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [301ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [302ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [601ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [601ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [601ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [601ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1202ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1841ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1843ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [4320ms] refreshing cache from master, [4320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4322ms] too many traces: truncated at 100 traces, deferred=Deferred@410266366(state=PENDING, result=null, callback=(continuation of Deferred@1493972407 after retry RPC after error@710555840) -> (continuation of Deferred@364179224 after retry RPC after error@749606026) -> (continuation of Deferred@339164453 after retry RPC after error@1875942235) -> (continuation of Deferred@1571714454 after retry RPC after error@33038573) -> (continuation of Deferred@747371490 after retry RPC after error@1198176107) -> (continuation of Deferred@1774610645 after retry RPC after error@695849544) -> (continuation of Deferred@1516136558 after retry RPC after error@1209884065) -> (continuation of Deferred@315032759 after retry RPC after error@1976266549) -> (continuation of Deferred@1551852794 after retry RPC after error@2125322881) -> (continuation of Deferred@1424333663 after retry RPC after error@2054808625) -> (continuation of Deferred@1560676144 after retry RPC after error@1307551683) -> (continuation of Deferred@900260418 after retry RPC after error@4571306) -> (continuation of Deferred@1830254613 after retry RPC after error@1568021451) -> (continuation of Deferred@792611029 after retry RPC after error@22060296) -> (continuation of Deferred@1464965863 after retry RPC after error@982805381) -> (continuation of Deferred@1731323106 after retry RPC after error@1644989905) -> (continuation of Deferred@970044885 after retry RPC after error@536881449) -> (continuation of Deferred@1224662847 after retry RPC after error@1310372340) -> (continuation of Deferred@2052180735 after retry RPC after error@1538915837) -> (continuation of Deferred@1694553746 after retry RPC after error@2123255511) -> (continuation of Deferred@184313291 after retry RPC after error@507393916) -> (continuation of Deferred@2104084079 after retry RPC after error@1897781219) -> (continuation of Deferred@413546038 after retry RPC after error@2009884553), errback=(continuation of Deferred@1493972407 after retry RPC after error@710555840) -> (continuation of Deferred@364179224 after retry RPC after error@749606026) -> (continuation of Deferred@339164453 after retry RPC after error@1875942235) -> (continuation of Deferred@1571714454 after retry RPC after error@33038573) -> (continuation of Deferred@747371490 after retry RPC after error@1198176107) -> (continuation of Deferred@1774610645 after retry RPC after error@695849544) -> (continuation of Deferred@1516136558 after retry RPC after error@1209884065) -> (continuation of Deferred@315032759 after retry RPC after error@1976266549) -> (continuation of Deferred@1551852794 after retry RPC after error@2125322881) -> (continuation of Deferred@1424333663 after retry RPC after error@2054808625) -> (continuation of Deferred@1560676144 after retry RPC after error@1307551683) -> (continuation of Deferred@900260418 after retry RPC after error@4571306) -> (continuation of Deferred@1830254613 after retry RPC after error@1568021451) -> (continuation of Deferred@792611029 after retry RPC after error@22060296) -> (continuation of Deferred@1464965863 after retry RPC after error@982805381) -> (continuation of Deferred@1731323106 after retry RPC after error@1644989905) -> (continuation of Deferred@970044885 after retry RPC after error@536881449) -> (continuation of Deferred@1224662847 after retry RPC after error@1310372340) -> (continuation of Deferred@2052180735 after retry RPC after error@1538915837) -> (continuation of Deferred@1694553746 after retry RPC after error@2123255511) -> (continuation of Deferred@184313291 after retry RPC after error@507393916) -> (continuation of Deferred@2104084079 after retry RPC after error@1897781219) -> (continuation of Deferred@413546038 after retry RPC after error@2009884553)))
18:34:17.625 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
18:34:17.625 [WARN - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26966), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [49ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [91ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [99ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [99ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [118ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [131ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [131ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [144ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [151ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [153ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [154ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [160ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [161ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [183ms] refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [184ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [184ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [186ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [186ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [202ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [243ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [284ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [284ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [301ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [301ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [302ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [601ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [601ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [601ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [601ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1202ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1841ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1843ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [4320ms] refreshing cache from master, [4320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4322ms] too many traces: truncated at 100 traces, deferred=Deferred@410266366(state=PENDING, result=null, callback=(continuation of Deferred@1493972407 after retry RPC after error@710555840) -> (continuation of Deferred@364179224 after retry RPC after error@749606026) -> (continuation of Deferred@339164453 after retry RPC after error@1875942235) -> (continuation of Deferred@1571714454 after retry RPC after error@33038573) -> (continuation of Deferred@747371490 after retry RPC after error@1198176107) -> (continuation of Deferred@1774610645 after retry RPC after error@695849544) -> (continuation of Deferred@1516136558 after retry RPC after error@1209884065) -> (continuation of Deferred@315032759 after retry RPC after error@1976266549) -> (continuation of Deferred@1551852794 after retry RPC after error@2125322881) -> (continuation of Deferred@1424333663 after retry RPC after error@2054808625) -> (continuation of Deferred@1560676144 after retry RPC after error@1307551683) -> (continuation of Deferred@900260418 after retry RPC after error@4571306) -> (continuation of Deferred@1830254613 after retry RPC after error@1568021451) -> (continuation of Deferred@792611029 after retry RPC after error@22060296) -> (continuation of Deferred@1464965863 after retry RPC after error@982805381) -> (continuation of Deferred@1731323106 after retry RPC after error@1644989905) -> (continuation of Deferred@970044885 after retry RPC after error@536881449) -> (continuation of Deferred@1224662847 after retry RPC after error@1310372340) -> (continuation of Deferred@2052180735 after retry RPC after error@1538915837) -> (continuation of Deferred@1694553746 after retry RPC after error@2123255511) -> (continuation of Deferred@184313291 after retry RPC after error@507393916) -> (continuation of Deferred@2104084079 after retry RPC after error@1897781219) -> (continuation of Deferred@413546038 after retry RPC after error@2009884553), errback=(continuation of Deferred@1493972407 after retry RPC after error@710555840) -> (continuation of Deferred@364179224 after retry RPC after error@749606026) -> (continuation of Deferred@339164453 after retry RPC after error@1875942235) -> (continuation of Deferred@1571714454 after retry RPC after error@33038573) -> (continuation of Deferred@747371490 after retry RPC after error@1198176107) -> (continuation of Deferred@1774610645 after retry RPC after error@695849544) -> (continuation of Deferred@1516136558 after retry RPC after error@1209884065) -> (continuation of Deferred@315032759 after retry RPC after error@1976266549) -> (continuation of Deferred@1551852794 after retry RPC after error@2125322881) -> (continuation of Deferred@1424333663 after retry RPC after error@2054808625) -> (continuation of Deferred@1560676144 after retry RPC after error@1307551683) -> (continuation of Deferred@900260418 after retry RPC after error@4571306) -> (continuation of Deferred@1830254613 after retry RPC after error@1568021451) -> (continuation of Deferred@792611029 after retry RPC after error@22060296) -> (continuation of Deferred@1464965863 after retry RPC after error@982805381) -> (continuation of Deferred@1731323106 after retry RPC after error@1644989905) -> (continuation of Deferred@970044885 after retry RPC after error@536881449) -> (continuation of Deferred@1224662847 after retry RPC after error@1310372340) -> (continuation of Deferred@2052180735 after retry RPC after error@1538915837) -> (continuation of Deferred@1694553746 after retry RPC after error@2123255511) -> (continuation of Deferred@184313291 after retry RPC after error@507393916) -> (continuation of Deferred@2104084079 after retry RPC after error@1897781219) -> (continuation of Deferred@413546038 after retry RPC after error@2009884553)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.124:38627
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:17.626 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_5).
18:34:17.686 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:17.686 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:17.686 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:17.687 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:17.688 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:17.688 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:17.689 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:17.689 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:17.690 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#5 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_5.
18:34:17.690 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:17.691 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:17.691 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:17.691 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:17.691 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:17.691 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:17.691 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:17.692 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26966), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [49ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [91ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [99ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [99ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [118ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [131ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [131ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [144ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [151ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [153ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [154ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [160ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [161ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [183ms] refreshing cache from master, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [184ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [184ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [186ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [186ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [202ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [243ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [284ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [284ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [301ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [301ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [302ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [601ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [601ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [601ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [601ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1202ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1841ms] refreshing cache from master, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1843ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [4320ms] refreshing cache from master, [4320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4322ms] too many traces: truncated at 100 traces, deferred=Deferred@410266366(state=PENDING, result=null, callback=(continuation of Deferred@1493972407 after retry RPC after error@710555840) -> (continuation of Deferred@364179224 after retry RPC after error@749606026) -> (continuation of Deferred@339164453 after retry RPC after error@1875942235) -> (continuation of Deferred@1571714454 after retry RPC after error@33038573) -> (continuation of Deferred@747371490 after retry RPC after error@1198176107) -> (continuation of Deferred@1774610645 after retry RPC after error@695849544) -> (continuation of Deferred@1516136558 after retry RPC after error@1209884065) -> (continuation of Deferred@315032759 after retry RPC after error@1976266549) -> (continuation of Deferred@1551852794 after retry RPC after error@2125322881) -> (continuation of Deferred@1424333663 after retry RPC after error@2054808625) -> (continuation of Deferred@1560676144 after retry RPC after error@1307551683) -> (continuation of Deferred@900260418 after retry RPC after error@4571306) -> (continuation of Deferred@1830254613 after retry RPC after error@1568021451) -> (continuation of Deferred@792611029 after retry RPC after error@22060296) -> (continuation of Deferred@1464965863 after retry RPC after error@982805381) -> (continuation of Deferred@1731323106 after retry RPC after error@1644989905) -> (continuation of Deferred@970044885 after retry RPC after error@536881449) -> (continuation of Deferred@1224662847 after retry RPC after error@1310372340) -> (continuation of Deferred@2052180735 after retry RPC after error@1538915837) -> (continuation of Deferred@1694553746 after retry RPC after error@2123255511) -> (continuation of Deferred@184313291 after retry RPC after error@507393916) -> (continuation of Deferred@2104084079 after retry RPC after error@1897781219) -> (continuation of Deferred@413546038 after retry RPC after error@2009884553), errback=(continuation of Deferred@1493972407 after retry RPC after error@710555840) -> (continuation of Deferred@364179224 after retry RPC after error@749606026) -> (continuation of Deferred@339164453 after retry RPC after error@1875942235) -> (continuation of Deferred@1571714454 after retry RPC after error@33038573) -> (continuation of Deferred@747371490 after retry RPC after error@1198176107) -> (continuation of Deferred@1774610645 after retry RPC after error@695849544) -> (continuation of Deferred@1516136558 after retry RPC after error@1209884065) -> (continuation of Deferred@315032759 after retry RPC after error@1976266549) -> (continuation of Deferred@1551852794 after retry RPC after error@2125322881) -> (continuation of Deferred@1424333663 after retry RPC after error@2054808625) -> (continuation of Deferred@1560676144 after retry RPC after error@1307551683) -> (continuation of Deferred@900260418 after retry RPC after error@4571306) -> (continuation of Deferred@1830254613 after retry RPC after error@1568021451) -> (continuation of Deferred@792611029 after retry RPC after error@22060296) -> (continuation of Deferred@1464965863 after retry RPC after error@982805381) -> (continuation of Deferred@1731323106 after retry RPC after error@1644989905) -> (continuation of Deferred@970044885 after retry RPC after error@536881449) -> (continuation of Deferred@1224662847 after retry RPC after error@1310372340) -> (continuation of Deferred@2052180735 after retry RPC after error@1538915837) -> (continuation of Deferred@1694553746 after retry RPC after error@2123255511) -> (continuation of Deferred@184313291 after retry RPC after error@507393916) -> (continuation of Deferred@2104084079 after retry RPC after error@1897781219) -> (continuation of Deferred@413546038 after retry RPC after error@2009884553)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.124:38627
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:17.693 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:17.693 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_5.
18:34:17.694 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state RUNNING to RESTARTING.
18:34:17.694 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#5) of source Source: KuduSource.
18:34:17.686 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:17.695 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:17.695 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:17.695 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:17.695 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:17.695 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:17.695 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:17.695 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:17.695 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:17.696 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:17.696 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:17.696 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:17.696 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:17.699 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:17.699 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:17.699 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:17.699 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.699 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.699 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.699 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.699 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.699 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.699 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.699 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.699 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.699 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:17.759 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:17.759 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:17.759 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:17.759 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.759 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.759 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:17.760 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.760 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.760 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:17.760 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.760 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.760 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:17.760 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:17.855 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:17.855 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:17.855 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:17.856 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:17.856 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:17.856 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:17.856 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:17.856 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:17.856 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:17.857 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:17.857 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:17.857 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:17.857 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:17.858 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29908), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [46ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [50ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [58ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [58ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [65ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [68ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [69ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [83ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [84ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [86ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [86ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [142ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [304ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [304ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [304ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [542ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [542ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [542ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [542ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [942ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [942ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [943ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [943ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1004ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1004ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1163ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [3041ms] refreshing cache from master, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [3041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [3042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [3042ms] too many traces: truncated at 100 traces, deferred=Deferred@1829217563(state=PENDING, result=null, callback=(continuation of Deferred@1669640707 after retry RPC after error@1676782321) -> (continuation of Deferred@841792822 after retry RPC after error@1658059029) -> (continuation of Deferred@612453350 after retry RPC after error@1254738853) -> (continuation of Deferred@500898503 after retry RPC after error@1614631736) -> (continuation of Deferred@1322117794 after retry RPC after error@1256031293) -> (continuation of Deferred@253076099 after retry RPC after error@96175306) -> (continuation of Deferred@612562469 after retry RPC after error@47735524) -> (continuation of Deferred@553372038 after retry RPC after error@2034209927) -> (continuation of Deferred@1245668955 after retry RPC after error@196211386) -> (continuation of Deferred@1970843059 after retry RPC after error@1894155319) -> (continuation of Deferred@1104816590 after retry RPC after error@1174026093) -> (continuation of Deferred@1977552724 after retry RPC after error@836561636) -> (continuation of Deferred@559423816 after retry RPC after error@890059601) -> (continuation of Deferred@950351627 after retry RPC after error@1861775665) -> (continuation of Deferred@239755207 after retry RPC after error@1388395244) -> (continuation of Deferred@1137525456 after retry RPC after error@1855046241) -> (continuation of Deferred@846797843 after retry RPC after error@1765037802) -> (continuation of Deferred@1086735070 after retry RPC after error@547619437) -> (continuation of Deferred@1522994158 after retry RPC after error@294618458) -> (continuation of Deferred@1663956231 after retry RPC after error@1662661733) -> (continuation of Deferred@31513491 after retry RPC after error@1822960544) -> (continuation of Deferred@1621196543 after retry RPC after error@1386928018) -> (continuation of Deferred@1435611671 after retry RPC after error@2026468910) -> (continuation of Deferred@334801230 after retry RPC after error@392624869) -> (continuation of Deferred@1329586964 after retry RPC after error@2088010971) -> (continuation of Deferred@1249705154 after retry RPC after error@1785566906) -> (continuation of Deferred@1518006176 after retry RPC after error@40958568), errback=(continuation of Deferred@1669640707 after retry RPC after error@1676782321) -> (continuation of Deferred@841792822 after retry RPC after error@1658059029) -> (continuation of Deferred@612453350 after retry RPC after error@1254738853) -> (continuation of Deferred@500898503 after retry RPC after error@1614631736) -> (continuation of Deferred@1322117794 after retry RPC after error@1256031293) -> (continuation of Deferred@253076099 after retry RPC after error@96175306) -> (continuation of Deferred@612562469 after retry RPC after error@47735524) -> (continuation of Deferred@553372038 after retry RPC after error@2034209927) -> (continuation of Deferred@1245668955 after retry RPC after error@196211386) -> (continuation of Deferred@1970843059 after retry RPC after error@1894155319) -> (continuation of Deferred@1104816590 after retry RPC after error@1174026093) -> (continuation of Deferred@1977552724 after retry RPC after error@836561636) -> (continuation of Deferred@559423816 after retry RPC after error@890059601) -> (continuation of Deferred@950351627 after retry RPC after error@1861775665) -> (continuation of Deferred@239755207 after retry RPC after error@1388395244) -> (continuation of Deferred@1137525456 after retry RPC after error@1855046241) -> (continuation of Deferred@846797843 after retry RPC after error@1765037802) -> (continuation of Deferred@1086735070 after retry RPC after error@547619437) -> (continuation of Deferred@1522994158 after retry RPC after error@294618458) -> (continuation of Deferred@1663956231 after retry RPC after error@1662661733) -> (continuation of Deferred@31513491 after retry RPC after error@1822960544) -> (continuation of Deferred@1621196543 after retry RPC after error@1386928018) -> (continuation of Deferred@1435611671 after retry RPC after error@2026468910) -> (continuation of Deferred@334801230 after retry RPC after error@392624869) -> (continuation of Deferred@1329586964 after retry RPC after error@2088010971) -> (continuation of Deferred@1249705154 after retry RPC after error@1785566906) -> (continuation of Deferred@1518006176 after retry RPC after error@40958568)))
18:34:17.971 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:17.972 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:17.973 [DEBUG - main] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:34:17.981 [DEBUG - main] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:34:17.982 [DEBUG - main] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:34:17.982 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.7.200.190:40077(127.7.200.190:40077)] Successfully connected to peer
18:34:17.982 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.7.200.189:42349(127.7.200.189:42349)] Successfully connected to peer
18:34:17.994 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.190
18:34:18.000 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.7.200.188:38999(127.7.200.188:38999)] Successfully connected to peer
18:34:18.013 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.188
18:34:18.025 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:18.027 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.189
18:34:18.029 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xbdeca4cd, L:/127.0.0.1:58962 - R:/127.7.200.190:40077] using SASL/PLAIN
18:34:18.035 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:18.036 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:18.042 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xab7307d6, L:/127.0.0.1:59120 - R:/127.7.200.188:38999] using SASL/PLAIN
18:34:18.043 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x46900214, L:/127.0.0.1:53728 - R:/127.7.200.189:42349] using SASL/PLAIN
18:34:18.046 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:34:18.046 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=74), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.189:42349, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.190:40077, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.188:38999, [62ms] Sub RPC ConnectToMaster: received response from server master-127.7.200.190:40077: OK, [72ms] Sub RPC ConnectToMaster: received response from server master-127.7.200.188:38999: OK, deferred=null) after lookup
18:34:18.049 [DEBUG - main] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:18.050 [DEBUG - main] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:18.050 [DEBUG - main] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:18.051 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:18.051 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:18.051 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:18.052 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:18.052 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:18.052 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:18.052 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:18.052 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:18.052 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:18.053 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:18.053 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:18.053 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:18.053 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:18.054 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.6.245.61:44495(127.6.245.61:44495)] Successfully connected to peer
18:34:18.058 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.6.245.62:36853(127.6.245.62:36853)] Successfully connected to peer
18:34:18.063 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.6.245.60:46787(127.6.245.60:46787)] Successfully connected to peer
18:34:18.064 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.62
18:34:18.067 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.61
18:34:18.078 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:18.079 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:18.079 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:18.079 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:18.079 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:18.079 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:18.079 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:18.079 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:18.079 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:18.079 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:18.079 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:18.079 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:18.080 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:18.080 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:18.083 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:18.084 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa84d486f, L:/127.0.0.1:53458 - R:/127.6.245.61:44495] using SASL/PLAIN
18:34:18.086 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.60
18:34:18.097 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5c82b263, L:/127.0.0.1:41102 - R:/127.6.245.62:36853] using SASL/PLAIN
18:34:18.099 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:18.108 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:18.111 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x5e3ea6f8, L:/127.0.0.1:56914 - R:/127.6.245.60:46787] using SASL/PLAIN
18:34:18.115 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:34:18.115 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=65), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [51ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: OK, [54ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: OK, [65ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: OK, deferred=null) after lookup
18:34:18.119 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table ffbf6c12abe4466485202b0208f6b095
18:34:18.126 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c39b66751cde487c94b99b60adc93d53 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
18:34:18.126 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f77f28191ee54426a01bed4a9478ccd6 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
18:34:18.126 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a84c5b3ea6b149718b3ae30a0ce84a17 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
18:34:18.126 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a2bab9e2604a4a9597798acdaf04474c for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:18.126 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 109afb7829a5484a844e346132a776be for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:18.126 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2ffabd13bdc04d08879bc28dc62155f3 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:18.127 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=c39b66751cde487c94b99b60adc93d53@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=f77f28191ee54426a01bed4a9478ccd6@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=a84c5b3ea6b149718b3ae30a0ce84a17@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=a2bab9e2604a4a9597798acdaf04474c@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=109afb7829a5484a844e346132a776be@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=2ffabd13bdc04d08879bc28dc62155f3@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:18.128 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:18.129 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:18.129 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:18.129 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:18.129 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:18.129 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:18.129 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:18.129 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:18.129 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:18.129 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:18.129 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:18.129 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:18.129 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:18.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.130390  8237 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59120:
18:34:18.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
18:34:18.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
18:34:18.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:34:18.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
18:34:18.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:34:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\000"
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 3
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key3"
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 42
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:34:18.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
18:34:18.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:18.139200  8237 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
18:34:18.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:18.197 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:18.197 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:18.197 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:18.197 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:18.198 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:18.198 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:18.198 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:18.198 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:18.198 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:18.198 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:18.199 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:18.199 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:18.199 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:18.267 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8fe8917b37c84035bbea7dbddc98d83c
18:34:18.333 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:18.333 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:18.333 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:18.333 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:18.333 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:18.333 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:18.334 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:18.334 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:18.334 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:18.334 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:18.334 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:18.334 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:18.334 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:18.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.383471  8578 tablet_service.cc:1511] Processing CreateTablet for tablet d9b4ee28af7743f59956e54d0900a1bc (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
18:34:18.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.385165  8578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b4ee28af7743f59956e54d0900a1bc. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.387920  8576 tablet_service.cc:1511] Processing CreateTablet for tablet 5c37815e96ea465a8c32e5a3d746b02b (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
18:34:18.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.389030  8576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c37815e96ea465a8c32e5a3d746b02b. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.390055  8575 tablet_service.cc:1511] Processing CreateTablet for tablet 13389bc0c0984bb788a1186c024e4f17 (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
18:34:18.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.392370  8577 tablet_service.cc:1511] Processing CreateTablet for tablet 8deb64d0611e4e7e9f7c8324b188cb2b (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
18:34:18.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.393412  8577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8deb64d0611e4e7e9f7c8324b188cb2b. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.402819  8580 tablet_service.cc:1511] Processing CreateTablet for tablet 569fbab27dcc46ceb35a25ca5373588b (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
18:34:18.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.403110  8575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13389bc0c0984bb788a1186c024e4f17. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.404237  8580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569fbab27dcc46ceb35a25ca5373588b. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.404604  8435 tablet_service.cc:1511] Processing CreateTablet for tablet 38eacb309d714c09b7c15323079452fd (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
18:34:18.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.405980  8435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38eacb309d714c09b7c15323079452fd. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.405460  8720 tablet_service.cc:1511] Processing CreateTablet for tablet 38eacb309d714c09b7c15323079452fd (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
18:34:18.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.407189  8720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38eacb309d714c09b7c15323079452fd. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.407307  8718 tablet_service.cc:1511] Processing CreateTablet for tablet 8deb64d0611e4e7e9f7c8324b188cb2b (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
18:34:18.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.408303  8434 tablet_service.cc:1511] Processing CreateTablet for tablet d9b4ee28af7743f59956e54d0900a1bc (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
18:34:18.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.408819  8716 tablet_service.cc:1511] Processing CreateTablet for tablet 13389bc0c0984bb788a1186c024e4f17 (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
18:34:18.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.409391  8434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b4ee28af7743f59956e54d0900a1bc. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.409370  8718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8deb64d0611e4e7e9f7c8324b188cb2b. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.410234  8716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13389bc0c0984bb788a1186c024e4f17. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.412451  8717 tablet_service.cc:1511] Processing CreateTablet for tablet 5c37815e96ea465a8c32e5a3d746b02b (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
18:34:18.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.412322  8433 tablet_service.cc:1511] Processing CreateTablet for tablet 8deb64d0611e4e7e9f7c8324b188cb2b (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
18:34:18.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.413352  8717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c37815e96ea465a8c32e5a3d746b02b. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.413399  8433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8deb64d0611e4e7e9f7c8324b188cb2b. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.415614  8721 tablet_service.cc:1511] Processing CreateTablet for tablet 569fbab27dcc46ceb35a25ca5373588b (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
18:34:18.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.416288  8432 tablet_service.cc:1511] Processing CreateTablet for tablet 5c37815e96ea465a8c32e5a3d746b02b (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
18:34:18.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.416736  8721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569fbab27dcc46ceb35a25ca5373588b. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.398581  8579 tablet_service.cc:1511] Processing CreateTablet for tablet 38eacb309d714c09b7c15323079452fd (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
18:34:18.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.417327  8432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c37815e96ea465a8c32e5a3d746b02b. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.418102  8579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38eacb309d714c09b7c15323079452fd. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.418565  8719 tablet_service.cc:1511] Processing CreateTablet for tablet d9b4ee28af7743f59956e54d0900a1bc (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
18:34:18.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.419710  8719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b4ee28af7743f59956e54d0900a1bc. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.419661  8431 tablet_service.cc:1511] Processing CreateTablet for tablet 13389bc0c0984bb788a1186c024e4f17 (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
18:34:18.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.420751  8431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13389bc0c0984bb788a1186c024e4f17. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.402160  8436 tablet_service.cc:1511] Processing CreateTablet for tablet 569fbab27dcc46ceb35a25ca5373588b (DEFAULT_TABLE table=replication_test_table [id=8fe8917b37c84035bbea7dbddc98d83c]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
18:34:18.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.435135  8436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569fbab27dcc46ceb35a25ca5373588b. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:18.459 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:18.459 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:18.459 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:18.460 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:18.460 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:18.460 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:18.460 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:18.460 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:18.460 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:18.461 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:18.461 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:18.461 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:18.461 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:18.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.508136  8951 tablet_bootstrap.cc:492] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3: Bootstrap starting.
18:34:18.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.534346  8952 tablet_bootstrap.cc:492] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e: Bootstrap starting.
18:34:18.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.551807  8952 tablet_bootstrap.cc:654] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e: Neither blocks nor log segments found. Creating new log.
18:34:18.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.552568  8953 tablet_bootstrap.cc:492] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651: Bootstrap starting.
18:34:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.554339  8952 log.cc:826] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e: Log is configured to *not* fsync() on all Append() calls
18:34:18.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.558092  8951 tablet_bootstrap.cc:654] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3: Neither blocks nor log segments found. Creating new log.
18:34:18.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.561000  8951 log.cc:826] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3: Log is configured to *not* fsync() on all Append() calls
18:34:18.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.564723  8953 tablet_bootstrap.cc:654] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651: Neither blocks nor log segments found. Creating new log.
18:34:18.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.568202  8953 log.cc:826] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651: Log is configured to *not* fsync() on all Append() calls
18:34:18.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.571859  8951 tablet_bootstrap.cc:492] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3: No bootstrap required, opened a new log
18:34:18.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.572579  8951 ts_tablet_manager.cc:1403] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.003s
18:34:18.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.573071  8952 tablet_bootstrap.cc:492] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e: No bootstrap required, opened a new log
18:34:18.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.573575  8952 ts_tablet_manager.cc:1403] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.011s
18:34:18.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.592338  8953 tablet_bootstrap.cc:492] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651: No bootstrap required, opened a new log
18:34:18.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.592900  8953 ts_tablet_manager.cc:1403] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.013s
18:34:18.599 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:18.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.609694  8952 raft_consensus.cc:359] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:18.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.610741  8952 raft_consensus.cc:385] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:18.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.611091  8952 raft_consensus.cc:740] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2eeb0ca41546d7bcaca3220385168e, State: Initialized, Role: FOLLOWER
18:34:18.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.610350  8951 raft_consensus.cc:359] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } } peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } }
18:34:18.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.611696  8951 raft_consensus.cc:385] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:18.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.612349  8951 raft_consensus.cc:740] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d36a83f4440eaac9ce006765394d3, State: Initialized, Role: FOLLOWER
18:34:18.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.612068  8952 consensus_queue.cc:260] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:18.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.613579  8951 consensus_queue.cc:260] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } } peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } }
18:34:18.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.624059  8951 ts_tablet_manager.cc:1434] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3: Time spent starting tablet: real 0.051s	user 0.032s	sys 0.008s
18:34:18.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.629467  8952 ts_tablet_manager.cc:1434] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e: Time spent starting tablet: real 0.056s	user 0.037s	sys 0.012s
18:34:18.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.630475  8952 tablet_bootstrap.cc:492] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e: Bootstrap starting.
18:34:18.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.636934  8952 tablet_bootstrap.cc:654] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e: Neither blocks nor log segments found. Creating new log.
18:34:18.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.640568  8951 tablet_bootstrap.cc:492] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3: Bootstrap starting.
18:34:18.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.650251  8951 tablet_bootstrap.cc:654] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3: Neither blocks nor log segments found. Creating new log.
18:34:18.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:18.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.693543  8957 raft_consensus.cc:493] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:18.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.694345  8957 raft_consensus.cc:515] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:18.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.716200  8957 leader_election.cc:290] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899), b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405)
18:34:18.724 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:18.725 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:18.725 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:18.725 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:18.725 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:18.725 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:18.726 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:18.726 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:18.726 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:18.726 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:18.726 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:18.726 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:18.726 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:18.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.725381  8953 raft_consensus.cc:359] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:18.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.729837  8952 tablet_bootstrap.cc:492] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e: No bootstrap required, opened a new log
18:34:18.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.730334  8952 ts_tablet_manager.cc:1403] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e: Time spent bootstrapping tablet: real 0.100s	user 0.033s	sys 0.043s
18:34:18.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.731017  8951 tablet_bootstrap.cc:492] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3: No bootstrap required, opened a new log
18:34:18.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.731616  8951 ts_tablet_manager.cc:1403] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3: Time spent bootstrapping tablet: real 0.091s	user 0.031s	sys 0.028s
18:34:18.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.733417  8952 raft_consensus.cc:359] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:18.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.734139  8952 raft_consensus.cc:385] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:18.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.734416  8952 raft_consensus.cc:740] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2eeb0ca41546d7bcaca3220385168e, State: Initialized, Role: FOLLOWER
18:34:18.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.735123  8952 consensus_queue.cc:260] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:18.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.735350  8951 raft_consensus.cc:359] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:18.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.736618  8951 raft_consensus.cc:385] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:18.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.737025  8951 raft_consensus.cc:740] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d36a83f4440eaac9ce006765394d3, State: Initialized, Role: FOLLOWER
18:34:18.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.737924  8951 consensus_queue.cc:260] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:18.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.740057  8951 ts_tablet_manager.cc:1434] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
18:34:18.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.727938  8953 raft_consensus.cc:385] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:18.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.747129  8953 raft_consensus.cc:740] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d916cabe36cb45ccb545d9fc771a4651, State: Initialized, Role: FOLLOWER
18:34:18.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.748515  8952 ts_tablet_manager.cc:1434] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
18:34:18.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.749225  8953 consensus_queue.cc:260] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:18.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.752653  8952 tablet_bootstrap.cc:492] T 569fbab27dcc46ceb35a25ca5373588b P 5e2eeb0ca41546d7bcaca3220385168e: Bootstrap starting.
18:34:18.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.753652  8951 tablet_bootstrap.cc:492] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3: Bootstrap starting.
18:34:18.782 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:18.782 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:18.782 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:18.783 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:18.783 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:18.783 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:18.783 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:18.783 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:18.783 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:18.783 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:18.783 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:18.783 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:18.783 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:18.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.777873  8952 tablet_bootstrap.cc:654] T 569fbab27dcc46ceb35a25ca5373588b P 5e2eeb0ca41546d7bcaca3220385168e: Neither blocks nor log segments found. Creating new log.
18:34:18.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.774712  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c37815e96ea465a8c32e5a3d746b02b" candidate_uuid: "5e2eeb0ca41546d7bcaca3220385168e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d916cabe36cb45ccb545d9fc771a4651" is_pre_election: true
18:34:18.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.780259  8951 tablet_bootstrap.cc:654] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3: Neither blocks nor log segments found. Creating new log.
18:34:18.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:18.781419  8674 leader_election.cc:343] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899): Illegal state: must be running to vote when last-logged opid is not known
18:34:18.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.785336  8953 ts_tablet_manager.cc:1434] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651: Time spent starting tablet: real 0.192s	user 0.031s	sys 0.013s
18:34:18.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.798233  8953 tablet_bootstrap.cc:492] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651: Bootstrap starting.
18:34:18.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.799386  8957 raft_consensus.cc:493] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:18.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.799969  8957 raft_consensus.cc:515] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:18.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.808418  8958 raft_consensus.cc:493] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:18.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.809067  8958 raft_consensus.cc:515] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:18.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.811203  8957 leader_election.cc:290] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899), b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405)
18:34:18.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.812492  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8deb64d0611e4e7e9f7c8324b188cb2b" candidate_uuid: "5e2eeb0ca41546d7bcaca3220385168e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d916cabe36cb45ccb545d9fc771a4651" is_pre_election: true
18:34:18.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:18.820613  8674 leader_election.cc:343] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899): Illegal state: must be running to vote when last-logged opid is not known
18:34:18.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:18.830945  8652 tablet.cc:2406] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:34:18.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.831748  8958 leader_election.cc:290] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899), 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157)
18:34:18.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.844311  8958 raft_consensus.cc:493] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:18.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.844846  8958 raft_consensus.cc:515] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } } peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } }
18:34:18.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.847266  8958 leader_election.cc:290] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157), d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899)
18:34:18.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.859229  8953 tablet_bootstrap.cc:654] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651: Neither blocks nor log segments found. Creating new log.
18:34:18.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:18.860181  8789 tablet.cc:2406] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:34:18.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.868281  8952 tablet_bootstrap.cc:492] T 569fbab27dcc46ceb35a25ca5373588b P 5e2eeb0ca41546d7bcaca3220385168e: No bootstrap required, opened a new log
18:34:18.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.868721  8952 ts_tablet_manager.cc:1403] T 569fbab27dcc46ceb35a25ca5373588b P 5e2eeb0ca41546d7bcaca3220385168e: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.028s
18:34:18.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.882922  8951 tablet_bootstrap.cc:492] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3: No bootstrap required, opened a new log
18:34:18.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.883401  8951 ts_tablet_manager.cc:1403] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3: Time spent bootstrapping tablet: real 0.130s	user 0.020s	sys 0.020s
18:34:18.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.889154  8600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c37815e96ea465a8c32e5a3d746b02b" candidate_uuid: "5e2eeb0ca41546d7bcaca3220385168e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d36a83f4440eaac9ce006765394d3" is_pre_election: true
18:34:18.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.888208  8951 raft_consensus.cc:359] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:18.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.889839  8951 raft_consensus.cc:385] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:18.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.893528  8599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8deb64d0611e4e7e9f7c8324b188cb2b" candidate_uuid: "5e2eeb0ca41546d7bcaca3220385168e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d36a83f4440eaac9ce006765394d3" is_pre_election: true
18:34:18.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:18.894078  8675 leader_election.cc:343] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405): Illegal state: must be running to vote when last-logged opid is not known
18:34:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.891813  8952 raft_consensus.cc:359] T 569fbab27dcc46ceb35a25ca5373588b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } } peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } }
18:34:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.894555  8675 leader_election.cc:304] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2eeb0ca41546d7bcaca3220385168e; no voters: b47d36a83f4440eaac9ce006765394d3, d916cabe36cb45ccb545d9fc771a4651
18:34:18.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.895166  8952 raft_consensus.cc:385] T 569fbab27dcc46ceb35a25ca5373588b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:18.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.896572  8952 raft_consensus.cc:740] T 569fbab27dcc46ceb35a25ca5373588b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2eeb0ca41546d7bcaca3220385168e, State: Initialized, Role: FOLLOWER
18:34:18.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.897119  8957 raft_consensus.cc:2749] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:34:18.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.897351  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fbab27dcc46ceb35a25ca5373588b" candidate_uuid: "b47d36a83f4440eaac9ce006765394d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d916cabe36cb45ccb545d9fc771a4651" is_pre_election: true
18:34:18.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.897328  8952 consensus_queue.cc:260] T 569fbab27dcc46ceb35a25ca5373588b P 5e2eeb0ca41546d7bcaca3220385168e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } } peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } }
18:34:18.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.898211  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b4ee28af7743f59956e54d0900a1bc" candidate_uuid: "b47d36a83f4440eaac9ce006765394d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d916cabe36cb45ccb545d9fc771a4651" is_pre_election: true
18:34:18.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.899592  8952 ts_tablet_manager.cc:1434] T 569fbab27dcc46ceb35a25ca5373588b P 5e2eeb0ca41546d7bcaca3220385168e: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
18:34:18.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:18.900127  8532 leader_election.cc:343] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899): Illegal state: must be running to vote when last-logged opid is not known
18:34:18.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:18.901023  8532 leader_election.cc:343] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899): Illegal state: must be running to vote when last-logged opid is not known
18:34:18.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.892297  8951 raft_consensus.cc:740] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d36a83f4440eaac9ce006765394d3, State: Initialized, Role: FOLLOWER
18:34:18.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:18.896090  8675 leader_election.cc:343] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405): Illegal state: must be running to vote when last-logged opid is not known
18:34:18.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.902626  8951 consensus_queue.cc:260] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:18.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.903137  8675 leader_election.cc:304] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2eeb0ca41546d7bcaca3220385168e; no voters: b47d36a83f4440eaac9ce006765394d3, d916cabe36cb45ccb545d9fc771a4651
18:34:18.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.904685  8961 raft_consensus.cc:2749] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:34:18.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.908475  8951 ts_tablet_manager.cc:1434] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
18:34:18.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.909770  8952 tablet_bootstrap.cc:492] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e: Bootstrap starting.
18:34:18.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.913662  8741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b4ee28af7743f59956e54d0900a1bc" candidate_uuid: "b47d36a83f4440eaac9ce006765394d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2eeb0ca41546d7bcaca3220385168e" is_pre_election: true
18:34:18.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.914443  8951 tablet_bootstrap.cc:492] T 8deb64d0611e4e7e9f7c8324b188cb2b P b47d36a83f4440eaac9ce006765394d3: Bootstrap starting.
18:34:18.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.915545  8740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fbab27dcc46ceb35a25ca5373588b" candidate_uuid: "b47d36a83f4440eaac9ce006765394d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2eeb0ca41546d7bcaca3220385168e" is_pre_election: true
18:34:18.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.916285  8740 raft_consensus.cc:2468] T 569fbab27dcc46ceb35a25ca5373588b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b47d36a83f4440eaac9ce006765394d3 in term 0.
18:34:18.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.921691  8951 tablet_bootstrap.cc:654] T 8deb64d0611e4e7e9f7c8324b188cb2b P b47d36a83f4440eaac9ce006765394d3: Neither blocks nor log segments found. Creating new log.
18:34:18.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.933202  8533 leader_election.cc:304] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2eeb0ca41546d7bcaca3220385168e, b47d36a83f4440eaac9ce006765394d3; no voters: d916cabe36cb45ccb545d9fc771a4651
18:34:18.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.935063  8958 raft_consensus.cc:2804] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:34:18.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.935420  8958 raft_consensus.cc:493] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:34:18.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.935711  8958 raft_consensus.cc:3060] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Advancing to term 1
18:34:18.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.940553  8952 tablet_bootstrap.cc:654] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e: Neither blocks nor log segments found. Creating new log.
18:34:18.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.953080  8964 raft_consensus.cc:493] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:18.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.953728  8964 raft_consensus.cc:515] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:18.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:18.956746  8533 leader_election.cc:343] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157): Illegal state: must be running to vote when last-logged opid is not known
18:34:18.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.959434  8964 leader_election.cc:290] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405), 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157)
18:34:18.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.961790  8533 leader_election.cc:304] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b47d36a83f4440eaac9ce006765394d3; no voters: 5e2eeb0ca41546d7bcaca3220385168e, d916cabe36cb45ccb545d9fc771a4651
18:34:18.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:18.975042  8509 tablet.cc:2406] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:34:18.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.981261  8958 raft_consensus.cc:515] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } } peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } }
18:34:18.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.986809  8953 tablet_bootstrap.cc:492] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651: No bootstrap required, opened a new log
18:34:18.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.987339  8953 ts_tablet_manager.cc:1403] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651: Time spent bootstrapping tablet: real 0.189s	user 0.008s	sys 0.006s
18:34:18.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.992202  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fbab27dcc46ceb35a25ca5373588b" candidate_uuid: "b47d36a83f4440eaac9ce006765394d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d916cabe36cb45ccb545d9fc771a4651"
18:34:18.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:18.993433  8532 leader_election.cc:343] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899): Illegal state: must be running to vote when last-logged opid is not known
18:34:18.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.992404  8953 raft_consensus.cc:359] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.999495  8953 raft_consensus.cc:385] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:19.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.000128  8953 raft_consensus.cc:740] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d916cabe36cb45ccb545d9fc771a4651, State: Initialized, Role: FOLLOWER
18:34:19.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.001209  8953 consensus_queue.cc:260] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:18.990682  8958 leader_election.cc:290] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 election: Requested vote from peers 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157), d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899)
18:34:19.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.019656  8953 ts_tablet_manager.cc:1434] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.003s
18:34:19.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.020015  8973 raft_consensus.cc:2749] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:34:19.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.020663  8953 tablet_bootstrap.cc:492] T 38eacb309d714c09b7c15323079452fd P d916cabe36cb45ccb545d9fc771a4651: Bootstrap starting.
18:34:19.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.031193  8741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569fbab27dcc46ceb35a25ca5373588b" candidate_uuid: "b47d36a83f4440eaac9ce006765394d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2eeb0ca41546d7bcaca3220385168e"
18:34:19.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.031795  8741 raft_consensus.cc:3060] T 569fbab27dcc46ceb35a25ca5373588b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Advancing to term 1
18:34:19.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.039889  8741 raft_consensus.cc:2468] T 569fbab27dcc46ceb35a25ca5373588b P 5e2eeb0ca41546d7bcaca3220385168e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b47d36a83f4440eaac9ce006765394d3 in term 1.
18:34:19.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.044289  8958 raft_consensus.cc:493] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:19.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.044952  8958 raft_consensus.cc:515] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.063809  8952 tablet_bootstrap.cc:492] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e: No bootstrap required, opened a new log
18:34:19.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.064625  8952 ts_tablet_manager.cc:1403] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e: Time spent bootstrapping tablet: real 0.155s	user 0.025s	sys 0.016s
18:34:19.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.066766  8953 tablet_bootstrap.cc:654] T 38eacb309d714c09b7c15323079452fd P d916cabe36cb45ccb545d9fc771a4651: Neither blocks nor log segments found. Creating new log.
18:34:19.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.068106  8952 raft_consensus.cc:359] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.069061  8952 raft_consensus.cc:385] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:19.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.069450  8952 raft_consensus.cc:740] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2eeb0ca41546d7bcaca3220385168e, State: Initialized, Role: FOLLOWER
18:34:19.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.070415  8952 consensus_queue.cc:260] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.079627  8952 ts_tablet_manager.cc:1434] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
18:34:19.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.092864  8958 leader_election.cc:290] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899), 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157)
18:34:19.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.043988  8533 leader_election.cc:304] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2eeb0ca41546d7bcaca3220385168e, b47d36a83f4440eaac9ce006765394d3; no voters: d916cabe36cb45ccb545d9fc771a4651
18:34:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:19.094352  8533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.200.131:36157, user_credentials={real_user=slave}} blocked reactor thread for 50436us
18:34:19.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.096202  8958 raft_consensus.cc:2804] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [term 1 FOLLOWER]: Leader election won for term 1
18:34:19.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.098762  8958 raft_consensus.cc:697] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [term 1 LEADER]: Becoming Leader. State: Replica: b47d36a83f4440eaac9ce006765394d3, State: Running, Role: LEADER
18:34:19.099 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:19.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.100525  8741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13389bc0c0984bb788a1186c024e4f17" candidate_uuid: "b47d36a83f4440eaac9ce006765394d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2eeb0ca41546d7bcaca3220385168e" is_pre_election: true
18:34:19.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:19.102401  8533 leader_election.cc:343] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157): Illegal state: must be running to vote when last-logged opid is not known
18:34:19.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.105355  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13389bc0c0984bb788a1186c024e4f17" candidate_uuid: "b47d36a83f4440eaac9ce006765394d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d916cabe36cb45ccb545d9fc771a4651" is_pre_election: true
18:34:19.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.106045  8456 raft_consensus.cc:2468] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b47d36a83f4440eaac9ce006765394d3 in term 0.
18:34:19.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.107343  8532 leader_election.cc:304] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b47d36a83f4440eaac9ce006765394d3, d916cabe36cb45ccb545d9fc771a4651; no voters: 5e2eeb0ca41546d7bcaca3220385168e
18:34:19.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.108598  8973 raft_consensus.cc:2804] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:34:19.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.109143  8973 raft_consensus.cc:493] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:34:19.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.109625  8973 raft_consensus.cc:3060] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Advancing to term 1
18:34:19.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.099807  8958 consensus_queue.cc:237] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } } peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } }
18:34:19.120 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:19.120 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:19.121 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:19.121 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:19.121 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:19.121 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:19.122 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:19.122 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:19.122 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:19.122 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:19.122 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:19.122 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:19.122 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:19.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.121696  8953 tablet_bootstrap.cc:492] T 38eacb309d714c09b7c15323079452fd P d916cabe36cb45ccb545d9fc771a4651: No bootstrap required, opened a new log
18:34:19.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.122681  8953 ts_tablet_manager.cc:1403] T 38eacb309d714c09b7c15323079452fd P d916cabe36cb45ccb545d9fc771a4651: Time spent bootstrapping tablet: real 0.102s	user 0.012s	sys 0.000s
18:34:19.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.126175  8953 raft_consensus.cc:359] T 38eacb309d714c09b7c15323079452fd P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.126987  8953 raft_consensus.cc:385] T 38eacb309d714c09b7c15323079452fd P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:19.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.127260  8953 raft_consensus.cc:740] T 38eacb309d714c09b7c15323079452fd P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d916cabe36cb45ccb545d9fc771a4651, State: Initialized, Role: FOLLOWER
18:34:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.128048  8953 consensus_queue.cc:260] T 38eacb309d714c09b7c15323079452fd P d916cabe36cb45ccb545d9fc771a4651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.134483  8599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13389bc0c0984bb788a1186c024e4f17" candidate_uuid: "d916cabe36cb45ccb545d9fc771a4651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d36a83f4440eaac9ce006765394d3" is_pre_election: true
18:34:19.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.137199  8952 tablet_bootstrap.cc:492] T d9b4ee28af7743f59956e54d0900a1bc P 5e2eeb0ca41546d7bcaca3220385168e: Bootstrap starting.
18:34:19.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.139590  8953 ts_tablet_manager.cc:1434] T 38eacb309d714c09b7c15323079452fd P d916cabe36cb45ccb545d9fc771a4651: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
18:34:19.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.148037  8953 tablet_bootstrap.cc:492] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651: Bootstrap starting.
18:34:19.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.151464  8951 tablet_bootstrap.cc:492] T 8deb64d0611e4e7e9f7c8324b188cb2b P b47d36a83f4440eaac9ce006765394d3: No bootstrap required, opened a new log
18:34:19.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.151971  8951 ts_tablet_manager.cc:1403] T 8deb64d0611e4e7e9f7c8324b188cb2b P b47d36a83f4440eaac9ce006765394d3: Time spent bootstrapping tablet: real 0.238s	user 0.048s	sys 0.065s
18:34:19.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.161983  8953 tablet_bootstrap.cc:654] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651: Neither blocks nor log segments found. Creating new log.
18:34:19.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.162410  8951 raft_consensus.cc:359] T 8deb64d0611e4e7e9f7c8324b188cb2b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.163235  8951 raft_consensus.cc:385] T 8deb64d0611e4e7e9f7c8324b188cb2b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:19.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.163573  8951 raft_consensus.cc:740] T 8deb64d0611e4e7e9f7c8324b188cb2b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d36a83f4440eaac9ce006765394d3, State: Initialized, Role: FOLLOWER
18:34:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.164316  8951 consensus_queue.cc:260] T 8deb64d0611e4e7e9f7c8324b188cb2b P b47d36a83f4440eaac9ce006765394d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.172 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:19.172 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:19.172 [DEBUG - pool-404-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:19.173 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:19.173 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:19.173 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:19.173 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:19.173 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:19.173 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:19.174 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:19.174 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:19.174 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:19.174 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:19.176 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28267), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [48ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [53ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [54ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [54ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [69ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [71ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [72ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [72ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [83ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [83ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [85ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [100ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [101ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [141ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [162ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [241ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [241ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [241ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [242ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [401ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [401ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [402ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [402ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [721ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [721ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [722ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [722ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1000ms] refreshing cache from master, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1002ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2201ms] refreshing cache from master, [2201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2202ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [3724ms] refreshing cache from master, [3724ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [3725ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [3725ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [3725ms] too many traces: truncated at 100 traces, deferred=Deferred@7681108(state=PENDING, result=null, callback=(continuation of Deferred@1838798465 after retry RPC after error@1338778116) -> (continuation of Deferred@1729382300 after retry RPC after error@1323960510) -> (continuation of Deferred@1835332156 after retry RPC after error@1125527958) -> (continuation of Deferred@117159631 after retry RPC after error@407564630) -> (continuation of Deferred@1383400817 after retry RPC after error@538776616) -> (continuation of Deferred@2064352042 after retry RPC after error@872684892) -> (continuation of Deferred@1319159840 after retry RPC after error@106183048) -> (continuation of Deferred@568453307 after retry RPC after error@891027238) -> (continuation of Deferred@2100482157 after retry RPC after error@1519201850) -> (continuation of Deferred@1946657248 after retry RPC after error@504337033) -> (continuation of Deferred@1976932509 after retry RPC after error@1184535779) -> (continuation of Deferred@257631601 after retry RPC after error@1839359433) -> (continuation of Deferred@879364496 after retry RPC after error@642100850) -> (continuation of Deferred@1893951334 after retry RPC after error@236046494) -> (continuation of Deferred@1792239173 after retry RPC after error@1634628435) -> (continuation of Deferred@182317135 after retry RPC after error@168336562) -> (continuation of Deferred@2073567992 after retry RPC after error@1769873971) -> (continuation of Deferred@214231259 after retry RPC after error@1122437373) -> (continuation of Deferred@2018672059 after retry RPC after error@1613084472) -> (continuation of Deferred@1267472855 after retry RPC after error@836124859) -> (continuation of Deferred@1510104223 after retry RPC after error@391363728) -> (continuation of Deferred@1018842380 after retry RPC after error@1072300472) -> (continuation of Deferred@2000966782 after retry RPC after error@2113519930) -> (continuation of Deferred@331686308 after retry RPC after error@2093811109) -> (continuation of Deferred@704600550 after retry RPC after error@440188402) -> (continuation of Deferred@550401808 after retry RPC after error@884653697), errback=(continuation of Deferred@1838798465 after retry RPC after error@1338778116) -> (continuation of Deferred@1729382300 after retry RPC after error@1323960510) -> (continuation of Deferred@1835332156 after retry RPC after error@1125527958) -> (continuation of Deferred@117159631 after retry RPC after error@407564630) -> (continuation of Deferred@1383400817 after retry RPC after error@538776616) -> (continuation of Deferred@2064352042 after retry RPC after error@872684892) -> (continuation of Deferred@1319159840 after retry RPC after error@106183048) -> (continuation of Deferred@568453307 after retry RPC after error@891027238) -> (continuation of Deferred@2100482157 after retry RPC after error@1519201850) -> (continuation of Deferred@1946657248 after retry RPC after error@504337033) -> (continuation of Deferred@1976932509 after retry RPC after error@1184535779) -> (continuation of Deferred@257631601 after retry RPC after error@1839359433) -> (continuation of Deferred@879364496 after retry RPC after error@642100850) -> (continuation of Deferred@1893951334 after retry RPC after error@236046494) -> (continuation of Deferred@1792239173 after retry RPC after error@1634628435) -> (continuation of Deferred@182317135 after retry RPC after error@168336562) -> (continuation of Deferred@2073567992 after retry RPC after error@1769873971) -> (continuation of Deferred@214231259 after retry RPC after error@1122437373) -> (continuation of Deferred@2018672059 after retry RPC after error@1613084472) -> (continuation of Deferred@1267472855 after retry RPC after error@836124859) -> (continuation of Deferred@1510104223 after retry RPC after error@391363728) -> (continuation of Deferred@1018842380 after retry RPC after error@1072300472) -> (continuation of Deferred@2000966782 after retry RPC after error@2113519930) -> (continuation of Deferred@331686308 after retry RPC after error@2093811109) -> (continuation of Deferred@704600550 after retry RPC after error@440188402) -> (continuation of Deferred@550401808 after retry RPC after error@884653697)))
18:34:19.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:19.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.179282  8741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13389bc0c0984bb788a1186c024e4f17" candidate_uuid: "d916cabe36cb45ccb545d9fc771a4651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2eeb0ca41546d7bcaca3220385168e" is_pre_election: true
18:34:19.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:19.181224  8390 leader_election.cc:343] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157): Illegal state: must be running to vote when last-logged opid is not known
18:34:19.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.181517  8973 raft_consensus.cc:515] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.190842  8953 tablet_bootstrap.cc:492] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651: No bootstrap required, opened a new log
18:34:19.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.191431  8953 ts_tablet_manager.cc:1403] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.002s
18:34:19.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.194294  8953 raft_consensus.cc:359] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.203138  8953 raft_consensus.cc:385] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:19.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.203431  8953 raft_consensus.cc:740] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d916cabe36cb45ccb545d9fc771a4651, State: Initialized, Role: FOLLOWER
18:34:19.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.204101  8953 consensus_queue.cc:260] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.201150  8238 catalog_manager.cc:5696] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b47d36a83f4440eaac9ce006765394d3 (127.7.200.130). New cstate: current_term: 1 leader_uuid: "b47d36a83f4440eaac9ce006765394d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } health_report { overall_health: UNKNOWN } } }
18:34:19.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.209295  8599 raft_consensus.cc:2393] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d916cabe36cb45ccb545d9fc771a4651 in current term 1: Already voted for candidate b47d36a83f4440eaac9ce006765394d3 in this term.
18:34:19.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.214413  8953 ts_tablet_manager.cc:1434] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
18:34:19.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.215232  8951 ts_tablet_manager.cc:1434] T 8deb64d0611e4e7e9f7c8324b188cb2b P b47d36a83f4440eaac9ce006765394d3: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.002s
18:34:19.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.216435  8390 leader_election.cc:304] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d916cabe36cb45ccb545d9fc771a4651; no voters: 5e2eeb0ca41546d7bcaca3220385168e, b47d36a83f4440eaac9ce006765394d3
18:34:19.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.217103  8741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13389bc0c0984bb788a1186c024e4f17" candidate_uuid: "b47d36a83f4440eaac9ce006765394d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2eeb0ca41546d7bcaca3220385168e"
18:34:19.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.217309  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13389bc0c0984bb788a1186c024e4f17" candidate_uuid: "b47d36a83f4440eaac9ce006765394d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d916cabe36cb45ccb545d9fc771a4651"
18:34:19.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.217844  8456 raft_consensus.cc:3060] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Advancing to term 1
18:34:19.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:19.219080  8533 leader_election.cc:343] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157): Illegal state: must be running to vote when last-logged opid is not known
18:34:19.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.223300  8973 leader_election.cc:290] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 election: Requested vote from peers d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899), 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157)
18:34:19.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.226738  8957 raft_consensus.cc:493] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:19.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.227233  8957 raft_consensus.cc:515] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.227768  8456 raft_consensus.cc:2468] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b47d36a83f4440eaac9ce006765394d3 in term 1.
18:34:19.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.228231  8964 raft_consensus.cc:2749] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:34:19.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.229305  8957 leader_election.cc:290] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899), b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405)
18:34:19.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.230069  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eacb309d714c09b7c15323079452fd" candidate_uuid: "5e2eeb0ca41546d7bcaca3220385168e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d916cabe36cb45ccb545d9fc771a4651" is_pre_election: true
18:34:19.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.230711  8455 raft_consensus.cc:2468] T 38eacb309d714c09b7c15323079452fd P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2eeb0ca41546d7bcaca3220385168e in term 0.
18:34:19.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.231788  8599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eacb309d714c09b7c15323079452fd" candidate_uuid: "5e2eeb0ca41546d7bcaca3220385168e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d36a83f4440eaac9ce006765394d3" is_pre_election: true
18:34:19.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.232113  8674 leader_election.cc:304] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2eeb0ca41546d7bcaca3220385168e, d916cabe36cb45ccb545d9fc771a4651; no voters: 
18:34:19.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.232892  8957 raft_consensus.cc:2804] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Leader pre-election won for term 1
18:34:19.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.233299  8957 raft_consensus.cc:493] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:34:19.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.233620  8957 raft_consensus.cc:3060] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Advancing to term 1
18:34:19.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.246613  8952 tablet_bootstrap.cc:654] T d9b4ee28af7743f59956e54d0900a1bc P 5e2eeb0ca41546d7bcaca3220385168e: Neither blocks nor log segments found. Creating new log.
18:34:19.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.235333  8532 leader_election.cc:304] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b47d36a83f4440eaac9ce006765394d3, d916cabe36cb45ccb545d9fc771a4651; no voters: 5e2eeb0ca41546d7bcaca3220385168e
18:34:19.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.249697  8973 raft_consensus.cc:2804] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [term 1 FOLLOWER]: Leader election won for term 1
18:34:19.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:19.250634  8675 leader_election.cc:343] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405): Illegal state: must be running to vote when last-logged opid is not known
18:34:19.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.232143  8951 tablet_bootstrap.cc:492] T 38eacb309d714c09b7c15323079452fd P b47d36a83f4440eaac9ce006765394d3: Bootstrap starting.
18:34:19.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.252362  8973 raft_consensus.cc:697] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [term 1 LEADER]: Becoming Leader. State: Replica: b47d36a83f4440eaac9ce006765394d3, State: Running, Role: LEADER
18:34:19.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.258282  8953 tablet_bootstrap.cc:492] T 5c37815e96ea465a8c32e5a3d746b02b P d916cabe36cb45ccb545d9fc771a4651: Bootstrap starting.
18:34:19.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.258026  8973 consensus_queue.cc:237] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.259964  8957 raft_consensus.cc:515] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.266677  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eacb309d714c09b7c15323079452fd" candidate_uuid: "5e2eeb0ca41546d7bcaca3220385168e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d916cabe36cb45ccb545d9fc771a4651"
18:34:19.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.267253  8456 raft_consensus.cc:3060] T 38eacb309d714c09b7c15323079452fd P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Advancing to term 1
18:34:19.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.273738  8957 leader_election.cc:290] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [CANDIDATE]: Term 1 election: Requested vote from peers d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899), b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405)
18:34:19.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.275878  8599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eacb309d714c09b7c15323079452fd" candidate_uuid: "5e2eeb0ca41546d7bcaca3220385168e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d36a83f4440eaac9ce006765394d3"
18:34:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:19.277410  8675 leader_election.cc:343] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405): Illegal state: must be running to vote when last-logged opid is not known
18:34:19.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.290681  8952 tablet_bootstrap.cc:492] T d9b4ee28af7743f59956e54d0900a1bc P 5e2eeb0ca41546d7bcaca3220385168e: No bootstrap required, opened a new log
18:34:19.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.291226  8952 ts_tablet_manager.cc:1403] T d9b4ee28af7743f59956e54d0900a1bc P 5e2eeb0ca41546d7bcaca3220385168e: Time spent bootstrapping tablet: real 0.188s	user 0.012s	sys 0.001s
18:34:19.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.294473  8951 tablet_bootstrap.cc:654] T 38eacb309d714c09b7c15323079452fd P b47d36a83f4440eaac9ce006765394d3: Neither blocks nor log segments found. Creating new log.
18:34:19.299 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:19.299 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:19.299 [DEBUG - pool-400-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:19.299 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:19.300 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:19.300 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:19.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:19.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:19.300 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:19.300 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:19.300 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:19.301 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:19.301 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:19.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.301410  8952 raft_consensus.cc:359] T d9b4ee28af7743f59956e54d0900a1bc P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.304704  8952 raft_consensus.cc:385] T d9b4ee28af7743f59956e54d0900a1bc P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.284485  8456 raft_consensus.cc:2468] T 38eacb309d714c09b7c15323079452fd P d916cabe36cb45ccb545d9fc771a4651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2eeb0ca41546d7bcaca3220385168e in term 1.
18:34:19.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.310779  8674 leader_election.cc:304] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e2eeb0ca41546d7bcaca3220385168e, d916cabe36cb45ccb545d9fc771a4651; no voters: b47d36a83f4440eaac9ce006765394d3
18:34:19.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.309978  8953 tablet_bootstrap.cc:654] T 5c37815e96ea465a8c32e5a3d746b02b P d916cabe36cb45ccb545d9fc771a4651: Neither blocks nor log segments found. Creating new log.
18:34:19.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.312041  8957 raft_consensus.cc:2804] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [term 1 FOLLOWER]: Leader election won for term 1
18:34:19.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.312507  8957 raft_consensus.cc:697] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [term 1 LEADER]: Becoming Leader. State: Replica: 5e2eeb0ca41546d7bcaca3220385168e, State: Running, Role: LEADER
18:34:19.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.313642  8957 consensus_queue.cc:237] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.304975  8952 raft_consensus.cc:740] T d9b4ee28af7743f59956e54d0900a1bc P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2eeb0ca41546d7bcaca3220385168e, State: Initialized, Role: FOLLOWER
18:34:19.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.321310  8952 consensus_queue.cc:260] T d9b4ee28af7743f59956e54d0900a1bc P 5e2eeb0ca41546d7bcaca3220385168e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.329104  8952 ts_tablet_manager.cc:1434] T d9b4ee28af7743f59956e54d0900a1bc P 5e2eeb0ca41546d7bcaca3220385168e: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
18:34:19.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.330108  8952 tablet_bootstrap.cc:492] T 13389bc0c0984bb788a1186c024e4f17 P 5e2eeb0ca41546d7bcaca3220385168e: Bootstrap starting.
18:34:19.335 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:19.335 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:19.335 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:19.336 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:19.336 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:19.336 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:19.336 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:19.336 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:19.337 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:19.337 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:19.337 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:19.337 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:19.337 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:19.359 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:19.359 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:19.359 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:19.359 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:19.359 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:19.360 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:19.360 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:19.360 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:19.360 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:19.360 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:19.360 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:19.360 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:19.360 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:19.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.365824  8953 tablet_bootstrap.cc:492] T 5c37815e96ea465a8c32e5a3d746b02b P d916cabe36cb45ccb545d9fc771a4651: No bootstrap required, opened a new log
18:34:19.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.366370  8953 ts_tablet_manager.cc:1403] T 5c37815e96ea465a8c32e5a3d746b02b P d916cabe36cb45ccb545d9fc771a4651: Time spent bootstrapping tablet: real 0.109s	user 0.008s	sys 0.005s
18:34:19.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.381031  8951 tablet_bootstrap.cc:492] T 38eacb309d714c09b7c15323079452fd P b47d36a83f4440eaac9ce006765394d3: No bootstrap required, opened a new log
18:34:19.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.381583  8951 ts_tablet_manager.cc:1403] T 38eacb309d714c09b7c15323079452fd P b47d36a83f4440eaac9ce006765394d3: Time spent bootstrapping tablet: real 0.150s	user 0.012s	sys 0.006s
18:34:19.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.381953  8237 catalog_manager.cc:5696] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131). New cstate: current_term: 1 leader_uuid: "5e2eeb0ca41546d7bcaca3220385168e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } health_report { overall_health: HEALTHY } } }
18:34:19.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.393111  8964 raft_consensus.cc:493] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:19.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.393714  8964 raft_consensus.cc:515] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.396118  8964 leader_election.cc:290] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405), 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157)
18:34:19.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.397257  8741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8deb64d0611e4e7e9f7c8324b188cb2b" candidate_uuid: "d916cabe36cb45ccb545d9fc771a4651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2eeb0ca41546d7bcaca3220385168e" is_pre_election: true
18:34:19.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.397843  8741 raft_consensus.cc:2468] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d916cabe36cb45ccb545d9fc771a4651 in term 0.
18:34:19.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.399246  8599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8deb64d0611e4e7e9f7c8324b188cb2b" candidate_uuid: "d916cabe36cb45ccb545d9fc771a4651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d36a83f4440eaac9ce006765394d3" is_pre_election: true
18:34:19.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.399838  8599 raft_consensus.cc:2468] T 8deb64d0611e4e7e9f7c8324b188cb2b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d916cabe36cb45ccb545d9fc771a4651 in term 0.
18:34:19.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.406421  8952 tablet_bootstrap.cc:654] T 13389bc0c0984bb788a1186c024e4f17 P 5e2eeb0ca41546d7bcaca3220385168e: Neither blocks nor log segments found. Creating new log.
18:34:19.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.406695  8390 leader_election.cc:304] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2eeb0ca41546d7bcaca3220385168e, d916cabe36cb45ccb545d9fc771a4651; no voters: 
18:34:19.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.396582  8951 raft_consensus.cc:359] T 38eacb309d714c09b7c15323079452fd P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.408521  8951 raft_consensus.cc:385] T 38eacb309d714c09b7c15323079452fd P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:19.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.410724  8951 raft_consensus.cc:740] T 38eacb309d714c09b7c15323079452fd P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d36a83f4440eaac9ce006765394d3, State: Initialized, Role: FOLLOWER
18:34:19.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.413244  8951 consensus_queue.cc:260] T 38eacb309d714c09b7c15323079452fd P b47d36a83f4440eaac9ce006765394d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.416608  8964 raft_consensus.cc:2804] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:34:19.417 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:19.417 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:19.417 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:19.417 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:19.418 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:19.418 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:19.418 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:19.418 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:19.418 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:19.418 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:19.418 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:19.418 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:19.418 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:19.419 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:19.419 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:19.419 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:19.419 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:19.419 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:19.419 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:19.419 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:19.420 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:19.420 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:19.420 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:19.419 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:19.420 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:19.420 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:19.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.421015  8964 raft_consensus.cc:493] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:34:19.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.421438  8964 raft_consensus.cc:3060] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Advancing to term 1
18:34:19.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.432503  8951 ts_tablet_manager.cc:1434] T 38eacb309d714c09b7c15323079452fd P b47d36a83f4440eaac9ce006765394d3: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.002s
18:34:19.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.437153  8951 tablet_bootstrap.cc:492] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3: Bootstrap starting.
18:34:19.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.446372  8952 tablet_bootstrap.cc:492] T 13389bc0c0984bb788a1186c024e4f17 P 5e2eeb0ca41546d7bcaca3220385168e: No bootstrap required, opened a new log
18:34:19.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.446821  8952 ts_tablet_manager.cc:1403] T 13389bc0c0984bb788a1186c024e4f17 P 5e2eeb0ca41546d7bcaca3220385168e: Time spent bootstrapping tablet: real 0.117s	user 0.008s	sys 0.004s
18:34:19.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.452159  8238 catalog_manager.cc:5696] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b47d36a83f4440eaac9ce006765394d3 (127.7.200.130). New cstate: current_term: 1 leader_uuid: "b47d36a83f4440eaac9ce006765394d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } health_report { overall_health: UNKNOWN } } }
18:34:19.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.463594  8952 raft_consensus.cc:359] T 13389bc0c0984bb788a1186c024e4f17 P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.472978  8952 raft_consensus.cc:385] T 13389bc0c0984bb788a1186c024e4f17 P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:19.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.475345  8951 tablet_bootstrap.cc:654] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3: Neither blocks nor log segments found. Creating new log.
18:34:19.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.475867  8952 raft_consensus.cc:740] T 13389bc0c0984bb788a1186c024e4f17 P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2eeb0ca41546d7bcaca3220385168e, State: Initialized, Role: FOLLOWER
18:34:19.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.478271  8952 consensus_queue.cc:260] T 13389bc0c0984bb788a1186c024e4f17 P 5e2eeb0ca41546d7bcaca3220385168e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.492810  8952 ts_tablet_manager.cc:1434] T 13389bc0c0984bb788a1186c024e4f17 P 5e2eeb0ca41546d7bcaca3220385168e: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.001s
18:34:19.495 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:19.495 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:19.495 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:19.495 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.495 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.495 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.495 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.495 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.495 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.496 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.496 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.496 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.496 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:19.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.371541  8953 raft_consensus.cc:359] T 5c37815e96ea465a8c32e5a3d746b02b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.514794  8953 raft_consensus.cc:385] T 5c37815e96ea465a8c32e5a3d746b02b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:19.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.515213  8953 raft_consensus.cc:740] T 5c37815e96ea465a8c32e5a3d746b02b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d916cabe36cb45ccb545d9fc771a4651, State: Initialized, Role: FOLLOWER
18:34:19.515 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:19.515 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:19.515 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:19.516 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.516 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.516 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.516 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.517 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.517 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.517 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.517 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.517 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.517 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:19.519 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28824), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [33ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [34ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [35ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [35ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [67ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [68ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [68ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [69ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [106ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [108ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [109ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [109ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [182ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [341ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [342ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [402ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [503ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1341ms] refreshing cache from master, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1343ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2960ms] refreshing cache from master, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2961ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [4761ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [4762ms] too many traces: truncated at 100 traces, deferred=Deferred@1630676906(state=PENDING, result=null, callback=(continuation of Deferred@1669729905 after retry RPC after error@162286828) -> (continuation of Deferred@1704143885 after retry RPC after error@359417954) -> (continuation of Deferred@1179269432 after retry RPC after error@761972273) -> (continuation of Deferred@1373992149 after retry RPC after error@649923027) -> (continuation of Deferred@833189829 after retry RPC after error@1250522255) -> (continuation of Deferred@816902871 after retry RPC after error@2123204227) -> (continuation of Deferred@73449928 after retry RPC after error@97317063) -> (continuation of Deferred@853384419 after retry RPC after error@544652709) -> (continuation of Deferred@580540130 after retry RPC after error@1085456574) -> (continuation of Deferred@508978895 after retry RPC after error@190343989) -> (continuation of Deferred@2063929850 after retry RPC after error@769952020) -> (continuation of Deferred@2744953 after retry RPC after error@1214259338) -> (continuation of Deferred@456745661 after retry RPC after error@303887591) -> (continuation of Deferred@1567221495 after retry RPC after error@340064672) -> (continuation of Deferred@1144544543 after retry RPC after error@829825715) -> (continuation of Deferred@591017012 after retry RPC after error@276844554) -> (continuation of Deferred@383137696 after retry RPC after error@381021299) -> (continuation of Deferred@1683808517 after retry RPC after error@1993272708) -> (continuation of Deferred@1359130570 after retry RPC after error@1751975917) -> (continuation of Deferred@1807386412 after retry RPC after error@1788470546) -> (continuation of Deferred@782334836 after retry RPC after error@779309858) -> (continuation of Deferred@290402855 after retry RPC after error@886826089) -> (continuation of Deferred@285496157 after retry RPC after error@626718748) -> (continuation of Deferred@1298938010 after retry RPC after error@654271986) -> (continuation of Deferred@357713099 after retry RPC after error@1740293221) -> (continuation of Deferred@1262389472 after retry RPC after error@372483200), errback=(continuation of Deferred@1669729905 after retry RPC after error@162286828) -> (continuation of Deferred@1704143885 after retry RPC after error@359417954) -> (continuation of Deferred@1179269432 after retry RPC after error@761972273) -> (continuation of Deferred@1373992149 after retry RPC after error@649923027) -> (continuation of Deferred@833189829 after retry RPC after error@1250522255) -> (continuation of Deferred@816902871 after retry RPC after error@2123204227) -> (continuation of Deferred@73449928 after retry RPC after error@97317063) -> (continuation of Deferred@853384419 after retry RPC after error@544652709) -> (continuation of Deferred@580540130 after retry RPC after error@1085456574) -> (continuation of Deferred@508978895 after retry RPC after error@190343989) -> (continuation of Deferred@2063929850 after retry RPC after error@769952020) -> (continuation of Deferred@2744953 after retry RPC after error@1214259338) -> (continuation of Deferred@456745661 after retry RPC after error@303887591) -> (continuation of Deferred@1567221495 after retry RPC after error@340064672) -> (continuation of Deferred@1144544543 after retry RPC after error@829825715) -> (continuation of Deferred@591017012 after retry RPC after error@276844554) -> (continuation of Deferred@383137696 after retry RPC after error@381021299) -> (continuation of Deferred@1683808517 after retry RPC after error@1993272708) -> (continuation of Deferred@1359130570 after retry RPC after error@1751975917) -> (continuation of Deferred@1807386412 after retry RPC after error@1788470546) -> (continuation of Deferred@782334836 after retry RPC after error@779309858) -> (continuation of Deferred@290402855 after retry RPC after error@886826089) -> (continuation of Deferred@285496157 after retry RPC after error@626718748) -> (continuation of Deferred@1298938010 after retry RPC after error@654271986) -> (continuation of Deferred@357713099 after retry RPC after error@1740293221) -> (continuation of Deferred@1262389472 after retry RPC after error@372483200)))
18:34:19.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.516076  8957 raft_consensus.cc:493] T 13389bc0c0984bb788a1186c024e4f17 P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:19.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.516484  8957 raft_consensus.cc:515] T 13389bc0c0984bb788a1186c024e4f17 P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.519 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:19.519 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:19.520 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:19.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.519914  8964 raft_consensus.cc:515] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.520288  8957 leader_election.cc:290] T 13389bc0c0984bb788a1186c024e4f17 P 5e2eeb0ca41546d7bcaca3220385168e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899), b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405)
18:34:19.520 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28824), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [33ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [34ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [35ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [35ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [67ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [68ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [68ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [69ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [106ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [108ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [109ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [109ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [182ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [341ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [342ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [402ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [503ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1341ms] refreshing cache from master, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1343ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2960ms] refreshing cache from master, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2961ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [4761ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [4762ms] too many traces: truncated at 100 traces, deferred=Deferred@1630676906(state=PENDING, result=null, callback=(continuation of Deferred@1669729905 after retry RPC after error@162286828) -> (continuation of Deferred@1704143885 after retry RPC after error@359417954) -> (continuation of Deferred@1179269432 after retry RPC after error@761972273) -> (continuation of Deferred@1373992149 after retry RPC after error@649923027) -> (continuation of Deferred@833189829 after retry RPC after error@1250522255) -> (continuation of Deferred@816902871 after retry RPC after error@2123204227) -> (continuation of Deferred@73449928 after retry RPC after error@97317063) -> (continuation of Deferred@853384419 after retry RPC after error@544652709) -> (continuation of Deferred@580540130 after retry RPC after error@1085456574) -> (continuation of Deferred@508978895 after retry RPC after error@190343989) -> (continuation of Deferred@2063929850 after retry RPC after error@769952020) -> (continuation of Deferred@2744953 after retry RPC after error@1214259338) -> (continuation of Deferred@456745661 after retry RPC after error@303887591) -> (continuation of Deferred@1567221495 after retry RPC after error@340064672) -> (continuation of Deferred@1144544543 after retry RPC after error@829825715) -> (continuation of Deferred@591017012 after retry RPC after error@276844554) -> (continuation of Deferred@383137696 after retry RPC after error@381021299) -> (continuation of Deferred@1683808517 after retry RPC after error@1993272708) -> (continuation of Deferred@1359130570 after retry RPC after error@1751975917) -> (continuation of Deferred@1807386412 after retry RPC after error@1788470546) -> (continuation of Deferred@782334836 after retry RPC after error@779309858) -> (continuation of Deferred@290402855 after retry RPC after error@886826089) -> (continuation of Deferred@285496157 after retry RPC after error@626718748) -> (continuation of Deferred@1298938010 after retry RPC after error@654271986) -> (continuation of Deferred@357713099 after retry RPC after error@1740293221) -> (continuation of Deferred@1262389472 after retry RPC after error@372483200), errback=(continuation of Deferred@1669729905 after retry RPC after error@162286828) -> (continuation of Deferred@1704143885 after retry RPC after error@359417954) -> (continuation of Deferred@1179269432 after retry RPC after error@761972273) -> (continuation of Deferred@1373992149 after retry RPC after error@649923027) -> (continuation of Deferred@833189829 after retry RPC after error@1250522255) -> (continuation of Deferred@816902871 after retry RPC after error@2123204227) -> (continuation of Deferred@73449928 after retry RPC after error@97317063) -> (continuation of Deferred@853384419 after retry RPC after error@544652709) -> (continuation of Deferred@580540130 after retry RPC after error@1085456574) -> (continuation of Deferred@508978895 after retry RPC after error@190343989) -> (continuation of Deferred@2063929850 after retry RPC after error@769952020) -> (continuation of Deferred@2744953 after retry RPC after error@1214259338) -> (continuation of Deferred@456745661 after retry RPC after error@303887591) -> (continuation of Deferred@1567221495 after retry RPC after error@340064672) -> (continuation of Deferred@1144544543 after retry RPC after error@829825715) -> (continuation of Deferred@591017012 after retry RPC after error@276844554) -> (continuation of Deferred@383137696 after retry RPC after error@381021299) -> (continuation of Deferred@1683808517 after retry RPC after error@1993272708) -> (continuation of Deferred@1359130570 after retry RPC after error@1751975917) -> (continuation of Deferred@1807386412 after retry RPC after error@1788470546) -> (continuation of Deferred@782334836 after retry RPC after error@779309858) -> (continuation of Deferred@290402855 after retry RPC after error@886826089) -> (continuation of Deferred@285496157 after retry RPC after error@626718748) -> (continuation of Deferred@1298938010 after retry RPC after error@654271986) -> (continuation of Deferred@357713099 after retry RPC after error@1740293221) -> (continuation of Deferred@1262389472 after retry RPC after error@372483200)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28824), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [33ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [34ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [35ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [35ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [67ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [68ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [68ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [69ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [106ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [108ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [109ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [109ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [182ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [341ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [342ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [402ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [503ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1341ms] refreshing cache from master, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1343ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2960ms] refreshing cache from master, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2961ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [4761ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [4762ms] too many traces: truncated at 100 traces, deferred=Deferred@1630676906(state=PENDING, result=null, callback=(continuation of Deferred@1669729905 after retry RPC after error@162286828) -> (continuation of Deferred@1704143885 after retry RPC after error@359417954) -> (continuation of Deferred@1179269432 after retry RPC after error@761972273) -> (continuation of Deferred@1373992149 after retry RPC after error@649923027) -> (continuation of Deferred@833189829 after retry RPC after error@1250522255) -> (continuation of Deferred@816902871 after retry RPC after error@2123204227) -> (continuation of Deferred@73449928 after retry RPC after error@97317063) -> (continuation of Deferred@853384419 after retry RPC after error@544652709) -> (continuation of Deferred@580540130 after retry RPC after error@1085456574) -> (continuation of Deferred@508978895 after retry RPC after error@190343989) -> (continuation of Deferred@2063929850 after retry RPC after error@769952020) -> (continuation of Deferred@2744953 after retry RPC after error@1214259338) -> (continuation of Deferred@456745661 after retry RPC after error@303887591) -> (continuation of Deferred@1567221495 after retry RPC after error@340064672) -> (continuation of Deferred@1144544543 after retry RPC after error@829825715) -> (continuation of Deferred@591017012 after retry RPC after error@276844554) -> (continuation of Deferred@383137696 after retry RPC after error@381021299) -> (continuation of Deferred@1683808517 after retry RPC after error@1993272708) -> (continuation of Deferred@1359130570 after retry RPC after error@1751975917) -> (continuation of Deferred@1807386412 after retry RPC after error@1788470546) -> (continuation of Deferred@782334836 after retry RPC after error@779309858) -> (continuation of Deferred@290402855 after retry RPC after error@886826089) -> (continuation of Deferred@285496157 after retry RPC after error@626718748) -> (continuation of Deferred@1298938010 after retry RPC after error@654271986) -> (continuation of Deferred@357713099 after retry RPC after error@1740293221) -> (continuation of Deferred@1262389472 after retry RPC after error@372483200), errback=(continuation of Deferred@1669729905 after retry RPC after error@162286828) -> (continuation of Deferred@1704143885 after retry RPC after error@359417954) -> (continuation of Deferred@1179269432 after retry RPC after error@761972273) -> (continuation of Deferred@1373992149 after retry RPC after error@649923027) -> (continuation of Deferred@833189829 after retry RPC after error@1250522255) -> (continuation of Deferred@816902871 after retry RPC after error@2123204227) -> (continuation of Deferred@73449928 after retry RPC after error@97317063) -> (continuation of Deferred@853384419 after retry RPC after error@544652709) -> (continuation of Deferred@580540130 after retry RPC after error@1085456574) -> (continuation of Deferred@508978895 after retry RPC after error@190343989) -> (continuation of Deferred@2063929850 after retry RPC after error@769952020) -> (continuation of Deferred@2744953 after retry RPC after error@1214259338) -> (continuation of Deferred@456745661 after retry RPC after error@303887591) -> (continuation of Deferred@1567221495 after retry RPC after error@340064672) -> (continuation of Deferred@1144544543 after retry RPC after error@829825715) -> (continuation of Deferred@591017012 after retry RPC after error@276844554) -> (continuation of Deferred@383137696 after retry RPC after error@381021299) -> (continuation of Deferred@1683808517 after retry RPC after error@1993272708) -> (continuation of Deferred@1359130570 after retry RPC after error@1751975917) -> (continuation of Deferred@1807386412 after retry RPC after error@1788470546) -> (continuation of Deferred@782334836 after retry RPC after error@779309858) -> (continuation of Deferred@290402855 after retry RPC after error@886826089) -> (continuation of Deferred@285496157 after retry RPC after error@626718748) -> (continuation of Deferred@1298938010 after retry RPC after error@654271986) -> (continuation of Deferred@357713099 after retry RPC after error@1740293221) -> (continuation of Deferred@1262389472 after retry RPC after error@372483200)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.11.253:35677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:19.521 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.521 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.522 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.522 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.522 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.522 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.522 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.522 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.522 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.522 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:19.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.521956  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13389bc0c0984bb788a1186c024e4f17" candidate_uuid: "5e2eeb0ca41546d7bcaca3220385168e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d916cabe36cb45ccb545d9fc771a4651" is_pre_election: true
18:34:19.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.522707  8456 raft_consensus.cc:2393] T 13389bc0c0984bb788a1186c024e4f17 P d916cabe36cb45ccb545d9fc771a4651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e2eeb0ca41546d7bcaca3220385168e in current term 1: Already voted for candidate b47d36a83f4440eaac9ce006765394d3 in this term.
18:34:19.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.518939  8953 consensus_queue.cc:260] T 5c37815e96ea465a8c32e5a3d746b02b P d916cabe36cb45ccb545d9fc771a4651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.535 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:19.535 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:19.535 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:19.535 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.535 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.536 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.536 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.536 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.536 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.536 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.536 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.536 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.536 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.527783  8599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13389bc0c0984bb788a1186c024e4f17" candidate_uuid: "5e2eeb0ca41546d7bcaca3220385168e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d36a83f4440eaac9ce006765394d3" is_pre_election: true
18:34:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.529613  8973 raft_consensus.cc:493] T 38eacb309d714c09b7c15323079452fd P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.530143  8973 raft_consensus.cc:515] T 38eacb309d714c09b7c15323079452fd P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.531461  8995 raft_consensus.cc:493] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.535342  8951 tablet_bootstrap.cc:492] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3: No bootstrap required, opened a new log
18:34:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.535759  8951 ts_tablet_manager.cc:1403] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3: Time spent bootstrapping tablet: real 0.099s	user 0.007s	sys 0.005s
18:34:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.536154  8741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eacb309d714c09b7c15323079452fd" candidate_uuid: "b47d36a83f4440eaac9ce006765394d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2eeb0ca41546d7bcaca3220385168e" is_pre_election: true
18:34:19.540 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:19.540 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:19.540 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:19.540 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:19.541 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:19.541 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:19.541 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:19.541 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:19.541 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:19.541 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:19.541 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:19.541 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:19.541 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:19.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.538719  8674 leader_election.cc:304] T 13389bc0c0984bb788a1186c024e4f17 P 5e2eeb0ca41546d7bcaca3220385168e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e2eeb0ca41546d7bcaca3220385168e; no voters: b47d36a83f4440eaac9ce006765394d3, d916cabe36cb45ccb545d9fc771a4651
18:34:19.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.539878  8957 raft_consensus.cc:3060] T 13389bc0c0984bb788a1186c024e4f17 P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Advancing to term 1
18:34:19.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.534966  8456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eacb309d714c09b7c15323079452fd" candidate_uuid: "b47d36a83f4440eaac9ce006765394d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d916cabe36cb45ccb545d9fc771a4651" is_pre_election: true
18:34:19.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.543956  8456 raft_consensus.cc:2393] T 38eacb309d714c09b7c15323079452fd P d916cabe36cb45ccb545d9fc771a4651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b47d36a83f4440eaac9ce006765394d3 in current term 1: Already voted for candidate 5e2eeb0ca41546d7bcaca3220385168e in this term.
18:34:19.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.531842  8995 raft_consensus.cc:515] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.547876  8532 leader_election.cc:304] T 38eacb309d714c09b7c15323079452fd P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b47d36a83f4440eaac9ce006765394d3; no voters: 5e2eeb0ca41546d7bcaca3220385168e, d916cabe36cb45ccb545d9fc771a4651
18:34:19.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.548938  8995 leader_election.cc:290] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405), 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157)
18:34:19.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.548964  8958 raft_consensus.cc:3060] T 38eacb309d714c09b7c15323079452fd P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Advancing to term 1
18:34:19.555 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:19.555 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:19.555 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:19.556 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.556 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.556 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.549726  8599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8deb64d0611e4e7e9f7c8324b188cb2b" candidate_uuid: "d916cabe36cb45ccb545d9fc771a4651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d36a83f4440eaac9ce006765394d3"
18:34:19.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.550035  8600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b4ee28af7743f59956e54d0900a1bc" candidate_uuid: "d916cabe36cb45ccb545d9fc771a4651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d36a83f4440eaac9ce006765394d3" is_pre_election: true
18:34:19.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.550299  8599 raft_consensus.cc:3060] T 8deb64d0611e4e7e9f7c8324b188cb2b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Advancing to term 1
18:34:19.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.550612  8600 raft_consensus.cc:2468] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d916cabe36cb45ccb545d9fc771a4651 in term 0.
18:34:19.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.551383  8964 leader_election.cc:290] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [CANDIDATE]: Term 1 election: Requested vote from peers b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405), 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157)
18:34:19.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.553580  8390 leader_election.cc:304] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d36a83f4440eaac9ce006765394d3, d916cabe36cb45ccb545d9fc771a4651; no voters: 
18:34:19.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.556453  8953 ts_tablet_manager.cc:1434] T 5c37815e96ea465a8c32e5a3d746b02b P d916cabe36cb45ccb545d9fc771a4651: Time spent starting tablet: real 0.190s	user 0.009s	sys 0.002s
18:34:19.559 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.559 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.559 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.559 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.559 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.559405  8953 tablet_bootstrap.cc:492] T 569fbab27dcc46ceb35a25ca5373588b P d916cabe36cb45ccb545d9fc771a4651: Bootstrap starting.
18:34:19.559 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.559 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:19.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.532507  8973 leader_election.cc:290] T 38eacb309d714c09b7c15323079452fd P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899), 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157)
18:34:19.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.562561  8958 raft_consensus.cc:2749] T 38eacb309d714c09b7c15323079452fd P b47d36a83f4440eaac9ce006765394d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:34:19.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.562608  8741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b4ee28af7743f59956e54d0900a1bc" candidate_uuid: "d916cabe36cb45ccb545d9fc771a4651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2eeb0ca41546d7bcaca3220385168e" is_pre_election: true
18:34:19.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.563256  8741 raft_consensus.cc:2468] T d9b4ee28af7743f59956e54d0900a1bc P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d916cabe36cb45ccb545d9fc771a4651 in term 0.
18:34:19.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.566705  8957 raft_consensus.cc:2749] T 13389bc0c0984bb788a1186c024e4f17 P 5e2eeb0ca41546d7bcaca3220385168e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:34:19.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.565433  8951 raft_consensus.cc:359] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.567649  8951 raft_consensus.cc:385] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:19.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.568819  8951 raft_consensus.cc:740] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47d36a83f4440eaac9ce006765394d3, State: Initialized, Role: FOLLOWER
18:34:19.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.571569  8998 raft_consensus.cc:2804] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:34:19.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.572238  8998 raft_consensus.cc:493] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:34:19.575 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28824), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [33ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [34ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [35ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [35ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [67ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [68ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [68ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [69ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [106ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [108ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [109ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [109ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [182ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [341ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [342ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [402ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [503ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1341ms] refreshing cache from master, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1343ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2960ms] refreshing cache from master, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2961ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [4761ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [4762ms] too many traces: truncated at 100 traces, deferred=Deferred@1630676906(state=PENDING, result=null, callback=(continuation of Deferred@1669729905 after retry RPC after error@162286828) -> (continuation of Deferred@1704143885 after retry RPC after error@359417954) -> (continuation of Deferred@1179269432 after retry RPC after error@761972273) -> (continuation of Deferred@1373992149 after retry RPC after error@649923027) -> (continuation of Deferred@833189829 after retry RPC after error@1250522255) -> (continuation of Deferred@816902871 after retry RPC after error@2123204227) -> (continuation of Deferred@73449928 after retry RPC after error@97317063) -> (continuation of Deferred@853384419 after retry RPC after error@544652709) -> (continuation of Deferred@580540130 after retry RPC after error@1085456574) -> (continuation of Deferred@508978895 after retry RPC after error@190343989) -> (continuation of Deferred@2063929850 after retry RPC after error@769952020) -> (continuation of Deferred@2744953 after retry RPC after error@1214259338) -> (continuation of Deferred@456745661 after retry RPC after error@303887591) -> (continuation of Deferred@1567221495 after retry RPC after error@340064672) -> (continuation of Deferred@1144544543 after retry RPC after error@829825715) -> (continuation of Deferred@591017012 after retry RPC after error@276844554) -> (continuation of Deferred@383137696 after retry RPC after error@381021299) -> (continuation of Deferred@1683808517 after retry RPC after error@1993272708) -> (continuation of Deferred@1359130570 after retry RPC after error@1751975917) -> (continuation of Deferred@1807386412 after retry RPC after error@1788470546) -> (continuation of Deferred@782334836 after retry RPC after error@779309858) -> (continuation of Deferred@290402855 after retry RPC after error@886826089) -> (continuation of Deferred@285496157 after retry RPC after error@626718748) -> (continuation of Deferred@1298938010 after retry RPC after error@654271986) -> (continuation of Deferred@357713099 after retry RPC after error@1740293221) -> (continuation of Deferred@1262389472 after retry RPC after error@372483200), errback=(continuation of Deferred@1669729905 after retry RPC after error@162286828) -> (continuation of Deferred@1704143885 after retry RPC after error@359417954) -> (continuation of Deferred@1179269432 after retry RPC after error@761972273) -> (continuation of Deferred@1373992149 after retry RPC after error@649923027) -> (continuation of Deferred@833189829 after retry RPC after error@1250522255) -> (continuation of Deferred@816902871 after retry RPC after error@2123204227) -> (continuation of Deferred@73449928 after retry RPC after error@97317063) -> (continuation of Deferred@853384419 after retry RPC after error@544652709) -> (continuation of Deferred@580540130 after retry RPC after error@1085456574) -> (continuation of Deferred@508978895 after retry RPC after error@190343989) -> (continuation of Deferred@2063929850 after retry RPC after error@769952020) -> (continuation of Deferred@2744953 after retry RPC after error@1214259338) -> (continuation of Deferred@456745661 after retry RPC after error@303887591) -> (continuation of Deferred@1567221495 after retry RPC after error@340064672) -> (continuation of Deferred@1144544543 after retry RPC after error@829825715) -> (continuation of Deferred@591017012 after retry RPC after error@276844554) -> (continuation of Deferred@383137696 after retry RPC after error@381021299) -> (continuation of Deferred@1683808517 after retry RPC after error@1993272708) -> (continuation of Deferred@1359130570 after retry RPC after error@1751975917) -> (continuation of Deferred@1807386412 after retry RPC after error@1788470546) -> (continuation of Deferred@782334836 after retry RPC after error@779309858) -> (continuation of Deferred@290402855 after retry RPC after error@886826089) -> (continuation of Deferred@285496157 after retry RPC after error@626718748) -> (continuation of Deferred@1298938010 after retry RPC after error@654271986) -> (continuation of Deferred@357713099 after retry RPC after error@1740293221) -> (continuation of Deferred@1262389472 after retry RPC after error@372483200)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28824), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [33ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [34ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [35ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [35ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [67ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [68ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [68ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [69ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [106ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [108ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [109ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [109ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [182ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [341ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [342ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [401ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [402ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [402ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [503ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1341ms] refreshing cache from master, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1343ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2960ms] refreshing cache from master, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [2961ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [2961ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [4761ms] refreshing cache from master, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [4761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [4762ms] too many traces: truncated at 100 traces, deferred=Deferred@1630676906(state=PENDING, result=null, callback=(continuation of Deferred@1669729905 after retry RPC after error@162286828) -> (continuation of Deferred@1704143885 after retry RPC after error@359417954) -> (continuation of Deferred@1179269432 after retry RPC after error@761972273) -> (continuation of Deferred@1373992149 after retry RPC after error@649923027) -> (continuation of Deferred@833189829 after retry RPC after error@1250522255) -> (continuation of Deferred@816902871 after retry RPC after error@2123204227) -> (continuation of Deferred@73449928 after retry RPC after error@97317063) -> (continuation of Deferred@853384419 after retry RPC after error@544652709) -> (continuation of Deferred@580540130 after retry RPC after error@1085456574) -> (continuation of Deferred@508978895 after retry RPC after error@190343989) -> (continuation of Deferred@2063929850 after retry RPC after error@769952020) -> (continuation of Deferred@2744953 after retry RPC after error@1214259338) -> (continuation of Deferred@456745661 after retry RPC after error@303887591) -> (continuation of Deferred@1567221495 after retry RPC after error@340064672) -> (continuation of Deferred@1144544543 after retry RPC after error@829825715) -> (continuation of Deferred@591017012 after retry RPC after error@276844554) -> (continuation of Deferred@383137696 after retry RPC after error@381021299) -> (continuation of Deferred@1683808517 after retry RPC after error@1993272708) -> (continuation of Deferred@1359130570 after retry RPC after error@1751975917) -> (continuation of Deferred@1807386412 after retry RPC after error@1788470546) -> (continuation of Deferred@782334836 after retry RPC after error@779309858) -> (continuation of Deferred@290402855 after retry RPC after error@886826089) -> (continuation of Deferred@285496157 after retry RPC after error@626718748) -> (continuation of Deferred@1298938010 after retry RPC after error@654271986) -> (continuation of Deferred@357713099 after retry RPC after error@1740293221) -> (continuation of Deferred@1262389472 after retry RPC after error@372483200), errback=(continuation of Deferred@1669729905 after retry RPC after error@162286828) -> (continuation of Deferred@1704143885 after retry RPC after error@359417954) -> (continuation of Deferred@1179269432 after retry RPC after error@761972273) -> (continuation of Deferred@1373992149 after retry RPC after error@649923027) -> (continuation of Deferred@833189829 after retry RPC after error@1250522255) -> (continuation of Deferred@816902871 after retry RPC after error@2123204227) -> (continuation of Deferred@73449928 after retry RPC after error@97317063) -> (continuation of Deferred@853384419 after retry RPC after error@544652709) -> (continuation of Deferred@580540130 after retry RPC after error@1085456574) -> (continuation of Deferred@508978895 after retry RPC after error@190343989) -> (continuation of Deferred@2063929850 after retry RPC after error@769952020) -> (continuation of Deferred@2744953 after retry RPC after error@1214259338) -> (continuation of Deferred@456745661 after retry RPC after error@303887591) -> (continuation of Deferred@1567221495 after retry RPC after error@340064672) -> (continuation of Deferred@1144544543 after retry RPC after error@829825715) -> (continuation of Deferred@591017012 after retry RPC after error@276844554) -> (continuation of Deferred@383137696 after retry RPC after error@381021299) -> (continuation of Deferred@1683808517 after retry RPC after error@1993272708) -> (continuation of Deferred@1359130570 after retry RPC after error@1751975917) -> (continuation of Deferred@1807386412 after retry RPC after error@1788470546) -> (continuation of Deferred@782334836 after retry RPC after error@779309858) -> (continuation of Deferred@290402855 after retry RPC after error@886826089) -> (continuation of Deferred@285496157 after retry RPC after error@626718748) -> (continuation of Deferred@1298938010 after retry RPC after error@654271986) -> (continuation of Deferred@357713099 after retry RPC after error@1740293221) -> (continuation of Deferred@1262389472 after retry RPC after error@372483200)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.11.253:35677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:19.576 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:34:19.576 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#5) of source Source: KuduSource.
18:34:19.577 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:19.577 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:19.578 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.578 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:19.578 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.578 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.578 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.578 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.578 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.578 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.578 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.578 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.578 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:19.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.570318  8951 consensus_queue.cc:260] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.579715  8951 ts_tablet_manager.cc:1434] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
18:34:19.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.579847  8998 raft_consensus.cc:3060] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Advancing to term 1
18:34:19.595 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:19.595 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:19.595 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:19.596 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.596 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.596 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.596 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.596 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.596 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.597 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.597 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.597 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.597 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:19.601 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:19.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.598243  8953 tablet_bootstrap.cc:654] T 569fbab27dcc46ceb35a25ca5373588b P d916cabe36cb45ccb545d9fc771a4651: Neither blocks nor log segments found. Creating new log.
18:34:19.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.599488  8998 raft_consensus.cc:515] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.600051  8958 consensus_queue.cc:1048] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:34:19.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.602504  8600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b4ee28af7743f59956e54d0900a1bc" candidate_uuid: "d916cabe36cb45ccb545d9fc771a4651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47d36a83f4440eaac9ce006765394d3"
18:34:19.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.603086  8600 raft_consensus.cc:3060] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Advancing to term 1
18:34:19.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.610683  8600 raft_consensus.cc:2468] T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d916cabe36cb45ccb545d9fc771a4651 in term 1.
18:34:19.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.612089  8390 leader_election.cc:304] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47d36a83f4440eaac9ce006765394d3, d916cabe36cb45ccb545d9fc771a4651; no voters: 
18:34:19.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.612947  8964 raft_consensus.cc:2804] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [term 1 FOLLOWER]: Leader election won for term 1
18:34:19.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.613410  8964 raft_consensus.cc:697] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [term 1 LEADER]: Becoming Leader. State: Replica: d916cabe36cb45ccb545d9fc771a4651, State: Running, Role: LEADER
18:34:19.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.615643  8998 leader_election.cc:290] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [CANDIDATE]: Term 1 election: Requested vote from peers b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405), 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157)
18:34:19.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.614368  8964 consensus_queue.cc:237] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.567936  8740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8deb64d0611e4e7e9f7c8324b188cb2b" candidate_uuid: "d916cabe36cb45ccb545d9fc771a4651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2eeb0ca41546d7bcaca3220385168e"
18:34:19.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.617882  8740 raft_consensus.cc:3060] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Advancing to term 1
18:34:19.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.615971  8739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b4ee28af7743f59956e54d0900a1bc" candidate_uuid: "d916cabe36cb45ccb545d9fc771a4651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2eeb0ca41546d7bcaca3220385168e"
18:34:19.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.619148  8739 raft_consensus.cc:3060] T d9b4ee28af7743f59956e54d0900a1bc P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Advancing to term 1
18:34:19.626 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:19.626 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:19.626 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:19.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.626271  8740 raft_consensus.cc:2468] T 8deb64d0611e4e7e9f7c8324b188cb2b P 5e2eeb0ca41546d7bcaca3220385168e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d916cabe36cb45ccb545d9fc771a4651 in term 1.
18:34:19.627 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:19.627 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:19.627 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:19.627 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:19.627 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:19.627 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:19.627 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:19.628 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:19.628 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:19.628 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:19.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.627633  8390 leader_election.cc:304] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2eeb0ca41546d7bcaca3220385168e, d916cabe36cb45ccb545d9fc771a4651; no voters: 
18:34:19.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.628449  8998 raft_consensus.cc:2804] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [term 1 FOLLOWER]: Leader election won for term 1
18:34:19.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.628902  8998 raft_consensus.cc:697] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [term 1 LEADER]: Becoming Leader. State: Replica: d916cabe36cb45ccb545d9fc771a4651, State: Running, Role: LEADER
18:34:19.629 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to CANCELING.
18:34:19.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.629585  8739 raft_consensus.cc:2468] T d9b4ee28af7743f59956e54d0900a1bc P 5e2eeb0ca41546d7bcaca3220385168e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d916cabe36cb45ccb545d9fc771a4651 in term 1.
18:34:19.630 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
18:34:19.630 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to CANCELING.
18:34:19.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.629710  8998 consensus_queue.cc:237] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.630 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
18:34:19.631 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#6) of source Source: KuduSource.
18:34:19.632 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from INITIALIZING to CANCELING.
18:34:19.633 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#6) of source Source: KuduSource.
18:34:19.633 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to CANCELING.
18:34:19.633 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
18:34:19.633 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CANCELING to CANCELED.
18:34:19.633 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#5 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
18:34:19.637 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_6).
18:34:19.637 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from INITIALIZING to CANCELING.
18:34:19.637 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_6).
18:34:19.638 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:19.638 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
18:34:19.638 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:19.638 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to CANCELING.
18:34:19.638 [INFO - flink-pekko.actor.default-dispatcher-9] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
18:34:19.638 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:19.638 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.638 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.638 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.638 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.639 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.639 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.639 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.639 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.639 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.639 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:19.639 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#5 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_5.
18:34:19.640 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CANCELING to CANCELED.
18:34:19.641 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:34:19.641 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
18:34:19.641 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CANCELING to CANCELED.
18:34:19.641 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
18:34:19.642 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#6 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_6.
18:34:19.642 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CANCELING to CANCELED.
18:34:19.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.643018  8599 raft_consensus.cc:2468] T 8deb64d0611e4e7e9f7c8324b188cb2b P b47d36a83f4440eaac9ce006765394d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d916cabe36cb45ccb545d9fc771a4651 in term 1.
18:34:19.643 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:34:19.644 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
18:34:19.645 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CANCELING to CANCELED.
18:34:19.645 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_6).
18:34:19.645 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#6 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_6.
18:34:19.645 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CANCELING to CANCELED.
18:34:19.646 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job f6e63683f34d031c5da392b08baea20c
18:34:19.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:19.673045  8532 consensus_peers.cc:597] T 569fbab27dcc46ceb35a25ca5373588b P b47d36a83f4440eaac9ce006765394d3 -> Peer d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899): Couldn't send request to peer d916cabe36cb45ccb545d9fc771a4651. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
18:34:19.674 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:19.674 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:19.675 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:19.675 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:19.675 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:19.675 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:19.675 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:19.675 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:19.675 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:19.676 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:19.676 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:19.676 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:19.676 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:19.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:19.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:19.681723  7310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.245.62:36853, user_credentials={real_user=slave}} blocked reactor thread for 67987us
18:34:19.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.690970  8238 catalog_manager.cc:5696] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129). New cstate: current_term: 1 leader_uuid: "d916cabe36cb45ccb545d9fc771a4651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } health_report { overall_health: UNKNOWN } } }
18:34:19.695 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:19.695 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:19.695 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:19.696 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.696 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.696 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.696 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.696 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.696 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.696 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.696 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.696 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.697 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:19.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.714179  8953 tablet_bootstrap.cc:492] T 569fbab27dcc46ceb35a25ca5373588b P d916cabe36cb45ccb545d9fc771a4651: No bootstrap required, opened a new log
18:34:19.715 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:19.715 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:19.715 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:19.715 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:19.715 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:19.715 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:19.716 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:19.716 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:19.716 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:19.716 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:19.716 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:19.716 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:19.717 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:19.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.714679  8953 ts_tablet_manager.cc:1403] T 569fbab27dcc46ceb35a25ca5373588b P d916cabe36cb45ccb545d9fc771a4651: Time spent bootstrapping tablet: real 0.157s	user 0.015s	sys 0.001s
18:34:19.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.750720  8953 raft_consensus.cc:359] T 569fbab27dcc46ceb35a25ca5373588b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } } peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } }
18:34:19.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.754210  8953 raft_consensus.cc:385] T 569fbab27dcc46ceb35a25ca5373588b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:19.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.759096  8953 raft_consensus.cc:740] T 569fbab27dcc46ceb35a25ca5373588b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d916cabe36cb45ccb545d9fc771a4651, State: Initialized, Role: FOLLOWER
18:34:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.762135  8238 catalog_manager.cc:5696] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 reported cstate change: term changed from 0 to 1, leader changed from <none> to d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129). New cstate: current_term: 1 leader_uuid: "d916cabe36cb45ccb545d9fc771a4651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } health_report { overall_health: UNKNOWN } } }
18:34:19.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.759825  8953 consensus_queue.cc:260] T 569fbab27dcc46ceb35a25ca5373588b P d916cabe36cb45ccb545d9fc771a4651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } } peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } }
18:34:19.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.770910  8953 ts_tablet_manager.cc:1434] T 569fbab27dcc46ceb35a25ca5373588b P d916cabe36cb45ccb545d9fc771a4651: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
18:34:19.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.776144  8957 consensus_queue.cc:1048] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
18:34:19.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.791172  8957 consensus_queue.cc:1048] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:34:19.795 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:19.796 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:19.796 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:19.796 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.797 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.797 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.797 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.797 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.797 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.798 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.798 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.798 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.798 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:19.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.804256  8973 consensus_queue.cc:1048] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:34:19.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.818298  8973 consensus_queue.cc:1048] T 13389bc0c0984bb788a1186c024e4f17 P b47d36a83f4440eaac9ce006765394d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:34:19.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.843691  8978 raft_consensus.cc:493] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:19.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.844292  8978 raft_consensus.cc:515] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.855350  8739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c37815e96ea465a8c32e5a3d746b02b" candidate_uuid: "b47d36a83f4440eaac9ce006765394d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2eeb0ca41546d7bcaca3220385168e" is_pre_election: true
18:34:19.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.856196  8739 raft_consensus.cc:2468] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b47d36a83f4440eaac9ce006765394d3 in term 0.
18:34:19.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.857869  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c37815e96ea465a8c32e5a3d746b02b" candidate_uuid: "b47d36a83f4440eaac9ce006765394d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d916cabe36cb45ccb545d9fc771a4651" is_pre_election: true
18:34:19.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.858695  8455 raft_consensus.cc:2468] T 5c37815e96ea465a8c32e5a3d746b02b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b47d36a83f4440eaac9ce006765394d3 in term 0.
18:34:19.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.858403  8533 leader_election.cc:304] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2eeb0ca41546d7bcaca3220385168e, b47d36a83f4440eaac9ce006765394d3; no voters: 
18:34:19.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.859948  8973 raft_consensus.cc:2804] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:34:19.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.860344  8973 raft_consensus.cc:493] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:34:19.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.860694  8973 raft_consensus.cc:3060] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [term 0 FOLLOWER]: Advancing to term 1
18:34:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.868183  8978 leader_election.cc:290] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899), 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157)
18:34:19.875 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:19.875 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:19.875 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:19.875 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.875 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.876 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:19.876 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.876 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.876 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:19.876 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.876 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.876 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:19.876 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:19.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.874420  8973 raft_consensus.cc:515] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.884899  8739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c37815e96ea465a8c32e5a3d746b02b" candidate_uuid: "b47d36a83f4440eaac9ce006765394d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e2eeb0ca41546d7bcaca3220385168e"
18:34:19.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.885491  8739 raft_consensus.cc:3060] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e [term 0 FOLLOWER]: Advancing to term 1
18:34:19.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.883611  8973 leader_election.cc:290] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 election: Requested vote from peers d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899), 5e2eeb0ca41546d7bcaca3220385168e (127.7.200.131:36157)
18:34:19.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.893805  8739 raft_consensus.cc:2468] T 5c37815e96ea465a8c32e5a3d746b02b P 5e2eeb0ca41546d7bcaca3220385168e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b47d36a83f4440eaac9ce006765394d3 in term 1.
18:34:19.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.889081  8455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c37815e96ea465a8c32e5a3d746b02b" candidate_uuid: "b47d36a83f4440eaac9ce006765394d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d916cabe36cb45ccb545d9fc771a4651"
18:34:19.896 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:19.897 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:19.897 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:19.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.895809  8455 raft_consensus.cc:3060] T 5c37815e96ea465a8c32e5a3d746b02b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Advancing to term 1
18:34:19.897 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:19.897 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:19.897 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:19.898 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:19.898 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:19.898 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:19.898 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:19.898 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:19.898 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:19.898 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:19.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.896520  8533 leader_election.cc:304] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2eeb0ca41546d7bcaca3220385168e, b47d36a83f4440eaac9ce006765394d3; no voters: 
18:34:19.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.899742  8978 raft_consensus.cc:2804] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [term 1 FOLLOWER]: Leader election won for term 1
18:34:19.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.900262  8978 raft_consensus.cc:697] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [term 1 LEADER]: Becoming Leader. State: Replica: b47d36a83f4440eaac9ce006765394d3, State: Running, Role: LEADER
18:34:19.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.901010  8978 consensus_queue.cc:237] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } }
18:34:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.920774  8455 raft_consensus.cc:2468] T 5c37815e96ea465a8c32e5a3d746b02b P d916cabe36cb45ccb545d9fc771a4651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b47d36a83f4440eaac9ce006765394d3 in term 1.
18:34:19.936 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:19.936 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:19.936 [DEBUG - pool-402-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:19.937 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:19.937 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:19.937 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:19.937 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:19.937 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:19.937 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:19.938 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:19.938 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:19.938 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:19.938 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:19.939 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29041), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [48ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [50ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [51ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [51ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [70ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [71ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [72ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [72ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [88ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [89ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [89ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [89ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [142ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [241ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [241ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [241ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [241ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [261ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [262ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [264ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [264ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [341ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [341ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [342ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [342ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1243ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1620ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1623ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1623ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [4340ms] refreshing cache from master, [4340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [4340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [4340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [4341ms] too many traces: truncated at 100 traces, deferred=Deferred@111184532(state=PENDING, result=null, callback=(continuation of Deferred@628122510 after retry RPC after error@1823111177) -> (continuation of Deferred@230711962 after retry RPC after error@255241628) -> (continuation of Deferred@704431079 after retry RPC after error@380214497) -> (continuation of Deferred@418641948 after retry RPC after error@580123859) -> (continuation of Deferred@1841295517 after retry RPC after error@933963615) -> (continuation of Deferred@815729326 after retry RPC after error@232201482) -> (continuation of Deferred@528367413 after retry RPC after error@1904304730) -> (continuation of Deferred@964938942 after retry RPC after error@201963977) -> (continuation of Deferred@1658894570 after retry RPC after error@411665758) -> (continuation of Deferred@1061706957 after retry RPC after error@2119068956) -> (continuation of Deferred@428785111 after retry RPC after error@1299802317) -> (continuation of Deferred@816511899 after retry RPC after error@1023497759) -> (continuation of Deferred@1359815789 after retry RPC after error@1471414657) -> (continuation of Deferred@816144079 after retry RPC after error@128141162) -> (continuation of Deferred@1060451775 after retry RPC after error@1215988689) -> (continuation of Deferred@1379135287 after retry RPC after error@1328970252) -> (continuation of Deferred@1496852120 after retry RPC after error@1161843301) -> (continuation of Deferred@138893229 after retry RPC after error@1952299699) -> (continuation of Deferred@1816747590 after retry RPC after error@727579344) -> (continuation of Deferred@420817449 after retry RPC after error@295834) -> (continuation of Deferred@647579314 after retry RPC after error@1649845195) -> (continuation of Deferred@1386387914 after retry RPC after error@1981732951) -> (continuation of Deferred@450804976 after retry RPC after error@1304501403) -> (continuation of Deferred@199991328 after retry RPC after error@188157290), errback=(continuation of Deferred@628122510 after retry RPC after error@1823111177) -> (continuation of Deferred@230711962 after retry RPC after error@255241628) -> (continuation of Deferred@704431079 after retry RPC after error@380214497) -> (continuation of Deferred@418641948 after retry RPC after error@580123859) -> (continuation of Deferred@1841295517 after retry RPC after error@933963615) -> (continuation of Deferred@815729326 after retry RPC after error@232201482) -> (continuation of Deferred@528367413 after retry RPC after error@1904304730) -> (continuation of Deferred@964938942 after retry RPC after error@201963977) -> (continuation of Deferred@1658894570 after retry RPC after error@411665758) -> (continuation of Deferred@1061706957 after retry RPC after error@2119068956) -> (continuation of Deferred@428785111 after retry RPC after error@1299802317) -> (continuation of Deferred@816511899 after retry RPC after error@1023497759) -> (continuation of Deferred@1359815789 after retry RPC after error@1471414657) -> (continuation of Deferred@816144079 after retry RPC after error@128141162) -> (continuation of Deferred@1060451775 after retry RPC after error@1215988689) -> (continuation of Deferred@1379135287 after retry RPC after error@1328970252) -> (continuation of Deferred@1496852120 after retry RPC after error@1161843301) -> (continuation of Deferred@138893229 after retry RPC after error@1952299699) -> (continuation of Deferred@1816747590 after retry RPC after error@727579344) -> (continuation of Deferred@420817449 after retry RPC after error@295834) -> (continuation of Deferred@647579314 after retry RPC after error@1649845195) -> (continuation of Deferred@1386387914 after retry RPC after error@1981732951) -> (continuation of Deferred@450804976 after retry RPC after error@1304501403) -> (continuation of Deferred@199991328 after retry RPC after error@188157290)))
18:34:19.946 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:19.946 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:19.946 [DEBUG - pool-396-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:19.946 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:19.947 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:19.947 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:19.947 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:19.947 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:19.947 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:19.947 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:19.947 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:19.947 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:19.948 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:19.949 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29233), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [48ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [49ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [75ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [76ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [77ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [77ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [88ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [109ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [109ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [109ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [110ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [120ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [121ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [160ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [160ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [160ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [161ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [202ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [321ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [461ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [461ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [462ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [462ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [521ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [521ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [521ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [521ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1520ms] refreshing cache from master, [1520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1521ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1522ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3141ms] refreshing cache from master, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [3141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3142ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [6682ms] refreshing cache from master, [6682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [6683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [6683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [6683ms] too many traces: truncated at 100 traces, deferred=Deferred@497676880(state=PENDING, result=null, callback=(continuation of Deferred@761053065 after retry RPC after error@1552797746) -> (continuation of Deferred@921526696 after retry RPC after error@1686384215) -> (continuation of Deferred@745305529 after retry RPC after error@517094470) -> (continuation of Deferred@1131408917 after retry RPC after error@115119801) -> (continuation of Deferred@1230174822 after retry RPC after error@1181605638) -> (continuation of Deferred@2060361368 after retry RPC after error@415606310) -> (continuation of Deferred@1176170130 after retry RPC after error@1848089784) -> (continuation of Deferred@1611916730 after retry RPC after error@1439865608) -> (continuation of Deferred@1143837022 after retry RPC after error@373098303) -> (continuation of Deferred@1769741943 after retry RPC after error@674747019) -> (continuation of Deferred@12059058 after retry RPC after error@2126703205) -> (continuation of Deferred@2001001580 after retry RPC after error@1643244421) -> (continuation of Deferred@553964440 after retry RPC after error@1216123935) -> (continuation of Deferred@420120256 after retry RPC after error@2009725863) -> (continuation of Deferred@1893101269 after retry RPC after error@1554436284) -> (continuation of Deferred@290943342 after retry RPC after error@704357408) -> (continuation of Deferred@1788401420 after retry RPC after error@5360083) -> (continuation of Deferred@707200182 after retry RPC after error@1586069366) -> (continuation of Deferred@1912988444 after retry RPC after error@2081731550) -> (continuation of Deferred@1845762654 after retry RPC after error@2070133287) -> (continuation of Deferred@648264532 after retry RPC after error@2138076701) -> (continuation of Deferred@828917063 after retry RPC after error@1463575503), errback=(continuation of Deferred@761053065 after retry RPC after error@1552797746) -> (continuation of Deferred@921526696 after retry RPC after error@1686384215) -> (continuation of Deferred@745305529 after retry RPC after error@517094470) -> (continuation of Deferred@1131408917 after retry RPC after error@115119801) -> (continuation of Deferred@1230174822 after retry RPC after error@1181605638) -> (continuation of Deferred@2060361368 after retry RPC after error@415606310) -> (continuation of Deferred@1176170130 after retry RPC after error@1848089784) -> (continuation of Deferred@1611916730 after retry RPC after error@1439865608) -> (continuation of Deferred@1143837022 after retry RPC after error@373098303) -> (continuation of Deferred@1769741943 after retry RPC after error@674747019) -> (continuation of Deferred@12059058 after retry RPC after error@2126703205) -> (continuation of Deferred@2001001580 after retry RPC after error@1643244421) -> (continuation of Deferred@553964440 after retry RPC after error@1216123935) -> (continuation of Deferred@420120256 after retry RPC after error@2009725863) -> (continuation of Deferred@1893101269 after retry RPC after error@1554436284) -> (continuation of Deferred@290943342 after retry RPC after error@704357408) -> (continuation of Deferred@1788401420 after retry RPC after error@5360083) -> (continuation of Deferred@707200182 after retry RPC after error@1586069366) -> (continuation of Deferred@1912988444 after retry RPC after error@2081731550) -> (continuation of Deferred@1845762654 after retry RPC after error@2070133287) -> (continuation of Deferred@648264532 after retry RPC after error@2138076701) -> (continuation of Deferred@828917063 after retry RPC after error@1463575503)))
18:34:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:19.964566  8236 catalog_manager.cc:5696] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b47d36a83f4440eaac9ce006765394d3 (127.7.200.130). New cstate: current_term: 1 leader_uuid: "b47d36a83f4440eaac9ce006765394d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 } health_report { overall_health: UNKNOWN } } }
18:34:20.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:20.057183  8998 consensus_queue.cc:1048] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:34:20.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:20.067232  8455 raft_consensus.cc:3060] T 569fbab27dcc46ceb35a25ca5373588b P d916cabe36cb45ccb545d9fc771a4651 [term 0 FOLLOWER]: Advancing to term 1
18:34:20.073 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:20.074 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:20.074 [DEBUG - pool-398-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:20.074 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:20.075 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:20.075 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:20.075 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:20.075 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:20.075 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:20.076 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:20.076 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:20.076 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:20.076 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:20.077 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29354), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [6ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [7ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [19ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [19ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [29ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [35ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [35ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [63ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [64ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [64ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [81ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [82ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [182ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [203ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [203ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [263ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [263ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [264ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [264ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [542ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [542ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1243ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1661ms] refreshing cache from master, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1663ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1663ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [4741ms] refreshing cache from master, [4741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [4742ms] too many traces: truncated at 100 traces, deferred=Deferred@1268663167(state=PENDING, result=null, callback=(continuation of Deferred@145921331 after retry RPC after error@649462626) -> (continuation of Deferred@657512442 after retry RPC after error@512556504) -> (continuation of Deferred@42727479 after retry RPC after error@338712087) -> (continuation of Deferred@899599468 after retry RPC after error@1275430202) -> (continuation of Deferred@294815437 after retry RPC after error@117766662) -> (continuation of Deferred@1153088294 after retry RPC after error@620157662) -> (continuation of Deferred@559383651 after retry RPC after error@19107461) -> (continuation of Deferred@273769996 after retry RPC after error@40070898) -> (continuation of Deferred@520783425 after retry RPC after error@37778563) -> (continuation of Deferred@431625153 after retry RPC after error@12053242) -> (continuation of Deferred@1271155747 after retry RPC after error@1243733428) -> (continuation of Deferred@55376682 after retry RPC after error@1016279427) -> (continuation of Deferred@1440733030 after retry RPC after error@299330580) -> (continuation of Deferred@1973829807 after retry RPC after error@1352431793) -> (continuation of Deferred@2069098787 after retry RPC after error@1372493201) -> (continuation of Deferred@371856447 after retry RPC after error@633384891) -> (continuation of Deferred@1098815689 after retry RPC after error@1689907050) -> (continuation of Deferred@586454062 after retry RPC after error@40458940) -> (continuation of Deferred@929313512 after retry RPC after error@479025617) -> (continuation of Deferred@442432394 after retry RPC after error@1386938055) -> (continuation of Deferred@1154446600 after retry RPC after error@846921617) -> (continuation of Deferred@1595265279 after retry RPC after error@1514950940) -> (continuation of Deferred@1704204392 after retry RPC after error@16246076) -> (continuation of Deferred@1897156597 after retry RPC after error@1231561850) -> (continuation of Deferred@217719399 after retry RPC after error@857467073), errback=(continuation of Deferred@145921331 after retry RPC after error@649462626) -> (continuation of Deferred@657512442 after retry RPC after error@512556504) -> (continuation of Deferred@42727479 after retry RPC after error@338712087) -> (continuation of Deferred@899599468 after retry RPC after error@1275430202) -> (continuation of Deferred@294815437 after retry RPC after error@117766662) -> (continuation of Deferred@1153088294 after retry RPC after error@620157662) -> (continuation of Deferred@559383651 after retry RPC after error@19107461) -> (continuation of Deferred@273769996 after retry RPC after error@40070898) -> (continuation of Deferred@520783425 after retry RPC after error@37778563) -> (continuation of Deferred@431625153 after retry RPC after error@12053242) -> (continuation of Deferred@1271155747 after retry RPC after error@1243733428) -> (continuation of Deferred@55376682 after retry RPC after error@1016279427) -> (continuation of Deferred@1440733030 after retry RPC after error@299330580) -> (continuation of Deferred@1973829807 after retry RPC after error@1352431793) -> (continuation of Deferred@2069098787 after retry RPC after error@1372493201) -> (continuation of Deferred@371856447 after retry RPC after error@633384891) -> (continuation of Deferred@1098815689 after retry RPC after error@1689907050) -> (continuation of Deferred@586454062 after retry RPC after error@40458940) -> (continuation of Deferred@929313512 after retry RPC after error@479025617) -> (continuation of Deferred@442432394 after retry RPC after error@1386938055) -> (continuation of Deferred@1154446600 after retry RPC after error@846921617) -> (continuation of Deferred@1595265279 after retry RPC after error@1514950940) -> (continuation of Deferred@1704204392 after retry RPC after error@16246076) -> (continuation of Deferred@1897156597 after retry RPC after error@1231561850) -> (continuation of Deferred@217719399 after retry RPC after error@857467073)))
18:34:20.095 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:20.095 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:20.095 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:20.096 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:20.096 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:20.096 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:20.096 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:20.096 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:20.096 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:20.096 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:20.097 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:20.097 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:20.097 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:20.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:20.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:20.158177  8964 consensus_queue.cc:1048] T 8deb64d0611e4e7e9f7c8324b188cb2b P d916cabe36cb45ccb545d9fc771a4651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:34:20.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:20.194 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.194 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.194 [DEBUG - pool-408-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.195 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.195 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.195 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.195 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.195 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.195 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.196 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.196 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.196 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.196 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.197 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29281), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [24ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [38ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [40ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [40ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [74ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [75ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [76ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [76ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [87ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [87ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [87ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [87ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [141ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [164ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [164ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [164ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [243ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [243ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [321ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [321ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [322ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [602ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [602ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [602ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [602ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1160ms] refreshing cache from master, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1161ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1162ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2000ms] refreshing cache from master, [2000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2001ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2001ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2001ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2002ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [3000ms] refreshing cache from master, [3000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [3001ms] too many traces: truncated at 100 traces, deferred=Deferred@1953183323(state=PENDING, result=null, callback=(continuation of Deferred@2038902471 after retry RPC after error@1469947351) -> (continuation of Deferred@1941351307 after retry RPC after error@1581421128) -> (continuation of Deferred@519274065 after retry RPC after error@624634749) -> (continuation of Deferred@1662461602 after retry RPC after error@697116762) -> (continuation of Deferred@738843340 after retry RPC after error@1343581427) -> (continuation of Deferred@183329381 after retry RPC after error@1247958170) -> (continuation of Deferred@677329056 after retry RPC after error@1398188972) -> (continuation of Deferred@852035049 after retry RPC after error@1784107438) -> (continuation of Deferred@1000140412 after retry RPC after error@1576089960) -> (continuation of Deferred@669878642 after retry RPC after error@2003269120) -> (continuation of Deferred@735353246 after retry RPC after error@2142953461) -> (continuation of Deferred@878145385 after retry RPC after error@2026686613) -> (continuation of Deferred@2002499195 after retry RPC after error@1589090834) -> (continuation of Deferred@1360304778 after retry RPC after error@1333946461) -> (continuation of Deferred@1698756536 after retry RPC after error@130385416) -> (continuation of Deferred@1919978672 after retry RPC after error@778879523) -> (continuation of Deferred@1282612577 after retry RPC after error@1739400993) -> (continuation of Deferred@290337384 after retry RPC after error@1509656504) -> (continuation of Deferred@230097395 after retry RPC after error@53324619) -> (continuation of Deferred@1661998132 after retry RPC after error@1716754857) -> (continuation of Deferred@1407099913 after retry RPC after error@1028078282) -> (continuation of Deferred@1578449122 after retry RPC after error@619801688) -> (continuation of Deferred@36268579 after retry RPC after error@113017286) -> (continuation of Deferred@1897491419 after retry RPC after error@1587890700) -> (continuation of Deferred@387210121 after retry RPC after error@1975802396), errback=(continuation of Deferred@2038902471 after retry RPC after error@1469947351) -> (continuation of Deferred@1941351307 after retry RPC after error@1581421128) -> (continuation of Deferred@519274065 after retry RPC after error@624634749) -> (continuation of Deferred@1662461602 after retry RPC after error@697116762) -> (continuation of Deferred@738843340 after retry RPC after error@1343581427) -> (continuation of Deferred@183329381 after retry RPC after error@1247958170) -> (continuation of Deferred@677329056 after retry RPC after error@1398188972) -> (continuation of Deferred@852035049 after retry RPC after error@1784107438) -> (continuation of Deferred@1000140412 after retry RPC after error@1576089960) -> (continuation of Deferred@669878642 after retry RPC after error@2003269120) -> (continuation of Deferred@735353246 after retry RPC after error@2142953461) -> (continuation of Deferred@878145385 after retry RPC after error@2026686613) -> (continuation of Deferred@2002499195 after retry RPC after error@1589090834) -> (continuation of Deferred@1360304778 after retry RPC after error@1333946461) -> (continuation of Deferred@1698756536 after retry RPC after error@130385416) -> (continuation of Deferred@1919978672 after retry RPC after error@778879523) -> (continuation of Deferred@1282612577 after retry RPC after error@1739400993) -> (continuation of Deferred@290337384 after retry RPC after error@1509656504) -> (continuation of Deferred@230097395 after retry RPC after error@53324619) -> (continuation of Deferred@1661998132 after retry RPC after error@1716754857) -> (continuation of Deferred@1407099913 after retry RPC after error@1028078282) -> (continuation of Deferred@1578449122 after retry RPC after error@619801688) -> (continuation of Deferred@36268579 after retry RPC after error@113017286) -> (continuation of Deferred@1897491419 after retry RPC after error@1587890700) -> (continuation of Deferred@387210121 after retry RPC after error@1975802396)))
18:34:20.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:20.200651  8964 consensus_queue.cc:1048] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47d36a83f4440eaac9ce006765394d3" member_type: VOTER last_known_addr { host: "127.7.200.130" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:34:20.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:20.229596  8998 consensus_queue.cc:1048] T d9b4ee28af7743f59956e54d0900a1bc P d916cabe36cb45ccb545d9fc771a4651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:34:20.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:20.322629  8973 consensus_queue.cc:1048] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e2eeb0ca41546d7bcaca3220385168e" member_type: VOTER last_known_addr { host: "127.7.200.131" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:34:20.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:20.348445  8958 consensus_queue.cc:1048] T 5c37815e96ea465a8c32e5a3d746b02b P b47d36a83f4440eaac9ce006765394d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d916cabe36cb45ccb545d9fc771a4651" member_type: VOTER last_known_addr { host: "127.7.200.129" port: 33899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:34:20.358 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:20.358 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:20.358 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:20.358 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:20.358 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:20.358 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:20.359 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:20.359 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:20.359 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:20.359 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:20.359 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:20.359 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:20.359 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:20.499 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:20.500 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:20.500 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:20.500 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:20.500 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:20.500 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:20.500 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:20.500 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:20.500 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:20.500 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:20.500 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:20.500 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:20.500 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:20.524 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (9de81db54be40687a2a82164db1dc50b) switched from state RESTARTING to RUNNING.
18:34:20.524 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 9de81db54be40687a2a82164db1dc50b from Checkpoint 74 @ 1783535598621 for 9de81db54be40687a2a82164db1dc50b located at file:/tmp/junit13379242205642315453/checkpoints/9de81db54be40687a2a82164db1dc50b/chk-74.
18:34:20.525 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
18:34:20.525 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:34:20.526 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED.
18:34:20.527 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:34:20.528 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING.
18:34:20.528 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #3) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id 30d104af07ed84a5695abb40e9c4cdae
18:34:20.528 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to SCHEDULED.
18:34:20.528 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 30d104af07ed84a5695abb40e9c4cdae.
18:34:20.529 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from SCHEDULED to DEPLOYING.
18:34:20.529 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #4) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id e340c57f8743c3b4810a5f8fd9742fae
18:34:20.529 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to SCHEDULED.
18:34:20.530 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id 30d104af07ed84a5695abb40e9c4cdae.
18:34:20.530 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from SCHEDULED to DEPLOYING.
18:34:20.530 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #3) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id afa7c94bd89aa521f7cc788a9467b76f
18:34:20.530 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:34:20.526 [INFO - Thread-59] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:34:20.531 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:20.531 [DEBUG - Thread-59] (Connection.java:575) [peer master-127.2.96.189:33339(127.2.96.189:33339)] disconnecting while in state TERMINATED
18:34:20.531 [DEBUG - Thread-59] (Connection.java:575) [peer master-127.2.96.188:32989(127.2.96.188:32989)] disconnecting while in state TERMINATED
18:34:20.530 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to SCHEDULED.
18:34:20.532 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:34:20.532 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from SCHEDULED to DEPLOYING.
18:34:20.532 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #3) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id 2d9055e68c7827d1c77d7c11ef4f5752
18:34:20.532 [DEBUG - Thread-59] (Connection.java:575) [peer master-127.2.96.190:44161(127.2.96.190:44161)] disconnecting while in state TERMINATED
18:34:20.532 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:20.534 [INFO - Thread-59] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:34:20.534 [INFO - Thread-59] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:34:20.536 [DEBUG - Thread-59] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:20.536 [INFO - Thread-59] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:34:20.538 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot e340c57f8743c3b4810a5f8fd9742fae.
18:34:20.538 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
18:34:20.539 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
18:34:20.539 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_4), deploy into slot with allocation id e340c57f8743c3b4810a5f8fd9742fae.
18:34:20.540 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7f74b82c
18:34:20.540 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:20.540 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:34:20.540 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot afa7c94bd89aa521f7cc788a9467b76f.
18:34:20.541 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
18:34:20.541 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
18:34:20.541 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_3), deploy into slot with allocation id afa7c94bd89aa521f7cc788a9467b76f.
18:34:20.542 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to DEPLOYING.
18:34:20.542 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to DEPLOYING.
18:34:20.542 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_4) [DEPLOYING].
18:34:20.542 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_3) [DEPLOYING].
18:34:20.543 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3d3505fa
18:34:20.543 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:20.543 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 2d9055e68c7827d1c77d7c11ef4f5752.
18:34:20.543 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:34:20.543 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@81fc1f7
18:34:20.544 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:20.544 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
18:34:20.544 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_3), deploy into slot with allocation id 2d9055e68c7827d1c77d7c11ef4f5752.
18:34:20.544 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:34:20.544 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
18:34:20.544 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
18:34:20.544 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
18:34:20.546 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5cc332e5
18:34:20.548 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2c7416c7
18:34:20.548 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:20.550 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@122135cc
18:34:20.550 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:20.551 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:20.559 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:20.559 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:20.559 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:20.559 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:20.559 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to DEPLOYING.
18:34:20.559 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.559 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_3) [DEPLOYING].
18:34:20.560 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.560 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6ed23f58
18:34:20.560 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:20.561 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:34:20.561 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
18:34:20.561 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
18:34:20.562 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.563 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@424d1744
18:34:20.563 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.563 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.563 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.564 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.564 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.564 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.565 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.565 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.565 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.565 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:20.565 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.565 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.566 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.566 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.566 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:20.568 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.569 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.569 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.569 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:20.569 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.570 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.570 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.571 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.571 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.571 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.571 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.571 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.571 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.571 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.572 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.572 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.572 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.572 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.573 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.573 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.573 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:20.574 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.574 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.574 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.574 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.574 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.574 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.574 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.575 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.575 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.575 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.575 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.575 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.575 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.575 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.575 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.575 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.575 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.576 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.576 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.579 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.580 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.583 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.584 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.584 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.584 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.584 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.585 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.585 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.585 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.585 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.586 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.586 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.586 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.586 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:20.587 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.587 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.597 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.597 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:20.597 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.601 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.601 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.601 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.601 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.601 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.601 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.602 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:20.602 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.602 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.603 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.603 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.603 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.603 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.603 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.603 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.603 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.603 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.603 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.603 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.604 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.604 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.604 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.604 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.604 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.604 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.604 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.605 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:20.607 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.607 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.607 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.607 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.619 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.619 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.620 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.620 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.620 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.620 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.620 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:20.621 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.622 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.622 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.622 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.622 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.622 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.623 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:20.623 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.623 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.623 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.623 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.624 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.624 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.624 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.624 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.624 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.625 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.625 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.625 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.625 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.625 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.625 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.625 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.627 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.627 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.627 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.627 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:20.628 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.628 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.628 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.628 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.635 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.635 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.635 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.636 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.636 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.640 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.640 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.640 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.640 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.640 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.640 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.640 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.640 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.641 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.641 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.641 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.641 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.641 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.641 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.643 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.643 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.643 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.643 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.644 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.644 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.644 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.644 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.645 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:20.651 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.651 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.652 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.652 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.652 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.652 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.652 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.652 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.652 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.652 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.653 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.653 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.653 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:20.654 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.654 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.654 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.654 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:20.654 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.654 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.654 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.655 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.655 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.655 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.655 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.655 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:20.655 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.655 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.655 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.655 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.656 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.656 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.656 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.656 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.656 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.656 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.657 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.659 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.660 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.660 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.660 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.660 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.660 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.661 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.661 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.661 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.662 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.662 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.662 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.662 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.664 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.664 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.664 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.664 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.665 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.665 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.665 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.665 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.665 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.665 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.665 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.665 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.665 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.665 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:20.665 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:20.665 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:20.665 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.665 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.665 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.666 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.666 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.666 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.666 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.666 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.666 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.666 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:20.673 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.673 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.673 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.673 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.673 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.673 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.673 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.673 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.673 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.674 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.674 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.674 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.674 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.679 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:20.680 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:20.680 [DEBUG - pool-394-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:20.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:20.680 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.680 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:20.680 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.681 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.681 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:20.681 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:20.681 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:20.681 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.681 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:20.681 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.681 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.681 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.682 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.682 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.682 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.682 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.682 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.680 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.683 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.684 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.684 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.684 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.684 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.684 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.684 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.684 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.684 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.684 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.685 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.685 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.685 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.685 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.685 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.685 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.685 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.685 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.685 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.685 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.686 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.686 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:20.686 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:20.686 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:20.681 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:20.686 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:20.686 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.686 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.687 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.687 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.687 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.687 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.687 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.687 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.687 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.687 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:20.681 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.680 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:20.688 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:20.688 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:20.688 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.688 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.688 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.688 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.688 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29993), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [12ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [17ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [41ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [41ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [75ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [76ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [77ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [77ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [84ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [92ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [93ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [101ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [101ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [102ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [124ms] refreshing cache from master, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [126ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [126ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [126ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [127ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [161ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [202ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [202ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [221ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [222ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [222ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [462ms] refreshing cache from master, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [463ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [463ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [464ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [581ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [581ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [581ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [581ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [861ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [861ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [861ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [861ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1041ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1042ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2941ms] refreshing cache from master, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2941ms] too many traces: truncated at 100 traces, deferred=Deferred@1130766834(state=PENDING, result=null, callback=(continuation of Deferred@376694505 after retry RPC after error@132316789) -> (continuation of Deferred@909054280 after retry RPC after error@1144311758) -> (continuation of Deferred@1299787023 after retry RPC after error@1568170883) -> (continuation of Deferred@328440885 after retry RPC after error@1899719478) -> (continuation of Deferred@1974350155 after retry RPC after error@1800675334) -> (continuation of Deferred@1688828781 after retry RPC after error@1323421205) -> (continuation of Deferred@1254197995 after retry RPC after error@14665637) -> (continuation of Deferred@797091520 after retry RPC after error@1867732035) -> (continuation of Deferred@696458640 after retry RPC after error@1470043626) -> (continuation of Deferred@1829838207 after retry RPC after error@404078034) -> (continuation of Deferred@692800733 after retry RPC after error@106183771) -> (continuation of Deferred@1674257163 after retry RPC after error@1451620749) -> (continuation of Deferred@635136548 after retry RPC after error@46804000) -> (continuation of Deferred@941851657 after retry RPC after error@1100176145) -> (continuation of Deferred@1063748429 after retry RPC after error@1822364589) -> (continuation of Deferred@1220067835 after retry RPC after error@329793582) -> (continuation of Deferred@274121981 after retry RPC after error@71352097) -> (continuation of Deferred@184095051 after retry RPC after error@1535215882) -> (continuation of Deferred@2102841259 after retry RPC after error@2096025239) -> (continuation of Deferred@1046477576 after retry RPC after error@1765932048) -> (continuation of Deferred@580996356 after retry RPC after error@674346417) -> (continuation of Deferred@1777835012 after retry RPC after error@254827606) -> (continuation of Deferred@659679705 after retry RPC after error@48778431) -> (continuation of Deferred@1470818138 after retry RPC after error@1517671189) -> (continuation of Deferred@1925375651 after retry RPC after error@839893488), errback=(continuation of Deferred@376694505 after retry RPC after error@132316789) -> (continuation of Deferred@909054280 after retry RPC after error@1144311758) -> (continuation of Deferred@1299787023 after retry RPC after error@1568170883) -> (continuation of Deferred@328440885 after retry RPC after error@1899719478) -> (continuation of Deferred@1974350155 after retry RPC after error@1800675334) -> (continuation of Deferred@1688828781 after retry RPC after error@1323421205) -> (continuation of Deferred@1254197995 after retry RPC after error@14665637) -> (continuation of Deferred@797091520 after retry RPC after error@1867732035) -> (continuation of Deferred@696458640 after retry RPC after error@1470043626) -> (continuation of Deferred@1829838207 after retry RPC after error@404078034) -> (continuation of Deferred@692800733 after retry RPC after error@106183771) -> (continuation of Deferred@1674257163 after retry RPC after error@1451620749) -> (continuation of Deferred@635136548 after retry RPC after error@46804000) -> (continuation of Deferred@941851657 after retry RPC after error@1100176145) -> (continuation of Deferred@1063748429 after retry RPC after error@1822364589) -> (continuation of Deferred@1220067835 after retry RPC after error@329793582) -> (continuation of Deferred@274121981 after retry RPC after error@71352097) -> (continuation of Deferred@184095051 after retry RPC after error@1535215882) -> (continuation of Deferred@2102841259 after retry RPC after error@2096025239) -> (continuation of Deferred@1046477576 after retry RPC after error@1765932048) -> (continuation of Deferred@580996356 after retry RPC after error@674346417) -> (continuation of Deferred@1777835012 after retry RPC after error@254827606) -> (continuation of Deferred@659679705 after retry RPC after error@48778431) -> (continuation of Deferred@1470818138 after retry RPC after error@1517671189) -> (continuation of Deferred@1925375651 after retry RPC after error@839893488)))
18:34:20.693 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.693 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.693 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.695 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.695 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.695 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.695 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.695 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.699 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.699 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.699 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.700 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.701 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.701 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.701 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.701 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.701 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.701 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.701 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.701 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.702 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.702 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.702 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.702 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.695 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.702 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.704 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.704 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.704 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.704 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.704 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.704 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.705 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.705 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.705 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.705 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.705 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.705 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.705 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.705 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:20.705 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:20.706 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:20.706 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.706 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.706 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.706 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.706 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.706 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.706 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.706 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.706 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.706 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:20.720 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.720 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.720 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.720 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.720 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.720 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.720 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.720 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.720 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.721 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.721 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.720 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.725 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.733 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.734 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.734 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.734 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.734 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.734 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.735 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.735 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.735 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.735 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.735 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.735 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.735 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.740 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.740 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.740 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.740 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.740 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.740 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.740 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.740 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.740 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.740 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.741 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.741 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.741 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.745 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:20.745 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:20.745 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:20.746 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.746 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.746 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.746 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.746 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.746 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.746 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.746 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.746 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.746 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:20.759 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.760 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.760 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.760 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.760 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.760 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.760 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.760 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.760 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.760 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.760 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.760 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.760 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.764 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.764 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.764 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.764 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.764 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.764 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.764 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.764 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.764 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.765 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.765 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.765 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:20.765 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.765 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.765 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:20.765 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:20.765 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.765 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.765 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.765 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.765 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.765 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.766 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.766 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.766 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.766 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:20.773 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.773 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.774 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.774 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.774 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.774 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.774 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.775 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.775 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.775 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.774 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.775 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.775 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.780 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.780 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.780 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.780 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.780 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.780 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.781 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.781 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.781 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.781 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.781 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.781 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.781 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.781 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.781 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.781 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.781 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.781 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.782 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.782 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.782 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.782 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.781 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.782 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.782 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.782 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.844 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.844 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.844 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.844 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.845 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.845 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.845 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.845 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.845 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.845 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.845 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.845 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.845 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.846 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:20.846 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:20.846 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:20.846 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.846 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.846 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.846 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.846 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.846 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.846 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:20.846 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:20.846 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:20.846 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:20.873 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.874 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.874 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.874 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.874 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.874 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.874 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.874 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.874 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.874 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.874 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.874 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.874 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.880 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.880 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.880 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.880 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.880 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.880 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.880 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.880 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.880 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.880 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.880 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.881 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.881 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.884 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:20.884 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:20.884 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:20.884 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.884 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.884 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.884 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.884 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.884 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:20.884 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.884 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:20.884 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:20.884 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:20.975 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:20.975 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:20.975 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:20.975 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:20.975 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:20.975 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:20.976 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:20.976 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:20.976 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:20.976 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:20.975 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:20.976 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:20.976 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:21.000 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:21.000 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:21.000 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:21.000 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.000 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.000 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.000 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.000 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.000 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.001 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.001 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.001 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.001 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:21.020 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:21.020 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:21.020 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:21.021 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:21.021 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:21.021 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:21.021 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:21.021 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:21.021 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:21.021 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:21.021 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:21.022 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:21.022 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:21.039 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:21.040 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:21.040 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:21.040 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:21.040 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:21.040 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:21.040 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:21.040 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:21.040 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:21.040 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:21.040 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:21.041 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:21.041 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:21.088 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:21.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:21.101 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:21.101 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:21.101 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:21.101 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.101 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.101 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.101 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.101 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.101 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.101 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.101 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.102 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.102 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:21.113 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:21.114 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:21.114 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:21.114 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.114 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.114 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.114 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.114 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.114 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.114 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.114 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.115 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.115 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:21.127 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:21.127 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:21.127 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:21.127 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:21.128 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:21.128 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:21.128 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:21.128 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:21.128 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:21.128 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:21.128 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:21.128 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:21.128 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:21.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:21.240 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:21.240 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:21.240 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:21.240 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.241 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.241 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.241 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.241 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.241 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.241 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.241 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.241 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.241 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:21.265 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:21.265 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:21.265 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:21.265 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.265 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.265 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.265 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.265 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.265 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.266 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.266 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.266 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.266 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:21.505 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:21.505 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:21.505 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:21.505 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.505 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.505 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.505 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.505 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.506 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.506 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.506 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.506 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.506 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:21.573 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:21.573 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:21.574 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:21.574 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.574 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.574 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.574 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.574 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.574 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.574 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.574 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.574 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.574 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:21.588 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:21.593 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:21.593 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:21.593 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:21.594 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.594 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.594 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.594 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.594 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.594 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.594 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.594 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.594 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.595 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:21.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:21.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:21.758 [DEBUG - main] (Connection.java:575) [peer master-127.6.245.62:36853(127.6.245.62:36853)] disconnecting while in state READY
18:34:21.758 [DEBUG - main] (Connection.java:575) [peer master-127.6.245.60:46787(127.6.245.60:46787)] disconnecting while in state READY
18:34:21.758 [DEBUG - main] (Connection.java:575) [peer master-127.6.245.61:44495(127.6.245.61:44495)] disconnecting while in state READY
18:34:21.759 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.6.245.60:46787(127.6.245.60:46787)] handling channelInactive
18:34:21.759 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state READY due to: connection closed
18:34:21.759 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.6.245.62:36853(127.6.245.62:36853)] handling channelInactive
18:34:21.759 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state READY due to: connection closed
18:34:21.761 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:21.762 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-1
18:34:21.762 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
18:34:21.763 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.6.245.61:44495(127.6.245.61:44495)] handling channelInactive
18:34:21.763 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state READY due to: connection closed
18:34:21.763 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
18:34:21.763 [DEBUG - main] (Connection.java:575) [peer master-127.7.200.189:42349(127.7.200.189:42349)] disconnecting while in state READY
18:34:21.764 [DEBUG - main] (Connection.java:575) [peer master-127.7.200.190:40077(127.7.200.190:40077)] disconnecting while in state READY
18:34:21.764 [DEBUG - main] (Connection.java:575) [peer master-127.7.200.188:38999(127.7.200.188:38999)] disconnecting while in state READY
18:34:21.764 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.7.200.189:42349(127.7.200.189:42349)] handling channelInactive
18:34:21.764 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:21.764 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.7.200.188:38999(127.7.200.188:38999)] handling channelInactive
18:34:21.764 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state READY due to: connection closed
18:34:21.766 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state READY due to: connection closed
18:34:21.766 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:34:21.766 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 28 thread-local buffer(s) from thread: kudu-nio-2
18:34:21.767 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.7.200.190:40077(127.7.200.190:40077)] handling channelInactive
18:34:21.767 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state READY due to: connection closed
18:34:21.767 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
18:34:21.768 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:34:21.769 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
18:34:21.769 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
18:34:21.769 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:34:21.769 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:34:21.769 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:34:21.776 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
18:34:21.776 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
18:34:21.776 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
18:34:21.776 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
18:34:21.776 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
18:34:21.776 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
18:34:21.777 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
18:34:21.796 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:21.796 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:21.796 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:21.796 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:21.796 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:21.796 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:21.796 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:21.796 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:21.796 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:21.797 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:21.797 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:21.797 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:21.797 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:21.822 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:21.822 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:21.822 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:21.822 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:21.822 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:21.823 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:21.823 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:21.823 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:21.823 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:21.823 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:21.823 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:21.823 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:21.823 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:21.825 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:21.825 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:21.825 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:21.826 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:21.826 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:21.826 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:21.826 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:21.826 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:21.826 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:21.826 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:21.826 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:21.826 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:21.826 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:21.880 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:21.880 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:21.880 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:21.880 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.880 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.880 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.880 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.881 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.881 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.881 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.881 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.881 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.881 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:21.920 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:21.920 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:21.921 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:21.921 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.921 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.921 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:21.925 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.925 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.925 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:21.925 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.925 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.925 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:21.925 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:22.009 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:22.009 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:22.009 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:22.010 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:22.010 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:22.010 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:22.010 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:22.010 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:22.010 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:22.010 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:22.010 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:22.010 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:22.010 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:22.067 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
18:34:22.088 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:22.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:22.142 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
18:34:22.142 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
18:34:22.142 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
18:34:22.158 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:22.158 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:22.158 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:22.158 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:22.159 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:22.159 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:22.159 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:22.159 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:22.159 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:22.159 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:22.159 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:22.159 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:22.159 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:22.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:22.187 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
18:34:22.425 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:22.425 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:22.425 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:22.425 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:22.425 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:22.425 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:22.426 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:22.426 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:22.426 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:22.426 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:22.426 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:22.426 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:22.426 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:22.587 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:22.599 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:22.649 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:22.649 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:22.650 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:22.650 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:22.650 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:22.650 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:22.650 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:22.650 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:22.650 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:22.650 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:22.650 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:22.650 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:22.650 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:22.668 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:22.668 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:22.668 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:22.669 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:22.669 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:22.669 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:22.669 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:22.669 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:22.669 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:22.669 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:22.669 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:22.669 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:22.669 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:22.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:22.921 [INFO - flink-pekko.actor.default-dispatcher-4] (Slf4jLogger.scala:117) Slf4jLogger started
18:34:22.983 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:22.983 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:22.983 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:22.984 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:22.984 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:22.984 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:22.984 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:22.984 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:22.984 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:22.983 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:22.984 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:22.984 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:22.984 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:22.984 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:22.984 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:22.985 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:22.985 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:22.985 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:22.985 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:22.985 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:22.985 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:22.985 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:22.985 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:22.985 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:22.985 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:22.985 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:23.087 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:23.099 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:23.123 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
18:34:23.144 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
18:34:23.171 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
18:34:23.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:23.190 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
18:34:23.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:23.191614  8498 debug-util.cc:398] Leaking SignalData structure 0x7b08000b10e0 after lost signal to thread 8361
18:34:23.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:23.192854  8498 debug-util.cc:398] Leaking SignalData structure 0x7b08000d1520 after lost signal to thread 8501
18:34:23.250 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
18:34:23.272 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
18:34:23.273 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
18:34:23.274 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
18:34:23.274 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
18:34:23.275 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
18:34:23.275 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
18:34:23.275 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
18:34:23.275 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
18:34:23.276 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
18:34:23.276 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
18:34:23.277 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
18:34:23.277 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
18:34:23.277 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
18:34:23.277 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
18:34:23.277 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
18:34:23.277 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
18:34:23.277 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
18:34:23.285 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
18:34:23.285 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
18:34:23.285 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
18:34:23.285 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
18:34:23.286 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
18:34:23.286 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
18:34:23.286 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
18:34:23.286 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_3450db7a8f2e18ce9416f0fb0de748a6/blobStorage
18:34:23.287 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:39219 - max concurrent requests: 50 - max backlog: 1000
18:34:23.292 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_3450db7a8f2e18ce9416f0fb0de748a6/blobStorage
18:34:23.299 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_3450db7a8f2e18ce9416f0fb0de748a6/blobStorage
18:34:23.305 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
18:34:23.306 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 18348981-93aa-4f9b-8ccb-9c57cd0bda38
18:34:23.311 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 32 GB (66.67% usable)
18:34:23.311 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-5fd41e96-3eb4-477a-9571-728734392aee
18:34:23.314 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-471e4013-fba1-4dcd-9dcd-810dadebce40
18:34:23.333 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:23.333 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:23.333 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:23.334 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:23.334 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:23.334 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:23.334 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:23.334 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:23.334 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:23.334 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:23.335 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:23.335 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:23.335 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:23.345 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:23.345 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:23.345 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:23.345 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:23.345 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:23.345 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:23.345 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:23.345 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:23.345 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:23.345 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:23.345 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:23.345 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:23.346 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:23.346 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:23.346 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:23.346 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:23.346 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:23.346 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:23.346 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:23.346 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:23.346 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:23.346 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:23.346 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:23.346 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:23.346 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:23.346 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:23.411 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
18:34:23.411 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
18:34:23.411 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
18:34:23.411 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
18:34:23.412 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
18:34:23.415 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_20 .
18:34:23.422 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:127) Start job leader service.
18:34:23.422 [INFO - flink-pekko.actor.default-dispatcher-4] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-c006a59e-f485-4482-87b5-0cfad1059b53
18:34:23.423 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
18:34:23.423 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
18:34:23.435 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
18:34:23.435 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
18:34:23.451 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:33075
18:34:23.452 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
18:34:23.468 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
18:34:23.468 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:33075 was granted leadership with leaderSessionID=bbc334e2-42fb-427a-af97-2c54b3d52b7b
18:34:23.469 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:33075 , session=bbc334e2-42fb-427a-af97-2c54b3d52b7b
18:34:23.471 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
18:34:23.471 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
18:34:23.471 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 3f800586-a023-4c90-8340-796482f5e611. Creating new DispatcherLeaderProcess.
18:34:23.472 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
18:34:23.480 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
18:34:23.482 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
18:34:23.482 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
18:34:23.485 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_21 .
18:34:23.492 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_21 , session=3f800586-a023-4c90-8340-796482f5e611
18:34:23.506 [INFO - pool-443-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 04e461e2-27f2-45e2-a737-24b8e529a6ec.
18:34:23.509 [INFO - pool-443-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_22 .
18:34:23.520 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:253) Starting the resource manager.
18:34:23.531 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:212) Starting the slot manager.
18:34:23.531 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:308) Starting tokens update task
18:34:23.531 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
18:34:23.532 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
18:34:23.532 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_22 , session=04e461e2-27f2-45e2-a737-24b8e529a6ec
18:34:23.533 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_22(a73724b8e529a6ec04e461e227f245e2).
18:34:23.558 [INFO - flink-pekko.actor.default-dispatcher-6] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
18:34:23.562 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (41f18052e8363382138bde77e16b10c3).
18:34:23.562 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (41f18052e8363382138bde77e16b10c3).
18:34:23.563 [INFO - flink-pekko.actor.default-dispatcher-7] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-41f18052e8363382138bde77e16b10c3'.
18:34:23.563 [INFO - mini-cluster-io-thread-1] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 41f18052e8363382138bde77e16b10c3 was granted leadership with leader id ae0e0187-c427-4941-9202-633f827032fd. Creating new JobMasterServiceProcess.
18:34:23.565 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:1080) Registering TaskManager with ResourceID 18348981-93aa-4f9b-8ccb-9c57cd0bda38 (pekko://flink/user/rpc/taskmanager_20) at ResourceManager
18:34:23.566 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_22 under registration id 39e82f9185aee727f17550265298ffbd.
18:34:23.567 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:344) Registering task executor 18348981-93aa-4f9b-8ccb-9c57cd0bda38 under 39e82f9185aee727f17550265298ffbd at the slot manager.
18:34:23.574 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_23 .
18:34:23.579 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (41f18052e8363382138bde77e16b10c3).
18:34:23.580 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (41f18052e8363382138bde77e16b10c3).
18:34:23.581 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 5d44d8e07885a93bb0f8ac0099104fe1 for job 41f18052e8363382138bde77e16b10c3.
18:34:23.581 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (41f18052e8363382138bde77e16b10c3).
18:34:23.581 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
18:34:23.582 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
18:34:23.582 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@57bf6b87
18:34:23.582 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:23.583 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit14319925403673159781/checkpoints")
18:34:23.584 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
18:34:23.584 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@568c07ea for Flink Streaming Job (41f18052e8363382138bde77e16b10c3).
18:34:23.585 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_23 , session=ae0e0187-c427-4941-9202-633f827032fd
18:34:23.586 [INFO - flink-pekko.actor.default-dispatcher-4] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (41f18052e8363382138bde77e16b10c3) under job master id 9202633f827032fdae0e0187c4274941.
18:34:23.587 [INFO - flink-pekko.actor.default-dispatcher-4] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:34:23.587 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:23.588 [DEBUG - flink-pekko.actor.default-dispatcher-4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:23.591 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
18:34:23.591 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (41f18052e8363382138bde77e16b10c3) switched from state CREATED to RUNNING.
18:34:23.592 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
18:34:23.592 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
18:34:23.593 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
18:34:23.593 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
18:34:23.593 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:23.594 [INFO - flink-pekko.actor.default-dispatcher-4] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_22(a73724b8e529a6ec04e461e227f245e2)
18:34:23.594 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:23.596 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
18:34:23.597 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:390) Registering job manager 9202633f827032fdae0e0187c4274941@pekko://flink/user/rpc/jobmanager_23 for job 41f18052e8363382138bde77e16b10c3.
18:34:23.599 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:23.607 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.6.245.61:44495(127.6.245.61:44495)] Successfully connected to peer
18:34:23.610 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:1015) Registered job manager 9202633f827032fdae0e0187c4274941@pekko://flink/user/rpc/jobmanager_23 for job 41f18052e8363382138bde77e16b10c3.
18:34:23.616 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:23.618 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.6.245.60:46787(127.6.245.60:46787)] Successfully connected to peer
18:34:23.619 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.61
18:34:23.620 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.6.245.62:36853(127.6.245.62:36853)] Successfully connected to peer
18:34:23.625 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.62
18:34:23.634 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.60
18:34:23.639 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: a73724b8e529a6ec04e461e227f245e2.
18:34:23.639 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 41f18052e8363382138bde77e16b10c3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:34:23.649 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:23.649 [DEBUG - main] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:34:23.651 [DEBUG - main] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:34:23.652 [DEBUG - main] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:34:23.652 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.7.200.189:42349(127.7.200.189:42349)] Successfully connected to peer
18:34:23.653 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.7.200.190:40077(127.7.200.190:40077)] Successfully connected to peer
18:34:23.654 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:23.654 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:23.654 [DEBUG - pool-378-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:23.655 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:23.655 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:23.655 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:23.655 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:23.655 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:23.655 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:23.655 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:23.655 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:23.655 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:23.655 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:23.657 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:23.665 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8c0fe579, L:/127.0.0.1:41786 - R:/127.6.245.61:44495] using SASL/PLAIN
18:34:23.667 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x7c8540eb, L:/127.0.0.1:42548 - R:/127.6.245.62:36853] using SASL/PLAIN
18:34:23.660 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.7.200.188:38999(127.7.200.188:38999)] Successfully connected to peer
18:34:23.678 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:23.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:23.682 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x40a014c8, L:/127.0.0.1:46046 - R:/127.6.245.60:46787] using SASL/PLAIN
18:34:23.685 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.188
18:34:23.688 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:34:23.688 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=95), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [78ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: OK, [78ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: OK, [94ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: OK, deferred=null) after lookup
18:34:23.693 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table ffbf6c12abe4466485202b0208f6b095
18:34:23.693 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.189
18:34:23.702 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 41f18052e8363382138bde77e16b10c3
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 18348981-93aa-4f9b-8ccb-9c57cd0bda38
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
18:34:23.703 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 1fb92e44b6a0ec833400217bb7150056 from 18348981-93aa-4f9b-8ccb-9c57cd0bda38 for job 41f18052e8363382138bde77e16b10c3 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:34:23.704 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 3ab80748f81d56605b604d6b67a52227 from 18348981-93aa-4f9b-8ccb-9c57cd0bda38 for job 41f18052e8363382138bde77e16b10c3 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:34:23.704 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 1fb92e44b6a0ec833400217bb7150056 for job 41f18052e8363382138bde77e16b10c3 from resource manager with leader id a73724b8e529a6ec04e461e227f245e2.
18:34:23.704 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 6fa98963f3433621a126e6db77ad5f3b from 18348981-93aa-4f9b-8ccb-9c57cd0bda38 for job 41f18052e8363382138bde77e16b10c3 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:34:23.704 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 1fb92e44b6a0ec833400217bb7150056 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:34:23.704 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 7a0ffa37add86fcce9866592db26034c from 18348981-93aa-4f9b-8ccb-9c57cd0bda38 for job 41f18052e8363382138bde77e16b10c3 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:34:23.709 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:192) Add job 41f18052e8363382138bde77e16b10c3 for job leader monitoring.
18:34:23.709 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.190
18:34:23.709 [INFO - mini-cluster-io-thread-1] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_23 with leader id ae0e0187-c427-4941-9202-633f827032fd.
18:34:23.709 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 3ab80748f81d56605b604d6b67a52227 for job 41f18052e8363382138bde77e16b10c3 from resource manager with leader id a73724b8e529a6ec04e461e227f245e2.
18:34:23.709 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 3ab80748f81d56605b604d6b67a52227 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:34:23.710 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c39b66751cde487c94b99b60adc93d53 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
18:34:23.710 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f77f28191ee54426a01bed4a9478ccd6 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
18:34:23.710 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a84c5b3ea6b149718b3ae30a0ce84a17 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
18:34:23.710 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a2bab9e2604a4a9597798acdaf04474c for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:23.710 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 109afb7829a5484a844e346132a776be for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:23.710 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2ffabd13bdc04d08879bc28dc62155f3 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:23.710 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=c39b66751cde487c94b99b60adc93d53@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=f77f28191ee54426a01bed4a9478ccd6@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=a84c5b3ea6b149718b3ae30a0ce84a17@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=a2bab9e2604a4a9597798acdaf04474c@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=109afb7829a5484a844e346132a776be@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=2ffabd13bdc04d08879bc28dc62155f3@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:23.712 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 6fa98963f3433621a126e6db77ad5f3b for job 41f18052e8363382138bde77e16b10c3 from resource manager with leader id a73724b8e529a6ec04e461e227f245e2.
18:34:23.712 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 6fa98963f3433621a126e6db77ad5f3b with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:34:23.713 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 7a0ffa37add86fcce9866592db26034c for job 41f18052e8363382138bde77e16b10c3 from resource manager with leader id a73724b8e529a6ec04e461e227f245e2.
18:34:23.713 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 7a0ffa37add86fcce9866592db26034c with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:34:23.713 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:23.714 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
18:34:23.715 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_23 for job 41f18052e8363382138bde77e16b10c3.
18:34:23.716 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1783) Establish JobManager connection for job 41f18052e8363382138bde77e16b10c3.
18:34:23.716 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 41f18052e8363382138bde77e16b10c3.
18:34:23.717 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
18:34:23.717 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 18348981-93aa-4f9b-8ccb-9c57cd0bda38 @ 127.0.0.1 (dataPort=-1) with allocation id 7a0ffa37add86fcce9866592db26034c
18:34:23.719 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:23.721 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 7a0ffa37add86fcce9866592db26034c.
18:34:23.722 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 41f18052e8363382138bde77e16b10c3.
18:34:23.722 [INFO - flink-pekko.actor.default-dispatcher-4] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
18:34:23.722 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 41f18052e8363382138bde77e16b10c3
18:34:23.723 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xbfc2004e, L:/127.0.0.1:45366 - R:/127.7.200.189:42349] using SASL/PLAIN
18:34:23.723 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 7a0ffa37add86fcce9866592db26034c.
18:34:23.727 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xde5853c1, L:/127.0.0.1:58080 - R:/127.7.200.190:40077] using SASL/PLAIN
18:34:23.727 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
18:34:23.727 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 18348981-93aa-4f9b-8ccb-9c57cd0bda38 @ 127.0.0.1 (dataPort=-1) with allocation id 6fa98963f3433621a126e6db77ad5f3b
18:34:23.734 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:23.735 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
18:34:23.735 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 18348981-93aa-4f9b-8ccb-9c57cd0bda38 @ 127.0.0.1 (dataPort=-1) with allocation id 3ab80748f81d56605b604d6b67a52227
18:34:23.741 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x0f49affd, L:/127.0.0.1:56618 - R:/127.7.200.188:38999] using SASL/PLAIN
18:34:23.743 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 6fa98963f3433621a126e6db77ad5f3b.
18:34:23.744 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 6fa98963f3433621a126e6db77ad5f3b.
18:34:23.745 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:34:23.746 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=121), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.189:42349, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.190:40077, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.188:38999, [77ms] Sub RPC ConnectToMaster: received response from server master-127.7.200.189:42349: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.7.200.190:40077: OK, [96ms] Sub RPC ConnectToMaster: received response from server master-127.7.200.188:38999: OK, deferred=null) after lookup
18:34:23.747 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
18:34:23.747 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
18:34:23.752 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
18:34:23.752 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 18348981-93aa-4f9b-8ccb-9c57cd0bda38 @ 127.0.0.1 (dataPort=-1) with allocation id 1fb92e44b6a0ec833400217bb7150056
18:34:23.752 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2fd07714
18:34:23.752 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:23.753 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit14319925403673159781/checkpoints")
18:34:23.753 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
18:34:23.753 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
18:34:23.757 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 3ab80748f81d56605b604d6b67a52227.
18:34:23.757 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8fe8917b37c84035bbea7dbddc98d83c
18:34:23.758 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
18:34:23.758 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
18:34:23.759 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6c048697
18:34:23.759 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:23.759 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit14319925403673159781/checkpoints")
18:34:23.759 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
18:34:23.760 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
18:34:23.765 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 3ab80748f81d56605b604d6b67a52227.
18:34:23.770 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 569fbab27dcc46ceb35a25ca5373588b for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
18:34:23.770 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 38eacb309d714c09b7c15323079452fd for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
18:34:23.770 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d9b4ee28af7743f59956e54d0900a1bc for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
18:34:23.770 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 8deb64d0611e4e7e9f7c8324b188cb2b for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:23.770 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5c37815e96ea465a8c32e5a3d746b02b for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:23.770 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 13389bc0c0984bb788a1186c024e4f17 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:23.771 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=569fbab27dcc46ceb35a25ca5373588b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=38eacb309d714c09b7c15323079452fd@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157)[L],b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=d9b4ee28af7743f59956e54d0900a1bc@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=8deb64d0611e4e7e9f7c8324b188cb2b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=5c37815e96ea465a8c32e5a3d746b02b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=13389bc0c0984bb788a1186c024e4f17@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:23.771 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=13), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.7.200.188:38999, [12ms] Sub RPC GetTableLocations: received response from server master-127.7.200.188:38999: OK, deferred=null)) after lookup
18:34:23.772 [DEBUG - kudu-nio-2] (Connection.java:748) [peer b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)] connecting to peer
18:34:23.773 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 7a0ffa37add86fcce9866592db26034c.
18:34:23.773 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 6fa98963f3433621a126e6db77ad5f3b.
18:34:23.773 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 3ab80748f81d56605b604d6b67a52227.
18:34:23.773 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 1fb92e44b6a0ec833400217bb7150056.
18:34:23.773 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 1fb92e44b6a0ec833400217bb7150056.
18:34:23.775 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
18:34:23.775 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
18:34:23.776 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id 1fb92e44b6a0ec833400217bb7150056.
18:34:23.776 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@598c434a
18:34:23.776 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4fec7975
18:34:23.776 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:23.776 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit14319925403673159781/checkpoints")
18:34:23.776 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
18:34:23.777 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
18:34:23.778 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:23.779 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3b304dd0
18:34:23.780 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:23.783 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@22df772e
18:34:23.785 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:23.787 [DEBUG - kudu-nio-3] (Connection.java:757) [peer b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)] Successfully connected to peer
18:34:23.805 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
18:34:23.805 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
18:34:23.807 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5afbfbf7
18:34:23.807 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:23.807 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit14319925403673159781/checkpoints")
18:34:23.807 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
18:34:23.808 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
18:34:23.816 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:23.817 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:34:23.820 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xfce8893e, L:/127.0.0.1:45772 - R:/127.7.200.130:45405] using TOKEN/null
18:34:23.820 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5b14a97b
18:34:23.823 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:23.830 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=569fbab27dcc46ceb35a25ca5373588b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:23.831 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 569fbab27dcc46ceb35a25ca5373588b for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
18:34:23.831 [DEBUG - main] (Connection.java:748) [peer 5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157)] connecting to peer
18:34:23.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:23.835 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:34:23.836 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:34:23.836 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:34:23.837 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.7.200.189:42349(127.7.200.189:42349)] Successfully connected to peer
18:34:23.839 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.189
18:34:23.847 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:34:23.854 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157)] Successfully connected to peer
18:34:23.857 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:23.860 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:23.860 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:23.860 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:23.861 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:23.861 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:23.861 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:23.862 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:23.862 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:23.862 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:23.866 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:23.866 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:23.866 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:23.866 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:23.870 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x48f42404, L:/127.0.0.1:45376 - R:/127.7.200.189:42349] using SASL/PLAIN
18:34:23.875 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:34:23.876 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.7.200.189:42349(127.7.200.189:42349)] Successfully connected to peer
18:34:23.880 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.189
18:34:23.903 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:23.903 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:23.906 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:34:23.911 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xf3baa16e, L:/127.0.0.1:54602 - R:/127.7.200.131:36157] using TOKEN/null
18:34:23.920 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.7.200.190:40077(127.7.200.190:40077)] Successfully connected to peer
18:34:23.924 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.190
18:34:23.927 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc6dc47d9, L:/127.0.0.1:45384 - R:/127.7.200.189:42349] using SASL/PLAIN
18:34:23.932 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.7.200.188:38999(127.7.200.188:38999)] Successfully connected to peer
18:34:23.944 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:34:23.945 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.7.200.189:42349(127.7.200.189:42349)] Successfully connected to peer
18:34:23.947 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.188
18:34:23.952 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=38eacb309d714c09b7c15323079452fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:23.952 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 38eacb309d714c09b7c15323079452fd for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
18:34:23.953 [DEBUG - main] (Connection.java:748) [peer d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)] connecting to peer
18:34:23.958 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.189
18:34:23.959 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:34:23.960 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.7.200.190:40077(127.7.200.190:40077)] Successfully connected to peer
18:34:23.966 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.7.200.188:38999(127.7.200.188:38999)] Successfully connected to peer
18:34:23.983 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:34:23.984 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.7.200.189:42349(127.7.200.189:42349)] Successfully connected to peer
18:34:23.986 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:23.992 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:23.992 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.189
18:34:23.993 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.188
18:34:23.998 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:34:23.999 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.7.200.190:40077(127.7.200.190:40077)] Successfully connected to peer
18:34:24.000 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x093c8833, L:/127.0.0.1:45400 - R:/127.7.200.189:42349] using SASL/PLAIN
18:34:24.006 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x3630f34d, L:/127.0.0.1:58094 - R:/127.7.200.190:40077] using SASL/PLAIN
18:34:24.008 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.190
18:34:24.009 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.011 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x67df2c94, L:/127.0.0.1:56646 - R:/127.7.200.188:38999] using SASL/PLAIN
18:34:24.015 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.018 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:34:24.019 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x598e6244, L:/127.0.0.1:58100 - R:/127.7.200.190:40077] using SASL/PLAIN
18:34:24.037 [DEBUG - kudu-nio-5] (Connection.java:757) [peer d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)] Successfully connected to peer
18:34:24.038 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.7.200.188:38999(127.7.200.188:38999)] Successfully connected to peer
18:34:24.040 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=215), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.189:42349, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.190:40077, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.188:38999, [164ms] Sub RPC ConnectToMaster: received response from server master-127.7.200.189:42349: OK, [171ms] Sub RPC ConnectToMaster: received response from server master-127.7.200.188:38999: OK, deferred=null) after lookup
18:34:24.044 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8fe8917b37c84035bbea7dbddc98d83c
18:34:24.044 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.048 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb2891076, L:/127.0.0.1:45416 - R:/127.7.200.189:42349] using SASL/PLAIN
18:34:24.049 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8fe8917b37c84035bbea7dbddc98d83c
18:34:24.049 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.188
18:34:24.049 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@28b6bf55
18:34:24.051 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
18:34:24.051 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
18:34:24.052 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:34:24.053 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.7.200.190:40077(127.7.200.190:40077)] Successfully connected to peer
18:34:24.059 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.190
18:34:24.069 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.076 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x870e9018, L:/127.0.0.1:58114 - R:/127.7.200.190:40077] using SASL/PLAIN
18:34:24.085 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.7.200.188:38999(127.7.200.188:38999)] Successfully connected to peer
18:34:24.087 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:24.099 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:24.101 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.103 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.190
18:34:24.108 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.113 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
18:34:24.113 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='adf3aaf54219f1e4ad40b242dbf1d45af89e33b1f53b6ad93bb54533c7922dec'}]
18:34:24.114 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.116 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.7.200.188
18:34:24.118 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:24.119 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
18:34:24.119 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x1fe10e2b, L:/127.0.0.1:56634 - R:/127.7.200.188:38999] using SASL/PLAIN
18:34:24.120 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:34:24.122 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299998, tablet=c39b66751cde487c94b99b60adc93d53@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}]
18:34:24.122 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:34:24.122 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=341), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.189:42349, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.190:40077, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.188:38999, [95ms] Sub RPC ConnectToMaster: received response from server master-127.7.200.189:42349: OK, [236ms] Sub RPC ConnectToMaster: received response from server master-127.7.200.190:40077: OK, [287ms] Sub RPC ConnectToMaster: received response from server master-127.7.200.188:38999: OK, deferred=null) after lookup
18:34:24.126 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:24.129 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8fe8917b37c84035bbea7dbddc98d83c
18:34:24.129 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x2de5c008, L:/127.0.0.1:56650 - R:/127.7.200.188:38999] using SASL/PLAIN
18:34:24.132 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.133 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0xa2fa90ab, L:/127.0.0.1:59176 - R:/127.7.200.129:33899] using TOKEN/null
18:34:24.134 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:34:24.134 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=348), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.189:42349, [147ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.190:40077, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.188:38999, [245ms] Sub RPC ConnectToMaster: received response from server master-127.7.200.190:40077: OK, [274ms] Sub RPC ConnectToMaster: received response from server master-127.7.200.189:42349: OK, [297ms] Sub RPC ConnectToMaster: received response from server master-127.7.200.188:38999: OK, deferred=null) after lookup
18:34:24.139 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x446bb282, L:/127.0.0.1:58126 - R:/127.7.200.190:40077] using SASL/PLAIN
18:34:24.142 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8fe8917b37c84035bbea7dbddc98d83c
18:34:24.143 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8fe8917b37c84035bbea7dbddc98d83c
18:34:24.143 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2ea41fca
18:34:24.145 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:24.145 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
18:34:24.146 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
18:34:24.155 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8fe8917b37c84035bbea7dbddc98d83c
18:34:24.155 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@192a50f
18:34:24.157 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
18:34:24.157 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
18:34:24.161 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:24.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:24.185 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.197 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.205 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x757b2bac, L:/127.0.0.1:54696 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:24.208 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d9b4ee28af7743f59956e54d0900a1bc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.208 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet d9b4ee28af7743f59956e54d0900a1bc for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
18:34:24.212 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x8af4181c, L:/127.0.0.1:56658 - R:/127.7.200.188:38999] using SASL/PLAIN
18:34:24.223 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
18:34:24.223 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a7f6d3c08d8ec1bf913e598c8e5e7df24d4f62df026025fb73ac92be377d2468'}]
18:34:24.224 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:34:24.225 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:24.225 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:24.225 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:24.225 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:24.225 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=447), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.189:42349, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.190:40077, [56ms] Sub RPC ConnectToMaster: received response from server master-127.7.200.189:42349: OK, [235ms] Sub RPC ConnectToMaster: sending RPC to server master-127.7.200.188:38999, [379ms] Sub RPC ConnectToMaster: received response from server master-127.7.200.190:40077: OK, [402ms] Sub RPC ConnectToMaster: received response from server master-127.7.200.188:38999: OK, deferred=null) after lookup
18:34:24.226 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:24.226 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:24.226 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:24.226 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:24.226 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:24.226 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:24.226 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:24.226 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:24.226 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:24.226 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:24.239 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:24.239 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:24.239 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:24.239 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:24.239 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:24.239 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:24.239 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:24.239 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:24.240 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:24.239 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:24.240 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:24.240 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:24.240 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:24.248 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8deb64d0611e4e7e9f7c8324b188cb2b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.249 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8deb64d0611e4e7e9f7c8324b188cb2b for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
18:34:24.250 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8fe8917b37c84035bbea7dbddc98d83c
18:34:24.254 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5c37815e96ea465a8c32e5a3d746b02b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.254 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5c37815e96ea465a8c32e5a3d746b02b for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
18:34:24.256 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
18:34:24.257 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8fe8917b37c84035bbea7dbddc98d83c
18:34:24.257 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6023f6b8
18:34:24.258 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
18:34:24.259 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
18:34:24.267 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=13389bc0c0984bb788a1186c024e4f17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.267 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 13389bc0c0984bb788a1186c024e4f17 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
18:34:24.277 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:34:24.277 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299998, tablet=f77f28191ee54426a01bed4a9478ccd6@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}]
18:34:24.291 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false, responseScanTimestamp = 7305362078072832001) for scanner KuduScanner(table=replication_test_table, tablet=c39b66751cde487c94b99b60adc93d53, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.292 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [adf3aaf54219f1e4ad40b242dbf1d45af89e33b1f53b6ad93bb54533c7922dec]
18:34:24.293 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
18:34:24.299 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [adf3aaf54219f1e4ad40b242dbf1d45af89e33b1f53b6ad93bb54533c7922dec]
18:34:24.299 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
18:34:24.299 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:34:24.299 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='ee479a4e8e47309ea70e83c355913bdd31ba8cfaea1213d929bf99ec61c81f22'}]
18:34:24.299 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:34:24.300 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:24.301 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:24.301 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:24.307 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 569fbab27dcc46ceb35a25ca5373588b for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
18:34:24.307 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 38eacb309d714c09b7c15323079452fd for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
18:34:24.307 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d9b4ee28af7743f59956e54d0900a1bc for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
18:34:24.307 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 8deb64d0611e4e7e9f7c8324b188cb2b for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:24.307 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5c37815e96ea465a8c32e5a3d746b02b for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:24.307 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 13389bc0c0984bb788a1186c024e4f17 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:24.307 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=569fbab27dcc46ceb35a25ca5373588b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=38eacb309d714c09b7c15323079452fd@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157)[L],b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=d9b4ee28af7743f59956e54d0900a1bc@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=8deb64d0611e4e7e9f7c8324b188cb2b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=5c37815e96ea465a8c32e5a3d746b02b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=13389bc0c0984bb788a1186c024e4f17@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:24.309 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:34:24.310 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299998, tablet=a84c5b3ea6b149718b3ae30a0ce84a17@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}]
18:34:24.312 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 569fbab27dcc46ceb35a25ca5373588b for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
18:34:24.312 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 38eacb309d714c09b7c15323079452fd for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
18:34:24.312 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d9b4ee28af7743f59956e54d0900a1bc for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
18:34:24.312 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 8deb64d0611e4e7e9f7c8324b188cb2b for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:24.312 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5c37815e96ea465a8c32e5a3d746b02b for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:24.312 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 13389bc0c0984bb788a1186c024e4f17 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:24.312 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=569fbab27dcc46ceb35a25ca5373588b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=38eacb309d714c09b7c15323079452fd@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157)[L],b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=d9b4ee28af7743f59956e54d0900a1bc@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=8deb64d0611e4e7e9f7c8324b188cb2b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=5c37815e96ea465a8c32e5a3d746b02b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=13389bc0c0984bb788a1186c024e4f17@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:24.314 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 569fbab27dcc46ceb35a25ca5373588b for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
18:34:24.315 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 38eacb309d714c09b7c15323079452fd for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
18:34:24.315 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d9b4ee28af7743f59956e54d0900a1bc for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
18:34:24.315 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 8deb64d0611e4e7e9f7c8324b188cb2b for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:24.315 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5c37815e96ea465a8c32e5a3d746b02b for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:24.315 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 13389bc0c0984bb788a1186c024e4f17 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:24.315 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=569fbab27dcc46ceb35a25ca5373588b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=38eacb309d714c09b7c15323079452fd@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157)[L],b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=d9b4ee28af7743f59956e54d0900a1bc@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=8deb64d0611e4e7e9f7c8324b188cb2b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=5c37815e96ea465a8c32e5a3d746b02b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=13389bc0c0984bb788a1186c024e4f17@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:24.324 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=569fbab27dcc46ceb35a25ca5373588b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.324 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 569fbab27dcc46ceb35a25ca5373588b for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
18:34:24.330 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=38eacb309d714c09b7c15323079452fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.330 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 38eacb309d714c09b7c15323079452fd for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
18:34:24.335 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:24.335 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d9b4ee28af7743f59956e54d0900a1bc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.336 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet d9b4ee28af7743f59956e54d0900a1bc for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
18:34:24.342 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8deb64d0611e4e7e9f7c8324b188cb2b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.342 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8deb64d0611e4e7e9f7c8324b188cb2b for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
18:34:24.350 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5c37815e96ea465a8c32e5a3d746b02b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.350 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5c37815e96ea465a8c32e5a3d746b02b for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
18:34:24.355 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
18:34:24.356 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='7cd418c9608e754fb98e7c8ad4067ca978208a37d138d701f4a008c2bfc38106'}]
18:34:24.357 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:24.363 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=13389bc0c0984bb788a1186c024e4f17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.363 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 13389bc0c0984bb788a1186c024e4f17 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
18:34:24.372 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:34:24.373 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299998, tablet=a2bab9e2604a4a9597798acdaf04474c@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}]
18:34:24.375 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:24.375 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:24.375 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:24.376 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:24.376 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:24.376 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:24.376 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:24.376 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:24.376 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:24.377 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:24.377 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:24.377 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:24.377 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:24.388 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:24.396 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:24.401 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:24.420 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.421 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=569fbab27dcc46ceb35a25ca5373588b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.421 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 569fbab27dcc46ceb35a25ca5373588b for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
18:34:24.431 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=38eacb309d714c09b7c15323079452fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.431 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 38eacb309d714c09b7c15323079452fd for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
18:34:24.435 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x144998ec, L:/127.0.0.1:54712 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:24.435 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:24.435 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:24.435 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:24.436 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:24.436 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:24.436 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:24.436 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:24.437 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:24.437 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:24.437 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:24.437 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:24.437 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:24.437 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:24.444 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d9b4ee28af7743f59956e54d0900a1bc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.444 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet d9b4ee28af7743f59956e54d0900a1bc for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
18:34:24.458 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305362078072832001) for scanner KuduScanner(table=replication_test_table, tablet=f77f28191ee54426a01bed4a9478ccd6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.458 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [a7f6d3c08d8ec1bf913e598c8e5e7df24d4f62df026025fb73ac92be377d2468]
18:34:24.459 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [a7f6d3c08d8ec1bf913e598c8e5e7df24d4f62df026025fb73ac92be377d2468]
18:34:24.459 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:34:24.459 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:34:24.459 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:24.460 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:24.462 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8deb64d0611e4e7e9f7c8324b188cb2b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.462 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8deb64d0611e4e7e9f7c8324b188cb2b for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
18:34:24.468 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5c37815e96ea465a8c32e5a3d746b02b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.468 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5c37815e96ea465a8c32e5a3d746b02b for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
18:34:24.475 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:24.475 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:24.476 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
18:34:24.476 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:34:24.485 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=13389bc0c0984bb788a1186c024e4f17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.486 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 13389bc0c0984bb788a1186c024e4f17 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
18:34:24.497 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:24.520 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:24.525 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
18:34:24.526 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
18:34:24.527 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split adf3aaf54219f1e4ad40b242dbf1d45af89e33b1f53b6ad93bb54533c7922dec finished by subtask 3; deferring removal (restored in pending)
18:34:24.528 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split a7f6d3c08d8ec1bf913e598c8e5e7df24d4f62df026025fb73ac92be377d2468 finished by subtask 2; deferring removal (restored in pending)
18:34:24.529 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:24.530 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e61b52af2f646edbd1beab19713286cf79d3b750b082f6caedb386fa45cc5ff6'}]
18:34:24.532 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:24.532 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='b32286337df890b647ef55bc8c4cabf8efec25a7720137e310521d70be9a2c8a'}]
18:34:24.533 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:24.534 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:34:24.534 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299984, tablet=109afb7829a5484a844e346132a776be@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}]
18:34:24.535 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:24.542 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=569fbab27dcc46ceb35a25ca5373588b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.542 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 569fbab27dcc46ceb35a25ca5373588b for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
18:34:24.547 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=38eacb309d714c09b7c15323079452fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.547 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 38eacb309d714c09b7c15323079452fd for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
18:34:24.555 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d9b4ee28af7743f59956e54d0900a1bc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.555 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet d9b4ee28af7743f59956e54d0900a1bc for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
18:34:24.567 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8deb64d0611e4e7e9f7c8324b188cb2b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.567 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8deb64d0611e4e7e9f7c8324b188cb2b for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
18:34:24.580 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.584 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5c37815e96ea465a8c32e5a3d746b02b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.584 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5c37815e96ea465a8c32e5a3d746b02b for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
18:34:24.587 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:24.588 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x270cec35, L:/127.0.0.1:54714 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:24.595 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=13389bc0c0984bb788a1186c024e4f17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.595 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 13389bc0c0984bb788a1186c024e4f17 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
18:34:24.599 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:24.599 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false, responseScanTimestamp = 7305362078072832001) for scanner KuduScanner(table=replication_test_table, tablet=a84c5b3ea6b149718b3ae30a0ce84a17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.599 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [ee479a4e8e47309ea70e83c355913bdd31ba8cfaea1213d929bf99ec61c81f22]
18:34:24.600 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
18:34:24.602 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [ee479a4e8e47309ea70e83c355913bdd31ba8cfaea1213d929bf99ec61c81f22]
18:34:24.602 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:34:24.602 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:34:24.604 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split ee479a4e8e47309ea70e83c355913bdd31ba8cfaea1213d929bf99ec61c81f22 finished by subtask 1; deferring removal (restored in pending)
18:34:24.605 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:24.605 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:24.609 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d9b4ee28af7743f59956e54d0900a1bc for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
18:34:24.609 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 8deb64d0611e4e7e9f7c8324b188cb2b for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:24.609 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5c37815e96ea465a8c32e5a3d746b02b for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:24.609 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 13389bc0c0984bb788a1186c024e4f17 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:24.610 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=d9b4ee28af7743f59956e54d0900a1bc@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=8deb64d0611e4e7e9f7c8324b188cb2b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=5c37815e96ea465a8c32e5a3d746b02b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=13389bc0c0984bb788a1186c024e4f17@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:24.619 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:24.619 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:24.619 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:34:24.619 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:34:24.637 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:24.641 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:24.652 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=569fbab27dcc46ceb35a25ca5373588b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.652 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 569fbab27dcc46ceb35a25ca5373588b for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
18:34:24.653 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.669 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=38eacb309d714c09b7c15323079452fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.670 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 38eacb309d714c09b7c15323079452fd for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
18:34:24.674 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:34:24.675 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x979f2df2, L:/127.0.0.1:54720 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:24.677 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299984, tablet=2ffabd13bdc04d08879bc28dc62155f3@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}]
18:34:24.683 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:24.684 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d9b4ee28af7743f59956e54d0900a1bc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.686 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet d9b4ee28af7743f59956e54d0900a1bc for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
18:34:24.691 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8deb64d0611e4e7e9f7c8324b188cb2b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.691 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8deb64d0611e4e7e9f7c8324b188cb2b for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
18:34:24.691 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:34:24.691 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:24.692 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:24.692 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:34:24.697 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5c37815e96ea465a8c32e5a3d746b02b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.698 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5c37815e96ea465a8c32e5a3d746b02b for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
18:34:24.700 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false, responseScanTimestamp = 7305362078072832001) for scanner KuduScanner(table=replication_test_table, tablet=a2bab9e2604a4a9597798acdaf04474c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.700 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [7cd418c9608e754fb98e7c8ad4067ca978208a37d138d701f4a008c2bfc38106]
18:34:24.701 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
18:34:24.703 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [7cd418c9608e754fb98e7c8ad4067ca978208a37d138d701f4a008c2bfc38106]
18:34:24.704 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 7cd418c9608e754fb98e7c8ad4067ca978208a37d138d701f4a008c2bfc38106 finished by subtask 0; deferring removal (restored in pending)
18:34:24.706 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:34:24.706 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:34:24.706 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:24.708 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:24.715 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 8deb64d0611e4e7e9f7c8324b188cb2b for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:24.715 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5c37815e96ea465a8c32e5a3d746b02b for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:24.715 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 13389bc0c0984bb788a1186c024e4f17 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:24.716 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=8deb64d0611e4e7e9f7c8324b188cb2b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=5c37815e96ea465a8c32e5a3d746b02b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=13389bc0c0984bb788a1186c024e4f17@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:24.716 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 8deb64d0611e4e7e9f7c8324b188cb2b for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:24.716 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5c37815e96ea465a8c32e5a3d746b02b for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:24.716 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 13389bc0c0984bb788a1186c024e4f17 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:24.716 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=8deb64d0611e4e7e9f7c8324b188cb2b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=5c37815e96ea465a8c32e5a3d746b02b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=13389bc0c0984bb788a1186c024e4f17@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:24.717 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 8deb64d0611e4e7e9f7c8324b188cb2b for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:24.717 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5c37815e96ea465a8c32e5a3d746b02b for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:24.717 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 13389bc0c0984bb788a1186c024e4f17 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:24.717 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=8deb64d0611e4e7e9f7c8324b188cb2b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=5c37815e96ea465a8c32e5a3d746b02b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=13389bc0c0984bb788a1186c024e4f17@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:24.720 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=13389bc0c0984bb788a1186c024e4f17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.721 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 13389bc0c0984bb788a1186c024e4f17 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
18:34:24.721 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:24.723 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:24.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:24.727370  7711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.245.1:39053, user_credentials={real_user=slave}} blocked reactor thread for 44269.4us
18:34:24.731 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:24.736 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RESTARTING to RUNNING.
18:34:24.736 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:24.737 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job fa73e37017778341a79e5b3ef3d55eb9 from Checkpoint 69 @ 1783535448409 for fa73e37017778341a79e5b3ef3d55eb9 located at file:/tmp/junit12731664100414606042/checkpoints/fa73e37017778341a79e5b3ef3d55eb9/chk-69.
18:34:24.738 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
18:34:24.738 [INFO - flink-pekko.actor.default-dispatcher-5] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:34:24.754 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.756 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:24.756 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:24.757 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:34:24.757 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:34:24.766 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8be83617, L:/127.0.0.1:54724 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:24.778 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=569fbab27dcc46ceb35a25ca5373588b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.778 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 569fbab27dcc46ceb35a25ca5373588b for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
18:34:24.785 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from CREATED to SCHEDULED.
18:34:24.786 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from SCHEDULED to DEPLOYING.
18:34:24.786 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #8) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_8 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 1623ba59e704d1676486c6f13d60068c
18:34:24.786 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from CREATED to SCHEDULED.
18:34:24.786 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from SCHEDULED to DEPLOYING.
18:34:24.786 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #8) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_8 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 409256c48f07c3602c01f545df4e7b3c
18:34:24.787 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CREATED to SCHEDULED.
18:34:24.787 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from SCHEDULED to DEPLOYING.
18:34:24.787 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #7) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 120c9de24dd4d7d83c84cb1a65b36252
18:34:24.787 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from CREATED to SCHEDULED.
18:34:24.788 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false, responseScanTimestamp = 7305362078072832001) for scanner KuduScanner(table=replication_test_table, tablet=2ffabd13bdc04d08879bc28dc62155f3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.788 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:34:24.788 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [b32286337df890b647ef55bc8c4cabf8efec25a7720137e310521d70be9a2c8a]
18:34:24.789 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=38eacb309d714c09b7c15323079452fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.789 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
18:34:24.789 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 1623ba59e704d1676486c6f13d60068c.
18:34:24.789 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from SCHEDULED to DEPLOYING.
18:34:24.789 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #8) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_8 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d
18:34:24.788 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:34:24.789 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:24.789 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:34:24.790 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_8), deploy into slot with allocation id 1623ba59e704d1676486c6f13d60068c.
18:34:24.789 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 38eacb309d714c09b7c15323079452fd for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
18:34:24.790 [INFO - Thread-66] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:34:24.790 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [b32286337df890b647ef55bc8c4cabf8efec25a7720137e310521d70be9a2c8a]
18:34:24.790 [DEBUG - Thread-66] (Connection.java:575) [peer master-127.28.68.190:40429(127.28.68.190:40429)] disconnecting while in state TERMINATED
18:34:24.791 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:34:24.791 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:34:24.792 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split b32286337df890b647ef55bc8c4cabf8efec25a7720137e310521d70be9a2c8a finished by subtask 2; deferring removal (restored in pending)
18:34:24.793 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:24.794 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 13389bc0c0984bb788a1186c024e4f17 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:24.794 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=13389bc0c0984bb788a1186c024e4f17@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:24.795 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d9b4ee28af7743f59956e54d0900a1bc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.795 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:24.795 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet d9b4ee28af7743f59956e54d0900a1bc for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
18:34:24.796 [DEBUG - Thread-66] (Connection.java:575) [peer master-127.28.68.188:38393(127.28.68.188:38393)] disconnecting while in state TERMINATED
18:34:24.796 [DEBUG - Thread-66] (Connection.java:575) [peer master-127.28.68.189:33753(127.28.68.189:33753)] disconnecting while in state TERMINATED
18:34:24.800 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8deb64d0611e4e7e9f7c8324b188cb2b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.800 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8deb64d0611e4e7e9f7c8324b188cb2b for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
18:34:24.806 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5c37815e96ea465a8c32e5a3d746b02b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.806 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5c37815e96ea465a8c32e5a3d746b02b for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
18:34:24.808 [DEBUG - Thread-66] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:24.809 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:24.815 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=13389bc0c0984bb788a1186c024e4f17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.815 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 13389bc0c0984bb788a1186c024e4f17 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
18:34:24.818 [INFO - Thread-66] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:34:24.818 [INFO - Thread-66] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:34:24.818 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:24.821 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:24.821 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:24.821 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:24.821 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:24.821 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:24.821 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:24.821 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:24.821 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:24.821 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:24.822 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:24.822 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:24.822 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 120c9de24dd4d7d83c84cb1a65b36252.
18:34:24.822 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:24.822 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:24.822 [DEBUG - Thread-66] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:24.822 [INFO - Thread-66] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:34:24.823 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_7), deploy into slot with allocation id 120c9de24dd4d7d83c84cb1a65b36252.
18:34:24.823 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from CREATED to DEPLOYING.
18:34:24.823 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_8) [DEPLOYING].
18:34:24.826 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6814e54a
18:34:24.826 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:24.827 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:34:24.829 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from DEPLOYING to INITIALIZING.
18:34:24.829 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from DEPLOYING to INITIALIZING.
18:34:24.837 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535664833 for job 41f18052e8363382138bde77e16b10c3.
18:34:24.839 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@232bf67d
18:34:24.839 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=3, operationSize=189, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@1e770ba3, flushNotification=Deferred@42394214(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:34:24.840 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)] connecting to peer
18:34:24.840 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=63, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@2dcf1598, flushNotification=Deferred@717768234(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:34:24.841 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)] connecting to peer
18:34:24.841 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=63, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@712ba352, flushNotification=Deferred@1104442051(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:34:24.841 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)] connecting to peer
18:34:24.841 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=3, operationSize=189, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@688ac282, flushNotification=Deferred@489800592(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:34:24.842 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)] connecting to peer
18:34:24.845 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:24.862 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.877 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=569fbab27dcc46ceb35a25ca5373588b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.877 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 569fbab27dcc46ceb35a25ca5373588b for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
18:34:24.877 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:24.877 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:24.877 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:24.877 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:24.879 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x126bd069, L:/127.0.0.1:54740 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:24.879 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 409256c48f07c3602c01f545df4e7b3c.
18:34:24.880 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:24.880 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:24.880 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:24.880 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_8), deploy into slot with allocation id 409256c48f07c3602c01f545df4e7b3c.
18:34:24.881 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:24.881 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:24.881 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:24.882 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:24.882 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:24.882 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:24.882 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:24.882 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:24.882 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:24.882 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:24.884 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=38eacb309d714c09b7c15323079452fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.884 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 38eacb309d714c09b7c15323079452fd for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
18:34:24.884 [DEBUG - kudu-nio-3] (Connection.java:757) [peer d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)] Successfully connected to peer
18:34:24.896 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CREATED to DEPLOYING.
18:34:24.896 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_7) [DEPLOYING].
18:34:24.897 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4efdcd10
18:34:24.897 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:24.897 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d9b4ee28af7743f59956e54d0900a1bc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.897 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:34:24.897 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet d9b4ee28af7743f59956e54d0900a1bc for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
18:34:24.897 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from DEPLOYING to INITIALIZING.
18:34:24.897 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from DEPLOYING to INITIALIZING.
18:34:24.901 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false, responseScanTimestamp = 7305362078072832001) for scanner KuduScanner(table=replication_test_table, tablet=109afb7829a5484a844e346132a776be, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.902 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [e61b52af2f646edbd1beab19713286cf79d3b750b082f6caedb386fa45cc5ff6]
18:34:24.906 [DEBUG - kudu-nio-3] (Connection.java:757) [peer d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)] Successfully connected to peer
18:34:24.909 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@175a5dc1
18:34:24.912 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:24.916 [DEBUG - kudu-nio-3] (Connection.java:757) [peer b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)] Successfully connected to peer
18:34:24.930 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8deb64d0611e4e7e9f7c8324b188cb2b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.930 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8deb64d0611e4e7e9f7c8324b188cb2b for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
18:34:24.942 [DEBUG - kudu-nio-3] (Connection.java:757) [peer b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)] Successfully connected to peer
18:34:24.943 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot fe2a3c24d55fce5c8d5a55c4e880b53d.
18:34:24.944 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_8), deploy into slot with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d.
18:34:24.945 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from CREATED to DEPLOYING.
18:34:24.945 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_8) [DEPLOYING].
18:34:24.947 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.950 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x1d4d61c9, L:/127.0.0.1:59192 - R:/127.7.200.129:33899] using TOKEN/null
18:34:24.952 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5c37815e96ea465a8c32e5a3d746b02b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.953 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5c37815e96ea465a8c32e5a3d746b02b for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
18:34:24.956 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:24.956 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:24.956 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:34:24.957 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:34:24.962 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=13389bc0c0984bb788a1186c024e4f17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:24.962 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 13389bc0c0984bb788a1186c024e4f17 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
18:34:24.962 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.964 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from CREATED to DEPLOYING.
18:34:24.964 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_8) [DEPLOYING].
18:34:24.964 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6655832a
18:34:24.965 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:24.965 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:34:24.965 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from DEPLOYING to INITIALIZING.
18:34:24.965 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from DEPLOYING to INITIALIZING.
18:34:24.968 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#8] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:24.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:24.977 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xfc20e544, L:/127.0.0.1:59196 - R:/127.7.200.129:33899] using TOKEN/null
18:34:24.990 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@104fe02f
18:34:24.991 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:24.991 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:34:24.991 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from DEPLOYING to INITIALIZING.
18:34:24.992 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from DEPLOYING to INITIALIZING.
18:34:24.993 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:24.995 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3a529d29
18:34:25.001 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#8] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.002 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.002 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.002 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.006 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7cfcf1e8
18:34:25.008 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x46b16039, L:/127.0.0.1:45774 - R:/127.7.200.130:45405] using TOKEN/null
18:34:25.010 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:25.017 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#8] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.021 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=569fbab27dcc46ceb35a25ca5373588b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.021 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 569fbab27dcc46ceb35a25ca5373588b for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
18:34:25.024 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:25.033 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:25.037 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xf4d95d7e, L:/127.0.0.1:45784 - R:/127.7.200.130:45405] using TOKEN/null
18:34:25.045 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=38eacb309d714c09b7c15323079452fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.045 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 38eacb309d714c09b7c15323079452fd for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
18:34:25.060 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d9b4ee28af7743f59956e54d0900a1bc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.060 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet d9b4ee28af7743f59956e54d0900a1bc for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
18:34:25.067 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.067 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.068 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8deb64d0611e4e7e9f7c8324b188cb2b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.069 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8deb64d0611e4e7e9f7c8324b188cb2b for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
18:34:25.070 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.075 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.075 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5c37815e96ea465a8c32e5a3d746b02b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.077 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5c37815e96ea465a8c32e5a3d746b02b for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
18:34:25.078 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.079 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.079 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.081 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:25.082 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#8] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.083 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:25.083 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.083 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.083 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.083 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:25.088 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.088 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:25.089 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=13389bc0c0984bb788a1186c024e4f17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.089 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 13389bc0c0984bb788a1186c024e4f17 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
18:34:25.099 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:25.099 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.102 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.102 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.101 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.101 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.102 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.103 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.103 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.103 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.103 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.103 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.104 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.104 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.104 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.104 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.105 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.105 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.106 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.106 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.101 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.101 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#8] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.100 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.107 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.108 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.108 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.108 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.108 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.108 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.108 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:25.100 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.100 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#8] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.108 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.108 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.122 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:25.151 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=569fbab27dcc46ceb35a25ca5373588b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.151 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.151 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 569fbab27dcc46ceb35a25ca5373588b for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
18:34:25.163 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#8] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.164 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.164 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.164 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.169 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#8] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.170 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.170 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.171 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.171 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.171 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.171 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.171 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:25.181 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.183 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=38eacb309d714c09b7c15323079452fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.184 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 38eacb309d714c09b7c15323079452fd for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
18:34:25.198 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d9b4ee28af7743f59956e54d0900a1bc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.199 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet d9b4ee28af7743f59956e54d0900a1bc for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
18:34:25.216 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8deb64d0611e4e7e9f7c8324b188cb2b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.217 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8deb64d0611e4e7e9f7c8324b188cb2b for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
18:34:25.220 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:25.220 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:25.220 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:25.221 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:25.221 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:25.221 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:25.221 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:25.221 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:25.221 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:25.222 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:25.222 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:25.222 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:25.222 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:25.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:25.231678  9304 log.cc:927] Time spent T d9b4ee28af7743f59956e54d0900a1bc P b47d36a83f4440eaac9ce006765394d3: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
18:34:25.252 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:25.253 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:25.253 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.253 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.253 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.253 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.254 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.254 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.254 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.254 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.254 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.254 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:25.261 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:25.270 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5c37815e96ea465a8c32e5a3d746b02b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.270 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5c37815e96ea465a8c32e5a3d746b02b for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
18:34:25.271 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.272 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.272 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.272 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.290 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.290 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.290 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.290 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.294 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#8] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.295 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.295 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.296 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.301 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.301 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.301 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.301 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.305 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:25.306 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.306 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.306 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.308 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.309 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:25.310 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.310 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.310 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.310 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.310 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.311 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.311 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:25.320 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=13389bc0c0984bb788a1186c024e4f17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.322 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:25.322 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:25.322 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:25.322 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.322 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.322 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.323 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.323 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.323 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.323 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.324 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.324 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.324 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.324 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:25.324 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 13389bc0c0984bb788a1186c024e4f17 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
18:34:25.341 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:25.341 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:25.342 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:25.342 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.342 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.342 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.342 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.343 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.343 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.343 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.343 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.343 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.343 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.343 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:25.343 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.344 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.344 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.344 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.345 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.345 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.345 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.352 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.353 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.353 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.353 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.356 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.357 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.357 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.357 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.357 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.357 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.357 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.357 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.362 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:25.362 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:25.362 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:25.363 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.363 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.363 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.364 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.364 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.364 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.364 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.364 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.364 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.364 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:25.365 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.365 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.366 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.366 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.368 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.369 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.369 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.369 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.369 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.369 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.369 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.369 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.369 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.369 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.369 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.369 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.369 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.369 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.369 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.369 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.369 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.376 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.377 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.378 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.378 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.384 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.389 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.389 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.389 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.389 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=569fbab27dcc46ceb35a25ca5373588b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.389 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.389 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 569fbab27dcc46ceb35a25ca5373588b for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
18:34:25.389 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.389 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.394 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.394 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.394 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.394 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.394 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.395 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.395 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.396 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=38eacb309d714c09b7c15323079452fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.396 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 38eacb309d714c09b7c15323079452fd for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
18:34:25.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:25.395406  8532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.200.129:33899, user_credentials={real_user=slave}} blocked reactor thread for 58720.4us
18:34:25.402 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:25.402 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:25.402 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.402 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:25.403 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:25.403 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:25.403 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:25.403 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:25.403 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:25.403 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:25.403 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:25.403 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:25.403 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:25.403 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:25.406 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:25.406 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:25.406 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:25.409 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.409 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.409 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.410 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.410 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.410 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.410 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.410 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.410 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.410 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.410 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.410 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.410 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.410 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.410 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.410 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.410 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.417 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.417 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.410 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.417 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.417 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.417 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:25.420 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d9b4ee28af7743f59956e54d0900a1bc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.420 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet d9b4ee28af7743f59956e54d0900a1bc for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
18:34:25.422 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.422 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.422 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.433 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.436 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.437 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.437 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.437 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.437 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.437 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.437 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.439 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8deb64d0611e4e7e9f7c8324b188cb2b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.439 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8deb64d0611e4e7e9f7c8324b188cb2b for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
18:34:25.443 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.449 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.449 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.449 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.450 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.450 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.450 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.450 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.450 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.450 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.451 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.451 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.451 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.451 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.451 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.451 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.451 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.451 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.452 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.452 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.452 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.452 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.462 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.462 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.462 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.463 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.463 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.463 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.463 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.463 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.463 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.463 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.463 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.463 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.463 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.471 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:25.472 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5c37815e96ea465a8c32e5a3d746b02b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.472 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5c37815e96ea465a8c32e5a3d746b02b for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
18:34:25.482 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.482 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.482 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.482 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.482 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.482 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.482 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.482 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.482 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.482 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.482 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.482 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.483 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.488 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.489 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.489 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.489 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.489 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.489 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.489 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.489 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.489 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.489 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.489 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.489 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.490 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.490 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.490 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.490 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.490 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.493 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=13389bc0c0984bb788a1186c024e4f17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.493 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 13389bc0c0984bb788a1186c024e4f17 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
18:34:25.496 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.496 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.496 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.497 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.501 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.502 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.502 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.502 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.503 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.503 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.503 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.503 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.503 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.503 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.503 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.503 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.503 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.503 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.503 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.504 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.504 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.504 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.504 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.504 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.504 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.504 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.508 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.508 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.508 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.508 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.508 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.508 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.508 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.508 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.509 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.509 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.509 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.509 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.509 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.509 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.509 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.509 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.509 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.515 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.515 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.515 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.515 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.515 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.515 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.515 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.515 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.521 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.521 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.521 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.521 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.521 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.521 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.521 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.521 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.521 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.522 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.522 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.521 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.522 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.523 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.523 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.523 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.523 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.523 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.523 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.523 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.523 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.523 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.524 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.524 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.524 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.524 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.528 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.529 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.529 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.529 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.529 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.529 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.529 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.529 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.529 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.530 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.530 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.530 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.530 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:25.531667  8533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.200.131:36157, user_credentials={real_user=slave}} blocked reactor thread for 89260us
18:34:25.541 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.541 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:25.542 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.542 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.542 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.542 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.542 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.542 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.542 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.542 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.542 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.542 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.542 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.542 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.542 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.543 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.543 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.543 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.543 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.543 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.543 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.543 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.543 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.543 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.543 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.543 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.543 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.543 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.543 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.543 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.543 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.543 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.543 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.544 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.544 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.544 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.544 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.544 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.542 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:25.544 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:25.544 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.544 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.544 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.545 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.545 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.545 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.542 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.545 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.542 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.545 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.545 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.546 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:25.547057  8532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.200.129:33899, user_credentials={real_user=slave}} blocked reactor thread for 90471.1us
18:34:25.549 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:25.549 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:25.549 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:25.549 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:25.549 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:25.549 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:25.549 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:25.549 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:25.549 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:25.549 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:25.549 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:25.549 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:25.549 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:25.560 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e61b52af2f646edbd1beab19713286cf79d3b750b082f6caedb386fa45cc5ff6]
18:34:25.561 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:34:25.561 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:34:25.561 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.561 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.561 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.562 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.562 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.562 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.562 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.562 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.562 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.562 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.562 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.562 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.562 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.563 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.563 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.563 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.564 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.564 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.564 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.564 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.564 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.564 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.565 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:25.565 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.565 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.565 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.566 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.566 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e61b52af2f646edbd1beab19713286cf79d3b750b082f6caedb386fa45cc5ff6 finished by subtask 3; deferring removal (restored in pending)
18:34:25.567 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:25.571 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=569fbab27dcc46ceb35a25ca5373588b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.571 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 569fbab27dcc46ceb35a25ca5373588b for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
18:34:25.575 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:25.575 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:25.575 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:25.576 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:25.576 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:25.576 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:25.576 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:25.576 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:25.576 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:25.577 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:25.577 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:25.577 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:25.577 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:25.582 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.583 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.583 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.583 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.583 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.583 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.583 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.583 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.584 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.584 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.584 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.584 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.584 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.587 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=38eacb309d714c09b7c15323079452fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.587 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 38eacb309d714c09b7c15323079452fd for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
18:34:25.588 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:25.599 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:25.604 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d9b4ee28af7743f59956e54d0900a1bc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.604 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet d9b4ee28af7743f59956e54d0900a1bc for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
18:34:25.618 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8deb64d0611e4e7e9f7c8324b188cb2b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.618 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8deb64d0611e4e7e9f7c8324b188cb2b for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
18:34:25.620 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:25.620 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:25.620 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:25.621 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:25.621 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:25.621 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:25.621 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:25.621 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:25.621 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:25.621 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:25.621 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:25.622 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:25.622 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:25.622 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.622 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.622 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.623 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.623 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.623 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.623 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.623 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.623 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.624 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.624 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.624 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.625 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5c37815e96ea465a8c32e5a3d746b02b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.625 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5c37815e96ea465a8c32e5a3d746b02b for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
18:34:25.625 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.625 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.625 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.625 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.625 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.625 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.626 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.626 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.626 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.626 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.628 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.628 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.628 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.628 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.630 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 41f18052e8363382138bde77e16b10c3 (5008 bytes, checkpointDuration=796 ms, finalizationTime=0 ms).
18:34:25.631 [INFO - Checkpoint Timer] (CheckpointRequestDecider.java:220) checkpoint request time in queue: 299
18:34:25.634 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
18:34:25.634 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split ee479a4e8e47309ea70e83c355913bdd31ba8cfaea1213d929bf99ec61c81f22 from pending
18:34:25.634 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split b32286337df890b647ef55bc8c4cabf8efec25a7720137e310521d70be9a2c8a from pending
18:34:25.634 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split adf3aaf54219f1e4ad40b242dbf1d45af89e33b1f53b6ad93bb54533c7922dec from pending
18:34:25.634 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split a7f6d3c08d8ec1bf913e598c8e5e7df24d4f62df026025fb73ac92be377d2468 from pending
18:34:25.634 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 7cd418c9608e754fb98e7c8ad4067ca978208a37d138d701f4a008c2bfc38106 from pending
18:34:25.634 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split e61b52af2f646edbd1beab19713286cf79d3b750b082f6caedb386fa45cc5ff6 from pending
18:34:25.634 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 6 finished splits from enumerator state
18:34:25.634 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=13389bc0c0984bb788a1186c024e4f17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.635 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 13389bc0c0984bb788a1186c024e4f17 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
18:34:25.638 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535665631 for job 41f18052e8363382138bde77e16b10c3.
18:34:25.645 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=2, operationSize=126, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5200d49a, flushNotification=Deferred@2063467095(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:34:25.663 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.663 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.663 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.663 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.664 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.664 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.664 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.664 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.664 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.665 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.665 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.665 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.665 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:25.681 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.681 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.682 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.682 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.682 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.682 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.682 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.683 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.683 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.683 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.683 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.683 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.683 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.687 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:25.687 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:25.687 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:25.688 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.688 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.688 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.688 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.688 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.688 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.688 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.688 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.688 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.689 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:25.694 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=569fbab27dcc46ceb35a25ca5373588b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.696 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 569fbab27dcc46ceb35a25ca5373588b for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
18:34:25.702 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.702 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.703 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.703 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.703 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.703 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.703 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.703 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.703 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.704 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.704 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.704 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.704 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.704 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=38eacb309d714c09b7c15323079452fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.704 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 38eacb309d714c09b7c15323079452fd for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
18:34:25.714 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d9b4ee28af7743f59956e54d0900a1bc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.714 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet d9b4ee28af7743f59956e54d0900a1bc for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
18:34:25.730 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8deb64d0611e4e7e9f7c8324b188cb2b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.731 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8deb64d0611e4e7e9f7c8324b188cb2b for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
18:34:25.739 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:25.739 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:25.739 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:34:25.739 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:34:25.745 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5c37815e96ea465a8c32e5a3d746b02b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.745 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5c37815e96ea465a8c32e5a3d746b02b for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
18:34:25.755 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=124 ms, finalizationTime=0 ms).
18:34:25.757 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=13389bc0c0984bb788a1186c024e4f17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.757 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 13389bc0c0984bb788a1186c024e4f17 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
18:34:25.758 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
18:34:25.761 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table ffbf6c12abe4466485202b0208f6b095
18:34:25.768 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8fe8917b37c84035bbea7dbddc98d83c
18:34:25.768 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.769 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.769 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.769 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.769 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.769 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.769 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.769 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.769 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.770 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.770 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.770 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.770 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.771 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table ffbf6c12abe4466485202b0208f6b095
18:34:25.774 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8fe8917b37c84035bbea7dbddc98d83c
18:34:25.779 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c39b66751cde487c94b99b60adc93d53 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
18:34:25.779 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f77f28191ee54426a01bed4a9478ccd6 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
18:34:25.779 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a84c5b3ea6b149718b3ae30a0ce84a17 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
18:34:25.779 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a2bab9e2604a4a9597798acdaf04474c for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:25.779 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 109afb7829a5484a844e346132a776be for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:25.779 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2ffabd13bdc04d08879bc28dc62155f3 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:25.779 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=c39b66751cde487c94b99b60adc93d53@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=f77f28191ee54426a01bed4a9478ccd6@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=a84c5b3ea6b149718b3ae30a0ce84a17@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=a2bab9e2604a4a9597798acdaf04474c@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=109afb7829a5484a844e346132a776be@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=2ffabd13bdc04d08879bc28dc62155f3@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:25.785 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 569fbab27dcc46ceb35a25ca5373588b for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
18:34:25.785 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 38eacb309d714c09b7c15323079452fd for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
18:34:25.785 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d9b4ee28af7743f59956e54d0900a1bc for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
18:34:25.785 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 8deb64d0611e4e7e9f7c8324b188cb2b for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:25.785 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5c37815e96ea465a8c32e5a3d746b02b for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:25.785 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 13389bc0c0984bb788a1186c024e4f17 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:25.786 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=569fbab27dcc46ceb35a25ca5373588b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=38eacb309d714c09b7c15323079452fd@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157)[L],b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=d9b4ee28af7743f59956e54d0900a1bc@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=8deb64d0611e4e7e9f7c8324b188cb2b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=5c37815e96ea465a8c32e5a3d746b02b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=13389bc0c0984bb788a1186c024e4f17@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:25.789 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table ffbf6c12abe4466485202b0208f6b095
18:34:25.792 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8fe8917b37c84035bbea7dbddc98d83c
18:34:25.796 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c39b66751cde487c94b99b60adc93d53 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
18:34:25.796 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f77f28191ee54426a01bed4a9478ccd6 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
18:34:25.796 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a84c5b3ea6b149718b3ae30a0ce84a17 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
18:34:25.796 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a2bab9e2604a4a9597798acdaf04474c for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:25.796 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 109afb7829a5484a844e346132a776be for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:25.796 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2ffabd13bdc04d08879bc28dc62155f3 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:25.796 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=c39b66751cde487c94b99b60adc93d53@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=f77f28191ee54426a01bed4a9478ccd6@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=a84c5b3ea6b149718b3ae30a0ce84a17@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=a2bab9e2604a4a9597798acdaf04474c@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=109afb7829a5484a844e346132a776be@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=2ffabd13bdc04d08879bc28dc62155f3@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:25.797 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.6.245.60:46787, [4ms] Sub RPC GetTableLocations: received response from server master-127.6.245.60:46787: OK, deferred=null)) after lookup
18:34:25.802 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.803 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.803 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.803 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.803 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.803 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.803 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.803 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.803 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.804 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.804 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.804 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.804 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.805 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c39b66751cde487c94b99b60adc93d53, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.805 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet c39b66751cde487c94b99b60adc93d53 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
18:34:25.811 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f77f28191ee54426a01bed4a9478ccd6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.811 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f77f28191ee54426a01bed4a9478ccd6 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
18:34:25.833 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535665833 for job 41f18052e8363382138bde77e16b10c3.
18:34:25.845 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:34:25.846 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
18:34:25.862 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a84c5b3ea6b149718b3ae30a0ce84a17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.862 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet a84c5b3ea6b149718b3ae30a0ce84a17 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
18:34:25.873 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:25.874 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:25.874 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a2bab9e2604a4a9597798acdaf04474c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.874 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet a2bab9e2604a4a9597798acdaf04474c for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
18:34:25.874 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:25.874 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:25.874 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:25.874 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:25.875 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:25.875 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:25.875 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:25.875 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:25.875 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:25.876 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:25.876 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:25.901 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.901 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.901 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.902 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.902 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.902 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.902 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.902 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.902 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.902 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.902 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.903 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.903 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.909 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=109afb7829a5484a844e346132a776be, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.909 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 109afb7829a5484a844e346132a776be for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
18:34:25.938 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ffabd13bdc04d08879bc28dc62155f3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.939 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2ffabd13bdc04d08879bc28dc62155f3 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
18:34:25.944 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 569fbab27dcc46ceb35a25ca5373588b for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
18:34:25.944 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 38eacb309d714c09b7c15323079452fd for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
18:34:25.944 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d9b4ee28af7743f59956e54d0900a1bc for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
18:34:25.944 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 8deb64d0611e4e7e9f7c8324b188cb2b for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:25.944 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 5c37815e96ea465a8c32e5a3d746b02b for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:25.944 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 13389bc0c0984bb788a1186c024e4f17 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:25.944 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=569fbab27dcc46ceb35a25ca5373588b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=38eacb309d714c09b7c15323079452fd@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157)[L],b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=d9b4ee28af7743f59956e54d0900a1bc@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=8deb64d0611e4e7e9f7c8324b188cb2b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405),d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=5c37815e96ea465a8c32e5a3d746b02b@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=13389bc0c0984bb788a1186c024e4f17@[5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157),b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)[L],d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:25.944 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.7.200.188:38999, [4ms] Sub RPC GetTableLocations: received response from server master-127.7.200.188:38999: OK, deferred=null)) after lookup
18:34:25.954 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=569fbab27dcc46ceb35a25ca5373588b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.954 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 569fbab27dcc46ceb35a25ca5373588b for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
18:34:25.960 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=38eacb309d714c09b7c15323079452fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.960 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 38eacb309d714c09b7c15323079452fd for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
18:34:25.968 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d9b4ee28af7743f59956e54d0900a1bc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.968 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet d9b4ee28af7743f59956e54d0900a1bc for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
18:34:25.971 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:25.979 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8deb64d0611e4e7e9f7c8324b188cb2b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.979 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8deb64d0611e4e7e9f7c8324b188cb2b for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
18:34:25.982 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:25.982 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:25.982 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:25.983 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:25.983 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:25.983 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:25.983 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.984 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.984 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:25.984 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.984 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.984 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.984 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:25.984 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.984 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.984 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:25.983 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.984 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.985 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:25.985 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:25.984 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.985 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:25.984 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.985 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.985 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:25.985 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:25.988 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5c37815e96ea465a8c32e5a3d746b02b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:25.988 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5c37815e96ea465a8c32e5a3d746b02b for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
18:34:26.007 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=13389bc0c0984bb788a1186c024e4f17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:26.008 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 13389bc0c0984bb788a1186c024e4f17 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
18:34:26.021 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:26.021 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:26.021 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:26.022 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:26.022 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:26.022 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:26.022 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:26.022 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:26.022 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:26.022 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:26.022 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:26.022 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:26.023 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:26.024 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:26.024 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:26.024 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:26.024 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:26.024 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:26.024 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:26.024 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:26.024 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:26.024 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:26.025 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:26.025 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:26.025 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:26.025 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:26.030 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c39b66751cde487c94b99b60adc93d53, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:26.031 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet c39b66751cde487c94b99b60adc93d53 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
18:34:26.044 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f77f28191ee54426a01bed4a9478ccd6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:26.045 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f77f28191ee54426a01bed4a9478ccd6 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
18:34:26.056 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a84c5b3ea6b149718b3ae30a0ce84a17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:26.057 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet a84c5b3ea6b149718b3ae30a0ce84a17 for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
18:34:26.073 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a2bab9e2604a4a9597798acdaf04474c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:26.073 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet a2bab9e2604a4a9597798acdaf04474c for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
18:34:26.084 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=109afb7829a5484a844e346132a776be, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:26.084 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 109afb7829a5484a844e346132a776be for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
18:34:26.088 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:26.099 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:26.110 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2ffabd13bdc04d08879bc28dc62155f3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:26.111 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2ffabd13bdc04d08879bc28dc62155f3 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
18:34:26.126 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=569fbab27dcc46ceb35a25ca5373588b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:26.126 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 569fbab27dcc46ceb35a25ca5373588b for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
18:34:26.136 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=38eacb309d714c09b7c15323079452fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:26.136 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 38eacb309d714c09b7c15323079452fd for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
18:34:26.148 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d9b4ee28af7743f59956e54d0900a1bc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:26.148 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet d9b4ee28af7743f59956e54d0900a1bc for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
18:34:26.159 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=8deb64d0611e4e7e9f7c8324b188cb2b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:26.159 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 8deb64d0611e4e7e9f7c8324b188cb2b for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
18:34:26.179 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:26.179 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:26.179 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:26.179 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:26.179 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:26.179 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:26.179 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:26.179 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:26.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:26.180 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:26.180 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:26.180 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:26.179 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:26.180 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:26.182 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:26.182 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:26.182 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:26.182 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:26.183 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:26.183 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:26.183 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:26.183 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:26.183 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:26.183 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:26.183 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:26.183 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:26.183 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:26.188 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=5c37815e96ea465a8c32e5a3d746b02b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:26.188 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 5c37815e96ea465a8c32e5a3d746b02b for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
18:34:26.203 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=13389bc0c0984bb788a1186c024e4f17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:26.203 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 13389bc0c0984bb788a1186c024e4f17 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
18:34:26.204 [DEBUG - main] (Connection.java:575) [peer master-127.7.200.189:42349(127.7.200.189:42349)] disconnecting while in state READY
18:34:26.204 [DEBUG - main] (Connection.java:575) [peer master-127.7.200.190:40077(127.7.200.190:40077)] disconnecting while in state READY
18:34:26.204 [DEBUG - main] (Connection.java:575) [peer d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)] disconnecting while in state READY
18:34:26.204 [DEBUG - main] (Connection.java:575) [peer b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)] disconnecting while in state READY
18:34:26.204 [DEBUG - main] (Connection.java:575) [peer 5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157)] disconnecting while in state READY
18:34:26.204 [DEBUG - main] (Connection.java:575) [peer master-127.7.200.188:38999(127.7.200.188:38999)] disconnecting while in state READY
18:34:26.204 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.7.200.190:40077(127.7.200.190:40077)] handling channelInactive
18:34:26.204 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.7.200.189:42349(127.7.200.189:42349)] handling channelInactive
18:34:26.204 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state READY due to: connection closed
18:34:26.204 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state READY due to: connection closed
18:34:26.204 [DEBUG - kudu-nio-5] (Connection.java:239) [peer d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)] handling channelInactive
18:34:26.204 [DEBUG - kudu-nio-5] (Connection.java:709) [peer d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)] cleaning up while in state READY due to: connection closed
18:34:26.205 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157)] handling channelInactive
18:34:26.205 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 5e2eeb0ca41546d7bcaca3220385168e(127.7.200.131:36157)] cleaning up while in state READY due to: connection closed
18:34:26.205 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.7.200.188:38999(127.7.200.188:38999)] handling channelInactive
18:34:26.205 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state READY due to: connection closed
18:34:26.209 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:26.210 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-5
18:34:26.210 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-2
18:34:26.210 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-4
18:34:26.216 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:26.216 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:26.217 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:26.219 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:26.219 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:26.219 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:26.219 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:26.219 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:26.219 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:26.221 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:26.221 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:26.221 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:26.222 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:26.223 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:34:26.223 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
18:34:26.224 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:26.224 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:26.224 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:26.225 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:26.225 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:26.225 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:26.225 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:26.225 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:26.225 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:26.225 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:26.225 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:26.226 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:26.226 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:26.231 [DEBUG - kudu-nio-3] (Connection.java:239) [peer b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)] handling channelInactive
18:34:26.231 [DEBUG - kudu-nio-3] (Connection.java:709) [peer b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)] cleaning up while in state READY due to: connection closed
18:34:26.231 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-3
18:34:26.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:26.232756  7970 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 8358
18:34:26.333 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535666333 for job 41f18052e8363382138bde77e16b10c3.
18:34:26.346 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:34:26.347 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
18:34:26.437 [DEBUG - kudu-nio-3] (Connection.java:239) [peer d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)] handling channelInactive
18:34:26.437 [DEBUG - kudu-nio-3] (Connection.java:709) [peer d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)] cleaning up while in state READY due to: connection closed
18:34:26.439 [DEBUG - kudu-nio-3] (Connection.java:239) [peer d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)] handling channelInactive
18:34:26.440 [DEBUG - kudu-nio-3] (Connection.java:709) [peer d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)] cleaning up while in state READY due to: connection closed
18:34:26.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:26.446364  7970 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 8506
18:34:26.471 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:26.482 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:26.482 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:26.482 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:26.482 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:26.482 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:26.482 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:26.483 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:26.483 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:26.483 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:26.483 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:26.483 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:26.483 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:26.483 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:26.535 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:26.535 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:26.536 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:26.536 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:26.536 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:26.536 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:26.536 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:26.537 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:26.537 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:26.537 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:26.537 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:26.537 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:26.537 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:26.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:26.555748  8674 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.200.129:33899: connect: Connection refused (error 111)
18:34:26.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:26.568833  8674 consensus_peers.cc:597] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e -> Peer d916cabe36cb45ccb545d9fc771a4651 (127.7.200.129:33899): Couldn't send request to peer d916cabe36cb45ccb545d9fc771a4651. Status: Network error: Client connection negotiation failed: client connection to 127.7.200.129:33899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
18:34:26.589 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:26.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:26.602 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:26.602 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:26.603 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:26.603 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:26.603 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:26.603 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:26.603 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:26.603 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:26.603 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:26.604 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:26.604 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:26.604 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:26.604 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:26.612 [DEBUG - kudu-nio-3] (Connection.java:239) [peer b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)] handling channelInactive
18:34:26.612 [DEBUG - kudu-nio-3] (Connection.java:709) [peer b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)] cleaning up while in state READY due to: connection closed
18:34:26.616 [DEBUG - kudu-nio-3] (Connection.java:239) [peer b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)] handling channelInactive
18:34:26.616 [DEBUG - kudu-nio-3] (Connection.java:709) [peer b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)] cleaning up while in state READY due to: connection closed
18:34:26.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:26.617527  8675 connection.cc:573] client connection to 127.7.200.130:45405 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:34:26.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:26.622529  8675 consensus_peers.cc:597] T 38eacb309d714c09b7c15323079452fd P 5e2eeb0ca41546d7bcaca3220385168e -> Peer b47d36a83f4440eaac9ce006765394d3 (127.7.200.130:45405): Couldn't send request to peer b47d36a83f4440eaac9ce006765394d3. Status: Network error: Client connection negotiation failed: client connection to 127.7.200.130:45405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
18:34:26.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:26.632566  7970 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 8655
18:34:26.673 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:26.673 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:26.674 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:26.674 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:26.674 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:26.674 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:26.674 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:26.674 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:26.674 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:26.674 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:26.674 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:26.674 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:26.674 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:26.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:26.682 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:26.682 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:26.682 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:26.682 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:26.683 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:26.683 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:26.683 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:26.683 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:26.683 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:26.683 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:26.683 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:26.683 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:26.683 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:26.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:26.720678  7970 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 7982
18:34:26.726 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:26.726 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:26.726 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:26.726 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:26.726 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:26.726 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:26.727 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:26.727 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:26.727 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:26.728 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:26.728 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:26.728 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:26.728 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:26.740 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:26.740 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:26.740 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:26.740 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:26.741 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:26.741 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:26.740 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:26.741 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:26.741 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:26.741 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:26.741 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:26.741 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:26.741 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:26.779 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.7.200.190:40077(127.7.200.190:40077)] handling channelInactive
18:34:26.779 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state READY due to: connection closed
18:34:26.779 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.7.200.190:40077(127.7.200.190:40077)] handling channelInactive
18:34:26.780 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state READY due to: connection closed
18:34:26.780 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.7.200.190:40077(127.7.200.190:40077)] handling channelInactive
18:34:26.779 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.7.200.190:40077(127.7.200.190:40077)] handling channelInactive
18:34:26.780 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state READY due to: connection closed
18:34:26.780 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state READY due to: connection closed
18:34:26.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:26.781031  7970 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 8056
18:34:26.833 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535666833 for job 41f18052e8363382138bde77e16b10c3.
18:34:26.843 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:34:26.844 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
18:34:26.872 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.7.200.189:42349(127.7.200.189:42349)] handling channelInactive
18:34:26.872 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state READY due to: connection closed
18:34:26.873 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.7.200.189:42349(127.7.200.189:42349)] handling channelInactive
18:34:26.873 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state READY due to: connection closed
18:34:26.873 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.7.200.189:42349(127.7.200.189:42349)] handling channelInactive
18:34:26.873 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state READY due to: connection closed
18:34:26.873 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.7.200.189:42349(127.7.200.189:42349)] handling channelInactive
18:34:26.873 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state READY due to: connection closed
18:34:26.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:26.879545  7970 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 8187
18:34:26.959 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.7.200.188:38999(127.7.200.188:38999)] handling channelInactive
18:34:26.959 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state READY due to: connection closed
18:34:26.971 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:26.975 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.7.200.188:38999(127.7.200.188:38999)] handling channelInactive
18:34:26.975 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state READY due to: connection closed
18:34:26.975 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.7.200.188:38999(127.7.200.188:38999)] handling channelInactive
18:34:26.976 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state READY due to: connection closed
18:34:26.976 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.7.200.188:38999(127.7.200.188:38999)] handling channelInactive
18:34:26.976 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state READY due to: connection closed
18:34:26.999 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:26.999 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:26.999 [DEBUG - pool-420-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:26.999 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:26.999 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:27.000 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:27.000 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:27.000 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:27.000 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:27.000 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:27.000 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:27.000 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:27.000 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:27.001 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:27.001 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:27.001 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:27.001 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=26409), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [6ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [7ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [8ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [8ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [32ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [33ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [34ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [34ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [53ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [57ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [58ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [58ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [81ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [82ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [103ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [104ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [104ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [124ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [182ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [183ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [301ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [302ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [462ms] refreshing cache from master, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [463ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [463ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [463ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [463ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [762ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [762ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [763ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [763ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1443ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2381ms] refreshing cache from master, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2384ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2384ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [6141ms] refreshing cache from master, [6141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [6141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [6141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [6142ms] too many traces: truncated at 100 traces, deferred=Deferred@1429923628(state=PENDING, result=null, callback=(continuation of Deferred@1896550765 after retry RPC after error@1442997252) -> (continuation of Deferred@981822054 after retry RPC after error@948234653) -> (continuation of Deferred@296556441 after retry RPC after error@1422549996) -> (continuation of Deferred@1158542665 after retry RPC after error@1524245620) -> (continuation of Deferred@590541161 after retry RPC after error@610280416) -> (continuation of Deferred@242036120 after retry RPC after error@94327205) -> (continuation of Deferred@831672774 after retry RPC after error@340269879) -> (continuation of Deferred@1932457419 after retry RPC after error@214143090) -> (continuation of Deferred@805108813 after retry RPC after error@2067389222) -> (continuation of Deferred@2143152423 after retry RPC after error@1869461154) -> (continuation of Deferred@658190742 after retry RPC after error@317603516) -> (continuation of Deferred@34216215 after retry RPC after error@13657938) -> (continuation of Deferred@2123977055 after retry RPC after error@501320686) -> (continuation of Deferred@1332870116 after retry RPC after error@1276706735) -> (continuation of Deferred@2017414362 after retry RPC after error@1762657992) -> (continuation of Deferred@704540373 after retry RPC after error@579869122) -> (continuation of Deferred@541841622 after retry RPC after error@1225043025) -> (continuation of Deferred@332856162 after retry RPC after error@824884947) -> (continuation of Deferred@1331256648 after retry RPC after error@601032406) -> (continuation of Deferred@133882917 after retry RPC after error@1665277487) -> (continuation of Deferred@1727314962 after retry RPC after error@1571480492), errback=(continuation of Deferred@1896550765 after retry RPC after error@1442997252) -> (continuation of Deferred@981822054 after retry RPC after error@948234653) -> (continuation of Deferred@296556441 after retry RPC after error@1422549996) -> (continuation of Deferred@1158542665 after retry RPC after error@1524245620) -> (continuation of Deferred@590541161 after retry RPC after error@610280416) -> (continuation of Deferred@242036120 after retry RPC after error@94327205) -> (continuation of Deferred@831672774 after retry RPC after error@340269879) -> (continuation of Deferred@1932457419 after retry RPC after error@214143090) -> (continuation of Deferred@805108813 after retry RPC after error@2067389222) -> (continuation of Deferred@2143152423 after retry RPC after error@1869461154) -> (continuation of Deferred@658190742 after retry RPC after error@317603516) -> (continuation of Deferred@34216215 after retry RPC after error@13657938) -> (continuation of Deferred@2123977055 after retry RPC after error@501320686) -> (continuation of Deferred@1332870116 after retry RPC after error@1276706735) -> (continuation of Deferred@2017414362 after retry RPC after error@1762657992) -> (continuation of Deferred@704540373 after retry RPC after error@579869122) -> (continuation of Deferred@541841622 after retry RPC after error@1225043025) -> (continuation of Deferred@332856162 after retry RPC after error@824884947) -> (continuation of Deferred@1331256648 after retry RPC after error@601032406) -> (continuation of Deferred@133882917 after retry RPC after error@1665277487) -> (continuation of Deferred@1727314962 after retry RPC after error@1571480492)))
18:34:27.001 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:27.002 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:27.002 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:27.002 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:27.002 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:27.002 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:27.002 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:27.002 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:27.002 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:27.002 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:27.003 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
18:34:27.003 [WARN - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=26409), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [6ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [7ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [8ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [8ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [32ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [33ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [34ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [34ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [53ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [57ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [58ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [58ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [81ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [82ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [103ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [104ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [104ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [124ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [182ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [183ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [301ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [302ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [462ms] refreshing cache from master, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [463ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [463ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [463ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [463ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [762ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [762ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [763ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [763ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1443ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2381ms] refreshing cache from master, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2384ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2384ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [6141ms] refreshing cache from master, [6141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [6141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [6141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [6142ms] too many traces: truncated at 100 traces, deferred=Deferred@1429923628(state=PENDING, result=null, callback=(continuation of Deferred@1896550765 after retry RPC after error@1442997252) -> (continuation of Deferred@981822054 after retry RPC after error@948234653) -> (continuation of Deferred@296556441 after retry RPC after error@1422549996) -> (continuation of Deferred@1158542665 after retry RPC after error@1524245620) -> (continuation of Deferred@590541161 after retry RPC after error@610280416) -> (continuation of Deferred@242036120 after retry RPC after error@94327205) -> (continuation of Deferred@831672774 after retry RPC after error@340269879) -> (continuation of Deferred@1932457419 after retry RPC after error@214143090) -> (continuation of Deferred@805108813 after retry RPC after error@2067389222) -> (continuation of Deferred@2143152423 after retry RPC after error@1869461154) -> (continuation of Deferred@658190742 after retry RPC after error@317603516) -> (continuation of Deferred@34216215 after retry RPC after error@13657938) -> (continuation of Deferred@2123977055 after retry RPC after error@501320686) -> (continuation of Deferred@1332870116 after retry RPC after error@1276706735) -> (continuation of Deferred@2017414362 after retry RPC after error@1762657992) -> (continuation of Deferred@704540373 after retry RPC after error@579869122) -> (continuation of Deferred@541841622 after retry RPC after error@1225043025) -> (continuation of Deferred@332856162 after retry RPC after error@824884947) -> (continuation of Deferred@1331256648 after retry RPC after error@601032406) -> (continuation of Deferred@133882917 after retry RPC after error@1665277487) -> (continuation of Deferred@1727314962 after retry RPC after error@1571480492), errback=(continuation of Deferred@1896550765 after retry RPC after error@1442997252) -> (continuation of Deferred@981822054 after retry RPC after error@948234653) -> (continuation of Deferred@296556441 after retry RPC after error@1422549996) -> (continuation of Deferred@1158542665 after retry RPC after error@1524245620) -> (continuation of Deferred@590541161 after retry RPC after error@610280416) -> (continuation of Deferred@242036120 after retry RPC after error@94327205) -> (continuation of Deferred@831672774 after retry RPC after error@340269879) -> (continuation of Deferred@1932457419 after retry RPC after error@214143090) -> (continuation of Deferred@805108813 after retry RPC after error@2067389222) -> (continuation of Deferred@2143152423 after retry RPC after error@1869461154) -> (continuation of Deferred@658190742 after retry RPC after error@317603516) -> (continuation of Deferred@34216215 after retry RPC after error@13657938) -> (continuation of Deferred@2123977055 after retry RPC after error@501320686) -> (continuation of Deferred@1332870116 after retry RPC after error@1276706735) -> (continuation of Deferred@2017414362 after retry RPC after error@1762657992) -> (continuation of Deferred@704540373 after retry RPC after error@579869122) -> (continuation of Deferred@541841622 after retry RPC after error@1225043025) -> (continuation of Deferred@332856162 after retry RPC after error@824884947) -> (continuation of Deferred@1331256648 after retry RPC after error@601032406) -> (continuation of Deferred@133882917 after retry RPC after error@1665277487) -> (continuation of Deferred@1727314962 after retry RPC after error@1571480492)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:27.003 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
18:34:27.006 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#5 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_5.
18:34:27.008 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to FAILED on 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=26409), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [6ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [7ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [8ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [8ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [32ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [33ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [34ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [34ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [53ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [57ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [58ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [58ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [81ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [82ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [103ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [104ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [104ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [124ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [182ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [183ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [301ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [302ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [462ms] refreshing cache from master, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [463ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [463ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [463ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [463ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [762ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [762ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [763ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [763ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1443ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2381ms] refreshing cache from master, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2384ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2384ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [6141ms] refreshing cache from master, [6141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [6141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [6141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [6142ms] too many traces: truncated at 100 traces, deferred=Deferred@1429923628(state=PENDING, result=null, callback=(continuation of Deferred@1896550765 after retry RPC after error@1442997252) -> (continuation of Deferred@981822054 after retry RPC after error@948234653) -> (continuation of Deferred@296556441 after retry RPC after error@1422549996) -> (continuation of Deferred@1158542665 after retry RPC after error@1524245620) -> (continuation of Deferred@590541161 after retry RPC after error@610280416) -> (continuation of Deferred@242036120 after retry RPC after error@94327205) -> (continuation of Deferred@831672774 after retry RPC after error@340269879) -> (continuation of Deferred@1932457419 after retry RPC after error@214143090) -> (continuation of Deferred@805108813 after retry RPC after error@2067389222) -> (continuation of Deferred@2143152423 after retry RPC after error@1869461154) -> (continuation of Deferred@658190742 after retry RPC after error@317603516) -> (continuation of Deferred@34216215 after retry RPC after error@13657938) -> (continuation of Deferred@2123977055 after retry RPC after error@501320686) -> (continuation of Deferred@1332870116 after retry RPC after error@1276706735) -> (continuation of Deferred@2017414362 after retry RPC after error@1762657992) -> (continuation of Deferred@704540373 after retry RPC after error@579869122) -> (continuation of Deferred@541841622 after retry RPC after error@1225043025) -> (continuation of Deferred@332856162 after retry RPC after error@824884947) -> (continuation of Deferred@1331256648 after retry RPC after error@601032406) -> (continuation of Deferred@133882917 after retry RPC after error@1665277487) -> (continuation of Deferred@1727314962 after retry RPC after error@1571480492), errback=(continuation of Deferred@1896550765 after retry RPC after error@1442997252) -> (continuation of Deferred@981822054 after retry RPC after error@948234653) -> (continuation of Deferred@296556441 after retry RPC after error@1422549996) -> (continuation of Deferred@1158542665 after retry RPC after error@1524245620) -> (continuation of Deferred@590541161 after retry RPC after error@610280416) -> (continuation of Deferred@242036120 after retry RPC after error@94327205) -> (continuation of Deferred@831672774 after retry RPC after error@340269879) -> (continuation of Deferred@1932457419 after retry RPC after error@214143090) -> (continuation of Deferred@805108813 after retry RPC after error@2067389222) -> (continuation of Deferred@2143152423 after retry RPC after error@1869461154) -> (continuation of Deferred@658190742 after retry RPC after error@317603516) -> (continuation of Deferred@34216215 after retry RPC after error@13657938) -> (continuation of Deferred@2123977055 after retry RPC after error@501320686) -> (continuation of Deferred@1332870116 after retry RPC after error@1276706735) -> (continuation of Deferred@2017414362 after retry RPC after error@1762657992) -> (continuation of Deferred@704540373 after retry RPC after error@579869122) -> (continuation of Deferred@541841622 after retry RPC after error@1225043025) -> (continuation of Deferred@332856162 after retry RPC after error@824884947) -> (continuation of Deferred@1331256648 after retry RPC after error@601032406) -> (continuation of Deferred@133882917 after retry RPC after error@1665277487) -> (continuation of Deferred@1727314962 after retry RPC after error@1571480492)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:27.009 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:27.010 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_5.
18:34:27.010 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9) switched from state RUNNING to RESTARTING.
18:34:27.010 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#5) of source Source: KuduSource.
18:34:27.025 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:27.025 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:27.025 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:27.025 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:27.025 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:27.025 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:27.026 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:27.026 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:27.026 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:27.026 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:27.026 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:27.026 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:27.026 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:27.087 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:27.135 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:27.135 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:27.135 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:27.136 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:27.136 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:27.136 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:27.136 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:27.136 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:27.136 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:27.136 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:27.136 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:27.136 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:27.136 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:27.144 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:27.144 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:27.144 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:27.145 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:27.145 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:27.145 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:27.145 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:27.145 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:27.145 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:27.145 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:27.145 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:27.145 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:27.145 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:27.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:27.220 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:27.220 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:27.220 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:27.221 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:27.221 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:27.221 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:27.221 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:27.221 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:27.221 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:27.221 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:27.222 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:27.222 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:27.222 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:27.242 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:27.242 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:27.242 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:27.242 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:27.242 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:27.242 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:27.242 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:27.243 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:27.243 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:27.243 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:27.243 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:27.243 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:27.243 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:27.243 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:27.243 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:27.243 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:27.243 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:27.243 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:27.243 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:27.243 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:27.243 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:27.243 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:27.244 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:27.244 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:27.244 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:27.244 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:27.315 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:27.316 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:27.316 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:27.316 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:27.316 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:27.316 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:27.317 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:27.317 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:27.317 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:27.317 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:27.317 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:27.317 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:27.317 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:27.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535667333 for job 41f18052e8363382138bde77e16b10c3.
18:34:27.347 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
18:34:27.349 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
18:34:27.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:27.481 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:27.481 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:27.482 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:27.482 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:27.482 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:27.482 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:27.483 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:27.483 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:27.483 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:27.483 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:27.483 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:27.483 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:27.483 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:27.587 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:27.593 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:27.593 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:27.594 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:27.596 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:27.596 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:27.596 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:27.596 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:27.596 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:27.596 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:27.597 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:27.597 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:27.597 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:27.597 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:27.600 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table ffbf6c12abe4466485202b0208f6b095
18:34:27.604 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c39b66751cde487c94b99b60adc93d53 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
18:34:27.604 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f77f28191ee54426a01bed4a9478ccd6 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
18:34:27.605 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a84c5b3ea6b149718b3ae30a0ce84a17 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
18:34:27.605 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a2bab9e2604a4a9597798acdaf04474c for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:27.605 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 109afb7829a5484a844e346132a776be for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:27.605 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2ffabd13bdc04d08879bc28dc62155f3 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:27.605 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=c39b66751cde487c94b99b60adc93d53@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=f77f28191ee54426a01bed4a9478ccd6@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=a84c5b3ea6b149718b3ae30a0ce84a17@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=a2bab9e2604a4a9597798acdaf04474c@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=109afb7829a5484a844e346132a776be@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=2ffabd13bdc04d08879bc28dc62155f3@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:27.605 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:27.605 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:27.605 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:27.606 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:27.606 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:27.606 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:27.606 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:27.606 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:27.606 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:27.606 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:27.606 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:27.606 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:27.607 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:27.612 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='77aac908110c78ddc8020459bab6e2cd4c4b574c6e67632e561ee4bc8d3e7e0b'}]
18:34:27.613 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:27.614 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:34:27.614 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='4eb7e64280e05c56b0be58d507e0d2185207cf3ddf5e7c9d986a478204e797a2'}]
18:34:27.614 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299998, tablet=c39b66751cde487c94b99b60adc93d53@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}]
18:34:27.615 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='913aff638687440436a16e7158d92e41cdf1f74edc990460e9ffe6eb38273b03'}]
18:34:27.615 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='32befbedbb1bd71f088790f09644af1be5b14267cce4ef01936a769d06683473'}]
18:34:27.616 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:27.616 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
18:34:27.617 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299998, tablet=f77f28191ee54426a01bed4a9478ccd6@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}]
18:34:27.618 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:27.618 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
18:34:27.619 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299998, tablet=a84c5b3ea6b149718b3ae30a0ce84a17@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}]
18:34:27.619 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:27.620 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
18:34:27.620 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299998, tablet=a2bab9e2604a4a9597798acdaf04474c@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}]
18:34:27.622 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:27.636 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:27.637 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:27.641 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:27.663 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:27.676 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:27.679 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:27.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:27.691 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:27.700 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:27.705 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x12536edf, L:/127.0.0.1:54750 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:27.706 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:27.720 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:27.725 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:27.727 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:27.731 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305362094456832001) for scanner KuduScanner(table=replication_test_table, tablet=c39b66751cde487c94b99b60adc93d53, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:27.731 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [77aac908110c78ddc8020459bab6e2cd4c4b574c6e67632e561ee4bc8d3e7e0b]
18:34:27.731 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [77aac908110c78ddc8020459bab6e2cd4c4b574c6e67632e561ee4bc8d3e7e0b]
18:34:27.731 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:34:27.731 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:34:27.732 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:27.733 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:27.733 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:27.741 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 77aac908110c78ddc8020459bab6e2cd4c4b574c6e67632e561ee4bc8d3e7e0b finished by subtask 1; deferring removal (restored in pending)
18:34:27.742 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='c84d937f90e3f76aec2a37bbcd7922103f9b53b4904dcd4fc4601208d309a749'}]
18:34:27.743 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6c524145, L:/127.0.0.1:54762 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:27.744 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:27.752 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:27.761 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe1ac3a87, L:/127.0.0.1:54766 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:27.763 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:27.768 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb2c260d3, L:/127.0.0.1:54768 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:27.778 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
18:34:27.781 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299998, tablet=109afb7829a5484a844e346132a776be@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}]
18:34:27.784 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:27.784 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:27.784 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305362094456832001) for scanner KuduScanner(table=replication_test_table, tablet=f77f28191ee54426a01bed4a9478ccd6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:27.784 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:34:27.784 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:34:27.785 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [4eb7e64280e05c56b0be58d507e0d2185207cf3ddf5e7c9d986a478204e797a2]
18:34:27.786 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [4eb7e64280e05c56b0be58d507e0d2185207cf3ddf5e7c9d986a478204e797a2]
18:34:27.786 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
18:34:27.786 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
18:34:27.786 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:27.787 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 4eb7e64280e05c56b0be58d507e0d2185207cf3ddf5e7c9d986a478204e797a2 finished by subtask 0; deferring removal (restored in pending)
18:34:27.788 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='c48e14de3e62e83c89734a20ef702378976579eab40ba5257f32de84f33b35b7'}]
18:34:27.789 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:27.789 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:27.794 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:27.814 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
18:34:27.816 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299997, tablet=2ffabd13bdc04d08879bc28dc62155f3@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}]
18:34:27.831 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
18:34:27.831 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:27.831 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:27.831 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:34:27.833 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535667833 for job 41f18052e8363382138bde77e16b10c3.
18:34:27.837 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:27.845 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:27.847 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 41f18052e8363382138bde77e16b10c3 (5068 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
18:34:27.848 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
18:34:27.848 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 7 complete: removed split 77aac908110c78ddc8020459bab6e2cd4c4b574c6e67632e561ee4bc8d3e7e0b from pending
18:34:27.848 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 7 complete: removed split 4eb7e64280e05c56b0be58d507e0d2185207cf3ddf5e7c9d986a478204e797a2 from pending
18:34:27.848 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 7 complete: removed 2 finished splits from enumerator state
18:34:27.861 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:27.871 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305362094456832001) for scanner KuduScanner(table=replication_test_table, tablet=a2bab9e2604a4a9597798acdaf04474c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:27.873 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [32befbedbb1bd71f088790f09644af1be5b14267cce4ef01936a769d06683473]
18:34:27.873 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [32befbedbb1bd71f088790f09644af1be5b14267cce4ef01936a769d06683473]
18:34:27.874 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
18:34:27.874 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
18:34:27.874 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 32befbedbb1bd71f088790f09644af1be5b14267cce4ef01936a769d06683473 finished by subtask 3; deferring removal (restored in pending)
18:34:27.875 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:27.875 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:27.879 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:27.887 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:27.905 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc66fbf2a, L:/127.0.0.1:54776 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:27.922 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:27.922 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:27.922 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:27.923 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:27.923 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:27.923 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:27.923 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:27.923 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:27.923 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:27.924 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:27.924 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:27.924 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:27.924 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:27.957 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:27.957 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:27.957 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:34:27.958 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
18:34:27.964 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:27.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:27.980 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:27.980 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:27.980 [DEBUG - pool-416-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:27.981 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:27.981 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:27.981 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:27.981 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:27.981 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:27.981 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:27.982 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:27.982 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:27.982 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:27.982 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:27.982 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:27.982 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=27400), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [8ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [9ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [9ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [9ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [25ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [26ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [27ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [27ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [58ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [68ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [69ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [69ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [83ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [83ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [103ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [104ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [104ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [124ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [124ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [182ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [301ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [302ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [321ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [322ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [402ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1022ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2540ms] refreshing cache from master, [2540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2541ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2541ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2542ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2542ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [3741ms] refreshing cache from master, [3741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [3741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [3741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [3741ms] too many traces: truncated at 100 traces, deferred=Deferred@1010008580(state=PENDING, result=null, callback=(continuation of Deferred@340279387 after retry RPC after error@994582039) -> (continuation of Deferred@1767944177 after retry RPC after error@1231238011) -> (continuation of Deferred@528480404 after retry RPC after error@1690105290) -> (continuation of Deferred@139448715 after retry RPC after error@1483195154) -> (continuation of Deferred@951860178 after retry RPC after error@1001233322) -> (continuation of Deferred@1293469405 after retry RPC after error@729936703) -> (continuation of Deferred@1924808502 after retry RPC after error@622692864) -> (continuation of Deferred@775462480 after retry RPC after error@168073379) -> (continuation of Deferred@702825818 after retry RPC after error@1625327596) -> (continuation of Deferred@171990974 after retry RPC after error@607068117) -> (continuation of Deferred@803885215 after retry RPC after error@1263631721) -> (continuation of Deferred@1139045906 after retry RPC after error@535365644) -> (continuation of Deferred@1652215238 after retry RPC after error@578838229) -> (continuation of Deferred@1110767729 after retry RPC after error@365572435) -> (continuation of Deferred@569039569 after retry RPC after error@20733647) -> (continuation of Deferred@1680787945 after retry RPC after error@539634838) -> (continuation of Deferred@1465992720 after retry RPC after error@885563413) -> (continuation of Deferred@649807588 after retry RPC after error@1468305465) -> (continuation of Deferred@176688415 after retry RPC after error@2066861139) -> (continuation of Deferred@121711031 after retry RPC after error@1949787198) -> (continuation of Deferred@1050505042 after retry RPC after error@1262190470) -> (continuation of Deferred@1169812423 after retry RPC after error@182481370) -> (continuation of Deferred@1599240235 after retry RPC after error@1325787912) -> (continuation of Deferred@1172887292 after retry RPC after error@1276055866) -> (continuation of Deferred@13679536 after retry RPC after error@1626168585) -> (continuation of Deferred@1672554718 after retry RPC after error@1468232531), errback=(continuation of Deferred@340279387 after retry RPC after error@994582039) -> (continuation of Deferred@1767944177 after retry RPC after error@1231238011) -> (continuation of Deferred@528480404 after retry RPC after error@1690105290) -> (continuation of Deferred@139448715 after retry RPC after error@1483195154) -> (continuation of Deferred@951860178 after retry RPC after error@1001233322) -> (continuation of Deferred@1293469405 after retry RPC after error@729936703) -> (continuation of Deferred@1924808502 after retry RPC after error@622692864) -> (continuation of Deferred@775462480 after retry RPC after error@168073379) -> (continuation of Deferred@702825818 after retry RPC after error@1625327596) -> (continuation of Deferred@171990974 after retry RPC after error@607068117) -> (continuation of Deferred@803885215 after retry RPC after error@1263631721) -> (continuation of Deferred@1139045906 after retry RPC after error@535365644) -> (continuation of Deferred@1652215238 after retry RPC after error@578838229) -> (continuation of Deferred@1110767729 after retry RPC after error@365572435) -> (continuation of Deferred@569039569 after retry RPC after error@20733647) -> (continuation of Deferred@1680787945 after retry RPC after error@539634838) -> (continuation of Deferred@1465992720 after retry RPC after error@885563413) -> (continuation of Deferred@649807588 after retry RPC after error@1468305465) -> (continuation of Deferred@176688415 after retry RPC after error@2066861139) -> (continuation of Deferred@121711031 after retry RPC after error@1949787198) -> (continuation of Deferred@1050505042 after retry RPC after error@1262190470) -> (continuation of Deferred@1169812423 after retry RPC after error@182481370) -> (continuation of Deferred@1599240235 after retry RPC after error@1325787912) -> (continuation of Deferred@1172887292 after retry RPC after error@1276055866) -> (continuation of Deferred@13679536 after retry RPC after error@1626168585) -> (continuation of Deferred@1672554718 after retry RPC after error@1468232531)))
18:34:27.983 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
18:34:27.983 [WARN - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=27400), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [8ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [9ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [9ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [9ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [25ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [26ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [27ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [27ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [58ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [68ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [69ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [69ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [83ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [83ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [103ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [104ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [104ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [124ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [124ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [182ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [301ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [302ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [321ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [322ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [402ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1022ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2540ms] refreshing cache from master, [2540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2541ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2541ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2542ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2542ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [3741ms] refreshing cache from master, [3741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [3741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [3741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [3741ms] too many traces: truncated at 100 traces, deferred=Deferred@1010008580(state=PENDING, result=null, callback=(continuation of Deferred@340279387 after retry RPC after error@994582039) -> (continuation of Deferred@1767944177 after retry RPC after error@1231238011) -> (continuation of Deferred@528480404 after retry RPC after error@1690105290) -> (continuation of Deferred@139448715 after retry RPC after error@1483195154) -> (continuation of Deferred@951860178 after retry RPC after error@1001233322) -> (continuation of Deferred@1293469405 after retry RPC after error@729936703) -> (continuation of Deferred@1924808502 after retry RPC after error@622692864) -> (continuation of Deferred@775462480 after retry RPC after error@168073379) -> (continuation of Deferred@702825818 after retry RPC after error@1625327596) -> (continuation of Deferred@171990974 after retry RPC after error@607068117) -> (continuation of Deferred@803885215 after retry RPC after error@1263631721) -> (continuation of Deferred@1139045906 after retry RPC after error@535365644) -> (continuation of Deferred@1652215238 after retry RPC after error@578838229) -> (continuation of Deferred@1110767729 after retry RPC after error@365572435) -> (continuation of Deferred@569039569 after retry RPC after error@20733647) -> (continuation of Deferred@1680787945 after retry RPC after error@539634838) -> (continuation of Deferred@1465992720 after retry RPC after error@885563413) -> (continuation of Deferred@649807588 after retry RPC after error@1468305465) -> (continuation of Deferred@176688415 after retry RPC after error@2066861139) -> (continuation of Deferred@121711031 after retry RPC after error@1949787198) -> (continuation of Deferred@1050505042 after retry RPC after error@1262190470) -> (continuation of Deferred@1169812423 after retry RPC after error@182481370) -> (continuation of Deferred@1599240235 after retry RPC after error@1325787912) -> (continuation of Deferred@1172887292 after retry RPC after error@1276055866) -> (continuation of Deferred@13679536 after retry RPC after error@1626168585) -> (continuation of Deferred@1672554718 after retry RPC after error@1468232531), errback=(continuation of Deferred@340279387 after retry RPC after error@994582039) -> (continuation of Deferred@1767944177 after retry RPC after error@1231238011) -> (continuation of Deferred@528480404 after retry RPC after error@1690105290) -> (continuation of Deferred@139448715 after retry RPC after error@1483195154) -> (continuation of Deferred@951860178 after retry RPC after error@1001233322) -> (continuation of Deferred@1293469405 after retry RPC after error@729936703) -> (continuation of Deferred@1924808502 after retry RPC after error@622692864) -> (continuation of Deferred@775462480 after retry RPC after error@168073379) -> (continuation of Deferred@702825818 after retry RPC after error@1625327596) -> (continuation of Deferred@171990974 after retry RPC after error@607068117) -> (continuation of Deferred@803885215 after retry RPC after error@1263631721) -> (continuation of Deferred@1139045906 after retry RPC after error@535365644) -> (continuation of Deferred@1652215238 after retry RPC after error@578838229) -> (continuation of Deferred@1110767729 after retry RPC after error@365572435) -> (continuation of Deferred@569039569 after retry RPC after error@20733647) -> (continuation of Deferred@1680787945 after retry RPC after error@539634838) -> (continuation of Deferred@1465992720 after retry RPC after error@885563413) -> (continuation of Deferred@649807588 after retry RPC after error@1468305465) -> (continuation of Deferred@176688415 after retry RPC after error@2066861139) -> (continuation of Deferred@121711031 after retry RPC after error@1949787198) -> (continuation of Deferred@1050505042 after retry RPC after error@1262190470) -> (continuation of Deferred@1169812423 after retry RPC after error@182481370) -> (continuation of Deferred@1599240235 after retry RPC after error@1325787912) -> (continuation of Deferred@1172887292 after retry RPC after error@1276055866) -> (continuation of Deferred@13679536 after retry RPC after error@1626168585) -> (continuation of Deferred@1672554718 after retry RPC after error@1468232531)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:27.984 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
18:34:27.984 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305362094456832001) for scanner KuduScanner(table=replication_test_table, tablet=109afb7829a5484a844e346132a776be, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:27.986 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#5 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
18:34:27.986 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [c84d937f90e3f76aec2a37bbcd7922103f9b53b4904dcd4fc4601208d309a749]
18:34:27.986 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [c84d937f90e3f76aec2a37bbcd7922103f9b53b4904dcd4fc4601208d309a749]
18:34:27.987 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
18:34:27.987 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
18:34:27.988 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split c84d937f90e3f76aec2a37bbcd7922103f9b53b4904dcd4fc4601208d309a749 finished by subtask 1; deferring removal (restored in pending)
18:34:27.988 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:27.988 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:27.988 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to FAILED on 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=27400), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [8ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [9ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [9ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [9ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [25ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [26ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [27ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [27ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [58ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [68ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [69ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [69ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [83ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [83ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [103ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [104ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [104ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [122ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [124ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [124ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [181ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [182ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [301ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [302ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [321ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [322ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [402ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1022ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2540ms] refreshing cache from master, [2540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2541ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2541ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2542ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2542ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [3741ms] refreshing cache from master, [3741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [3741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [3741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [3741ms] too many traces: truncated at 100 traces, deferred=Deferred@1010008580(state=PENDING, result=null, callback=(continuation of Deferred@340279387 after retry RPC after error@994582039) -> (continuation of Deferred@1767944177 after retry RPC after error@1231238011) -> (continuation of Deferred@528480404 after retry RPC after error@1690105290) -> (continuation of Deferred@139448715 after retry RPC after error@1483195154) -> (continuation of Deferred@951860178 after retry RPC after error@1001233322) -> (continuation of Deferred@1293469405 after retry RPC after error@729936703) -> (continuation of Deferred@1924808502 after retry RPC after error@622692864) -> (continuation of Deferred@775462480 after retry RPC after error@168073379) -> (continuation of Deferred@702825818 after retry RPC after error@1625327596) -> (continuation of Deferred@171990974 after retry RPC after error@607068117) -> (continuation of Deferred@803885215 after retry RPC after error@1263631721) -> (continuation of Deferred@1139045906 after retry RPC after error@535365644) -> (continuation of Deferred@1652215238 after retry RPC after error@578838229) -> (continuation of Deferred@1110767729 after retry RPC after error@365572435) -> (continuation of Deferred@569039569 after retry RPC after error@20733647) -> (continuation of Deferred@1680787945 after retry RPC after error@539634838) -> (continuation of Deferred@1465992720 after retry RPC after error@885563413) -> (continuation of Deferred@649807588 after retry RPC after error@1468305465) -> (continuation of Deferred@176688415 after retry RPC after error@2066861139) -> (continuation of Deferred@121711031 after retry RPC after error@1949787198) -> (continuation of Deferred@1050505042 after retry RPC after error@1262190470) -> (continuation of Deferred@1169812423 after retry RPC after error@182481370) -> (continuation of Deferred@1599240235 after retry RPC after error@1325787912) -> (continuation of Deferred@1172887292 after retry RPC after error@1276055866) -> (continuation of Deferred@13679536 after retry RPC after error@1626168585) -> (continuation of Deferred@1672554718 after retry RPC after error@1468232531), errback=(continuation of Deferred@340279387 after retry RPC after error@994582039) -> (continuation of Deferred@1767944177 after retry RPC after error@1231238011) -> (continuation of Deferred@528480404 after retry RPC after error@1690105290) -> (continuation of Deferred@139448715 after retry RPC after error@1483195154) -> (continuation of Deferred@951860178 after retry RPC after error@1001233322) -> (continuation of Deferred@1293469405 after retry RPC after error@729936703) -> (continuation of Deferred@1924808502 after retry RPC after error@622692864) -> (continuation of Deferred@775462480 after retry RPC after error@168073379) -> (continuation of Deferred@702825818 after retry RPC after error@1625327596) -> (continuation of Deferred@171990974 after retry RPC after error@607068117) -> (continuation of Deferred@803885215 after retry RPC after error@1263631721) -> (continuation of Deferred@1139045906 after retry RPC after error@535365644) -> (continuation of Deferred@1652215238 after retry RPC after error@578838229) -> (continuation of Deferred@1110767729 after retry RPC after error@365572435) -> (continuation of Deferred@569039569 after retry RPC after error@20733647) -> (continuation of Deferred@1680787945 after retry RPC after error@539634838) -> (continuation of Deferred@1465992720 after retry RPC after error@885563413) -> (continuation of Deferred@649807588 after retry RPC after error@1468305465) -> (continuation of Deferred@176688415 after retry RPC after error@2066861139) -> (continuation of Deferred@121711031 after retry RPC after error@1949787198) -> (continuation of Deferred@1050505042 after retry RPC after error@1262190470) -> (continuation of Deferred@1169812423 after retry RPC after error@182481370) -> (continuation of Deferred@1599240235 after retry RPC after error@1325787912) -> (continuation of Deferred@1172887292 after retry RPC after error@1276055866) -> (continuation of Deferred@13679536 after retry RPC after error@1626168585) -> (continuation of Deferred@1672554718 after retry RPC after error@1468232531)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:27.989 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:34:27.990 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#5) of source Source: KuduSource.
18:34:27.990 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
18:34:27.990 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6f911439, L:/127.0.0.1:54788 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:28.005 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305362094456832001) for scanner KuduScanner(table=replication_test_table, tablet=2ffabd13bdc04d08879bc28dc62155f3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:28.006 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [c48e14de3e62e83c89734a20ef702378976579eab40ba5257f32de84f33b35b7]
18:34:28.006 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [c48e14de3e62e83c89734a20ef702378976579eab40ba5257f32de84f33b35b7]
18:34:28.006 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
18:34:28.006 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
18:34:28.008 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:28.008 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:28.008 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:28.008 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split c48e14de3e62e83c89734a20ef702378976579eab40ba5257f32de84f33b35b7 finished by subtask 0; deferring removal (restored in pending)
18:34:28.009 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:28.009 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:28.009 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:28.009 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:28.009 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:28.009 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:28.009 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:28.009 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:28.009 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:28.009 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:28.009 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:28.010 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:28.033 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:28.034 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:28.034 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:34:28.034 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
18:34:28.043 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:28.043 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:28.043 [DEBUG - pool-414-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:28.043 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:28.043 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:28.043 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:28.044 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:28.044 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:28.044 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:28.044 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:28.044 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:28.044 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:28.044 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:28.045 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27491), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [12ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [12ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [13ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [13ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [28ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [29ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [30ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [30ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [46ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [47ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [48ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [48ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [61ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [62ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [82ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [101ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [102ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [143ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [143ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [144ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [144ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [161ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [162ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [701ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [701ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [701ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [702ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1260ms] refreshing cache from master, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1262ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2641ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2643ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2643ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2643ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [5381ms] refreshing cache from master, [5381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [5381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [5381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [5382ms] too many traces: truncated at 100 traces, deferred=Deferred@455574830(state=PENDING, result=null, callback=(continuation of Deferred@599130353 after retry RPC after error@1232220041) -> (continuation of Deferred@922588320 after retry RPC after error@290744740) -> (continuation of Deferred@41304823 after retry RPC after error@1520446295) -> (continuation of Deferred@2292791 after retry RPC after error@839494878) -> (continuation of Deferred@47722898 after retry RPC after error@1509509133) -> (continuation of Deferred@1311622209 after retry RPC after error@826146310) -> (continuation of Deferred@1915358482 after retry RPC after error@1627429498) -> (continuation of Deferred@1093617111 after retry RPC after error@524049978) -> (continuation of Deferred@1029472850 after retry RPC after error@1483349193) -> (continuation of Deferred@1674640366 after retry RPC after error@518042656) -> (continuation of Deferred@1199045564 after retry RPC after error@1332947919) -> (continuation of Deferred@731428420 after retry RPC after error@809649827) -> (continuation of Deferred@1209065740 after retry RPC after error@510367378) -> (continuation of Deferred@1890527629 after retry RPC after error@1383734885) -> (continuation of Deferred@497913255 after retry RPC after error@1596999558) -> (continuation of Deferred@1448804012 after retry RPC after error@1414613812) -> (continuation of Deferred@627057836 after retry RPC after error@2016500721) -> (continuation of Deferred@2032100805 after retry RPC after error@659134777) -> (continuation of Deferred@52988984 after retry RPC after error@1899274623) -> (continuation of Deferred@1929892817 after retry RPC after error@409734361), errback=(continuation of Deferred@599130353 after retry RPC after error@1232220041) -> (continuation of Deferred@922588320 after retry RPC after error@290744740) -> (continuation of Deferred@41304823 after retry RPC after error@1520446295) -> (continuation of Deferred@2292791 after retry RPC after error@839494878) -> (continuation of Deferred@47722898 after retry RPC after error@1509509133) -> (continuation of Deferred@1311622209 after retry RPC after error@826146310) -> (continuation of Deferred@1915358482 after retry RPC after error@1627429498) -> (continuation of Deferred@1093617111 after retry RPC after error@524049978) -> (continuation of Deferred@1029472850 after retry RPC after error@1483349193) -> (continuation of Deferred@1674640366 after retry RPC after error@518042656) -> (continuation of Deferred@1199045564 after retry RPC after error@1332947919) -> (continuation of Deferred@731428420 after retry RPC after error@809649827) -> (continuation of Deferred@1209065740 after retry RPC after error@510367378) -> (continuation of Deferred@1890527629 after retry RPC after error@1383734885) -> (continuation of Deferred@497913255 after retry RPC after error@1596999558) -> (continuation of Deferred@1448804012 after retry RPC after error@1414613812) -> (continuation of Deferred@627057836 after retry RPC after error@2016500721) -> (continuation of Deferred@2032100805 after retry RPC after error@659134777) -> (continuation of Deferred@52988984 after retry RPC after error@1899274623) -> (continuation of Deferred@1929892817 after retry RPC after error@409734361)))
18:34:28.046 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
18:34:28.046 [WARN - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27491), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [12ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [12ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [13ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [13ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [28ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [29ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [30ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [30ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [46ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [47ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [48ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [48ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [61ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [62ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [82ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [101ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [102ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [143ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [143ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [144ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [144ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [161ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [162ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [701ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [701ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [701ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [702ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1260ms] refreshing cache from master, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1262ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2641ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2643ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2643ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2643ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [5381ms] refreshing cache from master, [5381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [5381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [5381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [5382ms] too many traces: truncated at 100 traces, deferred=Deferred@455574830(state=PENDING, result=null, callback=(continuation of Deferred@599130353 after retry RPC after error@1232220041) -> (continuation of Deferred@922588320 after retry RPC after error@290744740) -> (continuation of Deferred@41304823 after retry RPC after error@1520446295) -> (continuation of Deferred@2292791 after retry RPC after error@839494878) -> (continuation of Deferred@47722898 after retry RPC after error@1509509133) -> (continuation of Deferred@1311622209 after retry RPC after error@826146310) -> (continuation of Deferred@1915358482 after retry RPC after error@1627429498) -> (continuation of Deferred@1093617111 after retry RPC after error@524049978) -> (continuation of Deferred@1029472850 after retry RPC after error@1483349193) -> (continuation of Deferred@1674640366 after retry RPC after error@518042656) -> (continuation of Deferred@1199045564 after retry RPC after error@1332947919) -> (continuation of Deferred@731428420 after retry RPC after error@809649827) -> (continuation of Deferred@1209065740 after retry RPC after error@510367378) -> (continuation of Deferred@1890527629 after retry RPC after error@1383734885) -> (continuation of Deferred@497913255 after retry RPC after error@1596999558) -> (continuation of Deferred@1448804012 after retry RPC after error@1414613812) -> (continuation of Deferred@627057836 after retry RPC after error@2016500721) -> (continuation of Deferred@2032100805 after retry RPC after error@659134777) -> (continuation of Deferred@52988984 after retry RPC after error@1899274623) -> (continuation of Deferred@1929892817 after retry RPC after error@409734361), errback=(continuation of Deferred@599130353 after retry RPC after error@1232220041) -> (continuation of Deferred@922588320 after retry RPC after error@290744740) -> (continuation of Deferred@41304823 after retry RPC after error@1520446295) -> (continuation of Deferred@2292791 after retry RPC after error@839494878) -> (continuation of Deferred@47722898 after retry RPC after error@1509509133) -> (continuation of Deferred@1311622209 after retry RPC after error@826146310) -> (continuation of Deferred@1915358482 after retry RPC after error@1627429498) -> (continuation of Deferred@1093617111 after retry RPC after error@524049978) -> (continuation of Deferred@1029472850 after retry RPC after error@1483349193) -> (continuation of Deferred@1674640366 after retry RPC after error@518042656) -> (continuation of Deferred@1199045564 after retry RPC after error@1332947919) -> (continuation of Deferred@731428420 after retry RPC after error@809649827) -> (continuation of Deferred@1209065740 after retry RPC after error@510367378) -> (continuation of Deferred@1890527629 after retry RPC after error@1383734885) -> (continuation of Deferred@497913255 after retry RPC after error@1596999558) -> (continuation of Deferred@1448804012 after retry RPC after error@1414613812) -> (continuation of Deferred@627057836 after retry RPC after error@2016500721) -> (continuation of Deferred@2032100805 after retry RPC after error@659134777) -> (continuation of Deferred@52988984 after retry RPC after error@1899274623) -> (continuation of Deferred@1929892817 after retry RPC after error@409734361)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:28.046 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_5).
18:34:28.048 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#5 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_5.
18:34:28.049 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:28.049 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:28.050 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
18:34:28.050 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
18:34:28.050 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to FAILED on 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=27491), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [12ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [12ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [13ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [13ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [28ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [29ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [30ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [30ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [46ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [47ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [48ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [48ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [61ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [62ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [82ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [101ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [102ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [143ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [143ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [144ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [144ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [161ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [162ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [701ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [701ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [701ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [702ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1260ms] refreshing cache from master, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1262ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2641ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2643ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2643ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2643ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [5381ms] refreshing cache from master, [5381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [5381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [5381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [5382ms] too many traces: truncated at 100 traces, deferred=Deferred@455574830(state=PENDING, result=null, callback=(continuation of Deferred@599130353 after retry RPC after error@1232220041) -> (continuation of Deferred@922588320 after retry RPC after error@290744740) -> (continuation of Deferred@41304823 after retry RPC after error@1520446295) -> (continuation of Deferred@2292791 after retry RPC after error@839494878) -> (continuation of Deferred@47722898 after retry RPC after error@1509509133) -> (continuation of Deferred@1311622209 after retry RPC after error@826146310) -> (continuation of Deferred@1915358482 after retry RPC after error@1627429498) -> (continuation of Deferred@1093617111 after retry RPC after error@524049978) -> (continuation of Deferred@1029472850 after retry RPC after error@1483349193) -> (continuation of Deferred@1674640366 after retry RPC after error@518042656) -> (continuation of Deferred@1199045564 after retry RPC after error@1332947919) -> (continuation of Deferred@731428420 after retry RPC after error@809649827) -> (continuation of Deferred@1209065740 after retry RPC after error@510367378) -> (continuation of Deferred@1890527629 after retry RPC after error@1383734885) -> (continuation of Deferred@497913255 after retry RPC after error@1596999558) -> (continuation of Deferred@1448804012 after retry RPC after error@1414613812) -> (continuation of Deferred@627057836 after retry RPC after error@2016500721) -> (continuation of Deferred@2032100805 after retry RPC after error@659134777) -> (continuation of Deferred@52988984 after retry RPC after error@1899274623) -> (continuation of Deferred@1929892817 after retry RPC after error@409734361), errback=(continuation of Deferred@599130353 after retry RPC after error@1232220041) -> (continuation of Deferred@922588320 after retry RPC after error@290744740) -> (continuation of Deferred@41304823 after retry RPC after error@1520446295) -> (continuation of Deferred@2292791 after retry RPC after error@839494878) -> (continuation of Deferred@47722898 after retry RPC after error@1509509133) -> (continuation of Deferred@1311622209 after retry RPC after error@826146310) -> (continuation of Deferred@1915358482 after retry RPC after error@1627429498) -> (continuation of Deferred@1093617111 after retry RPC after error@524049978) -> (continuation of Deferred@1029472850 after retry RPC after error@1483349193) -> (continuation of Deferred@1674640366 after retry RPC after error@518042656) -> (continuation of Deferred@1199045564 after retry RPC after error@1332947919) -> (continuation of Deferred@731428420 after retry RPC after error@809649827) -> (continuation of Deferred@1209065740 after retry RPC after error@510367378) -> (continuation of Deferred@1890527629 after retry RPC after error@1383734885) -> (continuation of Deferred@497913255 after retry RPC after error@1596999558) -> (continuation of Deferred@1448804012 after retry RPC after error@1414613812) -> (continuation of Deferred@627057836 after retry RPC after error@2016500721) -> (continuation of Deferred@2032100805 after retry RPC after error@659134777) -> (continuation of Deferred@52988984 after retry RPC after error@1899274623) -> (continuation of Deferred@1929892817 after retry RPC after error@409734361)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:28.052 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:34:28.054 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#5) of source Source: KuduSource.
18:34:28.054 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_5.
18:34:28.087 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:28.089 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305362094456832001) for scanner KuduScanner(table=replication_test_table, tablet=a84c5b3ea6b149718b3ae30a0ce84a17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:28.090 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [913aff638687440436a16e7158d92e41cdf1f74edc990460e9ffe6eb38273b03]
18:34:28.091 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [913aff638687440436a16e7158d92e41cdf1f74edc990460e9ffe6eb38273b03]
18:34:28.091 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
18:34:28.091 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
18:34:28.092 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 913aff638687440436a16e7158d92e41cdf1f74edc990460e9ffe6eb38273b03 finished by subtask 2; deferring removal (restored in pending)
18:34:28.094 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:28.095 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:28.095 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:28.095 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:28.095 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:28.095 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:28.095 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:28.095 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:28.095 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:28.095 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:28.095 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:28.096 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:28.096 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:28.096 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:28.096 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:28.117 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:28.117 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:28.118 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:34:28.118 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
18:34:28.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:28.264 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:28.264 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:28.265 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:28.267 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:28.267 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:28.267 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:28.268 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:28.268 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:28.268 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:28.268 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:28.268 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:28.268 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:28.268 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:28.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535668333 for job 41f18052e8363382138bde77e16b10c3.
18:34:28.364 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 41f18052e8363382138bde77e16b10c3 (3700 bytes, checkpointDuration=30 ms, finalizationTime=0 ms).
18:34:28.365 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
18:34:28.366 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 32befbedbb1bd71f088790f09644af1be5b14267cce4ef01936a769d06683473 from pending
18:34:28.366 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split c48e14de3e62e83c89734a20ef702378976579eab40ba5257f32de84f33b35b7 from pending
18:34:28.366 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 913aff638687440436a16e7158d92e41cdf1f74edc990460e9ffe6eb38273b03 from pending
18:34:28.366 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split c84d937f90e3f76aec2a37bbcd7922103f9b53b4904dcd4fc4601208d309a749 from pending
18:34:28.366 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 4 finished splits from enumerator state
18:34:28.383 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:28.383 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:28.383 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:28.383 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:28.383 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:28.383 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:28.383 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:28.383 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:28.383 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:28.384 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:28.384 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:28.384 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:28.384 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:28.455 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:28.455 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:28.455 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:28.456 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:28.456 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:28.456 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:28.456 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:28.456 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:28.456 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:28.457 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:28.457 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:28.457 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:28.457 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:28.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:28.587 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:28.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:28.721 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:28.721 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:28.722 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:28.722 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:28.722 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:28.722 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:28.723 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:28.723 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:28.723 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:28.725 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:28.725 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:28.725 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:28.725 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:28.785 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:28.785 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:28.785 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:28.786 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:28.786 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:28.786 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:28.786 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:28.786 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:28.786 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:28.786 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:28.786 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:28.786 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:28.786 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:28.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535668833 for job 41f18052e8363382138bde77e16b10c3.
18:34:28.844 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:34:28.845 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
18:34:28.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:34:28Z chronyd exiting
18:34:28.948 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:28.948 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:28.948 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:28.949 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:28.949 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:28.949 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:28.949 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:28.949 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:28.949 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:28.949 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:28.949 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:28.949 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:28.949 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:28.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:29.088 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:29.149 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:29.149 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:29.149 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:29.149 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:29.149 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:29.149 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:29.150 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:29.150 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:29.150 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:29.150 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:29.150 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:29.150 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:29.150 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:29.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:29.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535669333 for job 41f18052e8363382138bde77e16b10c3.
18:34:29.344 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:29.344 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:29.344 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:29.345 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:29.345 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:29.345 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:29.346 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:29.346 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:29.346 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:29.348 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:29.348 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:29.348 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:29.348 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:29.353 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
18:34:29.355 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
18:34:29.458 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:29.459 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:29.459 [DEBUG - pool-418-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:29.459 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:29.459 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:29.459 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:29.459 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:29.459 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:29.459 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:29.459 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:29.459 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:29.459 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:29.459 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:29.460 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28876), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [3ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [4ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [6ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [6ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [24ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [25ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [26ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [26ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [44ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [44ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [47ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [47ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [63ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [86ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [87ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [123ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [182ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [182ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [182ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [184ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [304ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [304ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [542ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [542ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [542ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [542ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1201ms] refreshing cache from master, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1203ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1622ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2781ms] refreshing cache from master, [2781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2782ms] too many traces: truncated at 100 traces, deferred=Deferred@1422417529(state=PENDING, result=null, callback=(continuation of Deferred@456983201 after retry RPC after error@1101255994) -> (continuation of Deferred@242752356 after retry RPC after error@416659268) -> (continuation of Deferred@1804502773 after retry RPC after error@886805691) -> (continuation of Deferred@2058754687 after retry RPC after error@1340927482) -> (continuation of Deferred@1355445212 after retry RPC after error@953965362) -> (continuation of Deferred@1920191412 after retry RPC after error@1524136765) -> (continuation of Deferred@1494202153 after retry RPC after error@55599857) -> (continuation of Deferred@1871853380 after retry RPC after error@1980409880) -> (continuation of Deferred@1377369871 after retry RPC after error@1381980247) -> (continuation of Deferred@747203919 after retry RPC after error@257972910) -> (continuation of Deferred@437599434 after retry RPC after error@840979007) -> (continuation of Deferred@1428464161 after retry RPC after error@1486628609) -> (continuation of Deferred@1801233332 after retry RPC after error@1541252426) -> (continuation of Deferred@723001786 after retry RPC after error@310751223) -> (continuation of Deferred@483061520 after retry RPC after error@705424950) -> (continuation of Deferred@1089736508 after retry RPC after error@2133981890) -> (continuation of Deferred@885536859 after retry RPC after error@1103563434) -> (continuation of Deferred@556429377 after retry RPC after error@1371367756) -> (continuation of Deferred@608344512 after retry RPC after error@1562990008) -> (continuation of Deferred@796106276 after retry RPC after error@364799375) -> (continuation of Deferred@620917345 after retry RPC after error@840001516), errback=(continuation of Deferred@456983201 after retry RPC after error@1101255994) -> (continuation of Deferred@242752356 after retry RPC after error@416659268) -> (continuation of Deferred@1804502773 after retry RPC after error@886805691) -> (continuation of Deferred@2058754687 after retry RPC after error@1340927482) -> (continuation of Deferred@1355445212 after retry RPC after error@953965362) -> (continuation of Deferred@1920191412 after retry RPC after error@1524136765) -> (continuation of Deferred@1494202153 after retry RPC after error@55599857) -> (continuation of Deferred@1871853380 after retry RPC after error@1980409880) -> (continuation of Deferred@1377369871 after retry RPC after error@1381980247) -> (continuation of Deferred@747203919 after retry RPC after error@257972910) -> (continuation of Deferred@437599434 after retry RPC after error@840979007) -> (continuation of Deferred@1428464161 after retry RPC after error@1486628609) -> (continuation of Deferred@1801233332 after retry RPC after error@1541252426) -> (continuation of Deferred@723001786 after retry RPC after error@310751223) -> (continuation of Deferred@483061520 after retry RPC after error@705424950) -> (continuation of Deferred@1089736508 after retry RPC after error@2133981890) -> (continuation of Deferred@885536859 after retry RPC after error@1103563434) -> (continuation of Deferred@556429377 after retry RPC after error@1371367756) -> (continuation of Deferred@608344512 after retry RPC after error@1562990008) -> (continuation of Deferred@796106276 after retry RPC after error@364799375) -> (continuation of Deferred@620917345 after retry RPC after error@840001516)))
18:34:29.461 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
18:34:29.461 [WARN - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28876), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [3ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [4ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [6ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [6ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [24ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [25ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [26ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [26ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [44ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [44ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [47ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [47ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [63ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [86ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [87ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [123ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [182ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [182ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [182ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [184ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [304ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [304ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [542ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [542ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [542ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [542ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1201ms] refreshing cache from master, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1203ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1622ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2781ms] refreshing cache from master, [2781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2782ms] too many traces: truncated at 100 traces, deferred=Deferred@1422417529(state=PENDING, result=null, callback=(continuation of Deferred@456983201 after retry RPC after error@1101255994) -> (continuation of Deferred@242752356 after retry RPC after error@416659268) -> (continuation of Deferred@1804502773 after retry RPC after error@886805691) -> (continuation of Deferred@2058754687 after retry RPC after error@1340927482) -> (continuation of Deferred@1355445212 after retry RPC after error@953965362) -> (continuation of Deferred@1920191412 after retry RPC after error@1524136765) -> (continuation of Deferred@1494202153 after retry RPC after error@55599857) -> (continuation of Deferred@1871853380 after retry RPC after error@1980409880) -> (continuation of Deferred@1377369871 after retry RPC after error@1381980247) -> (continuation of Deferred@747203919 after retry RPC after error@257972910) -> (continuation of Deferred@437599434 after retry RPC after error@840979007) -> (continuation of Deferred@1428464161 after retry RPC after error@1486628609) -> (continuation of Deferred@1801233332 after retry RPC after error@1541252426) -> (continuation of Deferred@723001786 after retry RPC after error@310751223) -> (continuation of Deferred@483061520 after retry RPC after error@705424950) -> (continuation of Deferred@1089736508 after retry RPC after error@2133981890) -> (continuation of Deferred@885536859 after retry RPC after error@1103563434) -> (continuation of Deferred@556429377 after retry RPC after error@1371367756) -> (continuation of Deferred@608344512 after retry RPC after error@1562990008) -> (continuation of Deferred@796106276 after retry RPC after error@364799375) -> (continuation of Deferred@620917345 after retry RPC after error@840001516), errback=(continuation of Deferred@456983201 after retry RPC after error@1101255994) -> (continuation of Deferred@242752356 after retry RPC after error@416659268) -> (continuation of Deferred@1804502773 after retry RPC after error@886805691) -> (continuation of Deferred@2058754687 after retry RPC after error@1340927482) -> (continuation of Deferred@1355445212 after retry RPC after error@953965362) -> (continuation of Deferred@1920191412 after retry RPC after error@1524136765) -> (continuation of Deferred@1494202153 after retry RPC after error@55599857) -> (continuation of Deferred@1871853380 after retry RPC after error@1980409880) -> (continuation of Deferred@1377369871 after retry RPC after error@1381980247) -> (continuation of Deferred@747203919 after retry RPC after error@257972910) -> (continuation of Deferred@437599434 after retry RPC after error@840979007) -> (continuation of Deferred@1428464161 after retry RPC after error@1486628609) -> (continuation of Deferred@1801233332 after retry RPC after error@1541252426) -> (continuation of Deferred@723001786 after retry RPC after error@310751223) -> (continuation of Deferred@483061520 after retry RPC after error@705424950) -> (continuation of Deferred@1089736508 after retry RPC after error@2133981890) -> (continuation of Deferred@885536859 after retry RPC after error@1103563434) -> (continuation of Deferred@556429377 after retry RPC after error@1371367756) -> (continuation of Deferred@608344512 after retry RPC after error@1562990008) -> (continuation of Deferred@796106276 after retry RPC after error@364799375) -> (continuation of Deferred@620917345 after retry RPC after error@840001516)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.189:42073
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:29.461 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#5 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_5).
18:34:29.463 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#5 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_5.
18:34:29.465 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to FAILED on 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28876), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [3ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [4ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [6ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [6ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [24ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [25ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [26ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [26ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [44ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [44ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [47ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [47ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [62ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [63ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [86ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [87ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [123ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [182ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [182ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [182ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [184ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [302ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [304ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [304ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [542ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [542ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [542ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [542ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1201ms] refreshing cache from master, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1203ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1621ms] refreshing cache from master, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1622ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2781ms] refreshing cache from master, [2781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2782ms] too many traces: truncated at 100 traces, deferred=Deferred@1422417529(state=PENDING, result=null, callback=(continuation of Deferred@456983201 after retry RPC after error@1101255994) -> (continuation of Deferred@242752356 after retry RPC after error@416659268) -> (continuation of Deferred@1804502773 after retry RPC after error@886805691) -> (continuation of Deferred@2058754687 after retry RPC after error@1340927482) -> (continuation of Deferred@1355445212 after retry RPC after error@953965362) -> (continuation of Deferred@1920191412 after retry RPC after error@1524136765) -> (continuation of Deferred@1494202153 after retry RPC after error@55599857) -> (continuation of Deferred@1871853380 after retry RPC after error@1980409880) -> (continuation of Deferred@1377369871 after retry RPC after error@1381980247) -> (continuation of Deferred@747203919 after retry RPC after error@257972910) -> (continuation of Deferred@437599434 after retry RPC after error@840979007) -> (continuation of Deferred@1428464161 after retry RPC after error@1486628609) -> (continuation of Deferred@1801233332 after retry RPC after error@1541252426) -> (continuation of Deferred@723001786 after retry RPC after error@310751223) -> (continuation of Deferred@483061520 after retry RPC after error@705424950) -> (continuation of Deferred@1089736508 after retry RPC after error@2133981890) -> (continuation of Deferred@885536859 after retry RPC after error@1103563434) -> (continuation of Deferred@556429377 after retry RPC after error@1371367756) -> (continuation of Deferred@608344512 after retry RPC after error@1562990008) -> (continuation of Deferred@796106276 after retry RPC after error@364799375) -> (continuation of Deferred@620917345 after retry RPC after error@840001516), errback=(continuation of Deferred@456983201 after retry RPC after error@1101255994) -> (continuation of Deferred@242752356 after retry RPC after error@416659268) -> (continuation of Deferred@1804502773 after retry RPC after error@886805691) -> (continuation of Deferred@2058754687 after retry RPC after error@1340927482) -> (continuation of Deferred@1355445212 after retry RPC after error@953965362) -> (continuation of Deferred@1920191412 after retry RPC after error@1524136765) -> (continuation of Deferred@1494202153 after retry RPC after error@55599857) -> (continuation of Deferred@1871853380 after retry RPC after error@1980409880) -> (continuation of Deferred@1377369871 after retry RPC after error@1381980247) -> (continuation of Deferred@747203919 after retry RPC after error@257972910) -> (continuation of Deferred@437599434 after retry RPC after error@840979007) -> (continuation of Deferred@1428464161 after retry RPC after error@1486628609) -> (continuation of Deferred@1801233332 after retry RPC after error@1541252426) -> (continuation of Deferred@723001786 after retry RPC after error@310751223) -> (continuation of Deferred@483061520 after retry RPC after error@705424950) -> (continuation of Deferred@1089736508 after retry RPC after error@2133981890) -> (continuation of Deferred@885536859 after retry RPC after error@1103563434) -> (continuation of Deferred@556429377 after retry RPC after error@1371367756) -> (continuation of Deferred@608344512 after retry RPC after error@1562990008) -> (continuation of Deferred@796106276 after retry RPC after error@364799375) -> (continuation of Deferred@620917345 after retry RPC after error@840001516)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.189:42073
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:29.466 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_5.
18:34:29.466 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 4cd649562a0f5305571102b5c888c5a9
18:34:29.467 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#5) of source Source: KuduSource.
18:34:29.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:29.495 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:29.495 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:29.495 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:29.496 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:29.496 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:29.496 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:29.496 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:29.496 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:29.496 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:29.497 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:29.497 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:29.497 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:29.497 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:29.545 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:29.545 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:29.545 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:29.546 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:29.546 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:29.546 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:29.546 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:29.546 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:29.546 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:29.547 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:29.547 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:29.547 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:29.547 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:29.588 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:29.601 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table ffbf6c12abe4466485202b0208f6b095
18:34:29.609 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c39b66751cde487c94b99b60adc93d53 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
18:34:29.609 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f77f28191ee54426a01bed4a9478ccd6 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
18:34:29.609 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a84c5b3ea6b149718b3ae30a0ce84a17 for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
18:34:29.609 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a2bab9e2604a4a9597798acdaf04474c for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
18:34:29.609 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 109afb7829a5484a844e346132a776be for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
18:34:29.609 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2ffabd13bdc04d08879bc28dc62155f3 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
18:34:29.610 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=c39b66751cde487c94b99b60adc93d53@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=f77f28191ee54426a01bed4a9478ccd6@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=a84c5b3ea6b149718b3ae30a0ce84a17@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=a2bab9e2604a4a9597798acdaf04474c@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=109afb7829a5484a844e346132a776be@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=2ffabd13bdc04d08879bc28dc62155f3@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
18:34:29.618 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='edb63b63b7195a91f26fdc0e31315de891ea62835b7490fc51b691e708523b0c'}]
18:34:29.618 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='5d548c08a55c24c094b5b22c858275bd54a9832a522bd6e4b515b10c046ddc5f'}]
18:34:29.619 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='16030e8cdbd619b52f9332219d848fcb423015a72f99450ef5f88487b33c211c'}]
18:34:29.619 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:29.619 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
18:34:29.620 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299998, tablet=c39b66751cde487c94b99b60adc93d53@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}]
18:34:29.620 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:29.620 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='10814f1d59fcd99a78ee67839fefe7a139035777e39aa22ef7ce9bc89513eca3'}]
18:34:29.621 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:29.623 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
18:34:29.623 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:29.623 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
18:34:29.623 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299998, tablet=a84c5b3ea6b149718b3ae30a0ce84a17@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}]
18:34:29.623 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299998, tablet=f77f28191ee54426a01bed4a9478ccd6@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)[L],82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}]
18:34:29.624 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
18:34:29.624 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299998, tablet=a2bab9e2604a4a9597798acdaf04474c@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}]
18:34:29.630 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:29.639 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:29.640 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:29.648 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:29.649 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:29.649 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:29.649 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:29.649 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:29.649 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:29.649 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:29.650 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:29.650 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:29.650 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:29.650 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:29.650 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:29.650 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:29.650 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:29.663 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:29.663 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:29.663 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:29.663 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:29.663 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:29.664 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:29.664 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:29.664 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:29.664 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:29.664 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:29.664 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:29.664 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:29.664 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:29.667 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:29.673 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:29.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:29.710 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:29.720 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:29.729 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:29.731 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb0474cf3, L:/127.0.0.1:54796 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:29.735 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:29.740 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:29.748 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:29.749 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:29.749 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:29.751 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:29.751 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:29.751 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:29.751 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:29.751 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:29.751 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:29.752 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:29.752 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:29.752 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:29.752 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:29.769 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:29.773 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305362102648832001) for scanner KuduScanner(table=replication_test_table, tablet=c39b66751cde487c94b99b60adc93d53, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:29.774 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [5d548c08a55c24c094b5b22c858275bd54a9832a522bd6e4b515b10c046ddc5f]
18:34:29.774 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [5d548c08a55c24c094b5b22c858275bd54a9832a522bd6e4b515b10c046ddc5f]
18:34:29.774 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
18:34:29.774 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
18:34:29.775 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:29.775 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 5d548c08a55c24c094b5b22c858275bd54a9832a522bd6e4b515b10c046ddc5f finished by subtask 3; deferring removal (restored in pending)
18:34:29.776 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='ddf45bc9bfee7051226ff6bc0da5e1a6e34186ae19eb8faf9b5d4a19be12acae'}]
18:34:29.776 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:29.777 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:29.777 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:29.779 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:29.784 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xeecd94d1, L:/127.0.0.1:54804 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:29.788 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:29.792 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:29.800 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9a47968c, L:/127.0.0.1:54822 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:29.803 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305362102648832001) for scanner KuduScanner(table=replication_test_table, tablet=a84c5b3ea6b149718b3ae30a0ce84a17, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:29.803 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [16030e8cdbd619b52f9332219d848fcb423015a72f99450ef5f88487b33c211c]
18:34:29.803 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [16030e8cdbd619b52f9332219d848fcb423015a72f99450ef5f88487b33c211c]
18:34:29.803 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
18:34:29.804 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
18:34:29.804 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8d4b2445, L:/127.0.0.1:54816 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:29.805 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 16030e8cdbd619b52f9332219d848fcb423015a72f99450ef5f88487b33c211c finished by subtask 0; deferring removal (restored in pending)
18:34:29.808 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:29.809 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8e062b1e88303821668cf68e0419e447d616d9ec14d212caea7dca3f5200949c'}]
18:34:29.811 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:29.811 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
18:34:29.812 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299998, tablet=2ffabd13bdc04d08879bc28dc62155f3@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053),2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)[L]]}]
18:34:29.812 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:29.823 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305362102648832001) for scanner KuduScanner(table=replication_test_table, tablet=f77f28191ee54426a01bed4a9478ccd6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:29.823 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [edb63b63b7195a91f26fdc0e31315de891ea62835b7490fc51b691e708523b0c]
18:34:29.823 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [edb63b63b7195a91f26fdc0e31315de891ea62835b7490fc51b691e708523b0c]
18:34:29.824 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
18:34:29.824 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
18:34:29.824 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split edb63b63b7195a91f26fdc0e31315de891ea62835b7490fc51b691e708523b0c finished by subtask 1; deferring removal (restored in pending)
18:34:29.824 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:29.825 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:29.830 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:29.830 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:29.830 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:34:29.830 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
18:34:29.831 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
18:34:29.833 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299998, tablet=109afb7829a5484a844e346132a776be@[2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)[L],2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933),82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)]}]
18:34:29.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535669833 for job 41f18052e8363382138bde77e16b10c3.
18:34:29.835 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:29.835 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:29.835 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:29.836 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:29.836 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:29.836 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:29.837 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:29.837 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:29.837 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:29.837 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:29.838 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:29.838 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:29.838 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:29.844 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 41f18052e8363382138bde77e16b10c3 (5068 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:34:29.845 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
18:34:29.846 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 11 complete: removed split 5d548c08a55c24c094b5b22c858275bd54a9832a522bd6e4b515b10c046ddc5f from pending
18:34:29.846 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 11 complete: removed split 16030e8cdbd619b52f9332219d848fcb423015a72f99450ef5f88487b33c211c from pending
18:34:29.846 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 11 complete: removed split edb63b63b7195a91f26fdc0e31315de891ea62835b7490fc51b691e708523b0c from pending
18:34:29.846 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 11 complete: removed 3 finished splits from enumerator state
18:34:29.852 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:29.882 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:29.882 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:29.883 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
18:34:29.883 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
18:34:29.893 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:29.898 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:29.915 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:29.921 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb271a37d, L:/127.0.0.1:54826 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:29.937 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:29.937 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:29.938 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
18:34:29.938 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
18:34:29.939 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] connecting to peer
18:34:29.956 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] Successfully connected to peer
18:34:29.956 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305362102648832001) for scanner KuduScanner(table=replication_test_table, tablet=2ffabd13bdc04d08879bc28dc62155f3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:29.957 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [8e062b1e88303821668cf68e0419e447d616d9ec14d212caea7dca3f5200949c]
18:34:29.957 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8e062b1e88303821668cf68e0419e447d616d9ec14d212caea7dca3f5200949c]
18:34:29.957 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
18:34:29.957 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
18:34:29.958 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8e062b1e88303821668cf68e0419e447d616d9ec14d212caea7dca3f5200949c finished by subtask 0; deferring removal (restored in pending)
18:34:29.959 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:29.959 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:29.961 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305362102648832001) for scanner KuduScanner(table=replication_test_table, tablet=a2bab9e2604a4a9597798acdaf04474c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:29.961 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [10814f1d59fcd99a78ee67839fefe7a139035777e39aa22ef7ce9bc89513eca3]
18:34:29.961 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [10814f1d59fcd99a78ee67839fefe7a139035777e39aa22ef7ce9bc89513eca3]
18:34:29.962 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
18:34:29.962 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
18:34:29.964 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 10814f1d59fcd99a78ee67839fefe7a139035777e39aa22ef7ce9bc89513eca3 finished by subtask 2; deferring removal (restored in pending)
18:34:29.964 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:29.968 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:29.969 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.6.245.1
18:34:29.971 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:29.983 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:34:29.988 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xca66e2bc, L:/127.0.0.1:54830 - R:/127.6.245.1:39053] using SASL/PLAIN
18:34:29.995 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305362102648832001) for scanner KuduScanner(table=replication_test_table, tablet=109afb7829a5484a844e346132a776be, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:34:29.996 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [ddf45bc9bfee7051226ff6bc0da5e1a6e34186ae19eb8faf9b5d4a19be12acae]
18:34:29.996 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [ddf45bc9bfee7051226ff6bc0da5e1a6e34186ae19eb8faf9b5d4a19be12acae]
18:34:29.996 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
18:34:29.996 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
18:34:29.997 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:29.997 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:29.997 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split ddf45bc9bfee7051226ff6bc0da5e1a6e34186ae19eb8faf9b5d4a19be12acae finished by subtask 3; deferring removal (restored in pending)
18:34:29.997 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:29.997 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
18:34:29.997 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
18:34:29.998 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:30.020 [DEBUG - main] (Connection.java:575) [peer 2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)] disconnecting while in state READY
18:34:30.020 [DEBUG - main] (Connection.java:575) [peer master-127.6.245.62:36853(127.6.245.62:36853)] disconnecting while in state READY
18:34:30.020 [DEBUG - main] (Connection.java:575) [peer master-127.6.245.60:46787(127.6.245.60:46787)] disconnecting while in state READY
18:34:30.020 [DEBUG - main] (Connection.java:575) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] disconnecting while in state READY
18:34:30.020 [DEBUG - main] (Connection.java:575) [peer master-127.6.245.61:44495(127.6.245.61:44495)] disconnecting while in state READY
18:34:30.020 [DEBUG - main] (Connection.java:575) [peer 82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)] disconnecting while in state READY
18:34:30.020 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)] handling channelInactive
18:34:30.021 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 2f76c37f74624d8aa5906e77684cad01(127.6.245.2:40933)] cleaning up while in state READY due to: connection closed
18:34:30.021 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.6.245.60:46787(127.6.245.60:46787)] handling channelInactive
18:34:30.021 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state READY due to: connection closed
18:34:30.021 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.6.245.62:36853(127.6.245.62:36853)] handling channelInactive
18:34:30.021 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:30.021 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state READY due to: connection closed
18:34:30.021 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:30.021 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:30.020 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.6.245.61:44495(127.6.245.61:44495)] handling channelInactive
18:34:30.022 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state READY due to: connection closed
18:34:30.023 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
18:34:30.023 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
18:34:30.024 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:34:30.024 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 28 thread-local buffer(s) from thread: kudu-nio-1
18:34:30.024 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-4
18:34:30.032 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:30.032 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:30.032 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:34:30.032 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
18:34:30.034 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)] handling channelInactive
18:34:30.034 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 82d9e0a8932940ac9e0041e68e8c7ff0(127.6.245.3:45063)] cleaning up while in state READY due to: connection closed
18:34:30.034 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-5
18:34:30.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:30.035456  7124 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 7424
18:34:30.052 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] handling channelInactive
18:34:30.053 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b4d808b605e47d0a90dce37fd8ecb5f(127.6.245.1:39053)] cleaning up while in state READY due to: connection closed
18:34:30.053 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:34:30.056 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
18:34:30.087 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state RESTARTING to RUNNING.
18:34:30.088 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:30.088 [INFO - flink-pekko.actor.default-dispatcher-10] (CheckpointCoordinator.java:1805) Restoring job f6e63683f34d031c5da392b08baea20c from Checkpoint 74 @ 1783535501335 for f6e63683f34d031c5da392b08baea20c located at file:/tmp/junit4154231101817438778/checkpoints/f6e63683f34d031c5da392b08baea20c/chk-74.
18:34:30.089 [INFO - flink-pekko.actor.default-dispatcher-10] (MasterHooks.java:201) No master state to restore
18:34:30.089 [INFO - flink-pekko.actor.default-dispatcher-10] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:34:30.103 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to SCHEDULED.
18:34:30.104 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from SCHEDULED to DEPLOYING.
18:34:30.104 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #6) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 13a0441c1420d35b57a28ebd584f9846
18:34:30.104 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CREATED to SCHEDULED.
18:34:30.104 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:30.105 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:30.105 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:30.105 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from SCHEDULED to DEPLOYING.
18:34:30.105 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #7) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id e5ed6e64fe4e0a504f52a2cb8573a359
18:34:30.105 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CREATED to SCHEDULED.
18:34:30.105 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.105 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.105 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.105 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from SCHEDULED to DEPLOYING.
18:34:30.105 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #7) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8c518d750e8767059e15b0e0577096dd
18:34:30.106 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to SCHEDULED.
18:34:30.106 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from SCHEDULED to DEPLOYING.
18:34:30.106 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #6) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8ff5a8fd5a1d7f8775f563b9a37bf60a
18:34:30.106 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:34:30.107 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.107 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.107 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.107 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 13a0441c1420d35b57a28ebd584f9846.
18:34:30.107 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.107 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.107 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.107 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:30.108 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29556), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [12ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [13ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [14ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [14ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [29ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [30ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [31ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [31ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [50ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [52ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [52ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [52ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [62ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [63ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [82ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [82ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [82ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [82ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [101ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [102ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [103ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [143ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [183ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [183ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [262ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [282ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [282ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [283ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1003ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2641ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2642ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [5441ms] refreshing cache from master, [5442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [5442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [5442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [5442ms] too many traces: truncated at 100 traces, deferred=Deferred@946578385(state=PENDING, result=null, callback=(continuation of Deferred@227841894 after retry RPC after error@1096898888) -> (continuation of Deferred@854497102 after retry RPC after error@1476321257) -> (continuation of Deferred@2121813463 after retry RPC after error@890826825) -> (continuation of Deferred@1938445635 after retry RPC after error@1386925388) -> (continuation of Deferred@1845503035 after retry RPC after error@484973322) -> (continuation of Deferred@1038706073 after retry RPC after error@959258565) -> (continuation of Deferred@1457771815 after retry RPC after error@168797370) -> (continuation of Deferred@2084363727 after retry RPC after error@759051962) -> (continuation of Deferred@1698464983 after retry RPC after error@316786366) -> (continuation of Deferred@145339272 after retry RPC after error@1417596865) -> (continuation of Deferred@1432744869 after retry RPC after error@1236077441) -> (continuation of Deferred@207475919 after retry RPC after error@780079682) -> (continuation of Deferred@1417491699 after retry RPC after error@1965939966) -> (continuation of Deferred@389317944 after retry RPC after error@1091532958) -> (continuation of Deferred@2095580896 after retry RPC after error@1731850159) -> (continuation of Deferred@1410841397 after retry RPC after error@1860629153) -> (continuation of Deferred@1376069275 after retry RPC after error@2062155747) -> (continuation of Deferred@332283288 after retry RPC after error@1256502970) -> (continuation of Deferred@833515651 after retry RPC after error@67995570) -> (continuation of Deferred@1716340822 after retry RPC after error@158556995) -> (continuation of Deferred@1260073094 after retry RPC after error@599985728) -> (continuation of Deferred@792788374 after retry RPC after error@1027340870) -> (continuation of Deferred@800485991 after retry RPC after error@339531999), errback=(continuation of Deferred@227841894 after retry RPC after error@1096898888) -> (continuation of Deferred@854497102 after retry RPC after error@1476321257) -> (continuation of Deferred@2121813463 after retry RPC after error@890826825) -> (continuation of Deferred@1938445635 after retry RPC after error@1386925388) -> (continuation of Deferred@1845503035 after retry RPC after error@484973322) -> (continuation of Deferred@1038706073 after retry RPC after error@959258565) -> (continuation of Deferred@1457771815 after retry RPC after error@168797370) -> (continuation of Deferred@2084363727 after retry RPC after error@759051962) -> (continuation of Deferred@1698464983 after retry RPC after error@316786366) -> (continuation of Deferred@145339272 after retry RPC after error@1417596865) -> (continuation of Deferred@1432744869 after retry RPC after error@1236077441) -> (continuation of Deferred@207475919 after retry RPC after error@780079682) -> (continuation of Deferred@1417491699 after retry RPC after error@1965939966) -> (continuation of Deferred@389317944 after retry RPC after error@1091532958) -> (continuation of Deferred@2095580896 after retry RPC after error@1731850159) -> (continuation of Deferred@1410841397 after retry RPC after error@1860629153) -> (continuation of Deferred@1376069275 after retry RPC after error@2062155747) -> (continuation of Deferred@332283288 after retry RPC after error@1256502970) -> (continuation of Deferred@833515651 after retry RPC after error@67995570) -> (continuation of Deferred@1716340822 after retry RPC after error@158556995) -> (continuation of Deferred@1260073094 after retry RPC after error@599985728) -> (continuation of Deferred@792788374 after retry RPC after error@1027340870) -> (continuation of Deferred@800485991 after retry RPC after error@339531999)))
18:34:30.108 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_6), deploy into slot with allocation id 13a0441c1420d35b57a28ebd584f9846.
18:34:30.109 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:30.109 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:30.109 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:30.109 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.109 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.109 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.110 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.110 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.110 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.110 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.110 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.110 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.110 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:30.110 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29556), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [12ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [13ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [14ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [14ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [29ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [30ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [31ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [31ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [50ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [52ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [52ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [52ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [62ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [63ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [82ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [82ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [82ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [82ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [101ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [102ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [103ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [143ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [183ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [183ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [262ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [282ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [282ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [283ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1003ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2641ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2642ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [5441ms] refreshing cache from master, [5442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [5442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [5442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [5442ms] too many traces: truncated at 100 traces, deferred=Deferred@946578385(state=PENDING, result=null, callback=(continuation of Deferred@227841894 after retry RPC after error@1096898888) -> (continuation of Deferred@854497102 after retry RPC after error@1476321257) -> (continuation of Deferred@2121813463 after retry RPC after error@890826825) -> (continuation of Deferred@1938445635 after retry RPC after error@1386925388) -> (continuation of Deferred@1845503035 after retry RPC after error@484973322) -> (continuation of Deferred@1038706073 after retry RPC after error@959258565) -> (continuation of Deferred@1457771815 after retry RPC after error@168797370) -> (continuation of Deferred@2084363727 after retry RPC after error@759051962) -> (continuation of Deferred@1698464983 after retry RPC after error@316786366) -> (continuation of Deferred@145339272 after retry RPC after error@1417596865) -> (continuation of Deferred@1432744869 after retry RPC after error@1236077441) -> (continuation of Deferred@207475919 after retry RPC after error@780079682) -> (continuation of Deferred@1417491699 after retry RPC after error@1965939966) -> (continuation of Deferred@389317944 after retry RPC after error@1091532958) -> (continuation of Deferred@2095580896 after retry RPC after error@1731850159) -> (continuation of Deferred@1410841397 after retry RPC after error@1860629153) -> (continuation of Deferred@1376069275 after retry RPC after error@2062155747) -> (continuation of Deferred@332283288 after retry RPC after error@1256502970) -> (continuation of Deferred@833515651 after retry RPC after error@67995570) -> (continuation of Deferred@1716340822 after retry RPC after error@158556995) -> (continuation of Deferred@1260073094 after retry RPC after error@599985728) -> (continuation of Deferred@792788374 after retry RPC after error@1027340870) -> (continuation of Deferred@800485991 after retry RPC after error@339531999), errback=(continuation of Deferred@227841894 after retry RPC after error@1096898888) -> (continuation of Deferred@854497102 after retry RPC after error@1476321257) -> (continuation of Deferred@2121813463 after retry RPC after error@890826825) -> (continuation of Deferred@1938445635 after retry RPC after error@1386925388) -> (continuation of Deferred@1845503035 after retry RPC after error@484973322) -> (continuation of Deferred@1038706073 after retry RPC after error@959258565) -> (continuation of Deferred@1457771815 after retry RPC after error@168797370) -> (continuation of Deferred@2084363727 after retry RPC after error@759051962) -> (continuation of Deferred@1698464983 after retry RPC after error@316786366) -> (continuation of Deferred@145339272 after retry RPC after error@1417596865) -> (continuation of Deferred@1432744869 after retry RPC after error@1236077441) -> (continuation of Deferred@207475919 after retry RPC after error@780079682) -> (continuation of Deferred@1417491699 after retry RPC after error@1965939966) -> (continuation of Deferred@389317944 after retry RPC after error@1091532958) -> (continuation of Deferred@2095580896 after retry RPC after error@1731850159) -> (continuation of Deferred@1410841397 after retry RPC after error@1860629153) -> (continuation of Deferred@1376069275 after retry RPC after error@2062155747) -> (continuation of Deferred@332283288 after retry RPC after error@1256502970) -> (continuation of Deferred@833515651 after retry RPC after error@67995570) -> (continuation of Deferred@1716340822 after retry RPC after error@158556995) -> (continuation of Deferred@1260073094 after retry RPC after error@599985728) -> (continuation of Deferred@792788374 after retry RPC after error@1027340870) -> (continuation of Deferred@800485991 after retry RPC after error@339531999)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29556), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [12ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [13ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [14ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [14ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [29ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [30ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [31ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [31ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [50ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [52ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [52ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [52ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [62ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [63ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [82ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [82ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [82ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [82ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [101ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [102ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [103ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [143ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [183ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [183ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [262ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [282ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [282ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [283ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1003ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2641ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2642ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [5441ms] refreshing cache from master, [5442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [5442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [5442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [5442ms] too many traces: truncated at 100 traces, deferred=Deferred@946578385(state=PENDING, result=null, callback=(continuation of Deferred@227841894 after retry RPC after error@1096898888) -> (continuation of Deferred@854497102 after retry RPC after error@1476321257) -> (continuation of Deferred@2121813463 after retry RPC after error@890826825) -> (continuation of Deferred@1938445635 after retry RPC after error@1386925388) -> (continuation of Deferred@1845503035 after retry RPC after error@484973322) -> (continuation of Deferred@1038706073 after retry RPC after error@959258565) -> (continuation of Deferred@1457771815 after retry RPC after error@168797370) -> (continuation of Deferred@2084363727 after retry RPC after error@759051962) -> (continuation of Deferred@1698464983 after retry RPC after error@316786366) -> (continuation of Deferred@145339272 after retry RPC after error@1417596865) -> (continuation of Deferred@1432744869 after retry RPC after error@1236077441) -> (continuation of Deferred@207475919 after retry RPC after error@780079682) -> (continuation of Deferred@1417491699 after retry RPC after error@1965939966) -> (continuation of Deferred@389317944 after retry RPC after error@1091532958) -> (continuation of Deferred@2095580896 after retry RPC after error@1731850159) -> (continuation of Deferred@1410841397 after retry RPC after error@1860629153) -> (continuation of Deferred@1376069275 after retry RPC after error@2062155747) -> (continuation of Deferred@332283288 after retry RPC after error@1256502970) -> (continuation of Deferred@833515651 after retry RPC after error@67995570) -> (continuation of Deferred@1716340822 after retry RPC after error@158556995) -> (continuation of Deferred@1260073094 after retry RPC after error@599985728) -> (continuation of Deferred@792788374 after retry RPC after error@1027340870) -> (continuation of Deferred@800485991 after retry RPC after error@339531999), errback=(continuation of Deferred@227841894 after retry RPC after error@1096898888) -> (continuation of Deferred@854497102 after retry RPC after error@1476321257) -> (continuation of Deferred@2121813463 after retry RPC after error@890826825) -> (continuation of Deferred@1938445635 after retry RPC after error@1386925388) -> (continuation of Deferred@1845503035 after retry RPC after error@484973322) -> (continuation of Deferred@1038706073 after retry RPC after error@959258565) -> (continuation of Deferred@1457771815 after retry RPC after error@168797370) -> (continuation of Deferred@2084363727 after retry RPC after error@759051962) -> (continuation of Deferred@1698464983 after retry RPC after error@316786366) -> (continuation of Deferred@145339272 after retry RPC after error@1417596865) -> (continuation of Deferred@1432744869 after retry RPC after error@1236077441) -> (continuation of Deferred@207475919 after retry RPC after error@780079682) -> (continuation of Deferred@1417491699 after retry RPC after error@1965939966) -> (continuation of Deferred@389317944 after retry RPC after error@1091532958) -> (continuation of Deferred@2095580896 after retry RPC after error@1731850159) -> (continuation of Deferred@1410841397 after retry RPC after error@1860629153) -> (continuation of Deferred@1376069275 after retry RPC after error@2062155747) -> (continuation of Deferred@332283288 after retry RPC after error@1256502970) -> (continuation of Deferred@833515651 after retry RPC after error@67995570) -> (continuation of Deferred@1716340822 after retry RPC after error@158556995) -> (continuation of Deferred@1260073094 after retry RPC after error@599985728) -> (continuation of Deferred@792788374 after retry RPC after error@1027340870) -> (continuation of Deferred@800485991 after retry RPC after error@339531999)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.0.106.253:45189
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:30.114 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:34:30.163 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot e5ed6e64fe4e0a504f52a2cb8573a359.
18:34:30.164 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:30.164 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:30.164 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:30.165 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_7), deploy into slot with allocation id e5ed6e64fe4e0a504f52a2cb8573a359.
18:34:30.165 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.165 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.165 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.165 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.165 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.165 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.165 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:30.154179  7851 connection.cc:573] client connection to 127.6.245.1:39053 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:34:30.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:30.154696  7851 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:34:30.168 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29556), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [12ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [13ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [14ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [14ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [29ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [30ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [31ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [31ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [50ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [52ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [52ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [52ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [62ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [63ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [82ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [82ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [82ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [82ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [101ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [102ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [103ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [143ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [183ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [183ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [262ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [282ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [282ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [283ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1003ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2641ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2642ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [5441ms] refreshing cache from master, [5442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [5442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [5442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [5442ms] too many traces: truncated at 100 traces, deferred=Deferred@946578385(state=PENDING, result=null, callback=(continuation of Deferred@227841894 after retry RPC after error@1096898888) -> (continuation of Deferred@854497102 after retry RPC after error@1476321257) -> (continuation of Deferred@2121813463 after retry RPC after error@890826825) -> (continuation of Deferred@1938445635 after retry RPC after error@1386925388) -> (continuation of Deferred@1845503035 after retry RPC after error@484973322) -> (continuation of Deferred@1038706073 after retry RPC after error@959258565) -> (continuation of Deferred@1457771815 after retry RPC after error@168797370) -> (continuation of Deferred@2084363727 after retry RPC after error@759051962) -> (continuation of Deferred@1698464983 after retry RPC after error@316786366) -> (continuation of Deferred@145339272 after retry RPC after error@1417596865) -> (continuation of Deferred@1432744869 after retry RPC after error@1236077441) -> (continuation of Deferred@207475919 after retry RPC after error@780079682) -> (continuation of Deferred@1417491699 after retry RPC after error@1965939966) -> (continuation of Deferred@389317944 after retry RPC after error@1091532958) -> (continuation of Deferred@2095580896 after retry RPC after error@1731850159) -> (continuation of Deferred@1410841397 after retry RPC after error@1860629153) -> (continuation of Deferred@1376069275 after retry RPC after error@2062155747) -> (continuation of Deferred@332283288 after retry RPC after error@1256502970) -> (continuation of Deferred@833515651 after retry RPC after error@67995570) -> (continuation of Deferred@1716340822 after retry RPC after error@158556995) -> (continuation of Deferred@1260073094 after retry RPC after error@599985728) -> (continuation of Deferred@792788374 after retry RPC after error@1027340870) -> (continuation of Deferred@800485991 after retry RPC after error@339531999), errback=(continuation of Deferred@227841894 after retry RPC after error@1096898888) -> (continuation of Deferred@854497102 after retry RPC after error@1476321257) -> (continuation of Deferred@2121813463 after retry RPC after error@890826825) -> (continuation of Deferred@1938445635 after retry RPC after error@1386925388) -> (continuation of Deferred@1845503035 after retry RPC after error@484973322) -> (continuation of Deferred@1038706073 after retry RPC after error@959258565) -> (continuation of Deferred@1457771815 after retry RPC after error@168797370) -> (continuation of Deferred@2084363727 after retry RPC after error@759051962) -> (continuation of Deferred@1698464983 after retry RPC after error@316786366) -> (continuation of Deferred@145339272 after retry RPC after error@1417596865) -> (continuation of Deferred@1432744869 after retry RPC after error@1236077441) -> (continuation of Deferred@207475919 after retry RPC after error@780079682) -> (continuation of Deferred@1417491699 after retry RPC after error@1965939966) -> (continuation of Deferred@389317944 after retry RPC after error@1091532958) -> (continuation of Deferred@2095580896 after retry RPC after error@1731850159) -> (continuation of Deferred@1410841397 after retry RPC after error@1860629153) -> (continuation of Deferred@1376069275 after retry RPC after error@2062155747) -> (continuation of Deferred@332283288 after retry RPC after error@1256502970) -> (continuation of Deferred@833515651 after retry RPC after error@67995570) -> (continuation of Deferred@1716340822 after retry RPC after error@158556995) -> (continuation of Deferred@1260073094 after retry RPC after error@599985728) -> (continuation of Deferred@792788374 after retry RPC after error@1027340870) -> (continuation of Deferred@800485991 after retry RPC after error@339531999)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29556), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [12ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [13ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [14ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [14ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [29ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [30ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [31ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [31ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [50ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [52ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [52ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [52ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [62ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [63ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [82ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [82ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [82ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [82ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [101ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [102ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [103ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [103ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [143ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [183ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [183ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [262ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [262ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [282ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [282ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [283ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [283ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1003ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2641ms] refreshing cache from master, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2642ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [5441ms] refreshing cache from master, [5442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [5442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [5442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [5442ms] too many traces: truncated at 100 traces, deferred=Deferred@946578385(state=PENDING, result=null, callback=(continuation of Deferred@227841894 after retry RPC after error@1096898888) -> (continuation of Deferred@854497102 after retry RPC after error@1476321257) -> (continuation of Deferred@2121813463 after retry RPC after error@890826825) -> (continuation of Deferred@1938445635 after retry RPC after error@1386925388) -> (continuation of Deferred@1845503035 after retry RPC after error@484973322) -> (continuation of Deferred@1038706073 after retry RPC after error@959258565) -> (continuation of Deferred@1457771815 after retry RPC after error@168797370) -> (continuation of Deferred@2084363727 after retry RPC after error@759051962) -> (continuation of Deferred@1698464983 after retry RPC after error@316786366) -> (continuation of Deferred@145339272 after retry RPC after error@1417596865) -> (continuation of Deferred@1432744869 after retry RPC after error@1236077441) -> (continuation of Deferred@207475919 after retry RPC after error@780079682) -> (continuation of Deferred@1417491699 after retry RPC after error@1965939966) -> (continuation of Deferred@389317944 after retry RPC after error@1091532958) -> (continuation of Deferred@2095580896 after retry RPC after error@1731850159) -> (continuation of Deferred@1410841397 after retry RPC after error@1860629153) -> (continuation of Deferred@1376069275 after retry RPC after error@2062155747) -> (continuation of Deferred@332283288 after retry RPC after error@1256502970) -> (continuation of Deferred@833515651 after retry RPC after error@67995570) -> (continuation of Deferred@1716340822 after retry RPC after error@158556995) -> (continuation of Deferred@1260073094 after retry RPC after error@599985728) -> (continuation of Deferred@792788374 after retry RPC after error@1027340870) -> (continuation of Deferred@800485991 after retry RPC after error@339531999), errback=(continuation of Deferred@227841894 after retry RPC after error@1096898888) -> (continuation of Deferred@854497102 after retry RPC after error@1476321257) -> (continuation of Deferred@2121813463 after retry RPC after error@890826825) -> (continuation of Deferred@1938445635 after retry RPC after error@1386925388) -> (continuation of Deferred@1845503035 after retry RPC after error@484973322) -> (continuation of Deferred@1038706073 after retry RPC after error@959258565) -> (continuation of Deferred@1457771815 after retry RPC after error@168797370) -> (continuation of Deferred@2084363727 after retry RPC after error@759051962) -> (continuation of Deferred@1698464983 after retry RPC after error@316786366) -> (continuation of Deferred@145339272 after retry RPC after error@1417596865) -> (continuation of Deferred@1432744869 after retry RPC after error@1236077441) -> (continuation of Deferred@207475919 after retry RPC after error@780079682) -> (continuation of Deferred@1417491699 after retry RPC after error@1965939966) -> (continuation of Deferred@389317944 after retry RPC after error@1091532958) -> (continuation of Deferred@2095580896 after retry RPC after error@1731850159) -> (continuation of Deferred@1410841397 after retry RPC after error@1860629153) -> (continuation of Deferred@1376069275 after retry RPC after error@2062155747) -> (continuation of Deferred@332283288 after retry RPC after error@1256502970) -> (continuation of Deferred@833515651 after retry RPC after error@67995570) -> (continuation of Deferred@1716340822 after retry RPC after error@158556995) -> (continuation of Deferred@1260073094 after retry RPC after error@599985728) -> (continuation of Deferred@792788374 after retry RPC after error@1027340870) -> (continuation of Deferred@800485991 after retry RPC after error@339531999)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.0.106.253:45189
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:30.169 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 8c518d750e8767059e15b0e0577096dd.
18:34:30.169 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:34:30.170 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:30.170 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:34:30.170 [INFO - Thread-67] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:34:30.171 [DEBUG - Thread-67] (Connection.java:575) [peer master-127.30.11.253:35677(127.30.11.253:35677)] disconnecting while in state TERMINATED
18:34:30.171 [DEBUG - Thread-67] (Connection.java:575) [peer master-127.30.11.252:39405(127.30.11.252:39405)] disconnecting while in state TERMINATED
18:34:30.171 [DEBUG - Thread-67] (Connection.java:575) [peer master-127.30.11.254:41811(127.30.11.254:41811)] disconnecting while in state TERMINATED
18:34:30.171 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:30.172 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_7), deploy into slot with allocation id 8c518d750e8767059e15b0e0577096dd.
18:34:30.165 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to DEPLOYING.
18:34:30.173 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_6) [DEPLOYING].
18:34:30.173 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@187a60c
18:34:30.174 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:30.174 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:34:30.174 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
18:34:30.165 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.165 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.175 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:30.175 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
18:34:30.176 [INFO - Thread-67] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:34:30.176 [INFO - Thread-67] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:34:30.177 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:34:30.178 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_6), deploy into slot with allocation id 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:34:30.179 [DEBUG - Thread-67] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:30.179 [INFO - Thread-67] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:34:30.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:30.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:30.181 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5660dd52
18:34:30.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:30.182189  7124 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 7689
18:34:30.184 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:30.185 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:30.185 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:30.185 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:30.172 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CREATED to DEPLOYING.
18:34:30.185 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_7) [DEPLOYING].
18:34:30.185 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.185 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.185 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.185 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.185 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.186 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.186 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.185 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.186 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.186 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:30.186 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4a75c502
18:34:30.186 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:30.186 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:34:30.186 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from DEPLOYING to INITIALIZING.
18:34:30.187 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from DEPLOYING to INITIALIZING.
18:34:30.191 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@43b3afcb
18:34:30.196 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to DEPLOYING.
18:34:30.197 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_6) [DEPLOYING].
18:34:30.199 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6a1bf35
18:34:30.199 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:30.199 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:34:30.199 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
18:34:30.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:30.200088  7851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.245.1:39053, user_credentials={real_user=slave}} blocked reactor thread for 45350.8us
18:34:30.201 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:30.202 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
18:34:30.203 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:30.203 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:30.203 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:30.203 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:30.204 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:30.204 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:30.204 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:30.204 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CREATED to DEPLOYING.
18:34:30.204 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_7) [DEPLOYING].
18:34:30.208 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7f43d474
18:34:30.208 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:30.208 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:34:30.208 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.208 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.208 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.209 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from DEPLOYING to INITIALIZING.
18:34:30.209 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from DEPLOYING to INITIALIZING.
18:34:30.210 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.210 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.210 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.210 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.210 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.210 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.210 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:30.210 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@9bc9b20
18:34:30.214 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:30.217 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.218 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.226 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:30.226 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:30.226 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:30.226 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.226 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1a8c48df
18:34:30.226 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.226 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.227 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.227 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.227 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.227 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.227 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.227 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.228 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:30.229 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:30.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:30.231990  7851 consensus_peers.cc:597] T 109afb7829a5484a844e346132a776be P 82d9e0a8932940ac9e0041e68e8c7ff0 -> Peer 2b4d808b605e47d0a90dce37fd8ecb5f (127.6.245.1:39053): Couldn't send request to peer 2b4d808b605e47d0a90dce37fd8ecb5f. Status: Network error: Client connection negotiation failed: client connection to 127.6.245.1:39053: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
18:34:30.239 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.240 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.241 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.241 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.241 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.241 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.242 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.242 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.242 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.243 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:30.243 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.243 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.243 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.243 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.243 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.244 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:30.244 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.244 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.244 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.244 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.245 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.245 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:30.245 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.245 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.245 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.245 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.245 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.245 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.245 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.246 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.246 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.246 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.246 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.246 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.246 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.246 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:30.247 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.247 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.247 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.247 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.247 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.248 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.248 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.248 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.248 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.248 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.248 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.248 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.249 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.249 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.249 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.249 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.249 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.249 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.249 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.249 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.250 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.250 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.250 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.250 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.250 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.250 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.250 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.258 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.259 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.259 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.259 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.259 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.260 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.260 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.260 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.260 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.260 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.260 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.260 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.260 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.260 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.261 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.261 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:30.262 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:30.262 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:30.262 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:30.262 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:30.262 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:30.262 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:30.262 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:30.262 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:30.262 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:30.262 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:30.262 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:30.263 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:30.263 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.263 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:30.264 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:30.264 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:30.265 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:30.265 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.265 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.265 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.265 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.265 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.265 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.265 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.265 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.265 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.265 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.265 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.265 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.265 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.265 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.265 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:30.266 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.266 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.266 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.266 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.266 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.266 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.266 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.266 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:30.267 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.267 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.267 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.267 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:30.267 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.268 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.268 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.268 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.268 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.268 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.268 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.269 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.269 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.269 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.269 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.269 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.270 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.270 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.270 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:30.270 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.270 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.270 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.270 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.271 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.271 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.271 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.271 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.275 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.276 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.276 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.276 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.276 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.276 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.276 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.276 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:30.278061  7124 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 7830
18:34:30.279 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.279 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.280 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.280 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.283 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:30.284 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.287 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.288 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.288 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.288 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.288 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.288 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.288 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.288 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.288 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.289 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.289 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.289 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.289 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.289 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.289 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.290 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.290 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.290 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.290 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.291 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:30.291 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.291 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.292 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.292 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:30.292 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.292 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.292 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.292 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.292 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.292 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.292 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.292 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.292 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.293 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.293 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.293 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.293 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.293 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.293 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.293 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.293 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.293 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.293 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.293 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.293 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.293 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.293 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:30.293 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.293 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.293 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.293 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.294 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.294 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.294 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.294 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.294 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.294 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.294 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.294 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.299 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.299 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.300 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.300 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.300 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.300 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.300 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.300 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.300 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.300 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.300 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.300 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.300 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.300 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.301 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.301 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.301 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.301 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.301 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.301 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.301 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.301 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.301 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.301 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.303 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.303 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:30.303 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.303 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:30.303 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.303 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.303 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.303 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:30.303 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.303 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.303 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.303 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.304 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.304 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.304 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.304 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.304 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:30.304 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.304 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.304 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:30.304 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:30.304 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.304 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.304 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.304 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.304 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.304 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.305 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.305 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.305 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.305 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.305 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.305 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.305 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.305 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:30.305 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.305 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.305 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.305 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:30.318 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.319 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.319 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.319 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.319 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.319 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.319 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.319 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.319 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.319 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.319 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.319 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.319 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.320 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.320 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.320 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.320 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.320 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.320 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.319 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.320 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.320 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:30.320 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.320 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.320 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.320 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.320 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:30.320 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.320 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:30.320 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:30.321 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:30.320 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.320 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.321 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.321 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.321 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.321 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:30.321 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:30.321 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:30.321 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.320 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:30.320 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.321 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.321 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.322 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.322 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:30.322 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.322 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.322 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.322 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:30.322 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:30.322 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:30.323 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.323 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.324 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:30.324 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.324 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:30.324 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.324 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.324 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:30.324 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.324 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.324 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.324 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.324 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.324 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.324 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.324 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.324 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.324 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.324 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.325 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.325 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.325 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.325 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.325 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.325 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.325 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:30.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535670333 for job 41f18052e8363382138bde77e16b10c3.
18:34:30.338 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.338 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.339 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.339 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.339 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.339 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.339 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.339 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.339 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.340 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.340 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.340 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.340 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.343 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:30.343 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:30.343 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:30.344 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.344 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:30.343982  7124 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 7136
18:34:30.344 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.344 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.344 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.345 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.345 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.345 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.345 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 41f18052e8363382138bde77e16b10c3 (3016 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:34:30.345 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.345 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:30.346 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
18:34:30.346 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 8e062b1e88303821668cf68e0419e447d616d9ec14d212caea7dca3f5200949c from pending
18:34:30.347 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 10814f1d59fcd99a78ee67839fefe7a139035777e39aa22ef7ce9bc89513eca3 from pending
18:34:30.347 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split ddf45bc9bfee7051226ff6bc0da5e1a6e34186ae19eb8faf9b5d4a19be12acae from pending
18:34:30.347 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 12 complete: removed 3 finished splits from enumerator state
18:34:30.358 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.358 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.359 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.359 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.359 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.359 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.359 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.359 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.359 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.359 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.359 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.359 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.359 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.359 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.359 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.359 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.359 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.359 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.360 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.360 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.360 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.360 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.360 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.360 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.360 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.360 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.360 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.360 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.360 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.360 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.360 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.360 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.360 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.361 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.361 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.361 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.361 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.361 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.361 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.363 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.363 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.363 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.364 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.364 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.364 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.364 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.364 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.364 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.364 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.364 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.364 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.364 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.365 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:30.365 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:30.365 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:30.366 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:30.366 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:30.366 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:30.366 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:30.366 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:30.366 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:30.366 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:30.366 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:30.366 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:30.366 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:30.378 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.378 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.378 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.379 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.379 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.379 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.379 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.379 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.379 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.379 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.379 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.379 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.379 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.384 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.384 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.384 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.384 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.384 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.384 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.384 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.384 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.384 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.384 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.384 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.384 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.384 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.393 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.6.245.62:36853(127.6.245.62:36853)] handling channelInactive
18:34:30.394 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state READY due to: connection closed
18:34:30.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:30.395015  7124 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 7206
18:34:30.403 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:30.403 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:30.403 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:30.403 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.403 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.404 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.404 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.404 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.404 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.404 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.404 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.404 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.404 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:30.405 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:30.405 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:30.405 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:30.405 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.405 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.405 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.406 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.406 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.407 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.407 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.407 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.407 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.407 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:30.418 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.419 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.419 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.419 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.419 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.419 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.419 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.419 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.419 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.419 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.419 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.419 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.419 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.419 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.420 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.420 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.420 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.420 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.420 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.420 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.420 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.420 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.420 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.421 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.421 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.421 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.439 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.6.245.61:44495(127.6.245.61:44495)] handling channelInactive
18:34:30.440 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state READY due to: connection closed
18:34:30.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:30.447057  7124 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 7282
18:34:30.455 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:30.455 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:30.455 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:30.456 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:30.456 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:30.456 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:30.456 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:30.456 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:30.456 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:30.457 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:30.457 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:30.457 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:30.457 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:30.458 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.458 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.458 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.458 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.459 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.459 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.459 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.459 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.459 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.459 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.459 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.459 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.459 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.471 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:30.478 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.478 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.478 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.479 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.479 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.479 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.479 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.479 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.479 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.479 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.479 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.479 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.480 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.480 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.479 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.480 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.480 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.480 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.480 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.480 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.480 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.479 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.480 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.480 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.480 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.480 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.483 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:30.483 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:30.483 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.483 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:30.483 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.484 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.484 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.484 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.484 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.484 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.484 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.484 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.484 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:30.485 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.6.245.60:46787(127.6.245.60:46787)] handling channelInactive
18:34:30.485 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state READY due to: connection closed
18:34:30.505 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:30.505 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:30.505 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:30.505 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.505 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.505 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.505 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.505 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.505 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.506 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.506 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.506 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.506 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:30.518 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.518 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.518 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.519 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.519 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.519 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.519 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.519 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.519 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.519 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.519 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.519 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.519 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.521 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:30.522 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:30.522 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:30.522 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:30.522 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:30.522 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:30.522 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:30.522 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:30.522 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:30.522 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:30.522 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:30.522 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:30.522 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:30.523 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.523 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.523 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.523 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.523 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.523 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.524 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.524 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.524 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.524 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.524 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.524 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.524 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.538 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.538 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.538 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.539 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.539 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.539 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.539 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.539 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.539 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.539 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.539 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.539 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.539 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.539 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.539 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.539 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.539 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.539 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.540 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.540 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.540 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.540 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.540 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.540 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.540 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.540 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.560 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:30.560 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:30.560 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:30.560 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:30.561 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:30.561 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:30.561 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:30.561 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:30.561 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:30.561 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:30.561 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:30.561 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:30.561 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:30.588 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:30.599 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.599 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.600 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.600 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.600 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.600 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.600 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.600 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.600 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.600 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.600 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.600 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.600 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.621 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:30.621 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:30.621 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:30.621 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:30.621 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:30.622 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:30.622 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:30.622 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:30.622 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:30.622 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:30.622 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:30.622 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:30.622 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:30.641 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:30.641 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:30.641 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:30.641 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:30.641 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:30.641 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:30.641 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:30.641 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:30.641 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:30.641 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:30.642 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:30.642 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:30.642 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:30.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:30.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:30.683 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:30.683 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:30.683 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:30.683 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.683 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.683 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.683 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.683 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.684 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:30.684 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:30.684 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.684 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:30.684 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:30.719 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.719 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.719 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.719 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.719 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.720 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.720 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.720 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.720 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.720 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.720 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.720 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.720 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.723 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.723 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.723 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.724 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.724 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.724 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.724 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.724 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.724 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.724 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.724 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.724 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.724 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.745 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:30.745 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:30.745 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:30.745 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.745 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.745 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:30.745 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.745 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.746 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.746 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.746 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:30.746 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:30.746 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:30.793 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:30.794 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:30.794 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:30.794 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:30.794 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:30.794 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:30.794 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:30.794 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:30.794 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:30.794 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:30.794 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:30.795 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:30.795 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:30.818 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.818 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.819 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.819 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.819 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.819 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.819 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.819 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.819 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.819 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.819 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.820 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.820 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535670833 for job 41f18052e8363382138bde77e16b10c3.
18:34:30.846 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
18:34:30.847 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
18:34:30.904 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.904 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.904 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.904 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.904 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.904 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.904 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.904 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.905 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.905 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.905 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.905 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.905 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.919 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:30.919 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:30.919 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:30.920 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.920 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.920 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.920 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.920 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.920 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.920 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:30.920 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:30.920 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:30.920 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:30.971 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:31.023 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:31.023 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:31.024 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:31.024 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:31.024 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:31.024 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:31.024 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:31.024 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:31.024 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:31.024 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:31.024 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:31.025 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:31.025 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:31.062 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:31.062 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:31.062 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:31.062 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:31.062 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:31.062 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:31.062 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:31.062 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:31.062 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:31.062 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:31.063 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:31.063 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:31.063 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:31.087 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:31.144 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:31.144 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:31.144 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:31.144 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:31.144 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:31.144 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:31.144 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:31.144 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:31.144 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:31.145 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:31.145 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:31.145 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:31.145 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:31.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:31.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:31.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535671333 for job 41f18052e8363382138bde77e16b10c3.
18:34:31.343 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:34:31.344 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
18:34:31.388 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:31.389 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:31.389 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:31.389 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:31.389 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:31.390 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:31.390 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:31.389 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:31.390 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:31.390 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:31.390 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:31.390 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:31.390 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:31.398 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:31.399 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:31.399 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:31.399 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:31.399 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:31.399 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:31.400 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:31.400 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:31.400 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:31.400 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:31.400 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:31.400 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:31.400 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:31.471 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:31.560 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:31.560 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:31.560 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:31.560 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:31.560 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:31.560 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:31.560 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:31.561 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:31.561 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:31.561 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:31.561 [INFO - pool-506-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:31.561 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:31.561 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:31.564 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:31.564 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:31.564 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:31.564 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:31.564 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:31.564 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:31.565 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:31.565 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:31.565 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:31.565 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:31.565 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:31.565 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:31.565 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:31.581 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:31.582 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:31.582 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:31.582 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:31.582 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:31.582 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:31.582 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:31.582 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:31.582 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:31.582 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:31.582 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:31.582 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:31.582 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:31.583 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:31.583 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:31.583 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:31.583 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:31.584 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:31.584 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:31.584 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:31.584 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:31.584 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:31.584 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:31.584 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:31.584 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:31.584 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:31.587 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:31.592 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:31.593 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.593 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.593 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.6.245.60:46787(127.6.245.60:46787) for tablet Kudu Master: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.614 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:31.615 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:31.615 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.615 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:31.615 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.615 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.616 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.616 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.616 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.616 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.616 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.616 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.616 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:31.634 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:31.635 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:31.635 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:31.635 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.635 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.635 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.635 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.635 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.635 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.635 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.635 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.635 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.635 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:31.654 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:31.655 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:31.655 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:31.655 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.655 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.655 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.655 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.655 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.655 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.655 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.655 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.655 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.655 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:31.673 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:31.673 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:31.673 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:31.673 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:31.674 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:31.674 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:31.674 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:31.674 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:31.674 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:31.674 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:31.674 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:31.674 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.674 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:31.674 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.674 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.674 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:31.674 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:31.674 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:31.674 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:31.674 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.674 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.674 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.674 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.675 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.675 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.675 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:31.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:31.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:31.694 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:31.694 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:31.694 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:31.694 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.695 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.695 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.695 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.695 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.695 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.694 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.695 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.695 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.695 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:31.714 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:31.714 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:31.714 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:31.714 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.714 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.714 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.714 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.714 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.714 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.714 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.714 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.714 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.715 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:31.753 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:31.754 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:31.754 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:31.754 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.754 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.754 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.754 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.754 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.754 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.754 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.754 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.754 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.754 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:31.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:34:31Z chronyd exiting
18:34:31.823 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:31.823 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:31.823 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:31.824 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:31.824 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:31.824 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:31.824 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:31.824 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:31.824 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:31.824 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:31.824 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:31.824 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:31.824 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:31.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535671833 for job 41f18052e8363382138bde77e16b10c3.
18:34:31.842 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:31.842 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:31.842 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:31.842 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:31.842 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:31.842 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:31.842 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:31.842 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:31.842 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:31.842 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:31.842 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:31.842 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:31.843 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:31.843 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:34:31.844 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
18:34:31.894 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:31.894 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:31.894 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:31.895 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.895 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.895 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.895 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.895 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.895 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.895 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:31.895 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:31.895 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:31.895 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:31.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:32.054 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:32.054 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:32.054 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:32.054 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:32.055 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:32.055 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:32.055 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:32.055 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:32.055 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:32.055 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:32.055 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:32.055 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:32.055 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:32.087 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:32.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:32.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:32.185 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:32.185 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:32.185 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:32.186 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:32.186 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:32.186 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:32.186 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:32.186 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:32.186 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:32.186 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:32.186 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:32.186 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:32.186 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:32.214 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:32.214 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:32.214 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:32.215 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:32.215 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:32.215 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:32.215 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:32.215 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:32.215 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:32.215 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:32.215 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:32.215 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:32.215 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:32.222 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:32.222 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:32.222 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:32.223 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:32.223 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:32.223 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:32.223 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:32.223 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:32.223 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:32.223 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:32.223 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:32.223 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:32.223 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:32.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535672333 for job 41f18052e8363382138bde77e16b10c3.
18:34:32.342 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:32.342 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:32.342 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:32.342 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:32.343 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:34:32.343 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:32.343 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:32.343 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:32.343 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:32.343 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:32.343 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:32.343 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:32.343 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:32.343 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:32.344 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
18:34:32.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:32.588 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:32.609 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:32.610 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:32.610 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:32.610 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:32.610 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:32.610 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:32.610 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:32.610 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:32.610 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:32.610 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:32.610 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:32.610 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:32.610 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:32.620 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:32.620 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:32.620 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:32.621 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:32.621 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:32.621 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:32.621 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:32.621 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:32.621 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:32.621 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:32.621 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:32.621 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:32.621 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:32.674 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:32.674 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:32.674 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:32.674 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:32.674 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:32.674 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:32.674 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:32.674 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:32.674 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:32.675 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:32.675 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:32.675 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:32.675 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:32.679 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:32.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:32.718 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:32.718 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:32.718 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:32.718 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:32.719 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:32.718 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:32.719 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:32.719 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:32.719 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:32.719 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:32.719 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:32.719 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:32.719 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
.18:34:32.813 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783535672813
18:34:32.814 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783535672814
18:34:32.821 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
18:34:32.828 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
18:34:32.828 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
18:34:32.828 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskSwO0Je/test-tmp
18:34:32.829 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
18:34:32.829 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskSwO0Je/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
18:34:32.834 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

18:34:32.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535672833 for job 41f18052e8363382138bde77e16b10c3.
18:34:32.845 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:34:32.846 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
18:34:32.883 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:32.884 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:32.884 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:32.884 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:32.884 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:32.884 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:32.884 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:32.884 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:32.884 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:32.885 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:32.885 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:32.885 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:32.885 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:32.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:33.045 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:33.045 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:33.045 [DEBUG - pool-412-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:33.045 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:33.045 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:33.045 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:33.045 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:33.045 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:33.045 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:33.045 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:33.045 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:33.045 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:33.046 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:33.088 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:33.180 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:33.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:33.272 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:34:33.272 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

18:34:33.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:33.276446  9535 mini_oidc.cc:150] Starting JWKS server
18:34:33.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:33.281584  9535 webserver.cc:534] Webserver started at http://127.0.0.1:43255/ using document root <none> and password file <none>
18:34:33.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:33.282277  9535 mini_oidc.cc:186] Starting OIDC Discovery server
18:34:33.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:33.284770  9535 webserver.cc:534] Webserver started at http://127.0.0.1:41825/ using document root <none> and password file <none>
18:34:33.299 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:33.300 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:33.300 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:33.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:33.300 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:33.300 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:33.301 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:33.301 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:33.301 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:33.301 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:33.301 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:33.301 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:33.301 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:33.323 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:33.323 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:33.323 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:33.324 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:33.324 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:33.324 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:33.324 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:33.324 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:33.324 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:33.324 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:33.324 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:33.324 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:33.324 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:33.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535673333 for job 41f18052e8363382138bde77e16b10c3.
18:34:33.346 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:34:33.347 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
18:34:33.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:34:33Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
18:34:33.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:34:33Z Disabled control of system clock
18:34:33.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:33.378279  9535 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/wal
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/data
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/logs
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/data/info.pb
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.79.254:42669
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.79.254
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.79.212:43203
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.79.254:42669,127.9.79.253:36577,127.9.79.252:38727
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:34:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43255/jwks.json with env {}
18:34:33.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:33.500 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:33.500 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:33.500 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:33.501 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:33.501 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:33.501 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:33.501 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:33.501 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:33.501 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:33.501 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:33.501 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:33.501 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:33.501 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:33.588 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:33.680 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:33.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:33.795 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:33.795 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:33.796 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:33.796 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:33.796 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:33.796 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:33.796 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:33.796 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:33.796 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:33.796 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:33.797 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:33.797 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:33.797 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:33.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:33.804862  9547 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:34:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:33.806062  9547 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:34:33.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:33.807267  9547 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:34:33.826 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:33.826 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:33.826 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:33.826 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:33.826 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:33.827 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:33.827 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:33.827 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:33.827 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:33.827 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:33.827 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:33.827 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:33.827 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:33.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535673833 for job 41f18052e8363382138bde77e16b10c3.
18:34:33.842 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:34:33.843 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
18:34:33.844 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:33.844 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:33.844 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:33.844 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:33.844 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:33.844 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:33.845 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:33.845 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:33.845 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:33.845 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:33.845 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:33.845 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:33.845 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:33.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:33.854949  9547 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:34:33.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:33.855338  9547 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:34:33.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:33.855618  9547 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:34:33.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:33.855890  9547 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:34:33.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:33.856103  9547 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:34:33.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:33.856302  9547 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43255/jwks.json
18:34:33.869 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:33.869 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:33.869 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:33.870 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:33.870 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:33.870 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:33.870 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:33.870 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:33.870 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:33.870 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:33.870 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:33.870 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:33.870 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:33.880 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:33.881 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:33.881 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:33.881 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:33.881 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:33.881 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:33.881 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:33.881 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:33.881 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:33.881 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:33.881 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:33.881 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:33.881 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:33.883 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:33.883 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:33.883 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:33.883 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:33.883 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:33.884 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:33.884 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:33.884 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:33.884 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:33.884 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:33.884 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:33.884 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:33.884 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:33.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:33.905943  9547 master_runner.cc:387] Master server non-default flags:
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.79.212:43203
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/data
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/wal
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.79.254:42669,127.9.79.253:36577,127.9.79.252:38727
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.79.254:42669
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43255/jwks.json
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/data/info.pb
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.79.254
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/logs
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:34:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:34:33.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:33.907997  9547 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:34:33.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:33.909788  9547 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:34:33.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:33.923805  9553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:33.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:33.978 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:33.978 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:33.978 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:33.978 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:33.978 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:33.978 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:33.979 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:33.979 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:33.979 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:33.978 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:33.980 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:33.980 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:33.980 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:33.982 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9) switched from state RESTARTING to RUNNING.
18:34:33.984 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 4cd649562a0f5305571102b5c888c5a9 from Checkpoint 65 @ 1783535546001 for 4cd649562a0f5305571102b5c888c5a9 located at file:/tmp/junit5514029058471043739/checkpoints/4cd649562a0f5305571102b5c888c5a9/chk-65.
18:34:33.985 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
18:34:33.985 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:34:33.988 [INFO - Thread-69] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:34:33.988 [DEBUG - Thread-69] (Connection.java:575) [peer master-127.0.106.253:45189(127.0.106.253:45189)] disconnecting while in state TERMINATED
18:34:33.988 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to SCHEDULED.
18:34:33.988 [DEBUG - Thread-69] (Connection.java:575) [peer master-127.0.106.254:32967(127.0.106.254:32967)] disconnecting while in state TERMINATED
18:34:33.988 [DEBUG - Thread-69] (Connection.java:575) [peer master-127.0.106.252:46705(127.0.106.252:46705)] disconnecting while in state TERMINATED
18:34:33.989 [DEBUG - Thread-69] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:33.989 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:34:33.990 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from SCHEDULED to DEPLOYING.
18:34:33.990 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #6) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id d0320e7b86362daa97e494337af6f333
18:34:33.991 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to SCHEDULED.
18:34:33.991 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot d0320e7b86362daa97e494337af6f333.
18:34:33.991 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:34:33.992 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_6), deploy into slot with allocation id d0320e7b86362daa97e494337af6f333.
18:34:33.992 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from SCHEDULED to DEPLOYING.
18:34:33.992 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #6) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id c230971fad26d6cfa2b63ff44e7a1af5
18:34:33.992 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to SCHEDULED.
18:34:33.992 [INFO - Thread-69] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:34:33.992 [INFO - Thread-69] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:34:33.993 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from SCHEDULED to DEPLOYING.
18:34:33.993 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #6) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id 0abd8d1f15ad274a5029e6ed83960f8c
18:34:33.993 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to SCHEDULED.
18:34:33.993 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from SCHEDULED to DEPLOYING.
18:34:33.994 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #6) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id 163e6d56962e3a45c0e4353eb3be3a9b
18:34:33.994 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:33.994 [DEBUG - Thread-69] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:33.994 [INFO - Thread-69] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:34:33.994 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:34:33.996 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot c230971fad26d6cfa2b63ff44e7a1af5.
18:34:33.997 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:33.997 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:33.997 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:33.997 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:33.998 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_6), deploy into slot with allocation id c230971fad26d6cfa2b63ff44e7a1af5.
18:34:34.000 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to DEPLOYING.
18:34:34.000 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_6) [DEPLOYING].
18:34:34.001 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@650daaee
18:34:34.001 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:34.001 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:34:34.001 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
18:34:34.002 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
18:34:34.005 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 0abd8d1f15ad274a5029e6ed83960f8c.
18:34:34.005 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to DEPLOYING.
18:34:34.005 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_6) [DEPLOYING].
18:34:34.006 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_6), deploy into slot with allocation id 0abd8d1f15ad274a5029e6ed83960f8c.
18:34:34.006 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@52a7c843
18:34:34.008 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 163e6d56962e3a45c0e4353eb3be3a9b.
18:34:34.009 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1a7ac6e
18:34:34.009 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:34.009 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:34:34.009 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:34.009 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_6), deploy into slot with allocation id 163e6d56962e3a45c0e4353eb3be3a9b.
18:34:34.010 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
18:34:34.010 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to DEPLOYING.
18:34:34.010 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
18:34:34.010 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_6) [DEPLOYING].
18:34:34.010 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@794c2c98
18:34:34.010 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:34.011 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:34:34.011 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
18:34:34.012 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
18:34:34.013 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@41dbfbec
18:34:34.015 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:34.017 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@39915ee8
18:34:34.018 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:34.021 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:34.022 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:34.022 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:34.022 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:34.023 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:34.023 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:34.023 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:34.023 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:34.023 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:34.023 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:34.024 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:34.024 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:34.024 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:34.024 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:34.026 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to DEPLOYING.
18:34:34.026 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_6) [DEPLOYING].
18:34:34.026 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.027 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@b5e640a
18:34:34.027 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:34.028 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:34:34.028 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
18:34:34.028 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
18:34:34.033 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7716df39
18:34:34.034 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.039 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:34.042 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:34.043 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.044 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.044 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.045 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.045 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.045 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.045 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.046 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.046 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.046 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.046 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.046 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.047 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.047 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.047 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.047 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.049 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.049 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.049 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.049 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.055 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.055 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.055 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.056 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.056 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.062 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.064 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.064 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.064 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.064 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.064 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.064 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.065 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.067 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.073 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.073 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.074 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.074 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.074 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.075 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:34.075 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.075 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.075 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:34.075 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.075 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:34.075 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:34.075 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.076 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:34.076 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:34.076 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:34.075 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:34.076 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:34.076 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:34.076 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:34.076 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:34.076 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:34.076 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.076 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.076 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.077 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.077 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.077 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.077 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.077 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.078 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.078 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.078 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.078 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.078 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.078 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.078 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.079 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.080 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.080 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.080 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.083 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:34.083 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.084 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.084 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.084 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.086 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.086 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.086 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.086 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.086 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.086 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.087 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.087 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.087 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.087 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:34.088 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:34.095 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.095 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.096 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.096 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.096 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.096 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.097 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.097 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.097 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.098 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:34.099 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.099 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.100 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.100 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.100 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.101 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.101 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.101 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.112 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.112 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.112 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.112 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.112 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.112 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.112 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.112 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.113 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:34.113 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.113 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.113 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.114 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.114 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.115 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.115 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.115 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.119 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.120 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.120 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.120 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.123 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.123 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.123 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.124 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.124 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.124 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.124 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.125 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:34.126 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.126 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.126 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.127 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.127 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.135 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.135 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.136 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.136 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:34.136 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.137 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.137 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.137 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.138 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:34.140 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.140 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.140 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.140 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.140 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.140 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.140 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.140 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.141 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.141 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.141 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.141 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.142 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.142 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.142 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.142 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.143 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:34.144 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.143 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.144 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.144 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.144 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:34.145 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.145 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.145 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.145 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.145 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.145 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.145 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:34.146 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.146 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.146 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.146 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.146 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.147 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.147 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.147 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.147 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.147 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.147 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.147 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.147 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.147 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.147 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.147 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.148 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.148 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.148 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.148 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.148 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.149 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.149 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.149 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.149 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.150 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.150 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.150 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.150 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.151 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.151 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.151 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.151 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.152 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.152 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.152 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.152 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.155 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.155 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.155 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.155 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.155 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.155 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.155 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.156 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.156 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.156 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.156 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:34.156 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.156 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.156 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.158 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:34.158 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:34.158 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:34.159 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.159 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.159 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.159 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.159 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.159 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.160 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.160 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.160 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.160 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:34.164 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.164 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.164 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.165 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.165 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.165 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.166 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.166 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.167 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.167 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.167 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.167 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.167 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.167 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.167 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.167 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.167 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.167 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.167 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.167 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.168 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.168 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.168 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.168 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.168 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.168 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.168 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.168 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.168 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.168 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.168 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.169 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.169 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.169 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.169 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.169 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.169 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.169 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.169 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.174 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.175 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.175 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.175 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.175 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.175 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.175 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.175 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.175 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.175 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.175 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.175 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.175 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.179 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:34.179 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:34.179 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:34.179 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.179 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.179 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.180 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.180 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.180 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.180 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.180 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.180 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.180 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:34.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:34.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:34.185 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.185 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.185 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.186 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.186 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.186 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.187 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.187 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.187 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.187 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.187 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.188 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.188 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.188 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.188 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.189 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.190 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.190 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.190 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.190 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.190 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.190 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.191 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.191 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.191 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.191 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.191 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.192 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.192 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.192 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.192 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.192 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.192 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.192 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.192 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.193 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.193 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.193 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.194 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.217 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.217 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.217 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.218 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.218 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.218 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.219 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.219 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.219 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.219 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.219 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.220 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.220 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.220 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:34.220 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:34.221 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:34.221 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.221 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.221 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.221 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.221 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.222 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.222 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.222 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.222 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.222 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:34.222 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.222 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.222 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.222 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.222 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.222 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.223 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.223 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.223 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.223 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.223 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.223 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.223 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.228 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.228 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.229 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.229 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.229 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.229 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.229 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.230 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.230 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.230 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.230 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.230 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.230 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.231 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.231 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.231 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.231 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.232 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.232 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.232 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.232 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.232 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.232 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.233 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.233 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.233 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.235 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.235 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.235 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.236 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.236 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.236 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.236 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.236 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.236 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.237 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.237 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.237 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.237 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.258 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:34.259 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.259 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.259 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.259 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:34.259 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:34.260 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.260 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.260 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.260 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.260 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.260 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.260 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:34.264 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.264 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.264 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.264 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.264 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.264 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.265 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.265 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.265 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.265 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.265 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.265 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.265 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.287 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.287 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.287 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.288 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.288 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.288 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.288 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.289 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.289 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.288 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.289 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.289 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.289 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.304 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.305 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.305 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.305 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.305 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.305 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.305 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.305 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.305 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.306 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.306 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.306 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.306 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.306 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.306 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.307 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.307 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.307 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.307 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.307 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.307 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.307 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.307 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.308 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.308 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.308 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.318 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:34.318 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:34.319 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:34.319 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.319 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.319 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.319 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.319 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.319 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.319 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.320 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.320 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.320 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:34.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535674333 for job 41f18052e8363382138bde77e16b10c3.
18:34:34.351 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
18:34:34.353 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
18:34:34.355 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.355 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.355 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.356 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.356 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.356 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.356 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.356 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.357 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.357 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.357 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.357 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.357 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.399 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:34.400 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:34.400 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:34.400 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:34.400 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:34.400 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:34.401 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:34.401 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:34.401 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:34.401 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:34.401 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:34.401 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:34.401 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:34.424 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.425 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.425 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.425 [INFO - pool-516-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.425 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.426 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.426 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.426 [INFO - pool-516-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.426 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.426 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.426 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.427 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.427 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.427 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.427 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.427 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.427 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.427 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.427 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.428 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.428 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.428 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.428 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.428 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.428 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.429 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.429 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.429 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.429 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.429 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.429 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.430 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.430 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.430 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.430 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.430 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.430 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.430 [INFO - pool-516-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.431 [WARN - pool-516-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.435 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.435 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.435 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.436 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.436 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.436 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.436 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.436 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.436 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.437 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.437 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.437 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.437 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:34.481 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:34.481 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:34.482 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:34.482 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:34.482 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:34.482 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:34.482 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:34.482 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:34.482 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:34.483 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:34.483 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:34.483 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:34.483 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:34.499 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:34.500 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:34.500 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.500 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.501 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.501 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.501 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:34.501 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.501 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.502 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.502 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.502 [INFO - pool-510-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.502 [WARN - pool-510-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:34.507 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.507 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.507 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.508 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.508 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.508 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.508 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.508 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.509 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.509 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.509 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.509 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.509 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.540 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:34.540 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:34.541 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:34.541 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:34.541 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:34.541 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:34.541 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:34.541 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:34.541 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:34.542 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:34.542 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:34.542 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:34.542 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:34.557 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:34.558 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:34.558 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:34.558 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:34.558 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:34.558 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:34.558 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:34.558 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:34.558 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:34.559 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:34.559 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:34.559 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:34.559 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:34.587 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:34.657 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:34.678 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:34.679 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:34.679 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.679 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.679 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:34.679 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:34.680 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.680 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.680 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:34.680 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.680 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.680 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:34.680 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:34.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:34.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:34.724 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.724 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.725 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.725 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.725 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.726 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.726 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.726 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.726 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.727 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.727 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.727 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.727 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.798 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:34.799 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:34.799 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:34.799 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:34.799 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:34.799 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:34.799 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:34.799 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:34.799 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:34.799 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:34.800 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:34.800 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:34.800 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:34.827 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.827 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.828 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.828 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.828 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.829 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.829 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.829 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.829 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.829 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.829 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.829 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.830 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.833 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535674833 for job 41f18052e8363382138bde77e16b10c3.
18:34:34.850 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
18:34:34.850 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
18:34:34.875 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.875 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.875 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.876 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.876 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.876 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.876 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.876 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.876 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.877 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.877 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.877 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.877 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.907 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:34.907 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:34.907 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:34.908 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.908 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.908 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.908 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:34.908 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.908 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:34.909 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.909 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.909 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:34.910 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:34.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:34.980 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:34.981 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:34.981 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:34.982 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:34.982 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:34.982 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:34.983 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:34.983 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:34.983 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:34.983 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:34.984 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:34.984 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:34.984 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:35.028 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:35.028 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:35.028 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:35.029 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:35.029 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:35.029 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:35.030 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:35.030 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:35.030 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:35.030 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:35.030 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:35.030 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:35.030 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:35.082 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:35.082 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:35.082 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:35.083 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:35.083 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:35.083 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:35.083 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:35.083 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:35.084 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:35.084 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:35.083 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:35.084 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:35.084 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:35.086 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:35.087 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:35.087 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:35.087 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:35.087 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:35.087 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:35.087 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:35.087 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:35.087 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:35.088 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:35.088 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:35.088 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:35.088 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:35.088 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:35.093 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:35.093 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:35.093 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:35.093 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:35.093 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:35.093 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:35.093 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:35.094 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:35.094 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:35.094 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:35.094 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:35.094 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:35.094 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:35.102 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:35.102 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:35.102 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:35.103 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:35.103 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:35.103 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:35.103 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:35.103 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:35.103 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:35.104 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:35.104 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:35.104 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:35.104 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:35.145 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:35.145 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:35.146 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:35.146 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:35.146 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:35.146 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:35.146 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:35.146 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:35.146 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:35.146 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:35.146 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:35.146 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:35.146 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:35.154 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:35.154 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:35.155 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:35.155 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:35.155 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:35.155 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:35.155 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:35.155 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:35.155 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:35.155 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:35.156 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:35.156 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:35.156 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:35.157 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:35.179 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:35.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:35.195 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:35.195 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:35.195 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:35.196 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:35.196 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:35.196 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:35.196 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:35.196 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:35.196 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:35.196 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:35.196 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:35.196 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:35.196 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:35.198 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:35.199 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:35.199 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:35.199 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:35.199 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:35.199 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:35.199 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:35.199 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:35.199 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:35.199 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:35.199 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:35.200 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:35.200 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:35.288 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:35.289 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:35.289 [DEBUG - pool-422-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:35.289 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:35.289 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:35.289 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:35.290 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:35.290 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:35.290 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:35.290 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:35.290 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:35.290 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:35.290 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:35.292 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29355), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [20ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [30ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [38ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [40ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [78ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [89ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [98ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [98ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [111ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [114ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [120ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [121ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [121ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [142ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [142ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [143ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [143ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [161ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [162ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [162ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [162ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [201ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [202ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [202ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [202ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [269ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [270ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [270ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [362ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [362ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [363ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [363ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [542ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [542ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [543ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [543ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [622ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [622ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [622ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [622ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1561ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [1565ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [1565ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1565ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [3361ms] refreshing cache from master, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [3362ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [3362ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [3363ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [3363ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [7021ms] refreshing cache from master, [7021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [7021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [7021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [7022ms] too many traces: truncated at 100 traces, deferred=Deferred@212116726(state=PENDING, result=null, callback=(continuation of Deferred@228401723 after retry RPC after error@1867343312) -> (continuation of Deferred@16900543 after retry RPC after error@682321533) -> (continuation of Deferred@1279460777 after retry RPC after error@1210358292) -> (continuation of Deferred@1185322678 after retry RPC after error@902662289) -> (continuation of Deferred@1635237324 after retry RPC after error@225411020) -> (continuation of Deferred@2131647473 after retry RPC after error@643747201) -> (continuation of Deferred@2048626011 after retry RPC after error@209460427) -> (continuation of Deferred@18882406 after retry RPC after error@1371731974) -> (continuation of Deferred@2006308400 after retry RPC after error@467863117) -> (continuation of Deferred@448389496 after retry RPC after error@1560094945) -> (continuation of Deferred@83906840 after retry RPC after error@106102427) -> (continuation of Deferred@1396010248 after retry RPC after error@1715137967) -> (continuation of Deferred@1630927073 after retry RPC after error@1879204986) -> (continuation of Deferred@136780383 after retry RPC after error@969005409) -> (continuation of Deferred@2004733000 after retry RPC after error@339691369) -> (continuation of Deferred@620380755 after retry RPC after error@323456380) -> (continuation of Deferred@172039376 after retry RPC after error@1680545534) -> (continuation of Deferred@313862386 after retry RPC after error@1035365301) -> (continuation of Deferred@1058232143 after retry RPC after error@62073525) -> (continuation of Deferred@955932809 after retry RPC after error@916414432) -> (continuation of Deferred@328458067 after retry RPC after error@166701334) -> (continuation of Deferred@1652194954 after retry RPC after error@785796474) -> (continuation of Deferred@598898356 after retry RPC after error@1466031309), errback=(continuation of Deferred@228401723 after retry RPC after error@1867343312) -> (continuation of Deferred@16900543 after retry RPC after error@682321533) -> (continuation of Deferred@1279460777 after retry RPC after error@1210358292) -> (continuation of Deferred@1185322678 after retry RPC after error@902662289) -> (continuation of Deferred@1635237324 after retry RPC after error@225411020) -> (continuation of Deferred@2131647473 after retry RPC after error@643747201) -> (continuation of Deferred@2048626011 after retry RPC after error@209460427) -> (continuation of Deferred@18882406 after retry RPC after error@1371731974) -> (continuation of Deferred@2006308400 after retry RPC after error@467863117) -> (continuation of Deferred@448389496 after retry RPC after error@1560094945) -> (continuation of Deferred@83906840 after retry RPC after error@106102427) -> (continuation of Deferred@1396010248 after retry RPC after error@1715137967) -> (continuation of Deferred@1630927073 after retry RPC after error@1879204986) -> (continuation of Deferred@136780383 after retry RPC after error@969005409) -> (continuation of Deferred@2004733000 after retry RPC after error@339691369) -> (continuation of Deferred@620380755 after retry RPC after error@323456380) -> (continuation of Deferred@172039376 after retry RPC after error@1680545534) -> (continuation of Deferred@313862386 after retry RPC after error@1035365301) -> (continuation of Deferred@1058232143 after retry RPC after error@62073525) -> (continuation of Deferred@955932809 after retry RPC after error@916414432) -> (continuation of Deferred@328458067 after retry RPC after error@166701334) -> (continuation of Deferred@1652194954 after retry RPC after error@785796474) -> (continuation of Deferred@598898356 after retry RPC after error@1466031309)))
18:34:35.293 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:34:35.293 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:35.293 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:35.293 [WARN - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#1 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29355), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [20ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [30ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [38ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [40ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [78ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [89ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [98ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [98ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [111ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [114ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [120ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [121ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [121ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [142ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [142ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [143ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [143ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [161ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [162ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [162ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [162ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [201ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [202ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [202ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [202ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [269ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [270ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [270ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [362ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [362ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [363ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [363ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [542ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [542ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [543ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [543ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [622ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [622ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [622ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [622ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1561ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [1565ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [1565ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1565ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [3361ms] refreshing cache from master, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [3362ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [3362ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [3363ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [3363ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [7021ms] refreshing cache from master, [7021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [7021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [7021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [7022ms] too many traces: truncated at 100 traces, deferred=Deferred@212116726(state=PENDING, result=null, callback=(continuation of Deferred@228401723 after retry RPC after error@1867343312) -> (continuation of Deferred@16900543 after retry RPC after error@682321533) -> (continuation of Deferred@1279460777 after retry RPC after error@1210358292) -> (continuation of Deferred@1185322678 after retry RPC after error@902662289) -> (continuation of Deferred@1635237324 after retry RPC after error@225411020) -> (continuation of Deferred@2131647473 after retry RPC after error@643747201) -> (continuation of Deferred@2048626011 after retry RPC after error@209460427) -> (continuation of Deferred@18882406 after retry RPC after error@1371731974) -> (continuation of Deferred@2006308400 after retry RPC after error@467863117) -> (continuation of Deferred@448389496 after retry RPC after error@1560094945) -> (continuation of Deferred@83906840 after retry RPC after error@106102427) -> (continuation of Deferred@1396010248 after retry RPC after error@1715137967) -> (continuation of Deferred@1630927073 after retry RPC after error@1879204986) -> (continuation of Deferred@136780383 after retry RPC after error@969005409) -> (continuation of Deferred@2004733000 after retry RPC after error@339691369) -> (continuation of Deferred@620380755 after retry RPC after error@323456380) -> (continuation of Deferred@172039376 after retry RPC after error@1680545534) -> (continuation of Deferred@313862386 after retry RPC after error@1035365301) -> (continuation of Deferred@1058232143 after retry RPC after error@62073525) -> (continuation of Deferred@955932809 after retry RPC after error@916414432) -> (continuation of Deferred@328458067 after retry RPC after error@166701334) -> (continuation of Deferred@1652194954 after retry RPC after error@785796474) -> (continuation of Deferred@598898356 after retry RPC after error@1466031309), errback=(continuation of Deferred@228401723 after retry RPC after error@1867343312) -> (continuation of Deferred@16900543 after retry RPC after error@682321533) -> (continuation of Deferred@1279460777 after retry RPC after error@1210358292) -> (continuation of Deferred@1185322678 after retry RPC after error@902662289) -> (continuation of Deferred@1635237324 after retry RPC after error@225411020) -> (continuation of Deferred@2131647473 after retry RPC after error@643747201) -> (continuation of Deferred@2048626011 after retry RPC after error@209460427) -> (continuation of Deferred@18882406 after retry RPC after error@1371731974) -> (continuation of Deferred@2006308400 after retry RPC after error@467863117) -> (continuation of Deferred@448389496 after retry RPC after error@1560094945) -> (continuation of Deferred@83906840 after retry RPC after error@106102427) -> (continuation of Deferred@1396010248 after retry RPC after error@1715137967) -> (continuation of Deferred@1630927073 after retry RPC after error@1879204986) -> (continuation of Deferred@136780383 after retry RPC after error@969005409) -> (continuation of Deferred@2004733000 after retry RPC after error@339691369) -> (continuation of Deferred@620380755 after retry RPC after error@323456380) -> (continuation of Deferred@172039376 after retry RPC after error@1680545534) -> (continuation of Deferred@313862386 after retry RPC after error@1035365301) -> (continuation of Deferred@1058232143 after retry RPC after error@62073525) -> (continuation of Deferred@955932809 after retry RPC after error@916414432) -> (continuation of Deferred@328458067 after retry RPC after error@166701334) -> (continuation of Deferred@1652194954 after retry RPC after error@785796474) -> (continuation of Deferred@598898356 after retry RPC after error@1466031309)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.5.136.61:43625
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:35.294 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
18:34:35.294 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:35.294 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:35.294 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:35.295 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:35.295 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:35.295 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:35.293 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:35.295 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:35.295 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:35.295 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:35.296 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:35.297 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
18:34:35.300 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED on 1bed232f-62eb-42dc-858c-7139d8e062d6 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29355), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [20ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [30ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [38ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [40ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [78ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [89ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [98ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [98ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [111ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [114ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [120ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [121ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [121ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [142ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [142ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [143ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [143ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [161ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [162ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [162ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [162ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [201ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [202ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [202ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [202ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [268ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [269ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [270ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [270ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [362ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [362ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [363ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [363ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [542ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [542ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [543ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [543ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [622ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [622ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [622ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [622ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1561ms] refreshing cache from master, [1561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [1562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [1563ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [1565ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [1565ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1565ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [3361ms] refreshing cache from master, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [3362ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [3362ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [3363ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [3363ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [7021ms] refreshing cache from master, [7021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [7021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [7021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [7022ms] too many traces: truncated at 100 traces, deferred=Deferred@212116726(state=PENDING, result=null, callback=(continuation of Deferred@228401723 after retry RPC after error@1867343312) -> (continuation of Deferred@16900543 after retry RPC after error@682321533) -> (continuation of Deferred@1279460777 after retry RPC after error@1210358292) -> (continuation of Deferred@1185322678 after retry RPC after error@902662289) -> (continuation of Deferred@1635237324 after retry RPC after error@225411020) -> (continuation of Deferred@2131647473 after retry RPC after error@643747201) -> (continuation of Deferred@2048626011 after retry RPC after error@209460427) -> (continuation of Deferred@18882406 after retry RPC after error@1371731974) -> (continuation of Deferred@2006308400 after retry RPC after error@467863117) -> (continuation of Deferred@448389496 after retry RPC after error@1560094945) -> (continuation of Deferred@83906840 after retry RPC after error@106102427) -> (continuation of Deferred@1396010248 after retry RPC after error@1715137967) -> (continuation of Deferred@1630927073 after retry RPC after error@1879204986) -> (continuation of Deferred@136780383 after retry RPC after error@969005409) -> (continuation of Deferred@2004733000 after retry RPC after error@339691369) -> (continuation of Deferred@620380755 after retry RPC after error@323456380) -> (continuation of Deferred@172039376 after retry RPC after error@1680545534) -> (continuation of Deferred@313862386 after retry RPC after error@1035365301) -> (continuation of Deferred@1058232143 after retry RPC after error@62073525) -> (continuation of Deferred@955932809 after retry RPC after error@916414432) -> (continuation of Deferred@328458067 after retry RPC after error@166701334) -> (continuation of Deferred@1652194954 after retry RPC after error@785796474) -> (continuation of Deferred@598898356 after retry RPC after error@1466031309), errback=(continuation of Deferred@228401723 after retry RPC after error@1867343312) -> (continuation of Deferred@16900543 after retry RPC after error@682321533) -> (continuation of Deferred@1279460777 after retry RPC after error@1210358292) -> (continuation of Deferred@1185322678 after retry RPC after error@902662289) -> (continuation of Deferred@1635237324 after retry RPC after error@225411020) -> (continuation of Deferred@2131647473 after retry RPC after error@643747201) -> (continuation of Deferred@2048626011 after retry RPC after error@209460427) -> (continuation of Deferred@18882406 after retry RPC after error@1371731974) -> (continuation of Deferred@2006308400 after retry RPC after error@467863117) -> (continuation of Deferred@448389496 after retry RPC after error@1560094945) -> (continuation of Deferred@83906840 after retry RPC after error@106102427) -> (continuation of Deferred@1396010248 after retry RPC after error@1715137967) -> (continuation of Deferred@1630927073 after retry RPC after error@1879204986) -> (continuation of Deferred@136780383 after retry RPC after error@969005409) -> (continuation of Deferred@2004733000 after retry RPC after error@339691369) -> (continuation of Deferred@620380755 after retry RPC after error@323456380) -> (continuation of Deferred@172039376 after retry RPC after error@1680545534) -> (continuation of Deferred@313862386 after retry RPC after error@1035365301) -> (continuation of Deferred@1058232143 after retry RPC after error@62073525) -> (continuation of Deferred@955932809 after retry RPC after error@916414432) -> (continuation of Deferred@328458067 after retry RPC after error@166701334) -> (continuation of Deferred@1652194954 after retry RPC after error@785796474) -> (continuation of Deferred@598898356 after retry RPC after error@1466031309)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.5.136.61:43625
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:35.301 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job 2f0efe0c81addbcaea565a6248e4a915: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:35.302 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
18:34:35.302 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2f0efe0c81addbcaea565a6248e4a915) switched from state RUNNING to RESTARTING.
18:34:35.303 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
18:34:35.320 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:35.321 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:35.321 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:35.321 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:35.321 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:35.321 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:35.321 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:35.321 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:35.322 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:35.322 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:35.322 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:35.321 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:35.322 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:35.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535675333 for job 41f18052e8363382138bde77e16b10c3.
18:34:35.352 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
18:34:35.354 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
18:34:35.471 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:35.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:33.925570  9554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:35.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:35.490438  9556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:35.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:35.494385  9555 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1564 milliseconds
18:34:35.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.494561  9547 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:34:35.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.496088  9547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:34:35.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.499665  9547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:34:35.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.501261  9547 hybrid_clock.cc:648] HybridClock initialized: now 1783535675501204 us; error 64 us; skew 500 ppm
18:34:35.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.502233  9547 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:34:35.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.509764  9547 webserver.cc:534] Webserver started at http://127.9.79.254:41897/ using document root <none> and password file <none>
18:34:35.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.510712  9547 fs_manager.cc:362] Metadata directory not provided
18:34:35.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.510965  9547 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:34:35.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.511472  9547 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:34:35.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.517510  9547 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/data/instance:
18:34:35.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4"
18:34:35.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:35 on dist-test-slave-dxnw"
18:34:35.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.519014  9547 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/wal/instance:
18:34:35.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4"
18:34:35.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:35 on dist-test-slave-dxnw"
18:34:35.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.527457  9547 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.003s	sys 0.005s
18:34:35.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.533977  9617 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:34:35.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.535215  9547 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
18:34:35.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.535571  9547 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/wal
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4"
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:35 on dist-test-slave-dxnw"
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.535933  9547 fs_report.cc:389] FS layout report
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/wal
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/wal
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/data/data
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:34:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:34:35.587 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:35.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.594627  9547 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:34:35.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.596472  9547 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:34:35.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.596977  9547 kserver.cc:163] Server-wide thread pool size limit: 3276
18:34:35.604 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:35.604 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:35.605 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:35.605 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:35.605 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:35.605 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:35.605 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:35.605 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:35.605 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:35.605 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:35.605 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:35.605 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:35.605 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:35.633 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:35.633 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:35.633 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:35.633 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:35.633 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:35.633 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:35.633 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:35.633 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:35.633 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:35.634 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:35.634 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:35.634 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:35.634 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:35.657 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:35.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:35.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.688441  9547 rpc_server.cc:307] RPC server started. Bound to: 127.9.79.254:42669
18:34:35.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.688531  9668 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.79.254:42669 every 8 connection(s)
18:34:35.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.691845  9547 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/data/info.pb
18:34:35.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.696408  9535 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 9547
18:34:35.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.696998  9535 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-0/wal/instance
18:34:35.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.700397  9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.702642  9535 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/wal
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/data
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/logs
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/data/info.pb
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.79.253:36577
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.79.253
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.79.212:43203
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.79.254:42669,127.9.79.253:36577,127.9.79.252:38727
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:34:35.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43255/jwks.json with env {}
18:34:35.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.716517  9669 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } has no permanent_uuid. Determining permanent_uuid...
18:34:35.724 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:35.724 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:35.724 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:35.724 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:35.724 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:35.724 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:35.724 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:35.725 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:35.725 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:35.725 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:35.725 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:35.725 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:35.725 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:35.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.756078  9669 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } has no permanent_uuid. Determining permanent_uuid...
18:34:35.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:35.759155  9618 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.79.253:36577: connect: Connection refused (error 111)
18:34:35.762 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:35.763 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:35.763 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:35.763 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:35.763 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:35.763 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:35.763 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:35.764 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:35.764 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:35.764 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:35.764 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:35.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:35.763818  9669 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.253:36577: Network error: Client connection negotiation failed: client connection to 127.9.79.253:36577: connect: Connection refused (error 111)
18:34:35.764 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:35.764 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:35.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.813380  9669 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } attempt: 1
18:34:35.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:35.818784  9669 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.253:36577: Network error: Client connection negotiation failed: client connection to 127.9.79.253:36577: connect: Connection refused (error 111)
18:34:35.820 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:35.820 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:35.820 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:35.821 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:35.821 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:35.821 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:35.821 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:35.821 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:35.821 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:35.821 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:35.821 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:35.821 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:35.821 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:35.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535675833 for job 41f18052e8363382138bde77e16b10c3.
18:34:35.842 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:35.843 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:35.843 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:35.843 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:35.843 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:35.843 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:35.843 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:35.843 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:35.843 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:35.843 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:35.843 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:35.843 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:35.843 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:35.847 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
18:34:35.848 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
18:34:35.875 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:35.875 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:35.875 [DEBUG - pool-424-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:35.876 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:35.876 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:35.876 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:35.876 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:35.876 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:35.876 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:35.876 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:35.876 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:35.876 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:35.876 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:35.877 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28430), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [14ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [17ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [34ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [34ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [49ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [78ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [80ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [80ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [109ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [119ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [119ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [119ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [142ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [142ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [143ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [143ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [161ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [162ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [162ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [162ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [203ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [203ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [203ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [204ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [241ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [242ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [242ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [242ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [301ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [302ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [302ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [302ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [522ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [522ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [522ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [522ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [902ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [902ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [902ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [903ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1381ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1382ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [2281ms] refreshing cache from master, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [2282ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [6200ms] refreshing cache from master, [6200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [6201ms] too many traces: truncated at 100 traces, deferred=Deferred@1574618113(state=PENDING, result=null, callback=(continuation of Deferred@1168032325 after retry RPC after error@1466855276) -> (continuation of Deferred@1784873300 after retry RPC after error@1628580565) -> (continuation of Deferred@1387085912 after retry RPC after error@1981567086) -> (continuation of Deferred@75990616 after retry RPC after error@1949515935) -> (continuation of Deferred@1285845441 after retry RPC after error@1479530267) -> (continuation of Deferred@1621245696 after retry RPC after error@251374643) -> (continuation of Deferred@1631514196 after retry RPC after error@1192196711) -> (continuation of Deferred@916719545 after retry RPC after error@1701687146) -> (continuation of Deferred@1941414365 after retry RPC after error@1339498894) -> (continuation of Deferred@1498971650 after retry RPC after error@1363582140) -> (continuation of Deferred@531719680 after retry RPC after error@1771892521) -> (continuation of Deferred@1940796534 after retry RPC after error@375973315) -> (continuation of Deferred@41746536 after retry RPC after error@211178153) -> (continuation of Deferred@244959945 after retry RPC after error@1603166244) -> (continuation of Deferred@899302909 after retry RPC after error@195513085) -> (continuation of Deferred@1260918466 after retry RPC after error@1728823491) -> (continuation of Deferred@14275698 after retry RPC after error@832079414) -> (continuation of Deferred@982321345 after retry RPC after error@62511755) -> (continuation of Deferred@1292756170 after retry RPC after error@953246315) -> (continuation of Deferred@1783152304 after retry RPC after error@669535472) -> (continuation of Deferred@90298227 after retry RPC after error@915423118) -> (continuation of Deferred@427993810 after retry RPC after error@2087250654) -> (continuation of Deferred@2000253039 after retry RPC after error@1080184137) -> (continuation of Deferred@1287306157 after retry RPC after error@2009040638) -> (continuation of Deferred@1262037614 after retry RPC after error@434323013) -> (continuation of Deferred@10324231 after retry RPC after error@186546076) -> (continuation of Deferred@158746315 after retry RPC after error@157761718), errback=(continuation of Deferred@1168032325 after retry RPC after error@1466855276) -> (continuation of Deferred@1784873300 after retry RPC after error@1628580565) -> (continuation of Deferred@1387085912 after retry RPC after error@1981567086) -> (continuation of Deferred@75990616 after retry RPC after error@1949515935) -> (continuation of Deferred@1285845441 after retry RPC after error@1479530267) -> (continuation of Deferred@1621245696 after retry RPC after error@251374643) -> (continuation of Deferred@1631514196 after retry RPC after error@1192196711) -> (continuation of Deferred@916719545 after retry RPC after error@1701687146) -> (continuation of Deferred@1941414365 after retry RPC after error@1339498894) -> (continuation of Deferred@1498971650 after retry RPC after error@1363582140) -> (continuation of Deferred@531719680 after retry RPC after error@1771892521) -> (continuation of Deferred@1940796534 after retry RPC after error@375973315) -> (continuation of Deferred@41746536 after retry RPC after error@211178153) -> (continuation of Deferred@244959945 after retry RPC after error@1603166244) -> (continuation of Deferred@899302909 after retry RPC after error@195513085) -> (continuation of Deferred@1260918466 after retry RPC after error@1728823491) -> (continuation of Deferred@14275698 after retry RPC after error@832079414) -> (continuation of Deferred@982321345 after retry RPC after error@62511755) -> (continuation of Deferred@1292756170 after retry RPC after error@953246315) -> (continuation of Deferred@1783152304 after retry RPC after error@669535472) -> (continuation of Deferred@90298227 after retry RPC after error@915423118) -> (continuation of Deferred@427993810 after retry RPC after error@2087250654) -> (continuation of Deferred@2000253039 after retry RPC after error@1080184137) -> (continuation of Deferred@1287306157 after retry RPC after error@2009040638) -> (continuation of Deferred@1262037614 after retry RPC after error@434323013) -> (continuation of Deferred@10324231 after retry RPC after error@186546076) -> (continuation of Deferred@158746315 after retry RPC after error@157761718)))
18:34:35.878 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
18:34:35.879 [WARN - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#1 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28430), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [14ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [17ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [34ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [34ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [49ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [78ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [80ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [80ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [109ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [119ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [119ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [119ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [142ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [142ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [143ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [143ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [161ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [162ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [162ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [162ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [203ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [203ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [203ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [204ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [241ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [242ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [242ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [242ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [301ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [302ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [302ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [302ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [522ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [522ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [522ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [522ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [902ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [902ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [902ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [903ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1381ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1382ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [2281ms] refreshing cache from master, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [2282ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [6200ms] refreshing cache from master, [6200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [6201ms] too many traces: truncated at 100 traces, deferred=Deferred@1574618113(state=PENDING, result=null, callback=(continuation of Deferred@1168032325 after retry RPC after error@1466855276) -> (continuation of Deferred@1784873300 after retry RPC after error@1628580565) -> (continuation of Deferred@1387085912 after retry RPC after error@1981567086) -> (continuation of Deferred@75990616 after retry RPC after error@1949515935) -> (continuation of Deferred@1285845441 after retry RPC after error@1479530267) -> (continuation of Deferred@1621245696 after retry RPC after error@251374643) -> (continuation of Deferred@1631514196 after retry RPC after error@1192196711) -> (continuation of Deferred@916719545 after retry RPC after error@1701687146) -> (continuation of Deferred@1941414365 after retry RPC after error@1339498894) -> (continuation of Deferred@1498971650 after retry RPC after error@1363582140) -> (continuation of Deferred@531719680 after retry RPC after error@1771892521) -> (continuation of Deferred@1940796534 after retry RPC after error@375973315) -> (continuation of Deferred@41746536 after retry RPC after error@211178153) -> (continuation of Deferred@244959945 after retry RPC after error@1603166244) -> (continuation of Deferred@899302909 after retry RPC after error@195513085) -> (continuation of Deferred@1260918466 after retry RPC after error@1728823491) -> (continuation of Deferred@14275698 after retry RPC after error@832079414) -> (continuation of Deferred@982321345 after retry RPC after error@62511755) -> (continuation of Deferred@1292756170 after retry RPC after error@953246315) -> (continuation of Deferred@1783152304 after retry RPC after error@669535472) -> (continuation of Deferred@90298227 after retry RPC after error@915423118) -> (continuation of Deferred@427993810 after retry RPC after error@2087250654) -> (continuation of Deferred@2000253039 after retry RPC after error@1080184137) -> (continuation of Deferred@1287306157 after retry RPC after error@2009040638) -> (continuation of Deferred@1262037614 after retry RPC after error@434323013) -> (continuation of Deferred@10324231 after retry RPC after error@186546076) -> (continuation of Deferred@158746315 after retry RPC after error@157761718), errback=(continuation of Deferred@1168032325 after retry RPC after error@1466855276) -> (continuation of Deferred@1784873300 after retry RPC after error@1628580565) -> (continuation of Deferred@1387085912 after retry RPC after error@1981567086) -> (continuation of Deferred@75990616 after retry RPC after error@1949515935) -> (continuation of Deferred@1285845441 after retry RPC after error@1479530267) -> (continuation of Deferred@1621245696 after retry RPC after error@251374643) -> (continuation of Deferred@1631514196 after retry RPC after error@1192196711) -> (continuation of Deferred@916719545 after retry RPC after error@1701687146) -> (continuation of Deferred@1941414365 after retry RPC after error@1339498894) -> (continuation of Deferred@1498971650 after retry RPC after error@1363582140) -> (continuation of Deferred@531719680 after retry RPC after error@1771892521) -> (continuation of Deferred@1940796534 after retry RPC after error@375973315) -> (continuation of Deferred@41746536 after retry RPC after error@211178153) -> (continuation of Deferred@244959945 after retry RPC after error@1603166244) -> (continuation of Deferred@899302909 after retry RPC after error@195513085) -> (continuation of Deferred@1260918466 after retry RPC after error@1728823491) -> (continuation of Deferred@14275698 after retry RPC after error@832079414) -> (continuation of Deferred@982321345 after retry RPC after error@62511755) -> (continuation of Deferred@1292756170 after retry RPC after error@953246315) -> (continuation of Deferred@1783152304 after retry RPC after error@669535472) -> (continuation of Deferred@90298227 after retry RPC after error@915423118) -> (continuation of Deferred@427993810 after retry RPC after error@2087250654) -> (continuation of Deferred@2000253039 after retry RPC after error@1080184137) -> (continuation of Deferred@1287306157 after retry RPC after error@2009040638) -> (continuation of Deferred@1262037614 after retry RPC after error@434323013) -> (continuation of Deferred@10324231 after retry RPC after error@186546076) -> (continuation of Deferred@158746315 after retry RPC after error@157761718)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.5.136.62:42905
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:35.880 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
18:34:35.882 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
18:34:35.885 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED on 1bed232f-62eb-42dc-858c-7139d8e062d6 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28430), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [14ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [17ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [34ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [34ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [49ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [78ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [80ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [80ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [109ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [119ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [119ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [119ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [142ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [142ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [143ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [143ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [161ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [162ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [162ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [162ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [203ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [203ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [203ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [204ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [241ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [242ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [242ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [242ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [301ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [302ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [302ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [302ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [522ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [522ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [522ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [522ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [902ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [902ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [902ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [903ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1381ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1382ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [2281ms] refreshing cache from master, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [2282ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [6200ms] refreshing cache from master, [6200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [6201ms] too many traces: truncated at 100 traces, deferred=Deferred@1574618113(state=PENDING, result=null, callback=(continuation of Deferred@1168032325 after retry RPC after error@1466855276) -> (continuation of Deferred@1784873300 after retry RPC after error@1628580565) -> (continuation of Deferred@1387085912 after retry RPC after error@1981567086) -> (continuation of Deferred@75990616 after retry RPC after error@1949515935) -> (continuation of Deferred@1285845441 after retry RPC after error@1479530267) -> (continuation of Deferred@1621245696 after retry RPC after error@251374643) -> (continuation of Deferred@1631514196 after retry RPC after error@1192196711) -> (continuation of Deferred@916719545 after retry RPC after error@1701687146) -> (continuation of Deferred@1941414365 after retry RPC after error@1339498894) -> (continuation of Deferred@1498971650 after retry RPC after error@1363582140) -> (continuation of Deferred@531719680 after retry RPC after error@1771892521) -> (continuation of Deferred@1940796534 after retry RPC after error@375973315) -> (continuation of Deferred@41746536 after retry RPC after error@211178153) -> (continuation of Deferred@244959945 after retry RPC after error@1603166244) -> (continuation of Deferred@899302909 after retry RPC after error@195513085) -> (continuation of Deferred@1260918466 after retry RPC after error@1728823491) -> (continuation of Deferred@14275698 after retry RPC after error@832079414) -> (continuation of Deferred@982321345 after retry RPC after error@62511755) -> (continuation of Deferred@1292756170 after retry RPC after error@953246315) -> (continuation of Deferred@1783152304 after retry RPC after error@669535472) -> (continuation of Deferred@90298227 after retry RPC after error@915423118) -> (continuation of Deferred@427993810 after retry RPC after error@2087250654) -> (continuation of Deferred@2000253039 after retry RPC after error@1080184137) -> (continuation of Deferred@1287306157 after retry RPC after error@2009040638) -> (continuation of Deferred@1262037614 after retry RPC after error@434323013) -> (continuation of Deferred@10324231 after retry RPC after error@186546076) -> (continuation of Deferred@158746315 after retry RPC after error@157761718), errback=(continuation of Deferred@1168032325 after retry RPC after error@1466855276) -> (continuation of Deferred@1784873300 after retry RPC after error@1628580565) -> (continuation of Deferred@1387085912 after retry RPC after error@1981567086) -> (continuation of Deferred@75990616 after retry RPC after error@1949515935) -> (continuation of Deferred@1285845441 after retry RPC after error@1479530267) -> (continuation of Deferred@1621245696 after retry RPC after error@251374643) -> (continuation of Deferred@1631514196 after retry RPC after error@1192196711) -> (continuation of Deferred@916719545 after retry RPC after error@1701687146) -> (continuation of Deferred@1941414365 after retry RPC after error@1339498894) -> (continuation of Deferred@1498971650 after retry RPC after error@1363582140) -> (continuation of Deferred@531719680 after retry RPC after error@1771892521) -> (continuation of Deferred@1940796534 after retry RPC after error@375973315) -> (continuation of Deferred@41746536 after retry RPC after error@211178153) -> (continuation of Deferred@244959945 after retry RPC after error@1603166244) -> (continuation of Deferred@899302909 after retry RPC after error@195513085) -> (continuation of Deferred@1260918466 after retry RPC after error@1728823491) -> (continuation of Deferred@14275698 after retry RPC after error@832079414) -> (continuation of Deferred@982321345 after retry RPC after error@62511755) -> (continuation of Deferred@1292756170 after retry RPC after error@953246315) -> (continuation of Deferred@1783152304 after retry RPC after error@669535472) -> (continuation of Deferred@90298227 after retry RPC after error@915423118) -> (continuation of Deferred@427993810 after retry RPC after error@2087250654) -> (continuation of Deferred@2000253039 after retry RPC after error@1080184137) -> (continuation of Deferred@1287306157 after retry RPC after error@2009040638) -> (continuation of Deferred@1262037614 after retry RPC after error@434323013) -> (continuation of Deferred@10324231 after retry RPC after error@186546076) -> (continuation of Deferred@158746315 after retry RPC after error@157761718)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.5.136.62:42905
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:35.886 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
18:34:35.886 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job 2f0efe0c81addbcaea565a6248e4a915: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:34:35.887 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
18:34:35.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.887292  9669 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } attempt: 2
18:34:35.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:35.893635  9669 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.253:36577: Network error: Client connection negotiation failed: client connection to 127.9.79.253:36577: connect: Connection refused (error 111)
18:34:35.958 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:35.958 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:35.958 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:35.959 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:35.959 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:35.959 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:35.959 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:35.959 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:35.959 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:35.959 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:35.959 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:35.959 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:35.959 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:35.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:35.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:35.985116  9669 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } attempt: 3
18:34:35.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:35.990604  9669 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.253:36577: Network error: Client connection negotiation failed: client connection to 127.9.79.253:36577: connect: Connection refused (error 111)
18:34:36.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:36.077967  9671 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:34:36.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:36.078548  9671 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:34:36.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:36.079223  9671 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:34:36.087 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:36.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:36.119796  9671 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:34:36.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:36.120198  9671 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:34:36.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:36.120577  9671 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:34:36.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:36.120975  9671 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:34:36.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:36.121366  9671 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:34:36.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:36.121618  9671 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43255/jwks.json
18:34:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:36.134078  9669 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } attempt: 4
18:34:36.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:36.138844  9669 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.253:36577: Network error: Client connection negotiation failed: client connection to 127.9.79.253:36577: connect: Connection refused (error 111)
18:34:36.157 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:36.167183  9671 master_runner.cc:387] Master server non-default flags:
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.79.212:43203
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/data
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/wal
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.79.254:42669,127.9.79.253:36577,127.9.79.252:38727
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.79.253:36577
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43255/jwks.json
18:34:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/data/info.pb
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.79.253
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/logs
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:34:36.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:34:36.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:36.168888  9671 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:34:36.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:36.170684  9671 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:34:36.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:36.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:36.183789  9680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:36.198 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:36.199 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:36.199 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:36.199 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:36.199 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:36.199 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:36.200 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:36.200 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:36.200 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:36.200 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:36.200 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:36.200 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:36.201 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:36.218 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:36.219 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:36.219 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:36.219 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:36.219 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:36.219 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:36.220 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:36.220 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:36.220 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:36.220 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:36.220 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:36.220 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:36.220 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:36.335 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535676333 for job 41f18052e8363382138bde77e16b10c3.
18:34:36.350 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
18:34:36.352 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
18:34:36.382 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:36.382 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:36.382 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:36.383 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:36.383 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:36.383 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:36.383 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:36.383 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:36.383 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:36.384 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:36.384 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:36.384 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:36.384 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:36.423 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:36.423 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:36.424 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:36.424 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:36.424 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:36.424 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:36.425 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:36.425 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:36.425 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:36.425 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:36.425 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:36.425 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:36.425 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:36.427 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:36.427 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:36.427 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:36.428 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:36.428 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:36.428 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:36.428 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:36.428 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:36.428 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:36.429 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:36.429 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:36.429 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:36.429 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:36.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:36.438364  9669 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } attempt: 5
18:34:36.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:36.449244  9669 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.253:36577: Network error: Client connection negotiation failed: client connection to 127.9.79.253:36577: connect: Connection refused (error 111)
18:34:36.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:36.588 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:36.657 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:36.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:36.713 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:36.713 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:36.713 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:36.714 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:36.714 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:36.714 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:36.715 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:36.715 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:36.715 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:36.715 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:36.715 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:36.715 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:36.715 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:36.738 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:36.739 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:36.739 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:36.739 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:36.739 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:36.739 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:36.740 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:36.740 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:36.740 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:36.740 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:36.740 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:36.740 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:36.740 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:36.760 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:36.760 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:36.760 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:36.761 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:36.761 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:36.761 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:36.762 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:36.762 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:36.762 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:36.762 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:36.762 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:36.762 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:36.762 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:36.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535676833 for job 41f18052e8363382138bde77e16b10c3.
18:34:36.852 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
18:34:36.855 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
18:34:36.887 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:36.887 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:36.887 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:36.888 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:36.888 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:36.888 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:36.888 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:36.888 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:36.889 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:36.889 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:36.889 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:36.889 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:36.889 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:36.903 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:36.904 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:36.904 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:36.904 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:36.904 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:36.904 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:36.905 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:36.905 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:36.905 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:36.905 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:36.905 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:36.905 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:36.905 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:36.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:36.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:36.996872  9669 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } attempt: 6
18:34:37.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:37.020635  9669 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.253:36577: Network error: Client connection negotiation failed: client connection to 127.9.79.253:36577: connect: Connection refused (error 111)
18:34:37.088 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:37.119 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:37.119 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:37.119 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:37.120 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:37.120 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:37.120 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:37.120 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:37.120 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:37.120 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:37.120 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:37.120 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:37.121 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:37.121 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:37.134 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:37.135 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:37.135 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:37.135 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:37.135 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:37.136 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:37.136 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:37.136 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:37.136 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:37.136 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:37.136 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:37.136 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:37.137 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:37.157 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:37.162 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:37.162 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:37.162 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:37.163 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:37.163 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:37.163 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:37.163 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:37.163 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:37.163 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:37.164 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:37.164 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:37.164 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:37.164 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:37.178 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:37.178 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:37.178 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:37.179 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:37.179 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:37.179 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:37.179 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:37.179 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:37.179 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:37.179 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:37.179 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:37.179 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:37.179 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:37.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:37.187 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:37.187 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:37.187 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:37.188 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:37.188 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:37.188 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:37.188 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:37.188 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:37.188 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:37.188 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:37.188 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:37.188 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:37.189 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:37.208 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:37.208 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:37.208 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:37.209 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:37.209 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:37.209 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:37.209 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:37.209 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:37.209 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:37.209 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:37.209 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:37.209 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:37.209 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:37.277 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:37.278 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:37.278 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:37.279 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:37.279 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:37.279 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:37.279 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:37.279 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:37.280 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:37.280 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:37.280 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:37.281 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:37.281 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:37.335 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535677334 for job 41f18052e8363382138bde77e16b10c3.
18:34:37.341 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:37.341 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:37.341 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:37.345 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:37.345 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:37.345 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:37.345 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:37.345 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:37.345 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:37.346 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:37.346 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:37.346 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:37.346 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:37.357 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=22 ms, finalizationTime=0 ms).
18:34:37.363 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
18:34:37.364 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:37.364 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:37.364 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:37.365 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:37.365 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:37.365 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:37.365 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:37.365 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:37.365 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:37.366 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:37.366 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:37.366 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:37.366 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:37.402 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:37.403 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:37.403 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:37.403 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:37.404 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:37.404 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:37.404 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:37.404 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:37.404 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:37.405 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:37.405 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:37.405 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:37.405 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:37.460 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:37.460 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:37.460 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:37.461 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:37.461 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:37.461 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:37.462 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:37.462 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:37.462 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:37.462 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:37.462 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:37.462 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:37.464 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:37.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:37.498 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:37.498 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:37.499 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:37.499 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:37.500 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:37.500 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:37.500 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:37.501 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:37.501 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:37.501 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:37.502 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:37.502 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:37.502 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:37.583 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:37.583 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:37.583 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:37.584 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:37.584 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:37.584 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:37.584 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:37.584 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:37.584 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:37.585 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:37.585 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:37.585 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:37.585 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:37.588 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:37.604 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:37.604 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:37.604 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:37.604 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:37.605 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:37.605 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:37.605 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:37.605 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:37.605 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:37.605 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:37.605 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:37.605 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:37.606 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:37.656 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:37.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:37.692 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job 2f0efe0c81addbcaea565a6248e4a915 from Checkpoint 68 @ 1783535644646 for 2f0efe0c81addbcaea565a6248e4a915 located at file:/tmp/junit6432019912241751994/checkpoints/2f0efe0c81addbcaea565a6248e4a915/chk-68.
18:34:37.693 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
18:34:37.694 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
18:34:37.695 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job 2f0efe0c81addbcaea565a6248e4a915: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:37.695 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
18:34:37.695 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 1bed232f-62eb-42dc-858c-7139d8e062d6 @ 127.0.0.1 (dataPort=-1) with allocation id cac6830ea48c76d0f02fea2daf2d606e
18:34:37.695 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot cac6830ea48c76d0f02fea2daf2d606e.
18:34:37.696 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2f0efe0c81addbcaea565a6248e4a915) switched from state RESTARTING to RUNNING.
18:34:37.696 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job 2f0efe0c81addbcaea565a6248e4a915 from Checkpoint 68 @ 1783535644646 for 2f0efe0c81addbcaea565a6248e4a915 located at file:/tmp/junit6432019912241751994/checkpoints/2f0efe0c81addbcaea565a6248e4a915/chk-68.
18:34:37.697 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id cac6830ea48c76d0f02fea2daf2d606e.
18:34:37.697 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
18:34:37.697 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
18:34:37.695 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 68 for source Source: KuduSource to checkpoint.
18:34:37.698 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 2 to checkpoint 68 for source Source: KuduSource to checkpoint.
18:34:37.698 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
18:34:37.698 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 1bed232f-62eb-42dc-858c-7139d8e062d6 @ 127.0.0.1 (dataPort=-1) with allocation id 724a237c36a82d0d22572c72ade5813d
18:34:37.698 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job 2f0efe0c81addbcaea565a6248e4a915: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:34:37.704 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 724a237c36a82d0d22572c72ade5813d.
18:34:37.705 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id 724a237c36a82d0d22572c72ade5813d.
18:34:37.706 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
18:34:37.706 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
18:34:37.707 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2cb42618
18:34:37.707 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:37.707 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit6432019912241751994/checkpoints")
18:34:37.707 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
18:34:37.707 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
18:34:37.710 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1c71b218
18:34:37.711 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
18:34:37.711 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
18:34:37.713 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@291df00d
18:34:37.713 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:37.715 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit6432019912241751994/checkpoints")
18:34:37.717 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
18:34:37.718 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
18:34:37.736 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6b882545
18:34:37.738 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:37.745 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:37.745 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:37.745 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:37.745 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:37.745 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:37.746 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:37.746 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:37.746 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:37.746 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:37.746 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:37.746 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:37.746 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:37.746 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:37.755 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:37.760 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:37.766 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:37.768 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:37.771 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:37.771 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.771 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.771 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.773 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:37.773 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.773 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.773 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.775 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.775 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.775 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.775 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:37.779 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:37.779 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.779 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.779 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.782 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:37.787 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:37.793 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.793 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.793 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.794 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.794 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.795 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.795 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:37.795 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:37.796 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.796 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.796 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.796 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:37.797 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.797 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.797 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.797 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.797 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.797 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.797 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:37.806 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:37.807 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:37.807 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.807 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.807 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.808 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:37.808 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:37.808 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.808 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.808 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.808 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.808 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.808 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.808 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:37.811 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:37.812 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:37.812 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.812 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.812 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.812 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.812 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.812 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.813 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.813 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.813 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.813 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:37.819 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:37.820 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:37.820 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:37.820 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:37.820 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:37.820 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:37.820 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:37.820 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:37.820 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:37.820 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:37.820 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:37.820 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:37.820 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:37.826 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:37.826 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:37.826 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:37.826 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:37.827 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.827 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.827 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.827 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.827 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.827 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.827 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.827 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.827 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.827 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:37.828 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:37.828 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:37.828 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:37.828 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:37.828 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:37.828 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:37.829 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:37.829 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:37.829 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:37.829 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:37.829 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:37.829 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:37.829 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:37.829 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:37.830 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.830 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.830 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.830 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:37.831 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.831 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.831 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.831 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.831 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.831 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.831 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:37.833 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535677833 for job 41f18052e8363382138bde77e16b10c3.
18:34:37.846 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:37.847 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:37.847 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:37.848 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.848 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.848 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.848 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.848 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.849 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.849 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.849 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.849 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.849 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:37.849 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:37.849 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:37.849 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:37.850 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.850 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.850 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.850 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.850 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.850 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.850 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.850 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.850 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.850 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:37.851 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
18:34:37.852 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
18:34:37.868 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:37.868 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:37.868 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:37.868 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.868 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.869 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.869 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.869 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.869 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.869 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.869 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.869 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.869 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:37.886 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:37.886 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:37.887 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:37.887 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.887 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.887 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.887 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.887 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.887 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.888 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.888 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.888 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.888 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:37.888 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:37.888 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:37.888 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:37.889 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.889 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.889 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.889 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.889 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.889 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.889 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.889 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.889 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.889 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:37.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:37.585662  9679 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 9671
18:34:37.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:37.909715  9679 kernel_stack_watchdog.cc:198] Thread 9671 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
18:34:37.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:34:37.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:34:37.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:34:37.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:34:37.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:37.909915  9671 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.726s	user 0.601s	sys 1.119s
18:34:37.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:36.185674  9681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:37.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:37.911103  9671 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.727s	user 0.601s	sys 1.120s
18:34:37.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:37.913224  9683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:37.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:37.918121  9682 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1727 milliseconds
18:34:37.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:37.918288  9671 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:34:37.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:37.920063  9671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:34:37.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:37.923149  9671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:34:37.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:37.924695  9671 hybrid_clock.cc:648] HybridClock initialized: now 1783535677924621 us; error 54 us; skew 500 ppm
18:34:37.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:37.925746  9671 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:34:37.926 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:37.926 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:37.926 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:37.926 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.926 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.927 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.927 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.927 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.927 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.927 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.927 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.927 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.927 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:37.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:37.934595  9671 webserver.cc:534] Webserver started at http://127.9.79.253:35987/ using document root <none> and password file <none>
18:34:37.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:37.937388  9671 fs_manager.cc:362] Metadata directory not provided
18:34:37.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:37.937608  9671 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:34:37.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:37.938115  9671 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:34:37.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:37.943569  9671 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/data/instance:
18:34:37.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b805021949bc4ddea83c38dc4690065b"
18:34:37.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:37 on dist-test-slave-dxnw"
18:34:37.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:37.944967  9671 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/wal/instance:
18:34:37.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b805021949bc4ddea83c38dc4690065b"
18:34:37.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:37 on dist-test-slave-dxnw"
18:34:37.947 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:37.947 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:37.947 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:37.947 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.947 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.947 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.948 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.948 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.948 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.948 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.948 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.948 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.948 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:37.949 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:37.949 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:37.949 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:37.949 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.949 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.949 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.949 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.949 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.949 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.949 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:37.949 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:37.949 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:37.950 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:37.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:37.954917  9671 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.000s	sys 0.009s
18:34:37.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:37.963001  9712 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:34:37.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:37.964443  9671 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.002s
18:34:37.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:37.964818  9671 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/wal
18:34:37.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b805021949bc4ddea83c38dc4690065b"
18:34:37.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:37 on dist-test-slave-dxnw"
18:34:37.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:37.965123  9671 fs_report.cc:389] FS layout report
18:34:37.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:34:37.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/wal
18:34:37.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/wal
18:34:37.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/data/data
18:34:37.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:34:37.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:34:37.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:34:37.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:34:37.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:34:37.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:34:37.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:34:37.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:34:37.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:34:37.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:34:37.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:34:37.971 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:37.982 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:37.982 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:37.982 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:37.983 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:37.983 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:37.983 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:37.983 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:37.983 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:37.983 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:37.983 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:37.983 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:37.983 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:37.983 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:38.008 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:38.008 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:38.008 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:38.008 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.008 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.008 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.009 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.009 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.009 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.009 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.009 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.009 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.009 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:38.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.070181  9671 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:34:38.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.072137  9671 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:34:38.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.072680  9671 kserver.cc:163] Server-wide thread pool size limit: 3276
18:34:38.079 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:38.079 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:38.079 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:38.079 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:38.079 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:38.079 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:38.079 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:38.079 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:38.079 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:38.080 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:38.080 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:38.080 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:38.080 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:38.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.081214  9669 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } attempt: 7
18:34:38.086 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:38.086 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:38.086 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:38.087 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.087 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.087 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.087 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.087 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.087 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.088 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.088 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.088 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.088 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:38.088 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:38.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.090456  9669 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.253:36577: Network error: Client connection negotiation failed: client connection to 127.9.79.253:36577: connect: Connection refused (error 111)
18:34:38.122 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:38.122 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:38.122 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:38.123 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:38.123 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:38.123 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:38.123 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:38.124 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:38.124 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:38.124 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:38.124 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:38.124 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:38.124 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:38.156 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:38.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.163268  9671 rpc_server.cc:307] RPC server started. Bound to: 127.9.79.253:36577
18:34:38.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.163494  9765 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.79.253:36577 every 8 connection(s)
18:34:38.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.166498  9671 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/data/info.pb
18:34:38.168 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:38.169 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:38.169 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:38.169 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.169 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.169 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.169 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.169 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.169 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.169 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.169 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.170 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.170 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:38.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.173914  9766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:38.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.176049  9535 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 9671
18:34:38.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.176544  9535 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-1/wal/instance
18:34:38.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.179134  9535 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:38.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:38.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/wal
18:34:38.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/data
18:34:38.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:34:38.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:34:38.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:34:38.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:38.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:38.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:38.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/logs
18:34:38.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/data/info.pb
18:34:38.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:38.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.79.252:38727
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.79.252
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.79.212:43203
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.79.254:42669,127.9.79.253:36577,127.9.79.252:38727
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:34:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43255/jwks.json with env {}
18:34:38.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:38.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.188186  9766 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } has no permanent_uuid. Determining permanent_uuid...
18:34:38.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.223091  9766 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } has no permanent_uuid. Determining permanent_uuid...
18:34:38.224 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:38.224 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:38.224 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:38.225 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:38.225 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:38.225 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:38.225 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:38.225 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:38.225 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:38.226 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:38.226 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:38.226 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:38.226 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:38.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.243938  9766 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } has no permanent_uuid. Determining permanent_uuid...
18:34:38.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.247682  9714 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.79.252:38727: connect: Connection refused (error 111)
18:34:38.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.253120  9766 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.252:38727: Network error: Client connection negotiation failed: client connection to 127.9.79.252:38727: connect: Connection refused (error 111)
18:34:38.260 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:38.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.302750  9766 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } attempt: 1
18:34:38.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.309281  9766 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.252:38727: Network error: Client connection negotiation failed: client connection to 127.9.79.252:38727: connect: Connection refused (error 111)
18:34:38.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535678333 for job 41f18052e8363382138bde77e16b10c3.
18:34:38.340 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:38.340 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:38.340 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:38.340 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:38.340 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:38.340 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:38.340 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:38.340 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:38.340 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:38.341 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:38.340 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:38.341 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:38.341 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:38.344 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:34:38.344 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
18:34:38.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.377811  9766 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } attempt: 2
18:34:38.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.383524  9766 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.252:38727: Network error: Client connection negotiation failed: client connection to 127.9.79.252:38727: connect: Connection refused (error 111)
18:34:38.418 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:38.418 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:38.418 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:38.418 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:38.418 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:38.418 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:38.418 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:38.418 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:38.418 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:38.418 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:38.418 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:38.418 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:38.419 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:38.446 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:38.447 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:38.447 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:38.447 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.447 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.447 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.447 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.447 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.447 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.447 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.447 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.447 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.448 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:38.471 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:38.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.475109  9766 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } attempt: 3
18:34:38.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.480792  9766 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.252:38727: Network error: Client connection negotiation failed: client connection to 127.9.79.252:38727: connect: Connection refused (error 111)
18:34:38.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.583616  9768 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:34:38.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.584491  9768 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:34:38.584 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:38.585 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:38.585 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:38.585 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:38.585 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:38.585 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:38.585 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:38.585 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:38.585 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:38.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.585467  9768 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:34:38.585 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:38.585 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:38.585 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:38.585 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:38.588 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:38.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.624333  9766 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } attempt: 4
18:34:38.628 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:38.629 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:38.629 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:38.629 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.629 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.629 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.629 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.629 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.629 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.629 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.629 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.630 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.630 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:38.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.630055  9766 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.252:38727: Network error: Client connection negotiation failed: client connection to 127.9.79.252:38727: connect: Connection refused (error 111)
18:34:38.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.631431  9768 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:34:38.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.631779  9768 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:34:38.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.632014  9768 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:34:38.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.632243  9768 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:34:38.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.632460  9768 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:34:38.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.632627  9768 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43255/jwks.json
18:34:38.656 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.680054  9768 master_runner.cc:387] Master server non-default flags:
18:34:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.79.212:43203
18:34:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/data
18:34:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/wal
18:34:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:34:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.79.254:42669,127.9.79.253:36577,127.9.79.252:38727
18:34:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:34:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.79.252:38727
18:34:38.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43255/jwks.json
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/data/info.pb
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.79.252
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/logs
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:34:38.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:34:38.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:38.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.681915  9768 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:34:38.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.684000  9768 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:34:38.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.710170  9778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:38.729 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:38.729 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:38.729 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:38.729 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.729 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.729 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.729 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.729 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.729 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.730 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.730 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.730 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.730 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:38.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:38.788 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:38.788 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:38.788 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:38.789 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.789 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.789 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.789 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.789 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:38.789 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.789 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.789 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:38.789 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:38.789 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:38.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535678833 for job 41f18052e8363382138bde77e16b10c3.
18:34:38.844 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:34:38.845 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
18:34:38.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:38.929605  9766 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } attempt: 5
18:34:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.936515  9766 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.252:38727: Network error: Client connection negotiation failed: client connection to 127.9.79.252:38727: connect: Connection refused (error 111)
18:34:38.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:38.994 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:38.994 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:38.995 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:38.995 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:38.995 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:38.995 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:38.995 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:38.995 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:38.995 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:38.995 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:38.995 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:38.995 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:38.996 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:39.015 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:39.015 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:39.016 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:39.016 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:39.016 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:39.016 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:39.016 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:39.016 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:39.016 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:39.016 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:39.016 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:39.016 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:39.016 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:39.087 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:39.157 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:39.160 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:39.160 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:39.160 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:39.160 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:39.160 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:39.160 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:39.161 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:39.161 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:39.161 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:39.161 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:39.161 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:39.161 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:39.161 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:39.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:39.206 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:39.207 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:39.207 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:39.207 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:39.207 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:39.207 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:39.207 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:39.207 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:39.207 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:39.207 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:39.207 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:39.207 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:39.207 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:39.246 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:39.247 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:39.247 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:39.247 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:39.247 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:39.247 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:39.247 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:39.247 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:39.247 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:39.247 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:39.247 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:39.247 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:39.248 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:39.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:39.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535679333 for job 41f18052e8363382138bde77e16b10c3.
18:34:39.342 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:34:39.343 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
18:34:39.367 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:39.367 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:39.367 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:39.368 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:39.368 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:39.368 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:39.368 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:39.368 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:39.368 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:39.368 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:39.368 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:39.368 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:39.368 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:39.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:39.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:39.484073  9766 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } attempt: 6
18:34:39.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:39.493526  9766 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.252:38727: Network error: Client connection negotiation failed: client connection to 127.9.79.252:38727: connect: Connection refused (error 111)
18:34:39.587 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:39.642 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:39.642 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:39.642 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:39.642 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:39.642 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:39.642 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:39.642 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:39.642 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:39.643 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:39.643 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:39.643 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:39.643 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:39.643 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:39.657 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:39.660 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:39.661 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:39.661 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:39.661 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:39.661 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:39.661 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:39.661 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:39.661 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:39.661 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:39.661 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:39.661 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:39.661 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:39.662 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:39.678 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:39.678 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:39.678 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:39.678 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:39.678 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:39.678 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:39.679 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:39.679 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:39.679 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:39.679 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:39.679 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:39.679 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:39.679 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:39.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:39.687 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:39.687 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:39.687 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:39.687 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:39.687 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:39.687 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:39.688 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:39.688 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:39.688 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:39.688 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:39.688 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:39.688 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:39.688 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:39.759 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:39.759 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:39.759 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:39.759 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:39.759 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:39.760 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:39.760 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:39.760 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:39.760 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:39.760 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:39.760 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:39.760 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:39.760 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:39.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:39.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535679833 for job 41f18052e8363382138bde77e16b10c3.
18:34:39.841 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:34:39.842 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
18:34:39.859 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:39.860 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:39.860 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:39.860 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:39.860 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:39.860 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:39.860 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:39.860 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:39.860 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:39.860 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:39.860 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:39.860 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:39.861 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:39.863 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:39.863 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:39.863 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:39.863 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:39.863 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:39.863 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:39.863 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:39.863 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:39.863 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:39.863 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:39.864 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:39.864 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:39.864 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:39.883 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:39.884 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:39.884 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:39.884 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:39.884 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:39.884 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:39.884 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:39.884 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:39.884 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:39.884 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:39.884 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:39.884 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:39.884 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:39.942 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:39.942 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:39.942 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:39.943 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:39.943 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:39.943 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:39.943 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:39.943 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:39.943 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:39.943 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:39.943 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:39.943 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:39.943 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:39.966 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:39.966 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:39.967 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:39.967 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:39.967 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:39.967 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:39.967 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:39.967 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:39.967 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:39.967 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:39.967 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:39.967 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:39.967 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:39.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:40.064 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:40.064 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:40.064 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:40.064 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:40.064 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:40.064 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:40.064 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:40.064 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:40.064 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:40.064 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:40.065 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:40.065 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:40.065 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:40.074 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:40.074 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:40.074 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:40.074 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:40.074 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:40.075 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:40.075 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:40.075 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:40.075 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:40.075 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:40.075 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:40.075 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:40.075 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:40.087 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:40.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.712931  9779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:40.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:38.715776  9781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:40.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:40.093952  9780 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
18:34:40.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.094095  9768 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:34:40.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.099084  9768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:34:40.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.102273  9768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:34:40.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.103643  9768 hybrid_clock.cc:648] HybridClock initialized: now 1783535680103613 us; error 40 us; skew 500 ppm
18:34:40.104 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:40.104 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:40.104 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:40.104 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:40.104 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:40.105 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:40.105 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:40.105 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:40.105 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:40.105 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:40.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.104755  9768 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:34:40.105 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:40.105 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:40.105 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:40.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.111752  9768 webserver.cc:534] Webserver started at http://127.9.79.252:43271/ using document root <none> and password file <none>
18:34:40.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.112848  9768 fs_manager.cc:362] Metadata directory not provided
18:34:40.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.113094  9768 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:34:40.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.113631  9768 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:34:40.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.118801  9768 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/data/instance:
18:34:40.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8b4eedf4ce954d9e99683de488bb937f"
18:34:40.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:40 on dist-test-slave-dxnw"
18:34:40.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.120137  9768 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/wal/instance:
18:34:40.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8b4eedf4ce954d9e99683de488bb937f"
18:34:40.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:40 on dist-test-slave-dxnw"
18:34:40.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.128631  9768 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.004s
18:34:40.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.134492  9790 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:34:40.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.135744  9768 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
18:34:40.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.136081  9768 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/wal
18:34:40.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8b4eedf4ce954d9e99683de488bb937f"
18:34:40.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:40 on dist-test-slave-dxnw"
18:34:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.136513  9768 fs_report.cc:389] FS layout report
18:34:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:34:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/wal
18:34:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/wal
18:34:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/data/data
18:34:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:34:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:34:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:34:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:34:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:34:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:34:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:34:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:34:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:34:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:34:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:34:40.140 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:40.140 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:40.140 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:40.140 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:40.141 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:40.141 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:40.141 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:40.141 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:40.141 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:40.141 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:40.141 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:40.141 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:40.141 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:40.157 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:40.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.180922  9669 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } attempt: 8
18:34:40.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:40.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.202239  9669 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } has no permanent_uuid. Determining permanent_uuid...
18:34:40.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.203636  9768 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:34:40.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.205732  9768 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:34:40.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.206331  9768 kserver.cc:163] Server-wide thread pool size limit: 3276
18:34:40.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:40.213958  9669 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.252:38727: Network error: Client connection negotiation failed: client connection to 127.9.79.252:38727: connect: Connection refused (error 111)
18:34:40.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:40.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.279517  9669 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } attempt: 1
18:34:40.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:40.284871  9669 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.79.252:38727: Network error: Client connection negotiation failed: client connection to 127.9.79.252:38727: connect: Connection refused (error 111)
18:34:40.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.301580  9768 rpc_server.cc:307] RPC server started. Bound to: 127.9.79.252:38727
18:34:40.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.301733  9844 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.79.252:38727 every 8 connection(s)
18:34:40.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.304800  9768 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/data/info.pb
18:34:40.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.305531  9535 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 9768
18:34:40.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.306229  9535 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/master-2/wal/instance
18:34:40.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.313026  9845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:40.320 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:40.320 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:40.321 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:40.321 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:40.321 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:40.321 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:40.322 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:40.322 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:40.322 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:40.322 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:40.322 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:40.322 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:40.322 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:40.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535680333 for job 41f18052e8363382138bde77e16b10c3.
18:34:40.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.338281  9669 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } attempt: 2
18:34:40.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.337373  9845 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } has no permanent_uuid. Determining permanent_uuid...
18:34:40.344 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:34:40.346 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
18:34:40.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.371100  9845 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } has no permanent_uuid. Determining permanent_uuid...
18:34:40.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.384130  9669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4: Bootstrap starting.
18:34:40.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.388024  9845 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } has no permanent_uuid. Determining permanent_uuid...
18:34:40.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.398180  9669 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4: Neither blocks nor log segments found. Creating new log.
18:34:40.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.400866  9669 log.cc:826] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4: Log is configured to *not* fsync() on all Append() calls
18:34:40.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.408505  9669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4: No bootstrap required, opened a new log
18:34:40.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.412298  9845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f: Bootstrap starting.
18:34:40.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.420499  9845 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f: Neither blocks nor log segments found. Creating new log.
18:34:40.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.423095  9845 log.cc:826] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f: Log is configured to *not* fsync() on all Append() calls
18:34:40.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.431811  9845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f: No bootstrap required, opened a new log
18:34:40.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.440531  9669 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } }
18:34:40.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.441386  9669 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:40.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.441746  9669 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c447fcdaf2d4b33acd5d5b7de8af8e4, State: Initialized, Role: FOLLOWER
18:34:40.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.442782  9669 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } }
18:34:40.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.445753  9855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } } }
18:34:40.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.446499  9855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [sys.catalog]: This master's current role is: FOLLOWER
18:34:40.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.447602  9669 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [sys.catalog]: configured and running, proceeding with master startup.
18:34:40.459 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:40.459 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:40.459 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:40.459 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:40.459 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:40.460 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:40.460 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:40.460 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:40.460 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:40.459 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:40.460 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:40.460 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:40.460 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:40.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.463208  9845 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } }
18:34:40.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.464331  9845 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:40.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.464668  9845 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4eedf4ce954d9e99683de488bb937f, State: Initialized, Role: FOLLOWER
18:34:40.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.465967  9845 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } }
18:34:40.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:40.473 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:40.473 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:40.473 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:40.473 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:40.473 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:40.474 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:40.474 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:40.474 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:40.474 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:40.474 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:40.474 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:40.474 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:40.474 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:40.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.474664  9862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } } }
18:34:40.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.478644  9845 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f [sys.catalog]: configured and running, proceeding with master startup.
18:34:40.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.482439  9862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f [sys.catalog]: This master's current role is: FOLLOWER
18:34:40.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:40.502614  9869 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:34:40.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:40.503157  9869 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:34:40.508 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:40.508 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:40.508 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:40.509 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:40.509 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:40.509 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:40.509 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:40.509 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:40.509 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:40.509 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:40.509 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:40.510 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:40.510 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:40.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.498484  9547 master_runner.cc:187] Error getting master registration for 127.9.79.253:36577: OK, instance_id { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" instance_seqno: 1783535678140370 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:34:40.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.533872  9547 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:34:40.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.534345  9879 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
18:34:40.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.553963  9766 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } attempt: 7
18:34:40.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.545624  9768 master_runner.cc:187] Error getting master registration for 127.9.79.253:36577: OK, instance_id { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" instance_seqno: 1783535678140370 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:34:40.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.572602  9768 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:34:40.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.584911  9766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b: Bootstrap starting.
18:34:40.586 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:40.586 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:40.586 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:40.587 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:40.587 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:40.587 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:40.587 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:40.587 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:40.587 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:40.587 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:40.588 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:40.588 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:40.588 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:40.588 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:40.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.595458  9766 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b: Neither blocks nor log segments found. Creating new log.
18:34:40.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.598536  9766 log.cc:826] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b: Log is configured to *not* fsync() on all Append() calls
18:34:40.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.604513  9766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b: No bootstrap required, opened a new log
18:34:40.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:40.610219  9623 tablet.cc:2406] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:34:40.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.633340  9766 raft_consensus.cc:359] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } }
18:34:40.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.634509  9766 raft_consensus.cc:385] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:40.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.634964  9766 raft_consensus.cc:740] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b805021949bc4ddea83c38dc4690065b, State: Initialized, Role: FOLLOWER
18:34:40.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.636035  9766 consensus_queue.cc:260] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } }
18:34:40.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.639107  9882 sys_catalog.cc:455] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } } }
18:34:40.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.639954  9882 sys_catalog.cc:458] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b [sys.catalog]: This master's current role is: FOLLOWER
18:34:40.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.640906  9766 sys_catalog.cc:565] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b [sys.catalog]: configured and running, proceeding with master startup.
18:34:40.657 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:40.675 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:40.675 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:40.675 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:40.676 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:40.676 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:40.676 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:40.676 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:40.676 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:40.676 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:40.676 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:40.676 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:40.676 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:40.676 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:40.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:40.674897  9893 catalog_manager.cc:1593] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:34:40.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:40.677666  9893 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:34:40.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:40.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.684639  9671 master_runner.cc:264] No leader master found from master b805021949bc4ddea83c38dc4690065b
18:34:40.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.685014  9671 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:34:40.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:40.716328  9799 tablet.cc:2406] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:34:40.743 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:40.743 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:40.743 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:40.743 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:40.743 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:40.743 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:40.743 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:40.743 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:40.743 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:40.744 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:40.744 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:40.744 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:40.744 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:40.760 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:40.785 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:40.786 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:40.786 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:40.786 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:40.786 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:40.786 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:40.787 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:40.787 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:40.787 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:40.787 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:40.787 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:40.787 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:40.787 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:40.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.825977  9855 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:40.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.826563  9855 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } }
18:34:40.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.830579  9741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b805021949bc4ddea83c38dc4690065b" is_pre_election: true
18:34:40.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.831243  9820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4eedf4ce954d9e99683de488bb937f" is_pre_election: true
18:34:40.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.831527  9741 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c447fcdaf2d4b33acd5d5b7de8af8e4 in term 0.
18:34:40.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.832137  9820 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c447fcdaf2d4b33acd5d5b7de8af8e4 in term 0.
18:34:40.835 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535680834 for job 41f18052e8363382138bde77e16b10c3.
18:34:40.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:40.832995  9718 tablet.cc:2406] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:34:40.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.833184  9618 leader_election.cc:304] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c447fcdaf2d4b33acd5d5b7de8af8e4, b805021949bc4ddea83c38dc4690065b; no voters: 
18:34:40.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.834205  9855 leader_election.cc:290] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b805021949bc4ddea83c38dc4690065b (127.9.79.253:36577), 8b4eedf4ce954d9e99683de488bb937f (127.9.79.252:38727)
18:34:40.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.834810  9855 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:34:40.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.835172  9855 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:34:40.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.835479  9855 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [term 0 FOLLOWER]: Advancing to term 1
18:34:40.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.844879  9855 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } }
18:34:40.845 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:34:40.847 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
18:34:40.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.848483  9820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4eedf4ce954d9e99683de488bb937f"
18:34:40.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.848542  9741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b805021949bc4ddea83c38dc4690065b"
18:34:40.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.849088  9820 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f [term 0 FOLLOWER]: Advancing to term 1
18:34:40.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.849107  9741 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b [term 0 FOLLOWER]: Advancing to term 1
18:34:40.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.857436  9820 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c447fcdaf2d4b33acd5d5b7de8af8e4 in term 1.
18:34:40.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.859216  9619 leader_election.cc:304] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c447fcdaf2d4b33acd5d5b7de8af8e4, 8b4eedf4ce954d9e99683de488bb937f; no voters: 
18:34:40.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.859486  9741 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c447fcdaf2d4b33acd5d5b7de8af8e4 in term 1.
18:34:40.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.860737  9895 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [term 1 FOLLOWER]: Leader election won for term 1
18:34:40.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.862510  9855 leader_election.cc:290] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [CANDIDATE]: Term 1 election: Requested vote from peers b805021949bc4ddea83c38dc4690065b (127.9.79.253:36577), 8b4eedf4ce954d9e99683de488bb937f (127.9.79.252:38727)
18:34:40.866 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:40.866 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:40.866 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:40.866 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:40.866 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:40.866 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:40.867 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:40.867 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:40.867 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:40.867 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:40.868 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:40.868 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:40.868 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:40.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.869076  9895 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [term 1 LEADER]: Becoming Leader. State: Replica: 5c447fcdaf2d4b33acd5d5b7de8af8e4, State: Running, Role: LEADER
18:34:40.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.870209  9895 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } }
18:34:40.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.892637  9855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c447fcdaf2d4b33acd5d5b7de8af8e4. Latest consensus state: current_term: 1 leader_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } } }
18:34:40.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.893391  9855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [sys.catalog]: This master's current role is: LEADER
18:34:40.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.896736  9898 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:34:40.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.904428  9898 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:34:40.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.922142  9820 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f [term 1 FOLLOWER]: Refusing update from remote peer 5c447fcdaf2d4b33acd5d5b7de8af8e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:34:40.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.922760  9741 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b [term 1 FOLLOWER]: Refusing update from remote peer 5c447fcdaf2d4b33acd5d5b7de8af8e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:34:40.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.924650  9855 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:34:40.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.925375  9895 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:34:40.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.962476  9862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c447fcdaf2d4b33acd5d5b7de8af8e4. Latest consensus state: current_term: 1 leader_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } } }
18:34:40.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.963471  9862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f [sys.catalog]: This master's current role is: FOLLOWER
18:34:40.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.969519  9882 sys_catalog.cc:455] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c447fcdaf2d4b33acd5d5b7de8af8e4. Latest consensus state: current_term: 1 leader_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } } }
18:34:40.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.970350  9882 sys_catalog.cc:458] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b [sys.catalog]: This master's current role is: FOLLOWER
18:34:40.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:40.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.980644  9901 mvcc.cc:204] Tried to move back new op lower bound from 7305362149033791488 to 7305362148856311808. Current Snapshot: MvccSnapshot[applied={T|T < 7305362149033791488}]
18:34:40.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.983948  9895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } } }
18:34:40.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.984695  9895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [sys.catalog]: This master's current role is: LEADER
18:34:40.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.985402  9895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } } }
18:34:40.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.986032  9895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4 [sys.catalog]: This master's current role is: LEADER
18:34:40.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.991575  9882 sys_catalog.cc:455] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } } }
18:34:40.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.992317  9882 sys_catalog.cc:458] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b [sys.catalog]: This master's current role is: FOLLOWER
18:34:41.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:40.999433  9862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c447fcdaf2d4b33acd5d5b7de8af8e4" member_type: VOTER last_known_addr { host: "127.9.79.254" port: 42669 } } peers { permanent_uuid: "b805021949bc4ddea83c38dc4690065b" member_type: VOTER last_known_addr { host: "127.9.79.253" port: 36577 } } peers { permanent_uuid: "8b4eedf4ce954d9e99683de488bb937f" member_type: VOTER last_known_addr { host: "127.9.79.252" port: 38727 } } }
18:34:41.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.000965  9862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f [sys.catalog]: This master's current role is: FOLLOWER
18:34:41.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.006688  9898 catalog_manager.cc:1382] Generated new cluster ID: c657677e6341499288f7bf829e321451
18:34:41.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.007035  9898 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:34:41.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.057050  9898 catalog_manager.cc:1405] Generated new certificate authority record
18:34:41.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.059926  9898 catalog_manager.cc:1539] Loading token signing keys...
18:34:41.088 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:41.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.095371  9898 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 5c447fcdaf2d4b33acd5d5b7de8af8e4: Generated new TSK 0
18:34:41.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.097790  9898 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.131793  9535 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/wal
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/data
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/logs
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/data/info.pb
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:41.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:41.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:34:41.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:34:41.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.79.193:0
18:34:41.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.79.193
18:34:41.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.79.193
18:34:41.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:41.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.79.254:42669,127.9.79.253:36577,127.9.79.252:38727
18:34:41.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.79.212:43203
18:34:41.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:41.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:41.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:34:41.157 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:41.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:41.202 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:41.202 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:41.203 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:41.203 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:41.203 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:41.203 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:41.203 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:41.203 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:41.203 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:41.204 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:41.204 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:41.204 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:41.204 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:41.260 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:41.335 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535681333 for job 41f18052e8363382138bde77e16b10c3.
18:34:41.349 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
18:34:41.351 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
18:34:41.380 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:41.380 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:41.380 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:41.380 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:41.380 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:41.380 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:41.380 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:41.380 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:41.380 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:41.381 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:41.381 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:41.381 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:41.381 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:41.381 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:41.381 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:41.382 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:41.382 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:41.382 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:41.382 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:41.382 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:41.382 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:41.382 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:41.382 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:41.382 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:41.382 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:41.382 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:41.444 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:41.445 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:41.445 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:41.445 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:41.445 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:41.445 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:41.446 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:41.446 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:41.446 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:41.446 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:41.446 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:41.446 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:41.446 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:41.471 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:41.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.542603  9879 catalog_manager.cc:1294] Loaded cluster ID: c657677e6341499288f7bf829e321451
18:34:41.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.543103  9879 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f: loading cluster ID for follower catalog manager: success
18:34:41.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.554755  9879 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f: acquiring CA information for follower catalog manager: success
18:34:41.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.573253  9879 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 8b4eedf4ce954d9e99683de488bb937f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:34:41.588 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:41.588 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:41.588 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:41.589 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:41.589 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:41.589 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:41.589 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:41.590 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:41.590 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:41.590 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:41.590 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:41.590 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:41.590 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:41.590 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:41.656 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:41.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:41.682 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:41.682 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:41.682 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:41.683 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:41.683 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:41.683 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:41.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.683213  9893 catalog_manager.cc:1294] Loaded cluster ID: c657677e6341499288f7bf829e321451
18:34:41.683 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:41.683 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:41.683 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:41.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.683599  9893 catalog_manager.cc:1587] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b: loading cluster ID for follower catalog manager: success
18:34:41.683 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:41.684 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:41.684 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:41.684 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:41.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:41.691382  9907 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:34:41.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:41.692101  9907 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:34:41.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:41.692863  9907 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:34:41.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.713460  9893 catalog_manager.cc:1609] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b: acquiring CA information for follower catalog manager: success
18:34:41.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.719349  9893 catalog_manager.cc:1637] T 00000000000000000000000000000000 P b805021949bc4ddea83c38dc4690065b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:34:41.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:41.752278  9907 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:34:41.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:41.753621  9907 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.79.193
18:34:41.760 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:41.760 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:41.760 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:41.760 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:41.760 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:41.760 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:41.760 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:41.761 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:41.761 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:41.761 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:41.761 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:41.761 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:41.761 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:41.761 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:41.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.819470  9907 tablet_server_runner.cc:78] Tablet server non-default flags:
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.79.212:43203
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/data
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/wal
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.79.193:0
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/data/info.pb
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.79.193
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.79.254:42669,127.9.79.253:36577,127.9.79.252:38727
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.79.193
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/logs
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:34:41.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:34:41.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.821156  9907 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:34:41.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:41.823220  9907 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:34:41.833 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535681833 for job 41f18052e8363382138bde77e16b10c3.
18:34:41.848 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
18:34:41.849 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
18:34:41.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:41.882388  9915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:41.905 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:41.905 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:41.905 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:41.906 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:41.906 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:41.906 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:41.906 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:41.907 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:41.907 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:41.907 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:41.907 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:41.907 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:41.907 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:41.974 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:42.004 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:42.004 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:42.004 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:42.004 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:42.005 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:42.005 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:42.005 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:42.005 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:42.005 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:42.005 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:42.005 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:42.005 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:42.005 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:42.088 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:42.100 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:42.100 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:42.100 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:42.100 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:42.100 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:42.100 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:42.101 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:42.101 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:42.101 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:42.101 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:42.101 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:42.101 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:42.101 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:42.127 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:42.128 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:42.128 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:42.128 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:42.128 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:42.128 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:42.129 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:42.129 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:42.129 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:42.129 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:42.129 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:42.129 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:42.129 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:42.156 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:42.181 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:42.181 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:42.181 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:42.181 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:42.182 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:42.182 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:42.183 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:42.183 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:42.183 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:42.183 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:42.184 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:42.184 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:42.184 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:42.184 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:42.260 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:42.267 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:42.267 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:42.267 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:42.268 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:42.268 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:42.268 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:42.268 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:42.268 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:42.268 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:42.269 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:42.269 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:42.269 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:42.269 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:42.274 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:42.274 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:42.275 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:42.275 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:42.275 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:42.275 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:42.275 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:42.275 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:42.275 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:42.276 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:42.276 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:42.276 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:42.276 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:42.333 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535682333 for job 41f18052e8363382138bde77e16b10c3.
18:34:42.342 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
18:34:42.343 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
18:34:42.347 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:42.347 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:42.347 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:42.347 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:42.347 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:42.347 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:42.348 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:42.348 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:42.348 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:42.348 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:42.348 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:42.348 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:42.348 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:42.348 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:42.349 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:42.349 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:42.349 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:42.349 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:42.349 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:42.349 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:42.349 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:42.349 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:42.349 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:42.349 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:42.349 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:42.349 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:42.362 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:42.363 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:42.363 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:42.363 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:42.363 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:42.363 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:42.363 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:42.363 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:42.363 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:42.364 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:42.364 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:42.364 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:42.364 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:42.438 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:42.439 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:42.439 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:42.439 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:42.439 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:42.439 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:42.439 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:42.439 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:42.439 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:42.440 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:42.440 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:42.440 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:42.440 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:42.447 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:42.447 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:42.447 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:42.447 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:42.447 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:42.447 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:42.447 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:42.447 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:42.448 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:42.448 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:42.448 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:42.448 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:42.448 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:42.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:42.587 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:42.656 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:42.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:42.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:42.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535682833 for job 41f18052e8363382138bde77e16b10c3.
18:34:42.853 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
18:34:42.855 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
18:34:42.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:42.986 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:42.986 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:42.987 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:42.987 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:42.987 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:42.987 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:42.987 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:42.987 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:42.987 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:42.988 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:42.988 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:42.988 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:42.988 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:42.999 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:43.000 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:43.000 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:43.000 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:43.000 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:43.000 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:43.001 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:43.001 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:43.001 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:43.001 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:43.002 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:43.002 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:43.004 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:43.087 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:43.156 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:43.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:43.181725  9762 debug-util.cc:398] Leaking SignalData structure 0x7b08000813e0 after lost signal to thread 9675
18:34:43.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:43.182399  9762 debug-util.cc:398] Leaking SignalData structure 0x7b080003e3c0 after lost signal to thread 9765
18:34:43.187 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:43.260 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:43.284 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:43.284 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:43.284 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:43.285 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:43.285 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:43.285 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:43.285 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:43.285 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:43.286 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:43.286 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:43.286 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:43.286 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:43.286 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:43.304 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:43.304 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:43.304 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:43.304 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:43.304 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:43.304 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:43.304 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:43.304 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:43.304 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:43.305 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:43.305 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:43.305 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:43.305 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:43.315 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:43.315 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:43.315 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:43.315 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:43.315 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:43.316 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:43.316 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:43.316 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:43.316 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:43.316 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:43.316 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:43.316 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:43.316 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:43.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535683333 for job 41f18052e8363382138bde77e16b10c3.
18:34:43.342 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:34:43.345 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
18:34:43.438 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:43.439 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:43.439 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:43.439 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:43.440 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:43.440 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:43.440 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:43.440 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:43.440 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:43.441 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:43.441 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:43.441 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:43.441 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:43.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:43.503 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:43.504 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:43.504 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:43.504 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:43.504 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:43.504 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:43.504 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:43.504 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:43.504 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:43.504 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:43.504 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:43.504 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:43.505 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:43.505 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:43.505 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:43.505 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:43.505 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:43.505 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:43.505 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:43.505 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:43.505 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:43.505 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:43.506 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:43.506 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:43.506 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:43.506 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:43.524 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:43.525 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:43.525 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:43.525 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:43.525 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:43.525 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:43.525 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:43.525 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:43.525 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:43.525 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:43.525 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:43.525 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:43.525 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:43.588 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:43.657 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:43.659 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:43.660 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:43.660 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:43.660 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:43.660 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:43.660 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:43.660 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:43.660 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:43.660 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:43.661 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:43.661 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:43.661 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:43.661 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:43.664 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:43.665 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:43.665 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:43.665 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:43.665 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:43.665 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:43.665 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:43.665 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:43.665 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:43.665 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:43.665 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:43.665 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:43.666 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:43.666 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:43.666 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:43.666 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:43.666 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:43.666 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:43.666 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:43.666 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:43.666 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:43.667 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:43.667 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:43.667 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:43.667 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:43.667 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:43.667 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:43.667 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:43.667 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:43.668 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:43.668 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:43.666 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:43.668 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:43.668 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:43.668 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:43.668 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:43.668 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:43.668 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:43.668 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:43.677 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:43.677 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:43.678 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:43.678 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:43.678 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:43.678 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:43.679 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:43.679 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:43.679 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:43.679 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:43.679 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:43.679 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:43.679 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:43.684 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:43.729 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:43.729 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:43.729 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:43.729 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:43.729 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:43.729 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:43.729 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:43.730 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:43.730 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:43.730 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:43.730 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:43.730 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:43.730 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:43.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:43.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535683833 for job 41f18052e8363382138bde77e16b10c3.
18:34:43.840 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
18:34:43.841 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
18:34:43.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:43.267270  9914 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 9907
18:34:43.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:43.875432  9907 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.984s	user 0.740s	sys 1.046s
18:34:43.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:43.884085  9907 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.993s	user 0.740s	sys 1.046s
18:34:43.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:41.894569  9916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:43.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:43.897876  9923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:43.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:43.903503  9907 server_base.cc:1061] running on GCE node
18:34:43.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:43.904958  9907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:34:43.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:43.920032  9907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:34:43.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:43.921491  9907 hybrid_clock.cc:648] HybridClock initialized: now 1783535683921448 us; error 48 us; skew 500 ppm
18:34:43.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:43.922631  9907 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:34:43.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:43.949115  9907 webserver.cc:534] Webserver started at http://127.9.79.193:39961/ using document root <none> and password file <none>
18:34:43.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:43.950409  9907 fs_manager.cc:362] Metadata directory not provided
18:34:43.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:43.950696  9907 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:34:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:43.951282  9907 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:34:43.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:43.957762  9907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/data/instance:
18:34:43.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7574f138ca2d45388a7343688d429edf"
18:34:43.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:43 on dist-test-slave-dxnw"
18:34:43.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:43.964246  9907 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/wal/instance:
18:34:43.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7574f138ca2d45388a7343688d429edf"
18:34:43.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:43 on dist-test-slave-dxnw"
18:34:43.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:43.980 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:43.980 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:43.980 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:43.981 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:43.981 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:43.981 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:43.982 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:43.982 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:43.982 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:43.982 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:43.982 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:43.982 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:43.982 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:43.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:43.992678  9907 fs_manager.cc:696] Time spent creating directory manager: real 0.028s	user 0.021s	sys 0.003s
18:34:44.014 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:44.014 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:44.014 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:44.014 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:44.014 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:44.015 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:44.015 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:44.014 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:44.015 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:44.015 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:44.015 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:44.015 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:44.015 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:44.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:44.025650  9928 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:34:44.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:44.027114  9907 fs_manager.cc:730] Time spent opening block manager: real 0.020s	user 0.004s	sys 0.002s
18:34:44.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:44.027524  9907 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/wal
18:34:44.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7574f138ca2d45388a7343688d429edf"
18:34:44.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:43 on dist-test-slave-dxnw"
18:34:44.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:44.028066  9907 fs_report.cc:389] FS layout report
18:34:44.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:34:44.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/wal
18:34:44.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/wal
18:34:44.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/data/data
18:34:44.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:34:44.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:34:44.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:34:44.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:34:44.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:34:44.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:34:44.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:34:44.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:34:44.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:34:44.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:34:44.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:34:44.088 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:44.128 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:44.128 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:44.129 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:44.129 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:44.129 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:44.129 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:44.130 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:44.130 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:44.130 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:44.130 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:44.130 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:44.130 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:44.130 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:44.133 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:44.133 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:44.133 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:44.133 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:44.133 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:44.133 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:44.134 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:44.134 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:44.134 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:44.134 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:44.134 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:44.134 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:44.134 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:44.134 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:44.135 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:44.135 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:44.135 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:44.135 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:44.135 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:44.136 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:44.136 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:44.136 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:44.136 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:44.136 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:44.136 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:44.136 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:44.157 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:44.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:44.170768  9907 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:34:44.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:44.172793  9907 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:34:44.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:44.173352  9907 kserver.cc:163] Server-wide thread pool size limit: 3276
18:34:44.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:44.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:44.195065  9907 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:34:44.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:44.206669  9907 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:34:44.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:44.207028  9907 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:34:44.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:44.207439  9907 ts_tablet_manager.cc:616] Registered 0 tablets
18:34:44.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:44.207684  9907 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:34:44.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:44.301 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:44.301 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:44.301 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:44.302 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:44.302 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:44.302 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:44.302 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:44.302 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:44.302 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:44.302 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:44.302 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:44.302 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:44.302 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:44.314 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:44.315 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:44.315 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:44.315 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:44.315 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:44.315 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:44.316 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:44.316 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:44.316 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:44.316 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:44.316 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:44.316 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:44.316 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:44.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535684333 for job 41f18052e8363382138bde77e16b10c3.
18:34:44.340 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
18:34:44.342 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
18:34:44.343 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:44.343 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:44.344 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:44.344 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:44.345 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:44.345 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:44.345 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:44.345 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:44.345 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:44.345 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:44.345 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:44.345 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:44.345 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:44.364 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:44.365 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:44.365 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:44.366 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:44.366 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:44.366 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:44.366 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:44.366 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:44.366 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:44.367 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:44.367 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:44.367 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:44.367 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:44.423 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:44.423 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:44.423 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:44.423 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:44.423 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:44.423 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:44.423 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:44.423 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:44.423 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:44.423 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:44.423 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:44.424 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:44.424 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:44.459 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:44.460 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:44.460 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:44.460 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:44.460 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:44.460 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:44.460 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:44.460 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:44.460 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:44.461 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:44.461 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:44.461 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:44.461 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:44.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:44.588 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:44.659 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:44.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:44.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:44.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535684833 for job 41f18052e8363382138bde77e16b10c3.
18:34:44.842 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
18:34:44.844 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
18:34:44.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:45.061 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:45.061 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:45.062 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:45.062 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:45.062 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:45.062 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:45.063 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:45.063 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:45.063 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:45.063 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:45.063 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:45.063 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:45.063 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:45.088 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:45.113 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:45.113 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:45.113 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:45.114 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:45.114 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:45.114 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:45.114 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:45.114 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:45.115 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:45.115 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:45.115 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:45.115 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:45.115 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:45.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.116696 10043 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.79.193:42499 every 8 connection(s)
18:34:45.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.117429  9907 rpc_server.cc:307] RPC server started. Bound to: 127.9.79.193:42499
18:34:45.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.121871  9907 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/data/info.pb
18:34:45.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.129765  9535 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 9907
18:34:45.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.130431  9535 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-0/wal/instance
18:34:45.142 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:45.142 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:45.142 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:45.142 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:45.142 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:45.143 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:45.143 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:45.143 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:45.143 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:45.144 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:45.144 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:45.144 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:45.144 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.144187  9535 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/wal
18:34:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/data
18:34:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:34:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:34:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:34:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:45.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/logs
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/data/info.pb
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.79.194:0
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.79.194
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.79.194
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.79.254:42669,127.9.79.253:36577,127.9.79.252:38727
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.79.212:43203
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:45.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:34:45.157 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:45.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:45.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.250670 10046 heartbeater.cc:344] Connected to a master server at 127.9.79.253:36577
18:34:45.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.251250 10046 heartbeater.cc:461] Registering TS with master...
18:34:45.252 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:45.253 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:45.253 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:45.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.252712 10046 heartbeater.cc:507] Master 127.9.79.253:36577 requested a full tablet report, sending...
18:34:45.253 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:45.253 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:45.253 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:45.254 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:45.254 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:45.254 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:45.254 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:45.254 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:45.254 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:45.254 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:45.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.257079  9731 ts_manager.cc:194] Registered new tserver with Master: 7574f138ca2d45388a7343688d429edf (127.9.79.193:42499)
18:34:45.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:45.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.266881 10051 heartbeater.cc:344] Connected to a master server at 127.9.79.254:42669
18:34:45.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.267331 10051 heartbeater.cc:461] Registering TS with master...
18:34:45.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.268448 10051 heartbeater.cc:507] Master 127.9.79.254:42669 requested a full tablet report, sending...
18:34:45.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.271555  9634 ts_manager.cc:194] Registered new tserver with Master: 7574f138ca2d45388a7343688d429edf (127.9.79.193:42499)
18:34:45.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.275799  9634 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.79.193:39905
18:34:45.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.278502 10044 heartbeater.cc:344] Connected to a master server at 127.9.79.252:38727
18:34:45.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.278920 10044 heartbeater.cc:461] Registering TS with master...
18:34:45.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.279971 10044 heartbeater.cc:507] Master 127.9.79.252:38727 requested a full tablet report, sending...
18:34:45.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.285550  9810 ts_manager.cc:194] Registered new tserver with Master: 7574f138ca2d45388a7343688d429edf (127.9.79.193:42499)
18:34:45.335 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535685333 for job 41f18052e8363382138bde77e16b10c3.
18:34:45.343 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:34:45.344 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
18:34:45.471 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:45.589 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:45.608 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:45.609 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:45.609 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:45.609 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:45.609 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:45.609 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:45.609 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:45.609 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:45.609 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:45.609 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:45.609 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:45.609 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:45.609 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:45.618 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:45.618 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:45.618 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:45.619 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:45.619 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:45.619 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:45.619 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:45.619 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:45.619 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:45.619 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:45.619 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:45.619 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:45.619 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:45.620 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:45.620 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:45.620 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:45.620 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:45.621 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:45.621 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:45.621 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:45.621 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:45.621 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:45.621 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:45.621 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:45.621 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:45.621 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:45.657 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:45.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:45.722 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:45.722 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:45.722 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:45.722 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:45.723 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:45.723 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:45.723 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:45.723 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:45.723 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:45.723 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:45.723 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:45.723 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:45.723 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:45.760 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:45.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:45.799819 10048 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:34:45.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:45.800455 10048 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:34:45.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:45.801196 10048 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:34:45.826 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:45.826 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:45.826 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:45.827 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:45.827 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:45.827 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:45.827 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:45.827 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:45.827 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:45.828 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:45.828 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:45.828 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:45.828 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:45.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535685833 for job 41f18052e8363382138bde77e16b10c3.
18:34:45.844 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:34:45.845 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
18:34:45.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:45.867794 10048 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:34:45.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:45.869222 10048 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.79.194
18:34:45.886 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:45.886 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:45.886 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:45.887 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:45.887 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:45.887 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:45.887 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:45.887 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:45.887 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:45.887 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:45.887 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:45.887 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:45.887 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:45.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.942148 10048 tablet_server_runner.cc:78] Tablet server non-default flags:
18:34:45.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:45.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.79.212:43203
18:34:45.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:45.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:45.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/data
18:34:45.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/wal
18:34:45.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:45.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:45.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.79.194:0
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/data/info.pb
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.79.194
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.79.254:42669,127.9.79.253:36577,127.9.79.252:38727
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.79.194
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/logs
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:34:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:34:45.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.943993 10048 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:34:45.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:45.946447 10048 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:34:45.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:45.967056 10063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:45.971 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:46.088 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:46.143 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:46.143 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:46.143 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:46.144 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:46.144 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:46.144 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:46.144 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:46.144 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:46.144 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:46.144 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:46.144 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:46.144 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:46.144 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:46.157 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:46.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:46.220 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:46.220 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:46.220 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:46.220 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:46.221 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:46.221 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:46.221 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:46.221 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:46.221 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:46.221 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:46.221 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:46.221 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:46.221 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:46.262 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:46.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:46.288797 10051 heartbeater.cc:499] Master 127.9.79.254:42669 was elected leader, sending a full tablet report...
18:34:46.306 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:46.306 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:46.306 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:46.307 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:46.307 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:46.307 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:46.307 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:46.307 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:46.307 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:46.307 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:46.307 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:46.308 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:46.308 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:46.333 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535686333 for job 41f18052e8363382138bde77e16b10c3.
18:34:46.345 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:46.345 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:46.345 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:46.346 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:46.346 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:46.346 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:46.346 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:46.346 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:46.346 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:46.347 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:46.347 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:46.347 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:46.347 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:46.348 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
18:34:46.352 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
18:34:46.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:46.587 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:46.604 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:46.604 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:46.604 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:46.604 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:46.604 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:46.604 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:46.605 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:46.605 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:46.605 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:46.605 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:46.605 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:46.605 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:46.605 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:46.628 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:46.628 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:46.628 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:46.629 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:46.629 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:46.629 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:46.629 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:46.629 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:46.629 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:46.629 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:46.629 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:46.629 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:46.630 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:46.640 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:46.641 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:46.641 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:46.641 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:46.641 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:46.641 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:46.642 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:46.642 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:46.642 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:46.642 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:46.642 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:46.642 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:46.642 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:46.656 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:46.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:46.760 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:46.833 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535686833 for job 41f18052e8363382138bde77e16b10c3.
18:34:46.842 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:34:46.843 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
18:34:46.844 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:46.844 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:46.844 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:46.844 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:46.844 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:46.844 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:46.844 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:46.844 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:46.844 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:46.845 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:46.845 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:46.845 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:46.845 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:46.940 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:46.940 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:46.940 [DEBUG - pool-434-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:46.941 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:46.941 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:46.941 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:46.941 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:46.941 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:46.941 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:46.941 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:46.941 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:46.941 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:46.941 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:46.942 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26392), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [4ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [6ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [13ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [14ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [27ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [48ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [48ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [65ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [66ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [66ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [66ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [103ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [125ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [126ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [126ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [166ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [201ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [221ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [222ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [223ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [223ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [441ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [441ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [442ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [442ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1321ms] refreshing cache from master, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1321ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1322ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2423ms] refreshing cache from master, [2423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2424ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2424ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2425ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2425ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2425ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2426ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [5061ms] refreshing cache from master, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [5062ms] too many traces: truncated at 100 traces, deferred=Deferred@719537160(state=PENDING, result=null, callback=(continuation of Deferred@931417311 after retry RPC after error@211110000) -> (continuation of Deferred@633894419 after retry RPC after error@364619174) -> (continuation of Deferred@5042554 after retry RPC after error@641527755) -> (continuation of Deferred@1084386801 after retry RPC after error@150759126) -> (continuation of Deferred@1868337554 after retry RPC after error@778008837) -> (continuation of Deferred@2109818074 after retry RPC after error@375408482) -> (continuation of Deferred@498828349 after retry RPC after error@1215910366) -> (continuation of Deferred@1063861151 after retry RPC after error@732311623) -> (continuation of Deferred@1786631010 after retry RPC after error@1753782354) -> (continuation of Deferred@508293919 after retry RPC after error@83217561) -> (continuation of Deferred@1567142 after retry RPC after error@754035710) -> (continuation of Deferred@1843619444 after retry RPC after error@1205403221) -> (continuation of Deferred@2017289681 after retry RPC after error@1504878451) -> (continuation of Deferred@789873399 after retry RPC after error@792656662) -> (continuation of Deferred@1019085005 after retry RPC after error@1899649326) -> (continuation of Deferred@2058514116 after retry RPC after error@579656911) -> (continuation of Deferred@1853360187 after retry RPC after error@1294524403) -> (continuation of Deferred@612715740 after retry RPC after error@1621857831) -> (continuation of Deferred@1312580569 after retry RPC after error@1163983530) -> (continuation of Deferred@1259187574 after retry RPC after error@2007699614) -> (continuation of Deferred@1512343321 after retry RPC after error@408130397) -> (continuation of Deferred@1041496892 after retry RPC after error@294855552) -> (continuation of Deferred@1878094564 after retry RPC after error@1799146812) -> (continuation of Deferred@1255608700 after retry RPC after error@1120973957) -> (continuation of Deferred@642947177 after retry RPC after error@730522802), errback=(continuation of Deferred@931417311 after retry RPC after error@211110000) -> (continuation of Deferred@633894419 after retry RPC after error@364619174) -> (continuation of Deferred@5042554 after retry RPC after error@641527755) -> (continuation of Deferred@1084386801 after retry RPC after error@150759126) -> (continuation of Deferred@1868337554 after retry RPC after error@778008837) -> (continuation of Deferred@2109818074 after retry RPC after error@375408482) -> (continuation of Deferred@498828349 after retry RPC after error@1215910366) -> (continuation of Deferred@1063861151 after retry RPC after error@732311623) -> (continuation of Deferred@1786631010 after retry RPC after error@1753782354) -> (continuation of Deferred@508293919 after retry RPC after error@83217561) -> (continuation of Deferred@1567142 after retry RPC after error@754035710) -> (continuation of Deferred@1843619444 after retry RPC after error@1205403221) -> (continuation of Deferred@2017289681 after retry RPC after error@1504878451) -> (continuation of Deferred@789873399 after retry RPC after error@792656662) -> (continuation of Deferred@1019085005 after retry RPC after error@1899649326) -> (continuation of Deferred@2058514116 after retry RPC after error@579656911) -> (continuation of Deferred@1853360187 after retry RPC after error@1294524403) -> (continuation of Deferred@612715740 after retry RPC after error@1621857831) -> (continuation of Deferred@1312580569 after retry RPC after error@1163983530) -> (continuation of Deferred@1259187574 after retry RPC after error@2007699614) -> (continuation of Deferred@1512343321 after retry RPC after error@408130397) -> (continuation of Deferred@1041496892 after retry RPC after error@294855552) -> (continuation of Deferred@1878094564 after retry RPC after error@1799146812) -> (continuation of Deferred@1255608700 after retry RPC after error@1120973957) -> (continuation of Deferred@642947177 after retry RPC after error@730522802)))
18:34:46.943 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
18:34:46.943 [WARN - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26392), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [4ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [6ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [13ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [14ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [27ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [48ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [48ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [65ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [66ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [66ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [66ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [103ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [125ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [126ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [126ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [166ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [201ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [221ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [222ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [223ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [223ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [441ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [441ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [442ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [442ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1321ms] refreshing cache from master, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1321ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1322ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2423ms] refreshing cache from master, [2423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2424ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2424ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2425ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2425ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2425ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2426ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [5061ms] refreshing cache from master, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [5062ms] too many traces: truncated at 100 traces, deferred=Deferred@719537160(state=PENDING, result=null, callback=(continuation of Deferred@931417311 after retry RPC after error@211110000) -> (continuation of Deferred@633894419 after retry RPC after error@364619174) -> (continuation of Deferred@5042554 after retry RPC after error@641527755) -> (continuation of Deferred@1084386801 after retry RPC after error@150759126) -> (continuation of Deferred@1868337554 after retry RPC after error@778008837) -> (continuation of Deferred@2109818074 after retry RPC after error@375408482) -> (continuation of Deferred@498828349 after retry RPC after error@1215910366) -> (continuation of Deferred@1063861151 after retry RPC after error@732311623) -> (continuation of Deferred@1786631010 after retry RPC after error@1753782354) -> (continuation of Deferred@508293919 after retry RPC after error@83217561) -> (continuation of Deferred@1567142 after retry RPC after error@754035710) -> (continuation of Deferred@1843619444 after retry RPC after error@1205403221) -> (continuation of Deferred@2017289681 after retry RPC after error@1504878451) -> (continuation of Deferred@789873399 after retry RPC after error@792656662) -> (continuation of Deferred@1019085005 after retry RPC after error@1899649326) -> (continuation of Deferred@2058514116 after retry RPC after error@579656911) -> (continuation of Deferred@1853360187 after retry RPC after error@1294524403) -> (continuation of Deferred@612715740 after retry RPC after error@1621857831) -> (continuation of Deferred@1312580569 after retry RPC after error@1163983530) -> (continuation of Deferred@1259187574 after retry RPC after error@2007699614) -> (continuation of Deferred@1512343321 after retry RPC after error@408130397) -> (continuation of Deferred@1041496892 after retry RPC after error@294855552) -> (continuation of Deferred@1878094564 after retry RPC after error@1799146812) -> (continuation of Deferred@1255608700 after retry RPC after error@1120973957) -> (continuation of Deferred@642947177 after retry RPC after error@730522802), errback=(continuation of Deferred@931417311 after retry RPC after error@211110000) -> (continuation of Deferred@633894419 after retry RPC after error@364619174) -> (continuation of Deferred@5042554 after retry RPC after error@641527755) -> (continuation of Deferred@1084386801 after retry RPC after error@150759126) -> (continuation of Deferred@1868337554 after retry RPC after error@778008837) -> (continuation of Deferred@2109818074 after retry RPC after error@375408482) -> (continuation of Deferred@498828349 after retry RPC after error@1215910366) -> (continuation of Deferred@1063861151 after retry RPC after error@732311623) -> (continuation of Deferred@1786631010 after retry RPC after error@1753782354) -> (continuation of Deferred@508293919 after retry RPC after error@83217561) -> (continuation of Deferred@1567142 after retry RPC after error@754035710) -> (continuation of Deferred@1843619444 after retry RPC after error@1205403221) -> (continuation of Deferred@2017289681 after retry RPC after error@1504878451) -> (continuation of Deferred@789873399 after retry RPC after error@792656662) -> (continuation of Deferred@1019085005 after retry RPC after error@1899649326) -> (continuation of Deferred@2058514116 after retry RPC after error@579656911) -> (continuation of Deferred@1853360187 after retry RPC after error@1294524403) -> (continuation of Deferred@612715740 after retry RPC after error@1621857831) -> (continuation of Deferred@1312580569 after retry RPC after error@1163983530) -> (continuation of Deferred@1259187574 after retry RPC after error@2007699614) -> (continuation of Deferred@1512343321 after retry RPC after error@408130397) -> (continuation of Deferred@1041496892 after retry RPC after error@294855552) -> (continuation of Deferred@1878094564 after retry RPC after error@1799146812) -> (continuation of Deferred@1255608700 after retry RPC after error@1120973957) -> (continuation of Deferred@642947177 after retry RPC after error@730522802)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.43.189:32951
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:46.944 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
18:34:46.946 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#3 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
18:34:46.950 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to FAILED on b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26392), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [4ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [6ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [13ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [14ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [27ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [48ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [48ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [65ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [66ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [66ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [66ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [103ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [103ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [125ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [126ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [126ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [166ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [201ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [221ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [222ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [223ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [223ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [441ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [441ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [442ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [442ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1321ms] refreshing cache from master, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1321ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1322ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2423ms] refreshing cache from master, [2423ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2424ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2424ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2425ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2425ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2425ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2426ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [5061ms] refreshing cache from master, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [5061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [5062ms] too many traces: truncated at 100 traces, deferred=Deferred@719537160(state=PENDING, result=null, callback=(continuation of Deferred@931417311 after retry RPC after error@211110000) -> (continuation of Deferred@633894419 after retry RPC after error@364619174) -> (continuation of Deferred@5042554 after retry RPC after error@641527755) -> (continuation of Deferred@1084386801 after retry RPC after error@150759126) -> (continuation of Deferred@1868337554 after retry RPC after error@778008837) -> (continuation of Deferred@2109818074 after retry RPC after error@375408482) -> (continuation of Deferred@498828349 after retry RPC after error@1215910366) -> (continuation of Deferred@1063861151 after retry RPC after error@732311623) -> (continuation of Deferred@1786631010 after retry RPC after error@1753782354) -> (continuation of Deferred@508293919 after retry RPC after error@83217561) -> (continuation of Deferred@1567142 after retry RPC after error@754035710) -> (continuation of Deferred@1843619444 after retry RPC after error@1205403221) -> (continuation of Deferred@2017289681 after retry RPC after error@1504878451) -> (continuation of Deferred@789873399 after retry RPC after error@792656662) -> (continuation of Deferred@1019085005 after retry RPC after error@1899649326) -> (continuation of Deferred@2058514116 after retry RPC after error@579656911) -> (continuation of Deferred@1853360187 after retry RPC after error@1294524403) -> (continuation of Deferred@612715740 after retry RPC after error@1621857831) -> (continuation of Deferred@1312580569 after retry RPC after error@1163983530) -> (continuation of Deferred@1259187574 after retry RPC after error@2007699614) -> (continuation of Deferred@1512343321 after retry RPC after error@408130397) -> (continuation of Deferred@1041496892 after retry RPC after error@294855552) -> (continuation of Deferred@1878094564 after retry RPC after error@1799146812) -> (continuation of Deferred@1255608700 after retry RPC after error@1120973957) -> (continuation of Deferred@642947177 after retry RPC after error@730522802), errback=(continuation of Deferred@931417311 after retry RPC after error@211110000) -> (continuation of Deferred@633894419 after retry RPC after error@364619174) -> (continuation of Deferred@5042554 after retry RPC after error@641527755) -> (continuation of Deferred@1084386801 after retry RPC after error@150759126) -> (continuation of Deferred@1868337554 after retry RPC after error@778008837) -> (continuation of Deferred@2109818074 after retry RPC after error@375408482) -> (continuation of Deferred@498828349 after retry RPC after error@1215910366) -> (continuation of Deferred@1063861151 after retry RPC after error@732311623) -> (continuation of Deferred@1786631010 after retry RPC after error@1753782354) -> (continuation of Deferred@508293919 after retry RPC after error@83217561) -> (continuation of Deferred@1567142 after retry RPC after error@754035710) -> (continuation of Deferred@1843619444 after retry RPC after error@1205403221) -> (continuation of Deferred@2017289681 after retry RPC after error@1504878451) -> (continuation of Deferred@789873399 after retry RPC after error@792656662) -> (continuation of Deferred@1019085005 after retry RPC after error@1899649326) -> (continuation of Deferred@2058514116 after retry RPC after error@579656911) -> (continuation of Deferred@1853360187 after retry RPC after error@1294524403) -> (continuation of Deferred@612715740 after retry RPC after error@1621857831) -> (continuation of Deferred@1312580569 after retry RPC after error@1163983530) -> (continuation of Deferred@1259187574 after retry RPC after error@2007699614) -> (continuation of Deferred@1512343321 after retry RPC after error@408130397) -> (continuation of Deferred@1041496892 after retry RPC after error@294855552) -> (continuation of Deferred@1878094564 after retry RPC after error@1799146812) -> (continuation of Deferred@1255608700 after retry RPC after error@1120973957) -> (continuation of Deferred@642947177 after retry RPC after error@730522802)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.3.43.189:32951
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:46.951 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#3) of source Source: KuduSource.
18:34:46.951 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:46.951 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
18:34:46.952 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (9de81db54be40687a2a82164db1dc50b) switched from state RUNNING to RESTARTING.
18:34:46.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:47.035 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:47.035 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:47.035 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:47.035 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:47.035 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:47.035 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:47.035 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:47.035 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:47.036 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:47.036 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:47.036 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:47.036 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:47.036 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:47.038 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:47.038 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:47.039 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:47.039 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:47.039 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:47.039 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:47.039 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:47.039 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:47.039 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:47.039 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:47.039 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:47.039 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:47.040 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:47.156 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:47.158 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:47.158 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:47.158 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:47.159 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:47.159 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:47.159 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:47.159 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:47.159 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:47.159 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:47.159 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:47.159 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:47.160 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:47.160 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:47.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:47.193 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:47.194 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:47.194 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:47.194 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:47.194 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:47.194 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:47.194 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:47.194 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:47.195 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:47.195 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:47.195 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:47.195 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:47.195 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:47.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:47.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535687333 for job 41f18052e8363382138bde77e16b10c3.
18:34:47.347 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
18:34:47.348 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
18:34:47.362 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:47.362 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:47.362 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:47.362 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:47.363 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:47.363 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:47.363 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:47.363 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:47.363 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:47.363 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:47.363 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:47.363 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:47.363 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:47.425 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:47.425 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:47.425 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:47.425 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:47.426 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:47.426 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:47.426 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:47.426 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:47.426 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:47.426 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:47.426 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:47.426 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:47.426 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:47.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:47.553 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:47.554 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:47.554 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:47.554 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:47.554 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:47.554 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:47.554 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:47.555 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:47.555 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:47.555 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:47.555 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:47.556 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:47.556 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:47.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:45.973351 10064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:47.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:47.570634 10066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:47.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:47.575188 10065 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1600 milliseconds
18:34:47.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.575191 10048 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:34:47.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.577950 10048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:34:47.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.581533 10048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:34:47.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.583122 10048 hybrid_clock.cc:648] HybridClock initialized: now 1783535687583078 us; error 44 us; skew 500 ppm
18:34:47.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.584066 10048 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:34:47.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.591284 10048 webserver.cc:534] Webserver started at http://127.9.79.194:45717/ using document root <none> and password file <none>
18:34:47.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.592319 10048 fs_manager.cc:362] Metadata directory not provided
18:34:47.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.592563 10048 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:34:47.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.593107 10048 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:34:47.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.598753 10048 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/data/instance:
18:34:47.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1efcebc990364b10942ae70571022125"
18:34:47.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:47 on dist-test-slave-dxnw"
18:34:47.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.600059 10048 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/wal/instance:
18:34:47.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1efcebc990364b10942ae70571022125"
18:34:47.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:47 on dist-test-slave-dxnw"
18:34:47.608 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:47.608 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:47.609 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:47.609 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:47.609 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:47.609 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:47.609 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:47.609 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:47.609 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:47.609 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:47.609 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:47.609 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:47.609 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:47.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.609469 10048 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.005s	sys 0.003s
18:34:47.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.615866 10075 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:34:47.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.617383 10048 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
18:34:47.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.617825 10048 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/wal
18:34:47.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1efcebc990364b10942ae70571022125"
18:34:47.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:47 on dist-test-slave-dxnw"
18:34:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.618201 10048 fs_report.cc:389] FS layout report
18:34:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:34:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/wal
18:34:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/wal
18:34:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/data/data
18:34:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:34:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:34:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:34:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:34:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:34:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:34:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:34:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:34:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:34:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:34:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:34:47.656 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:47.679 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:47.680 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:47.680 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:47.680 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:47.680 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:47.680 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:47.680 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:47.680 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:47.680 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:47.680 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:47.680 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:47.680 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:47.680 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:47.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:47.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.695421 10048 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:34:47.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.697269 10048 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:34:47.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.697882 10048 kserver.cc:163] Server-wide thread pool size limit: 3276
18:34:47.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.701051 10048 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:34:47.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.706588 10048 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:34:47.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.706907 10048 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:34:47.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.707248 10048 ts_tablet_manager.cc:616] Registered 0 tablets
18:34:47.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.707437 10048 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:34:47.729 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:47.729 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:47.729 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:47.729 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:47.729 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:47.729 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:47.729 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:47.729 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:47.729 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:47.730 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:47.730 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:47.730 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:47.730 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:47.747 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:47.747 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:47.748 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:47.748 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:47.748 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:47.748 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:47.748 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:47.748 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:47.748 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:47.749 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:47.749 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:47.749 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:47.749 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:47.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:47.789 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:47.789 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:47.789 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:47.789 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:47.789 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:47.790 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:47.790 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:47.790 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:47.790 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:47.790 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:47.790 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:47.790 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:47.790 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:47.804 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:47.804 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:47.804 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:47.804 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:47.805 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:47.805 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:47.805 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:47.805 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:47.805 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:47.805 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:47.805 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:47.805 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:47.806 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:47.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535687833 for job 41f18052e8363382138bde77e16b10c3.
18:34:47.845 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
18:34:47.848 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
18:34:47.885 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:47.886 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:47.886 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:47.886 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:47.886 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:47.886 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:47.886 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:47.886 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:47.886 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:47.887 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:47.887 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:47.887 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:47.887 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:47.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.891795 10048 rpc_server.cc:307] RPC server started. Bound to: 127.9.79.194:36053
18:34:47.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.891983 10187 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.79.194:36053 every 8 connection(s)
18:34:47.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.894649 10048 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/data/info.pb
18:34:47.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.897583  9535 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 10048
18:34:47.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.898123  9535 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-1/wal/instance
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.924683  9535 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/wal
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/data
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/logs
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/data/info.pb
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.79.195:0
18:34:47.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.79.195
18:34:47.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.79.195
18:34:47.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:47.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.79.254:42669,127.9.79.253:36577,127.9.79.252:38727
18:34:47.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.79.212:43203
18:34:47.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:47.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:47.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:34:47.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.946043 10189 heartbeater.cc:344] Connected to a master server at 127.9.79.253:36577
18:34:47.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.946559 10189 heartbeater.cc:461] Registering TS with master...
18:34:47.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.947312 10188 heartbeater.cc:344] Connected to a master server at 127.9.79.252:38727
18:34:47.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.947577 10188 heartbeater.cc:461] Registering TS with master...
18:34:47.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.947860 10189 heartbeater.cc:507] Master 127.9.79.253:36577 requested a full tablet report, sending...
18:34:47.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.948606 10188 heartbeater.cc:507] Master 127.9.79.252:38727 requested a full tablet report, sending...
18:34:47.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.950213 10190 heartbeater.cc:344] Connected to a master server at 127.9.79.254:42669
18:34:47.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.950605 10190 heartbeater.cc:461] Registering TS with master...
18:34:47.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.950980  9731 ts_manager.cc:194] Registered new tserver with Master: 1efcebc990364b10942ae70571022125 (127.9.79.194:36053)
18:34:47.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.953678  9810 ts_manager.cc:194] Registered new tserver with Master: 1efcebc990364b10942ae70571022125 (127.9.79.194:36053)
18:34:47.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.951664 10190 heartbeater.cc:507] Master 127.9.79.254:42669 requested a full tablet report, sending...
18:34:47.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.956887  9634 ts_manager.cc:194] Registered new tserver with Master: 1efcebc990364b10942ae70571022125 (127.9.79.194:36053)
18:34:47.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:47.959030  9634 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.79.194:53875
18:34:47.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:48.142 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:48.142 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:48.142 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:48.142 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:48.142 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:48.142 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:48.142 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:48.142 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:48.142 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:48.142 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:48.142 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:48.143 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:48.143 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:48.156 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:48.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:48.183 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:48.183 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:48.183 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:48.183 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:48.183 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:48.183 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:48.183 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:48.183 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:48.183 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:48.183 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:48.183 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:48.184 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:48.184 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:48.259 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:48.259 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:48.259 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:48.259 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:48.259 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:48.259 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:48.259 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:48.259 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:48.259 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:48.260 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:48.260 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:48.260 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:48.260 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:48.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:48.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:48.320953 10198 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:34:48.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:48.321561 10198 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:34:48.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:48.322212 10198 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:34:48.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535688333 for job 41f18052e8363382138bde77e16b10c3.
18:34:48.341 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:34:48.342 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
18:34:48.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:48.362912 10198 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:34:48.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:48.363903 10198 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.79.195
18:34:48.405 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:48.405 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:48.405 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:48.405 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.406 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.406 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.405 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.405 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.406 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.406 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.406 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.406 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.406 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:48.406 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:48.406 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:48.406 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:48.407 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27842), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [5ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [10ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [21ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [21ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [57ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [58ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [62ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [89ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [89ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [90ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [90ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [100ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [122ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [141ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [181ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [200ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [200ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [201ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [201ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [281ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [281ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [281ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [281ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [562ms] refreshing cache from master, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [563ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [563ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [563ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [564ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1260ms] refreshing cache from master, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [1261ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2084ms] refreshing cache from master, [2084ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [2084ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [2085ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [2085ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [2085ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2085ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [2086ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [3660ms] refreshing cache from master, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [3661ms] too many traces: truncated at 100 traces, deferred=Deferred@1432178702(state=PENDING, result=null, callback=(continuation of Deferred@1687036002 after retry RPC after error@1313195105) -> (continuation of Deferred@844606214 after retry RPC after error@229982306) -> (continuation of Deferred@414051462 after retry RPC after error@2024490302) -> (continuation of Deferred@2007752374 after retry RPC after error@1345992305) -> (continuation of Deferred@662972716 after retry RPC after error@86252119) -> (continuation of Deferred@743647787 after retry RPC after error@760944750) -> (continuation of Deferred@730892704 after retry RPC after error@239323175) -> (continuation of Deferred@1005889974 after retry RPC after error@1310285518) -> (continuation of Deferred@1642791716 after retry RPC after error@1903820238) -> (continuation of Deferred@1868448590 after retry RPC after error@1798672197) -> (continuation of Deferred@1392395044 after retry RPC after error@1817658168) -> (continuation of Deferred@1905142223 after retry RPC after error@914804508) -> (continuation of Deferred@373378443 after retry RPC after error@1079608056) -> (continuation of Deferred@1083775853 after retry RPC after error@1080541773) -> (continuation of Deferred@1549202143 after retry RPC after error@1351939567) -> (continuation of Deferred@1482612451 after retry RPC after error@643107343) -> (continuation of Deferred@1300153360 after retry RPC after error@976382941) -> (continuation of Deferred@339022782 after retry RPC after error@448685637) -> (continuation of Deferred@568028998 after retry RPC after error@144610339) -> (continuation of Deferred@881512045 after retry RPC after error@1567558391) -> (continuation of Deferred@666173251 after retry RPC after error@1542932506) -> (continuation of Deferred@963386543 after retry RPC after error@477204935) -> (continuation of Deferred@482294765 after retry RPC after error@2112423928) -> (continuation of Deferred@607774094 after retry RPC after error@878098279), errback=(continuation of Deferred@1687036002 after retry RPC after error@1313195105) -> (continuation of Deferred@844606214 after retry RPC after error@229982306) -> (continuation of Deferred@414051462 after retry RPC after error@2024490302) -> (continuation of Deferred@2007752374 after retry RPC after error@1345992305) -> (continuation of Deferred@662972716 after retry RPC after error@86252119) -> (continuation of Deferred@743647787 after retry RPC after error@760944750) -> (continuation of Deferred@730892704 after retry RPC after error@239323175) -> (continuation of Deferred@1005889974 after retry RPC after error@1310285518) -> (continuation of Deferred@1642791716 after retry RPC after error@1903820238) -> (continuation of Deferred@1868448590 after retry RPC after error@1798672197) -> (continuation of Deferred@1392395044 after retry RPC after error@1817658168) -> (continuation of Deferred@1905142223 after retry RPC after error@914804508) -> (continuation of Deferred@373378443 after retry RPC after error@1079608056) -> (continuation of Deferred@1083775853 after retry RPC after error@1080541773) -> (continuation of Deferred@1549202143 after retry RPC after error@1351939567) -> (continuation of Deferred@1482612451 after retry RPC after error@643107343) -> (continuation of Deferred@1300153360 after retry RPC after error@976382941) -> (continuation of Deferred@339022782 after retry RPC after error@448685637) -> (continuation of Deferred@568028998 after retry RPC after error@144610339) -> (continuation of Deferred@881512045 after retry RPC after error@1567558391) -> (continuation of Deferred@666173251 after retry RPC after error@1542932506) -> (continuation of Deferred@963386543 after retry RPC after error@477204935) -> (continuation of Deferred@482294765 after retry RPC after error@2112423928) -> (continuation of Deferred@607774094 after retry RPC after error@878098279)))
18:34:48.407 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:48.406667 10198 tablet_server_runner.cc:78] Tablet server non-default flags:
18:34:48.407 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:48.407 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:48.407 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:48.407 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.79.212:43203
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:48.407 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/data
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/wal
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.79.195:0
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/data/info.pb
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.79.195
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:48.407 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.79.254:42669,127.9.79.253:36577,127.9.79.252:38727
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.79.195
18:34:48.407 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:48.407 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:48.407 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:48.407 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:48.407 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:48.407 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:48.408 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.408 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.408 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.408 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.408 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.408 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/logs
18:34:48.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:48.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:34:48.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:34:48.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:34:48.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:34:48.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:34:48.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:34:48.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:34:48.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:34:48.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:34:48.407 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27842), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [5ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [10ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [21ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [21ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [57ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [58ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [62ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [89ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [89ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [90ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [90ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [100ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [122ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [141ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [181ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [200ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [200ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [201ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [201ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [281ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [281ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [281ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [281ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [562ms] refreshing cache from master, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [563ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [563ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [563ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [564ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1260ms] refreshing cache from master, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [1261ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2084ms] refreshing cache from master, [2084ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [2084ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [2085ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [2085ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [2085ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2085ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [2086ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [3660ms] refreshing cache from master, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [3661ms] too many traces: truncated at 100 traces, deferred=Deferred@1432178702(state=PENDING, result=null, callback=(continuation of Deferred@1687036002 after retry RPC after error@1313195105) -> (continuation of Deferred@844606214 after retry RPC after error@229982306) -> (continuation of Deferred@414051462 after retry RPC after error@2024490302) -> (continuation of Deferred@2007752374 after retry RPC after error@1345992305) -> (continuation of Deferred@662972716 after retry RPC after error@86252119) -> (continuation of Deferred@743647787 after retry RPC after error@760944750) -> (continuation of Deferred@730892704 after retry RPC after error@239323175) -> (continuation of Deferred@1005889974 after retry RPC after error@1310285518) -> (continuation of Deferred@1642791716 after retry RPC after error@1903820238) -> (continuation of Deferred@1868448590 after retry RPC after error@1798672197) -> (continuation of Deferred@1392395044 after retry RPC after error@1817658168) -> (continuation of Deferred@1905142223 after retry RPC after error@914804508) -> (continuation of Deferred@373378443 after retry RPC after error@1079608056) -> (continuation of Deferred@1083775853 after retry RPC after error@1080541773) -> (continuation of Deferred@1549202143 after retry RPC after error@1351939567) -> (continuation of Deferred@1482612451 after retry RPC after error@643107343) -> (continuation of Deferred@1300153360 after retry RPC after error@976382941) -> (continuation of Deferred@339022782 after retry RPC after error@448685637) -> (continuation of Deferred@568028998 after retry RPC after error@144610339) -> (continuation of Deferred@881512045 after retry RPC after error@1567558391) -> (continuation of Deferred@666173251 after retry RPC after error@1542932506) -> (continuation of Deferred@963386543 after retry RPC after error@477204935) -> (continuation of Deferred@482294765 after retry RPC after error@2112423928) -> (continuation of Deferred@607774094 after retry RPC after error@878098279), errback=(continuation of Deferred@1687036002 after retry RPC after error@1313195105) -> (continuation of Deferred@844606214 after retry RPC after error@229982306) -> (continuation of Deferred@414051462 after retry RPC after error@2024490302) -> (continuation of Deferred@2007752374 after retry RPC after error@1345992305) -> (continuation of Deferred@662972716 after retry RPC after error@86252119) -> (continuation of Deferred@743647787 after retry RPC after error@760944750) -> (continuation of Deferred@730892704 after retry RPC after error@239323175) -> (continuation of Deferred@1005889974 after retry RPC after error@1310285518) -> (continuation of Deferred@1642791716 after retry RPC after error@1903820238) -> (continuation of Deferred@1868448590 after retry RPC after error@1798672197) -> (continuation of Deferred@1392395044 after retry RPC after error@1817658168) -> (continuation of Deferred@1905142223 after retry RPC after error@914804508) -> (continuation of Deferred@373378443 after retry RPC after error@1079608056) -> (continuation of Deferred@1083775853 after retry RPC after error@1080541773) -> (continuation of Deferred@1549202143 after retry RPC after error@1351939567) -> (continuation of Deferred@1482612451 after retry RPC after error@643107343) -> (continuation of Deferred@1300153360 after retry RPC after error@976382941) -> (continuation of Deferred@339022782 after retry RPC after error@448685637) -> (continuation of Deferred@568028998 after retry RPC after error@144610339) -> (continuation of Deferred@881512045 after retry RPC after error@1567558391) -> (continuation of Deferred@666173251 after retry RPC after error@1542932506) -> (continuation of Deferred@963386543 after retry RPC after error@477204935) -> (continuation of Deferred@482294765 after retry RPC after error@2112423928) -> (continuation of Deferred@607774094 after retry RPC after error@878098279)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27842), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [5ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [10ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [21ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [21ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [57ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [58ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [62ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [89ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [89ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [90ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [90ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [100ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [122ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [141ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [181ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [200ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [200ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [201ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [201ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [281ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [281ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [281ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [281ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [562ms] refreshing cache from master, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [563ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [563ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [563ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [564ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1260ms] refreshing cache from master, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [1261ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2084ms] refreshing cache from master, [2084ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [2084ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [2085ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [2085ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [2085ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2085ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [2086ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [3660ms] refreshing cache from master, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [3661ms] too many traces: truncated at 100 traces, deferred=Deferred@1432178702(state=PENDING, result=null, callback=(continuation of Deferred@1687036002 after retry RPC after error@1313195105) -> (continuation of Deferred@844606214 after retry RPC after error@229982306) -> (continuation of Deferred@414051462 after retry RPC after error@2024490302) -> (continuation of Deferred@2007752374 after retry RPC after error@1345992305) -> (continuation of Deferred@662972716 after retry RPC after error@86252119) -> (continuation of Deferred@743647787 after retry RPC after error@760944750) -> (continuation of Deferred@730892704 after retry RPC after error@239323175) -> (continuation of Deferred@1005889974 after retry RPC after error@1310285518) -> (continuation of Deferred@1642791716 after retry RPC after error@1903820238) -> (continuation of Deferred@1868448590 after retry RPC after error@1798672197) -> (continuation of Deferred@1392395044 after retry RPC after error@1817658168) -> (continuation of Deferred@1905142223 after retry RPC after error@914804508) -> (continuation of Deferred@373378443 after retry RPC after error@1079608056) -> (continuation of Deferred@1083775853 after retry RPC after error@1080541773) -> (continuation of Deferred@1549202143 after retry RPC after error@1351939567) -> (continuation of Deferred@1482612451 after retry RPC after error@643107343) -> (continuation of Deferred@1300153360 after retry RPC after error@976382941) -> (continuation of Deferred@339022782 after retry RPC after error@448685637) -> (continuation of Deferred@568028998 after retry RPC after error@144610339) -> (continuation of Deferred@881512045 after retry RPC after error@1567558391) -> (continuation of Deferred@666173251 after retry RPC after error@1542932506) -> (continuation of Deferred@963386543 after retry RPC after error@477204935) -> (continuation of Deferred@482294765 after retry RPC after error@2112423928) -> (continuation of Deferred@607774094 after retry RPC after error@878098279), errback=(continuation of Deferred@1687036002 after retry RPC after error@1313195105) -> (continuation of Deferred@844606214 after retry RPC after error@229982306) -> (continuation of Deferred@414051462 after retry RPC after error@2024490302) -> (continuation of Deferred@2007752374 after retry RPC after error@1345992305) -> (continuation of Deferred@662972716 after retry RPC after error@86252119) -> (continuation of Deferred@743647787 after retry RPC after error@760944750) -> (continuation of Deferred@730892704 after retry RPC after error@239323175) -> (continuation of Deferred@1005889974 after retry RPC after error@1310285518) -> (continuation of Deferred@1642791716 after retry RPC after error@1903820238) -> (continuation of Deferred@1868448590 after retry RPC after error@1798672197) -> (continuation of Deferred@1392395044 after retry RPC after error@1817658168) -> (continuation of Deferred@1905142223 after retry RPC after error@914804508) -> (continuation of Deferred@373378443 after retry RPC after error@1079608056) -> (continuation of Deferred@1083775853 after retry RPC after error@1080541773) -> (continuation of Deferred@1549202143 after retry RPC after error@1351939567) -> (continuation of Deferred@1482612451 after retry RPC after error@643107343) -> (continuation of Deferred@1300153360 after retry RPC after error@976382941) -> (continuation of Deferred@339022782 after retry RPC after error@448685637) -> (continuation of Deferred@568028998 after retry RPC after error@144610339) -> (continuation of Deferred@881512045 after retry RPC after error@1567558391) -> (continuation of Deferred@666173251 after retry RPC after error@1542932506) -> (continuation of Deferred@963386543 after retry RPC after error@477204935) -> (continuation of Deferred@482294765 after retry RPC after error@2112423928) -> (continuation of Deferred@607774094 after retry RPC after error@878098279)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.96.188:32989
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:48.408 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.409 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.409 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.409 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:48.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:48.408926 10198 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:34:48.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:48.410728 10198 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:34:48.412 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27842), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [5ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [10ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [21ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [21ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [57ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [58ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [62ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [89ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [89ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [90ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [90ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [100ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [122ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [141ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [181ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [200ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [200ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [201ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [201ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [281ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [281ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [281ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [281ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [562ms] refreshing cache from master, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [563ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [563ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [563ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [564ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1260ms] refreshing cache from master, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [1261ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2084ms] refreshing cache from master, [2084ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [2084ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [2085ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [2085ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [2085ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2085ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [2086ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [3660ms] refreshing cache from master, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [3661ms] too many traces: truncated at 100 traces, deferred=Deferred@1432178702(state=PENDING, result=null, callback=(continuation of Deferred@1687036002 after retry RPC after error@1313195105) -> (continuation of Deferred@844606214 after retry RPC after error@229982306) -> (continuation of Deferred@414051462 after retry RPC after error@2024490302) -> (continuation of Deferred@2007752374 after retry RPC after error@1345992305) -> (continuation of Deferred@662972716 after retry RPC after error@86252119) -> (continuation of Deferred@743647787 after retry RPC after error@760944750) -> (continuation of Deferred@730892704 after retry RPC after error@239323175) -> (continuation of Deferred@1005889974 after retry RPC after error@1310285518) -> (continuation of Deferred@1642791716 after retry RPC after error@1903820238) -> (continuation of Deferred@1868448590 after retry RPC after error@1798672197) -> (continuation of Deferred@1392395044 after retry RPC after error@1817658168) -> (continuation of Deferred@1905142223 after retry RPC after error@914804508) -> (continuation of Deferred@373378443 after retry RPC after error@1079608056) -> (continuation of Deferred@1083775853 after retry RPC after error@1080541773) -> (continuation of Deferred@1549202143 after retry RPC after error@1351939567) -> (continuation of Deferred@1482612451 after retry RPC after error@643107343) -> (continuation of Deferred@1300153360 after retry RPC after error@976382941) -> (continuation of Deferred@339022782 after retry RPC after error@448685637) -> (continuation of Deferred@568028998 after retry RPC after error@144610339) -> (continuation of Deferred@881512045 after retry RPC after error@1567558391) -> (continuation of Deferred@666173251 after retry RPC after error@1542932506) -> (continuation of Deferred@963386543 after retry RPC after error@477204935) -> (continuation of Deferred@482294765 after retry RPC after error@2112423928) -> (continuation of Deferred@607774094 after retry RPC after error@878098279), errback=(continuation of Deferred@1687036002 after retry RPC after error@1313195105) -> (continuation of Deferred@844606214 after retry RPC after error@229982306) -> (continuation of Deferred@414051462 after retry RPC after error@2024490302) -> (continuation of Deferred@2007752374 after retry RPC after error@1345992305) -> (continuation of Deferred@662972716 after retry RPC after error@86252119) -> (continuation of Deferred@743647787 after retry RPC after error@760944750) -> (continuation of Deferred@730892704 after retry RPC after error@239323175) -> (continuation of Deferred@1005889974 after retry RPC after error@1310285518) -> (continuation of Deferred@1642791716 after retry RPC after error@1903820238) -> (continuation of Deferred@1868448590 after retry RPC after error@1798672197) -> (continuation of Deferred@1392395044 after retry RPC after error@1817658168) -> (continuation of Deferred@1905142223 after retry RPC after error@914804508) -> (continuation of Deferred@373378443 after retry RPC after error@1079608056) -> (continuation of Deferred@1083775853 after retry RPC after error@1080541773) -> (continuation of Deferred@1549202143 after retry RPC after error@1351939567) -> (continuation of Deferred@1482612451 after retry RPC after error@643107343) -> (continuation of Deferred@1300153360 after retry RPC after error@976382941) -> (continuation of Deferred@339022782 after retry RPC after error@448685637) -> (continuation of Deferred@568028998 after retry RPC after error@144610339) -> (continuation of Deferred@881512045 after retry RPC after error@1567558391) -> (continuation of Deferred@666173251 after retry RPC after error@1542932506) -> (continuation of Deferred@963386543 after retry RPC after error@477204935) -> (continuation of Deferred@482294765 after retry RPC after error@2112423928) -> (continuation of Deferred@607774094 after retry RPC after error@878098279)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27842), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [5ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [10ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [21ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [21ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [57ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [58ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [62ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [89ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [89ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [90ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [90ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [100ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [122ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [141ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [181ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [200ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [200ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [201ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [201ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [281ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [281ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [281ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [281ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [562ms] refreshing cache from master, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [563ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [563ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [563ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [564ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1260ms] refreshing cache from master, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [1261ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2084ms] refreshing cache from master, [2084ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [2084ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [2085ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [2085ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [2085ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [2085ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [2086ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [3660ms] refreshing cache from master, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [3661ms] too many traces: truncated at 100 traces, deferred=Deferred@1432178702(state=PENDING, result=null, callback=(continuation of Deferred@1687036002 after retry RPC after error@1313195105) -> (continuation of Deferred@844606214 after retry RPC after error@229982306) -> (continuation of Deferred@414051462 after retry RPC after error@2024490302) -> (continuation of Deferred@2007752374 after retry RPC after error@1345992305) -> (continuation of Deferred@662972716 after retry RPC after error@86252119) -> (continuation of Deferred@743647787 after retry RPC after error@760944750) -> (continuation of Deferred@730892704 after retry RPC after error@239323175) -> (continuation of Deferred@1005889974 after retry RPC after error@1310285518) -> (continuation of Deferred@1642791716 after retry RPC after error@1903820238) -> (continuation of Deferred@1868448590 after retry RPC after error@1798672197) -> (continuation of Deferred@1392395044 after retry RPC after error@1817658168) -> (continuation of Deferred@1905142223 after retry RPC after error@914804508) -> (continuation of Deferred@373378443 after retry RPC after error@1079608056) -> (continuation of Deferred@1083775853 after retry RPC after error@1080541773) -> (continuation of Deferred@1549202143 after retry RPC after error@1351939567) -> (continuation of Deferred@1482612451 after retry RPC after error@643107343) -> (continuation of Deferred@1300153360 after retry RPC after error@976382941) -> (continuation of Deferred@339022782 after retry RPC after error@448685637) -> (continuation of Deferred@568028998 after retry RPC after error@144610339) -> (continuation of Deferred@881512045 after retry RPC after error@1567558391) -> (continuation of Deferred@666173251 after retry RPC after error@1542932506) -> (continuation of Deferred@963386543 after retry RPC after error@477204935) -> (continuation of Deferred@482294765 after retry RPC after error@2112423928) -> (continuation of Deferred@607774094 after retry RPC after error@878098279), errback=(continuation of Deferred@1687036002 after retry RPC after error@1313195105) -> (continuation of Deferred@844606214 after retry RPC after error@229982306) -> (continuation of Deferred@414051462 after retry RPC after error@2024490302) -> (continuation of Deferred@2007752374 after retry RPC after error@1345992305) -> (continuation of Deferred@662972716 after retry RPC after error@86252119) -> (continuation of Deferred@743647787 after retry RPC after error@760944750) -> (continuation of Deferred@730892704 after retry RPC after error@239323175) -> (continuation of Deferred@1005889974 after retry RPC after error@1310285518) -> (continuation of Deferred@1642791716 after retry RPC after error@1903820238) -> (continuation of Deferred@1868448590 after retry RPC after error@1798672197) -> (continuation of Deferred@1392395044 after retry RPC after error@1817658168) -> (continuation of Deferred@1905142223 after retry RPC after error@914804508) -> (continuation of Deferred@373378443 after retry RPC after error@1079608056) -> (continuation of Deferred@1083775853 after retry RPC after error@1080541773) -> (continuation of Deferred@1549202143 after retry RPC after error@1351939567) -> (continuation of Deferred@1482612451 after retry RPC after error@643107343) -> (continuation of Deferred@1300153360 after retry RPC after error@976382941) -> (continuation of Deferred@339022782 after retry RPC after error@448685637) -> (continuation of Deferred@568028998 after retry RPC after error@144610339) -> (continuation of Deferred@881512045 after retry RPC after error@1567558391) -> (continuation of Deferred@666173251 after retry RPC after error@1542932506) -> (continuation of Deferred@963386543 after retry RPC after error@477204935) -> (continuation of Deferred@482294765 after retry RPC after error@2112423928) -> (continuation of Deferred@607774094 after retry RPC after error@878098279)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.96.188:32989
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:48.412 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:34:48.412 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#3) of source Source: KuduSource.
18:34:48.413 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to CANCELING.
18:34:48.413 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#4) of source Source: KuduSource.
18:34:48.413 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
18:34:48.413 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to CANCELING.
18:34:48.413 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to CANCELING.
18:34:48.413 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
18:34:48.413 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#3) of source Source: KuduSource.
18:34:48.414 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to CANCELING.
18:34:48.415 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
18:34:48.415 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to CANCELING.
18:34:48.415 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
18:34:48.415 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
18:34:48.415 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CANCELING to CANCELED.
18:34:48.415 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
18:34:48.425 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:48.426 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:48.426 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:48.426 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.426 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.426 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.426 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.426 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.426 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.426 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.426 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.427 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.427 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:48.431 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
18:34:48.432 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CANCELING to CANCELED.
18:34:48.432 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
18:34:48.436 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
18:34:48.436 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to CANCELING.
18:34:48.436 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
18:34:48.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:48.435794 10208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:48.438 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
18:34:48.438 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CANCELING to CANCELED.
18:34:48.438 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#3 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
18:34:48.443 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:48.444 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:48.444 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:48.444 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:48.448 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:48.448 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:48.447 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:48.449 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:48.449 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:48.444 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#3 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
18:34:48.449 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#4 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
18:34:48.449 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#3 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
18:34:48.449 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CANCELING to CANCELED.
18:34:48.450 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.450 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.450 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.450 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.450 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.450 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.450 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.450 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.450 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.450 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:48.444 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:48.451 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:48.451 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:48.444 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:48.451 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:48.451 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:48.451 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:48.451 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:34:48.450 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CANCELING to CANCELED.
18:34:48.452 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CANCELING to CANCELED.
18:34:48.453 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:34:48.453 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 9de81db54be40687a2a82164db1dc50b
18:34:48.465 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:48.465 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:48.465 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:48.466 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.466 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.466 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.466 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.466 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.466 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.466 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.466 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.466 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.466 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:48.466 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:48.466 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:48.467 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:48.467 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:48.467 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:48.467 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:48.467 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:48.467 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:48.468 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:48.468 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:48.468 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:48.468 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:48.468 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:48.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:48.482 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:48.483 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:48.483 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:48.483 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:48.483 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:48.483 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:48.484 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:48.484 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:48.484 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:48.484 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:48.484 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:48.484 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:48.484 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:48.485 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:48.485 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:48.485 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:48.485 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:48.486 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:48.486 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:48.486 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:48.486 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:48.486 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:48.486 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:48.486 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:48.486 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:48.487 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:48.487 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:48.487 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:48.487 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:48.487 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.487 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.488 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.488 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.488 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.488 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.488 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.488 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.488 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.488 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:48.525 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:48.526 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:48.526 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:48.526 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.527 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.527 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.527 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.527 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.527 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.526 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.529 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.529 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.529 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:48.587 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:48.588 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:48.588 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:48.588 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.588 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.588 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.588 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.588 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.589 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.589 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.589 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.588 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.589 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:48.605 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:48.605 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:48.605 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:48.606 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.606 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.606 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.606 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.606 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.606 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.606 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.606 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.606 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.607 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:48.657 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:48.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:48.705 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:48.705 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:48.706 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:48.706 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.706 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.706 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.707 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.707 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.707 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.706 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.707 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.707 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.707 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:48.725 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:48.725 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:48.725 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:48.726 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.726 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.726 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.726 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.726 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.726 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.726 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.726 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.726 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.726 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:48.727 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:48.727 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:48.727 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:48.727 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:48.727 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:48.727 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:48.728 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:48.728 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:48.728 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:48.728 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:48.728 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:48.728 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:48.728 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:48.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:48.785 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:48.785 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:48.785 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:48.786 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.786 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.786 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.786 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:48.786 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.786 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.786 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:48.786 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.787 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:48.787 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:48.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535688833 for job 41f18052e8363382138bde77e16b10c3.
18:34:48.853 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
18:34:48.855 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
18:34:48.864 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:48.865 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:48.865 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:48.865 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:48.865 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:48.865 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:48.865 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:48.865 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:48.865 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:48.866 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:48.866 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:48.866 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:48.866 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:48.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:48.963187 10190 heartbeater.cc:499] Master 127.9.79.254:42669 was elected leader, sending a full tablet report...
18:34:48.971 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:49.033 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:49.034 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:49.034 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:49.034 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:49.036 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:49.036 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:49.035 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:49.036 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:49.036 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:49.035 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:49.036 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:49.036 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:49.036 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:49.157 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:49.157 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:49.157 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:49.158 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:49.158 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:49.158 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:49.158 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:49.159 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:49.159 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:49.159 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:49.159 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:49.159 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:49.159 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:49.159 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:49.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:49.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:49.308 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:49.309 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:49.309 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:49.309 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:49.309 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:49.309 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:49.309 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:49.309 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:49.309 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:49.309 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:49.309 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:49.310 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:49.310 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:49.335 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535689333 for job 41f18052e8363382138bde77e16b10c3.
18:34:49.348 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
18:34:49.350 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
18:34:49.357 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:49.358 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:49.358 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:49.358 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:49.358 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:49.358 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:49.358 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:49.358 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:49.358 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:49.358 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:49.358 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:49.359 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:49.359 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:49.471 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:49.603 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:49.603 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:49.603 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:49.604 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:49.604 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:49.604 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:49.604 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:49.605 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:49.605 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:49.605 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:49.605 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:49.605 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:49.605 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:49.657 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:49.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:49.726 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:49.726 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:49.726 [DEBUG - pool-432-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:49.726 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:49.726 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:49.727 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:49.727 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:49.727 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:49.727 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:49.727 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:49.727 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:49.727 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:49.728 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:49.760 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:49.761 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:49.761 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:49.761 [DEBUG - pool-436-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:49.761 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:49.761 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:49.761 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:49.761 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:49.762 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:49.762 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:49.762 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:49.762 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:49.762 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:49.762 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:49.763 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29211), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [9ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [11ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [15ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [15ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [60ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [60ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [95ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [96ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [96ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [97ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [128ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [128ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [142ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [180ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [180ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [181ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [221ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [222ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [222ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [320ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [320ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [321ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [321ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [541ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [541ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [542ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [542ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [681ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [681ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [681ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [681ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1360ms] refreshing cache from master, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1365ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1365ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1365ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [3300ms] refreshing cache from master, [3300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [3300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [3300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [3301ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [3302ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [3306ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [3306ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [4320ms] refreshing cache from master, [4320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [4320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [4320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [4321ms] too many traces: truncated at 100 traces, deferred=Deferred@972953808(state=PENDING, result=null, callback=(continuation of Deferred@796906201 after retry RPC after error@732336701) -> (continuation of Deferred@1793805901 after retry RPC after error@597353304) -> (continuation of Deferred@1914836200 after retry RPC after error@1829394411) -> (continuation of Deferred@1571022113 after retry RPC after error@701976046) -> (continuation of Deferred@1261472104 after retry RPC after error@1958357738) -> (continuation of Deferred@913462193 after retry RPC after error@635027628) -> (continuation of Deferred@1793943222 after retry RPC after error@1327885435) -> (continuation of Deferred@1810809333 after retry RPC after error@5873796) -> (continuation of Deferred@16826095 after retry RPC after error@1638321280) -> (continuation of Deferred@2094684200 after retry RPC after error@835357367) -> (continuation of Deferred@892976551 after retry RPC after error@1647097164) -> (continuation of Deferred@1285139001 after retry RPC after error@694357551) -> (continuation of Deferred@1364154913 after retry RPC after error@1447957393) -> (continuation of Deferred@1460122371 after retry RPC after error@1713687994) -> (continuation of Deferred@1292967181 after retry RPC after error@1810193829) -> (continuation of Deferred@26240113 after retry RPC after error@1092165860) -> (continuation of Deferred@69575871 after retry RPC after error@1164757483) -> (continuation of Deferred@1205702363 after retry RPC after error@1330350276) -> (continuation of Deferred@1726143950 after retry RPC after error@1164079976) -> (continuation of Deferred@1860339273 after retry RPC after error@2113679097) -> (continuation of Deferred@218136613 after retry RPC after error@1538218974) -> (continuation of Deferred@553999916 after retry RPC after error@1024599827) -> (continuation of Deferred@882542908 after retry RPC after error@357189082) -> (continuation of Deferred@506826081 after retry RPC after error@850594571) -> (continuation of Deferred@1375778568 after retry RPC after error@354634759), errback=(continuation of Deferred@796906201 after retry RPC after error@732336701) -> (continuation of Deferred@1793805901 after retry RPC after error@597353304) -> (continuation of Deferred@1914836200 after retry RPC after error@1829394411) -> (continuation of Deferred@1571022113 after retry RPC after error@701976046) -> (continuation of Deferred@1261472104 after retry RPC after error@1958357738) -> (continuation of Deferred@913462193 after retry RPC after error@635027628) -> (continuation of Deferred@1793943222 after retry RPC after error@1327885435) -> (continuation of Deferred@1810809333 after retry RPC after error@5873796) -> (continuation of Deferred@16826095 after retry RPC after error@1638321280) -> (continuation of Deferred@2094684200 after retry RPC after error@835357367) -> (continuation of Deferred@892976551 after retry RPC after error@1647097164) -> (continuation of Deferred@1285139001 after retry RPC after error@694357551) -> (continuation of Deferred@1364154913 after retry RPC after error@1447957393) -> (continuation of Deferred@1460122371 after retry RPC after error@1713687994) -> (continuation of Deferred@1292967181 after retry RPC after error@1810193829) -> (continuation of Deferred@26240113 after retry RPC after error@1092165860) -> (continuation of Deferred@69575871 after retry RPC after error@1164757483) -> (continuation of Deferred@1205702363 after retry RPC after error@1330350276) -> (continuation of Deferred@1726143950 after retry RPC after error@1164079976) -> (continuation of Deferred@1860339273 after retry RPC after error@2113679097) -> (continuation of Deferred@218136613 after retry RPC after error@1538218974) -> (continuation of Deferred@553999916 after retry RPC after error@1024599827) -> (continuation of Deferred@882542908 after retry RPC after error@357189082) -> (continuation of Deferred@506826081 after retry RPC after error@850594571) -> (continuation of Deferred@1375778568 after retry RPC after error@354634759)))
18:34:49.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535689833 for job 41f18052e8363382138bde77e16b10c3.
18:34:49.853 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
18:34:49.854 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
18:34:49.875 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:49.875 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:49.875 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:49.876 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:49.876 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:49.876 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:49.876 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:49.877 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:49.877 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:49.877 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:49.877 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:49.877 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:49.877 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:49.898 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:49.898 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:49.898 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:49.899 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:49.899 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:49.899 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:49.899 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:49.900 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:49.900 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:49.900 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:49.900 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:49.900 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:49.900 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:49.918 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:49.918 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:49.918 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:49.919 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:49.919 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:49.919 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:49.919 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:49.919 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:49.919 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:49.920 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:49.920 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:49.920 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:49.920 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:49.962 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:49.962 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:49.963 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:49.963 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:49.963 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:49.963 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:49.963 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:49.963 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:49.963 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:49.963 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:49.963 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:49.963 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:49.963 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:49.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:50.004 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:50.004 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:50.005 [DEBUG - pool-438-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:50.006 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:50.006 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:50.006 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:50.006 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:50.006 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:50.006 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:50.008 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:50.008 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:50.008 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:50.008 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:50.009 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29456), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [3ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [8ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [11ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [11ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [38ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [38ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [40ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [40ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [73ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [80ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [81ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [123ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [142ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [201ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [202ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [282ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [282ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [282ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [282ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [321ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [321ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [321ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [321ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [702ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [702ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [703ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [703ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [942ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [943ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [943ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [943ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1861ms] refreshing cache from master, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1862ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1863ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1863ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1863ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2781ms] refreshing cache from master, [2781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2782ms] too many traces: truncated at 100 traces, deferred=Deferred@42710296(state=PENDING, result=null, callback=(continuation of Deferred@628621912 after retry RPC after error@1507370951) -> (continuation of Deferred@1476436882 after retry RPC after error@134020863) -> (continuation of Deferred@1660110490 after retry RPC after error@2114528156) -> (continuation of Deferred@591926268 after retry RPC after error@1126369900) -> (continuation of Deferred@1000096516 after retry RPC after error@205423144) -> (continuation of Deferred@1862969248 after retry RPC after error@883007559) -> (continuation of Deferred@1836859828 after retry RPC after error@363569649) -> (continuation of Deferred@791028547 after retry RPC after error@381427064) -> (continuation of Deferred@423792634 after retry RPC after error@1361973514) -> (continuation of Deferred@1326193751 after retry RPC after error@967679763) -> (continuation of Deferred@874375811 after retry RPC after error@362416971) -> (continuation of Deferred@979059467 after retry RPC after error@1876629076) -> (continuation of Deferred@877244638 after retry RPC after error@1900815695) -> (continuation of Deferred@300901238 after retry RPC after error@649182889) -> (continuation of Deferred@1594308065 after retry RPC after error@1341195539) -> (continuation of Deferred@628046664 after retry RPC after error@243310010) -> (continuation of Deferred@1749944758 after retry RPC after error@802177073) -> (continuation of Deferred@1941539832 after retry RPC after error@2044638584) -> (continuation of Deferred@1640304716 after retry RPC after error@1287198093) -> (continuation of Deferred@1935716777 after retry RPC after error@2132393928) -> (continuation of Deferred@915900183 after retry RPC after error@839317813) -> (continuation of Deferred@1151200037 after retry RPC after error@1992883073) -> (continuation of Deferred@2087548272 after retry RPC after error@2041050265) -> (continuation of Deferred@1388899403 after retry RPC after error@1668088160) -> (continuation of Deferred@1950101128 after retry RPC after error@855187370) -> (continuation of Deferred@658904842 after retry RPC after error@749429891) -> (continuation of Deferred@964052976 after retry RPC after error@1124604731), errback=(continuation of Deferred@628621912 after retry RPC after error@1507370951) -> (continuation of Deferred@1476436882 after retry RPC after error@134020863) -> (continuation of Deferred@1660110490 after retry RPC after error@2114528156) -> (continuation of Deferred@591926268 after retry RPC after error@1126369900) -> (continuation of Deferred@1000096516 after retry RPC after error@205423144) -> (continuation of Deferred@1862969248 after retry RPC after error@883007559) -> (continuation of Deferred@1836859828 after retry RPC after error@363569649) -> (continuation of Deferred@791028547 after retry RPC after error@381427064) -> (continuation of Deferred@423792634 after retry RPC after error@1361973514) -> (continuation of Deferred@1326193751 after retry RPC after error@967679763) -> (continuation of Deferred@874375811 after retry RPC after error@362416971) -> (continuation of Deferred@979059467 after retry RPC after error@1876629076) -> (continuation of Deferred@877244638 after retry RPC after error@1900815695) -> (continuation of Deferred@300901238 after retry RPC after error@649182889) -> (continuation of Deferred@1594308065 after retry RPC after error@1341195539) -> (continuation of Deferred@628046664 after retry RPC after error@243310010) -> (continuation of Deferred@1749944758 after retry RPC after error@802177073) -> (continuation of Deferred@1941539832 after retry RPC after error@2044638584) -> (continuation of Deferred@1640304716 after retry RPC after error@1287198093) -> (continuation of Deferred@1935716777 after retry RPC after error@2132393928) -> (continuation of Deferred@915900183 after retry RPC after error@839317813) -> (continuation of Deferred@1151200037 after retry RPC after error@1992883073) -> (continuation of Deferred@2087548272 after retry RPC after error@2041050265) -> (continuation of Deferred@1388899403 after retry RPC after error@1668088160) -> (continuation of Deferred@1950101128 after retry RPC after error@855187370) -> (continuation of Deferred@658904842 after retry RPC after error@749429891) -> (continuation of Deferred@964052976 after retry RPC after error@1124604731)))
18:34:50.113 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:50.113 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:50.113 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:50.113 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:50.113 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:50.114 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:50.114 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:50.114 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:50.114 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:50.114 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:50.114 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:50.114 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:50.114 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:50.115 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29547), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [3ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [4ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [12ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [12ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [25ms] refreshing cache from master, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [32ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [50ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [56ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [56ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [62ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [80ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [80ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [80ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [81ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [123ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [127ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [130ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [163ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [163ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [163ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [202ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [203ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [203ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [203ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [302ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [302ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [542ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [542ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [543ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [543ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1003ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1023ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2760ms] refreshing cache from master, [2760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2763ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [5301ms] refreshing cache from master, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [5302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [5302ms] too many traces: truncated at 100 traces, deferred=Deferred@1218745529(state=PENDING, result=null, callback=(continuation of Deferred@290717938 after retry RPC after error@149056663) -> (continuation of Deferred@657366821 after retry RPC after error@1262732837) -> (continuation of Deferred@2048986159 after retry RPC after error@1639731496) -> (continuation of Deferred@842546573 after retry RPC after error@1730127617) -> (continuation of Deferred@355311545 after retry RPC after error@379304229) -> (continuation of Deferred@1706830382 after retry RPC after error@2130816567) -> (continuation of Deferred@111687225 after retry RPC after error@1303504216) -> (continuation of Deferred@1238911898 after retry RPC after error@995763328) -> (continuation of Deferred@2089079852 after retry RPC after error@1046308289) -> (continuation of Deferred@894598411 after retry RPC after error@1598435589) -> (continuation of Deferred@87669621 after retry RPC after error@1352643966) -> (continuation of Deferred@1979916355 after retry RPC after error@405010847) -> (continuation of Deferred@1351162877 after retry RPC after error@2098229463) -> (continuation of Deferred@310265358 after retry RPC after error@353807071) -> (continuation of Deferred@232267123 after retry RPC after error@1940931287) -> (continuation of Deferred@320742553 after retry RPC after error@863908983) -> (continuation of Deferred@2122351854 after retry RPC after error@257410835) -> (continuation of Deferred@1838088332 after retry RPC after error@797990086) -> (continuation of Deferred@1439504942 after retry RPC after error@1687363803) -> (continuation of Deferred@1896728485 after retry RPC after error@1549194030) -> (continuation of Deferred@1635233504 after retry RPC after error@471846893) -> (continuation of Deferred@53478180 after retry RPC after error@1763016655) -> (continuation of Deferred@902421667 after retry RPC after error@1472925008) -> (continuation of Deferred@1424039342 after retry RPC after error@382266362) -> (continuation of Deferred@1830748484 after retry RPC after error@1647390778) -> (continuation of Deferred@1054956991 after retry RPC after error@1864885922) -> (continuation of Deferred@2049429283 after retry RPC after error@293372093) -> (continuation of Deferred@633613192 after retry RPC after error@1963383652), errback=(continuation of Deferred@290717938 after retry RPC after error@149056663) -> (continuation of Deferred@657366821 after retry RPC after error@1262732837) -> (continuation of Deferred@2048986159 after retry RPC after error@1639731496) -> (continuation of Deferred@842546573 after retry RPC after error@1730127617) -> (continuation of Deferred@355311545 after retry RPC after error@379304229) -> (continuation of Deferred@1706830382 after retry RPC after error@2130816567) -> (continuation of Deferred@111687225 after retry RPC after error@1303504216) -> (continuation of Deferred@1238911898 after retry RPC after error@995763328) -> (continuation of Deferred@2089079852 after retry RPC after error@1046308289) -> (continuation of Deferred@894598411 after retry RPC after error@1598435589) -> (continuation of Deferred@87669621 after retry RPC after error@1352643966) -> (continuation of Deferred@1979916355 after retry RPC after error@405010847) -> (continuation of Deferred@1351162877 after retry RPC after error@2098229463) -> (continuation of Deferred@310265358 after retry RPC after error@353807071) -> (continuation of Deferred@232267123 after retry RPC after error@1940931287) -> (continuation of Deferred@320742553 after retry RPC after error@863908983) -> (continuation of Deferred@2122351854 after retry RPC after error@257410835) -> (continuation of Deferred@1838088332 after retry RPC after error@797990086) -> (continuation of Deferred@1439504942 after retry RPC after error@1687363803) -> (continuation of Deferred@1896728485 after retry RPC after error@1549194030) -> (continuation of Deferred@1635233504 after retry RPC after error@471846893) -> (continuation of Deferred@53478180 after retry RPC after error@1763016655) -> (continuation of Deferred@902421667 after retry RPC after error@1472925008) -> (continuation of Deferred@1424039342 after retry RPC after error@382266362) -> (continuation of Deferred@1830748484 after retry RPC after error@1647390778) -> (continuation of Deferred@1054956991 after retry RPC after error@1864885922) -> (continuation of Deferred@2049429283 after retry RPC after error@293372093) -> (continuation of Deferred@633613192 after retry RPC after error@1963383652)))
18:34:50.127 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:50.127 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:50.127 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:50.128 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:50.128 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:50.128 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:50.128 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:50.129 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:50.129 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:50.129 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:50.129 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:50.129 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:50.129 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:50.157 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:50.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:50.260 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:50.333 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535690333 for job 41f18052e8363382138bde77e16b10c3.
18:34:50.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:49.831445 10207 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 10198
18:34:50.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:50.335857 10214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:50.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:50.336174 10212 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1897 milliseconds
18:34:50.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:50.335014 10198 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.898s	user 0.690s	sys 1.175s
18:34:50.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:50.337193 10198 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.901s	user 0.690s	sys 1.175s
18:34:50.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:48.438012 10210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:50.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.337598 10198 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:34:50.342 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:34:50.343 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
18:34:50.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.345214 10198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:34:50.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.348112 10198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:34:50.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.349655 10198 hybrid_clock.cc:648] HybridClock initialized: now 1783535690349564 us; error 86 us; skew 500 ppm
18:34:50.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.350826 10198 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:34:50.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.358873 10198 webserver.cc:534] Webserver started at http://127.9.79.195:34593/ using document root <none> and password file <none>
18:34:50.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.360397 10198 fs_manager.cc:362] Metadata directory not provided
18:34:50.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.360807 10198 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:34:50.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.361512 10198 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:34:50.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.368620 10198 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/data/instance:
18:34:50.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "dd6b79d156f3425f9339508e1f01df9c"
18:34:50.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:50 on dist-test-slave-dxnw"
18:34:50.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.370097 10198 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/wal/instance:
18:34:50.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "dd6b79d156f3425f9339508e1f01df9c"
18:34:50.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:50 on dist-test-slave-dxnw"
18:34:50.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.380692 10198 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.009s	sys 0.001s
18:34:50.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.387723 10224 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:34:50.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.389104 10198 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
18:34:50.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.389456 10198 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/wal
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "dd6b79d156f3425f9339508e1f01df9c"
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:50 on dist-test-slave-dxnw"
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.389760 10198 fs_report.cc:389] FS layout report
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/wal
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/wal
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/data/data
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:34:50.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:34:50.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.471381 10198 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:34:50.471 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:50.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.473348 10198 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:34:50.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.473795 10198 kserver.cc:163] Server-wide thread pool size limit: 3276
18:34:50.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.477349 10198 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:34:50.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.483433 10198 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:34:50.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.483660 10198 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:34:50.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.483958 10198 ts_tablet_manager.cc:616] Registered 0 tablets
18:34:50.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.484579 10198 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
18:34:50.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.652635 10198 rpc_server.cc:307] RPC server started. Bound to: 127.9.79.195:41625
18:34:50.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.652927 10336 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.79.195:41625 every 8 connection(s)
18:34:50.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.655649 10198 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/data/info.pb
18:34:50.656 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:50.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.658643  9535 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 10198
18:34:50.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.659266  9535 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster15892739223442263458/ts-2/wal/instance
18:34:50.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:50.720 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:50.720 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:50.720 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:50.720 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:50.720 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:50.720 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:50.720 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:50.720 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:50.721 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:50.721 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:50.721 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:50.720 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:50.721 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:50.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.739387 10337 heartbeater.cc:344] Connected to a master server at 127.9.79.252:38727
18:34:50.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.739902 10337 heartbeater.cc:461] Registering TS with master...
18:34:50.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.741232 10337 heartbeater.cc:507] Master 127.9.79.252:38727 requested a full tablet report, sending...
18:34:50.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.744865  9810 ts_manager.cc:194] Registered new tserver with Master: dd6b79d156f3425f9339508e1f01df9c (127.9.79.195:41625)
18:34:50.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.748833 10338 heartbeater.cc:344] Connected to a master server at 127.9.79.253:36577
18:34:50.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.749307 10338 heartbeater.cc:461] Registering TS with master...
18:34:50.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.750542 10338 heartbeater.cc:507] Master 127.9.79.253:36577 requested a full tablet report, sending...
18:34:50.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.754391  9731 ts_manager.cc:194] Registered new tserver with Master: dd6b79d156f3425f9339508e1f01df9c (127.9.79.195:41625)
18:34:50.760 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:50.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.767601 10341 heartbeater.cc:344] Connected to a master server at 127.9.79.254:42669
18:34:50.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.767941 10341 heartbeater.cc:461] Registering TS with master...
18:34:50.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.768791 10341 heartbeater.cc:507] Master 127.9.79.254:42669 requested a full tablet report, sending...
18:34:50.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.770761  9633 ts_manager.cc:194] Registered new tserver with Master: dd6b79d156f3425f9339508e1f01df9c (127.9.79.195:41625)
18:34:50.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.772900  9633 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.79.195:38069
18:34:50.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:50.785403  9535 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
18:34:50.802 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:34:50.803 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

18:34:50.804 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.9.79.254"
      port: 42669
    }
    bound_http_address {
      host: "127.9.79.254"
      port: 41897
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.9.79.253"
      port: 36577
    }
    bound_http_address {
      host: "127.9.79.253"
      port: 35987
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.9.79.252"
      port: 38727
    }
    bound_http_address {
      host: "127.9.79.252"
      port: 43271
    }
  }
}

18:34:50.805 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

18:34:50.806 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.9.79.193"
      port: 42499
    }
    bound_http_address {
      host: "127.9.79.193"
      port: 39961
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.9.79.194"
      port: 36053
    }
    bound_http_address {
      host: "127.9.79.194"
      port: 45717
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.9.79.195"
      port: 41625
    }
    bound_http_address {
      host: "127.9.79.195"
      port: 34593
    }
  }
}

18:34:50.806 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
18:34:50.808 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:50.808 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
18:34:50.808 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskSwO0Je/test-tmp
18:34:50.808 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
18:34:50.808 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskSwO0Je/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
18:34:50.816 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

18:34:50.833 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535690833 for job 41f18052e8363382138bde77e16b10c3.
18:34:50.834 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:50.834 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:50.834 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:50.834 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:50.834 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:50.834 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:50.834 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:50.834 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:50.834 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:50.834 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:50.834 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:50.834 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:50.835 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:50.841 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:34:50.842 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
18:34:50.904 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:50.905 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:50.905 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:50.905 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:50.905 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:50.905 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:50.905 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:50.905 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:50.905 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:50.905 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:50.905 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:50.905 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:50.906 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:50.972 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:51.123 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:51.123 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:51.123 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:51.123 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:51.123 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:51.123 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:51.123 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:51.123 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:51.123 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:51.123 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:51.123 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:51.123 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:51.124 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:51.156 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:51.168 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:51.168 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:51.169 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:51.169 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:51.169 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:51.169 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:51.169 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:51.169 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:51.169 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:51.169 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:51.169 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:51.169 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:51.169 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:51.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:51.211 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:34:51.211 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

18:34:51.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:51.214759 10347 mini_oidc.cc:150] Starting JWKS server
18:34:51.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:51.218922 10347 webserver.cc:534] Webserver started at http://127.0.0.1:41629/ using document root <none> and password file <none>
18:34:51.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:51.219439 10347 mini_oidc.cc:186] Starting OIDC Discovery server
18:34:51.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:51.221621 10347 webserver.cc:534] Webserver started at http://127.0.0.1:35711/ using document root <none> and password file <none>
18:34:51.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:51.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:34:51Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
18:34:51.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:34:51Z Disabled control of system clock
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:51.298763 10347 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/wal
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/data
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/logs
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/data/info.pb
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:34:51.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:34:51.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.26.254:36869
18:34:51.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.26.254
18:34:51.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:51.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.26.212:43597
18:34:51.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:51.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:51.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:51.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:34:51.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.26.254:36869,127.10.26.253:36107,127.10.26.252:40435
18:34:51.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:34:51.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41629/jwks.json with env {}
18:34:51.333 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535691333 for job 41f18052e8363382138bde77e16b10c3.
18:34:51.342 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
18:34:51.342 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
18:34:51.420 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:51.420 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:51.420 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:51.420 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:51.420 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:51.420 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:51.420 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:51.421 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:51.421 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:51.421 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:51.421 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:51.421 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:51.421 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:51.472 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:51.482 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:51.482 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:51.482 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:51.482 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:51.482 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:51.483 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:51.483 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:51.483 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:51.483 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:51.483 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:51.483 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:51.483 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:51.483 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:51.543 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:51.543 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:51.543 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:51.544 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:51.544 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:51.544 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:51.544 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:51.544 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:51.544 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:51.544 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:51.544 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:51.544 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:51.544 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:51.574 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (9de81db54be40687a2a82164db1dc50b) switched from state RESTARTING to RUNNING.
18:34:51.575 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 9de81db54be40687a2a82164db1dc50b from Checkpoint 74 @ 1783535598621 for 9de81db54be40687a2a82164db1dc50b located at file:/tmp/junit13379242205642315453/checkpoints/9de81db54be40687a2a82164db1dc50b/chk-74.
18:34:51.575 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
18:34:51.576 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:34:51.576 [INFO - Thread-71] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:34:51.576 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to SCHEDULED.
18:34:51.576 [DEBUG - Thread-71] (Connection.java:575) [peer master-127.2.96.189:33339(127.2.96.189:33339)] disconnecting while in state TERMINATED
18:34:51.577 [DEBUG - Thread-71] (Connection.java:575) [peer master-127.2.96.188:32989(127.2.96.188:32989)] disconnecting while in state TERMINATED
18:34:51.577 [DEBUG - Thread-71] (Connection.java:575) [peer master-127.2.96.190:44161(127.2.96.190:44161)] disconnecting while in state TERMINATED
18:34:51.577 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:51.577 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:34:51.578 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from SCHEDULED to DEPLOYING.
18:34:51.578 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #4) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id 30d104af07ed84a5695abb40e9c4cdae
18:34:51.578 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to SCHEDULED.
18:34:51.578 [INFO - Thread-71] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:34:51.580 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from SCHEDULED to DEPLOYING.
18:34:51.579 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:34:51.578 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 30d104af07ed84a5695abb40e9c4cdae.
18:34:51.581 [INFO - Thread-71] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:34:51.582 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_4), deploy into slot with allocation id 30d104af07ed84a5695abb40e9c4cdae.
18:34:51.581 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #5) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id e340c57f8743c3b4810a5f8fd9742fae
18:34:51.583 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to DEPLOYING.
18:34:51.583 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_4) [DEPLOYING].
18:34:51.583 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot e340c57f8743c3b4810a5f8fd9742fae.
18:34:51.583 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5f5b6d56
18:34:51.584 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:51.584 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:34:51.584 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#5 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_5), deploy into slot with allocation id e340c57f8743c3b4810a5f8fd9742fae.
18:34:51.584 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
18:34:51.584 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to SCHEDULED.
18:34:51.585 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:51.585 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from SCHEDULED to DEPLOYING.
18:34:51.585 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #4) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id afa7c94bd89aa521f7cc788a9467b76f
18:34:51.586 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to SCHEDULED.
18:34:51.586 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:34:51.586 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from SCHEDULED to DEPLOYING.
18:34:51.587 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #4) with attempt id 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to b5c0bb97-d5b4-4dae-a260-0b572e900c6e @ 127.0.0.1 (dataPort=-1) with allocation id 2d9055e68c7827d1c77d7c11ef4f5752
18:34:51.587 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
18:34:51.587 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5f2031c3
18:34:51.587 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot afa7c94bd89aa521f7cc788a9467b76f.
18:34:51.588 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_4), deploy into slot with allocation id afa7c94bd89aa521f7cc788a9467b76f.
18:34:51.589 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 2d9055e68c7827d1c77d7c11ef4f5752.
18:34:51.589 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:51.589 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_4), deploy into slot with allocation id 2d9055e68c7827d1c77d7c11ef4f5752.
18:34:51.590 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to DEPLOYING.
18:34:51.590 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#5 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_5) [DEPLOYING].
18:34:51.591 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@f91a395
18:34:51.591 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:51.591 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:34:51.591 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
18:34:51.591 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
18:34:51.592 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to DEPLOYING.
18:34:51.592 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_4) [DEPLOYING].
18:34:51.592 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@505590dd
18:34:51.592 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:51.592 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:34:51.593 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
18:34:51.593 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
18:34:51.593 [DEBUG - Thread-71] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:51.593 [INFO - Thread-71] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:34:51.596 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3618a964
18:34:51.597 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@613234d6
18:34:51.599 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.612 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to DEPLOYING.
18:34:51.612 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_4) [DEPLOYING].
18:34:51.613 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:51.613 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:51.613 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:51.613 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:34:51.614 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:51.615 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.616 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:51.616 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5d55ce15
18:34:51.616 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:34:51.617 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit13379242205642315453/checkpoints")
18:34:51.617 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
18:34:51.617 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
18:34:51.618 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:51.619 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.620 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.620 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.620 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.620 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@66fa356e
18:34:51.622 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.622 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.622 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.622 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.623 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:51.623 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.624 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.624 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.624 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:34:51.626 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:51.626 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:51.626 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:51.627 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:51.627 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:51.627 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:51.627 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:51.627 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:51.627 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:51.627 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:51.627 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.627 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.627 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:51.627 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.628 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:51.628 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:51.628 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:51.630 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.631 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.631 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.631 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.632 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.632 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.632 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.632 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:51.634 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:51.635 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.639 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.639 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:51.639 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:51.640 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:51.640 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:51.640 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:51.640 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:51.640 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:51.640 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:51.640 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:51.640 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:51.640 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:51.640 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:51.640 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:51.646 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:51.646 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:51.646 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:51.647 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:51.647 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:51.647 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:51.647 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:51.647 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:51.647 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:51.647 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:51.647 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:51.647 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:51.647 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:51.655 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.656 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:51.665 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.665 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:51.666 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.666 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.666 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.666 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.666 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.666 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.666 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.666 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.666 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.666 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.666 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.667 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.667 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.667 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.667 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.667 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.667 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.667 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.671 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.671 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.671 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.671 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.672 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:51.672 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.672 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.672 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.672 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.672 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.673 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.673 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.673 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.673 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.673 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.673 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.674 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.674 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.674 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.674 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:51.674 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.674 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.674 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.674 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.674 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.675 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.675 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.675 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.676 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.679 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.679 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.679 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.679 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.679 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.680 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.681 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:51.681 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.681 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.681 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.681 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.681 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.681 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.681 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.681 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.682 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.682 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.682 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.682 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.682 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.682 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.682 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.682 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.682 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.682 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.682 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.682 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.683 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.683 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.683 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.683 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.683 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.683 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.683 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.683 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.683 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.683 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.695 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:51.695 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.695 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.695 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:51.696 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.696 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.696 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.696 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.696 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.696 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.696 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.697 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.697 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.697 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.697 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.697 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:51.698 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.698 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.698 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.698 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.698 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.698 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.698 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:51.698 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.699 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.699 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.699 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.699 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.699 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.699 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.699 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.699 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.699 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.699 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.699 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.699 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.700 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.700 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.700 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.700 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.700 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.700 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.700 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.700 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.700 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.700 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.700 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.700 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.701 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.701 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.701 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.701 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.703 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.703 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.704 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.704 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.704 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.704 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.704 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.704 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.704 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.705 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.705 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.705 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.705 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.707 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:51.707 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:51.708 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:51.708 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:51.708 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:51.708 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:51.708 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:51.708 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:51.708 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:51.708 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:51.708 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:51.708 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:51.708 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:51.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:51.712682 10359 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:34:51.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:51.713423 10359 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:34:51.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:51.714013 10359 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:34:51.715 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:51.715 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:51.715 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:51.715 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.715 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.715 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.715 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.715 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.715 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.715 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.715 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.715 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.715 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:51.716 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.716 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.716 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.716 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.716 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.716 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.717 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.717 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.717 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.717 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.717 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.717 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.717 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.717 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.717 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.717 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.718 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.718 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.718 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.718 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.718 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.718 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.718 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.718 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.718 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.718 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.720 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.720 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.720 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.720 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.720 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.720 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.720 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.720 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.721 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.721 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.721 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.721 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.721 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.723 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.723 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.723 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.723 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.723 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.723 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.724 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.724 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.724 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.724 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.724 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.724 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.724 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.734 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:51.734 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:51.734 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:51.735 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.735 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.735 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.735 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.735 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.735 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.735 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.735 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.735 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.735 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:51.735 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.735 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.735 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.735 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.735 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.736 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.736 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.736 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.736 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.736 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.736 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.736 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.736 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.736 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.736 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.736 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.736 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.736 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.736 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.736 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.736 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.736 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.737 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.737 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.737 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.737 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.743 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.743 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.743 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.743 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.743 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.743 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.743 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.743 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.743 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.743 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.743 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.743 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.743 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.755 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:51.755 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:51.755 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:51.755 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.755 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.755 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.755 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.755 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.756 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.756 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.756 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.756 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.756 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.756 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.756 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.756 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.756 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.756 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.756 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.756 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.756 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.756 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.756 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.756 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:51.757 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.757 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.760 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.760 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.760 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:51.760 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.761 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.761 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.761 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.761 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.761 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.761 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.761 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.761 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.761 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.761 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.763 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.763 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.763 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.763 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.763 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.763 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.763 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.764 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.764 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.764 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:51.764137 10359 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:34:51.764 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.764 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:51.764468 10359 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:34:51.764 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:51.764703 10359 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:34:51.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:51.765003 10359 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:34:51.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:51.765331 10359 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:34:51.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:51.765569 10359 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:41629/jwks.json
18:34:51.776 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.776 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.776 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.777 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.777 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.777 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.777 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.777 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.777 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:51.777746 10341 heartbeater.cc:499] Master 127.9.79.254:42669 was elected leader, sending a full tablet report...
18:34:51.780 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.780 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.780 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.780 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.780 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.780 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.781 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.781 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.781 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.781 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.781 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.781 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.781 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.783 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.783 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.783 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.783 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.783 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.783 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.783 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.783 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.783 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.783 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.783 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.783 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.783 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.787 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.787 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.787 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.787 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.794 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:51.795 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:51.795 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:51.795 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.795 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.795 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.795 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.795 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.795 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.795 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.795 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.795 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.795 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:51.795 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.796 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.796 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.796 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.796 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.796 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.796 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.796 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.796 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.796 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.796 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.796 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.796 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.803 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.803 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.803 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.803 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.804 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.804 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.804 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.804 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.804 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.804 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.804 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.804 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.804 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.816 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.816 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.816 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.817 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.817 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.817 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.817 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.817 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.817 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.817 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.817 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.817 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.817 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.819 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.820 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.820 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.820 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.820 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.820 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.820 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.820 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.820 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.820 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.820 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.820 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.820 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:51.826292 10359 master_runner.cc:387] Master server non-default flags:
18:34:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.26.212:43597
18:34:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/data
18:34:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/wal
18:34:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:34:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.26.254:36869,127.10.26.253:36107,127.10.26.252:40435
18:34:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:34:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.26.254:36869
18:34:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:34:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41629/jwks.json
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/data/info.pb
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.26.254
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/logs
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:34:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:34:51.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:51.827966 10359 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:34:51.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:51.830039 10359 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:34:51.833 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535691833 for job 41f18052e8363382138bde77e16b10c3.
18:34:51.835 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.835 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.835 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.836 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.836 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.836 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.836 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.836 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.836 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.836 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.836 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.837 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.837 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.843 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:34:51.844 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
18:34:51.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:51.844866 10419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:51.855 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.855 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.856 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.856 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.856 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.856 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.856 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.856 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.856 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.856 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.857 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.857 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.857 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.858 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:51.858 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:51.858 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:51.858 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:51.859 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:51.859 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:51.859 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:51.859 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:51.859 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:51.859 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:51.859 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:51.859 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:51.859 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:51.874 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:51.875 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:51.875 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:51.875 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.875 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.875 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.875 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.875 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.875 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.875 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.875 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.876 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.876 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:51.883 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.883 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.883 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.884 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.884 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.884 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.884 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.884 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.884 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.884 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.884 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.884 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.884 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.895 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.895 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.896 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.896 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.896 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.896 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.897 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.897 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.897 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.897 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.897 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.897 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.897 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.903 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:51.914 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:51.914 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:51.915 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:51.915 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.915 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.915 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.915 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.915 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.915 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.916 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:51.916 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:51.916 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:51.916 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.916 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.916 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:51.917 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.917 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.917 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:51.917 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.917 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.917 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:51.917 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:51.915 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.915 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.918 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.919 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:51.935 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:51.935 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:51.936 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:51.936 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.936 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.936 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.936 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:51.936 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.936 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.936 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:51.936 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.936 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:51.937 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:51.977 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:52.036 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:52.037 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:52.037 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:52.037 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.037 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.038 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.038 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.038 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.038 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.038 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.038 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.039 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.039 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:52.039 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:52.039 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:52.040 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:52.040 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.040 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.040 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.040 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.040 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.040 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.041 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.041 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.041 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.041 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:52.043 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:52.043 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:52.043 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:52.043 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.043 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.044 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.044 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.044 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.044 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.044 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.044 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.044 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.045 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:52.055 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:52.055 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:52.055 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:52.056 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.056 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.056 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.057 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.057 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.057 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.057 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.057 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.057 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.057 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:52.156 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:52.156 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:52.156 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:52.156 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:52.157 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:52.157 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:52.157 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:52.158 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:52.158 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:52.158 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:52.159 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:52.159 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:52.159 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:52.159 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:52.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:52.235 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:52.236 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:52.236 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:52.236 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.236 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.236 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.237 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.237 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.237 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.237 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.237 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.237 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.237 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:52.239 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:52.239 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:52.239 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:52.240 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.240 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.240 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.240 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.240 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.240 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.241 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.241 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.241 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.241 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:52.263 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:52.315 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:52.315 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:52.315 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:52.315 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:52.315 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:52.315 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:52.316 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:52.316 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:52.316 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:52.316 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:52.316 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:52.316 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:52.316 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:52.323 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:52.323 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:52.324 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:52.324 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:52.324 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:52.324 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:52.324 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:52.324 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:52.324 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:52.324 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:52.324 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:52.324 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:52.324 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:52.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535692333 for job 41f18052e8363382138bde77e16b10c3.
18:34:52.352 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
18:34:52.353 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
18:34:52.362 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:52.363 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:52.363 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:52.363 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:52.363 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:52.363 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:52.363 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:52.363 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:52.363 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:52.363 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:52.363 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:52.364 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:52.364 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.364 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.364 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.364 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:52.364 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.364 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:52.364 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.364 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.364 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:52.364 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:52.363 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:52.364 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:52.364 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:52.365 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:52.365 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27452), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [5ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [50ms] refreshing cache from master, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [170ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [171ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [265ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [268ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [269ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [283ms] refreshing cache from master, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [335ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [336ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [350ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [350ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [351ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [351ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [362ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [402ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [444ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [483ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [483ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [703ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [703ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1080ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1082ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1582ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2821ms] refreshing cache from master, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2823ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2823ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3281ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3282ms] too many traces: truncated at 100 traces, deferred=Deferred@1540455790(state=PENDING, result=null, callback=(continuation of Deferred@1565138677 after retry RPC after error@1352576801) -> (continuation of Deferred@162684123 after retry RPC after error@1507359374) -> (continuation of Deferred@1416129270 after retry RPC after error@1898590461) -> (continuation of Deferred@1785065095 after retry RPC after error@1886643535) -> (continuation of Deferred@1742409325 after retry RPC after error@1196844979) -> (continuation of Deferred@33732616 after retry RPC after error@1840540826) -> (continuation of Deferred@1378070311 after retry RPC after error@641478959) -> (continuation of Deferred@828968728 after retry RPC after error@2138535187) -> (continuation of Deferred@811775821 after retry RPC after error@1997557031) -> (continuation of Deferred@251170066 after retry RPC after error@1256439347) -> (continuation of Deferred@1864278269 after retry RPC after error@437432652) -> (continuation of Deferred@1346907905 after retry RPC after error@126685469) -> (continuation of Deferred@495865945 after retry RPC after error@303630965) -> (continuation of Deferred@54005520 after retry RPC after error@1825760147) -> (continuation of Deferred@53574344 after retry RPC after error@1495368313) -> (continuation of Deferred@438458050 after retry RPC after error@1628958830) -> (continuation of Deferred@1777869246 after retry RPC after error@1008686258) -> (continuation of Deferred@872649141 after retry RPC after error@1783202779) -> (continuation of Deferred@1108654845 after retry RPC after error@82365641) -> (continuation of Deferred@743341016 after retry RPC after error@180318929) -> (continuation of Deferred@1838936617 after retry RPC after error@794293719) -> (continuation of Deferred@1889065822 after retry RPC after error@29361766) -> (continuation of Deferred@863549133 after retry RPC after error@588321848) -> (continuation of Deferred@367360303 after retry RPC after error@337096387) -> (continuation of Deferred@1655680082 after retry RPC after error@1236587755), errback=(continuation of Deferred@1565138677 after retry RPC after error@1352576801) -> (continuation of Deferred@162684123 after retry RPC after error@1507359374) -> (continuation of Deferred@1416129270 after retry RPC after error@1898590461) -> (continuation of Deferred@1785065095 after retry RPC after error@1886643535) -> (continuation of Deferred@1742409325 after retry RPC after error@1196844979) -> (continuation of Deferred@33732616 after retry RPC after error@1840540826) -> (continuation of Deferred@1378070311 after retry RPC after error@641478959) -> (continuation of Deferred@828968728 after retry RPC after error@2138535187) -> (continuation of Deferred@811775821 after retry RPC after error@1997557031) -> (continuation of Deferred@251170066 after retry RPC after error@1256439347) -> (continuation of Deferred@1864278269 after retry RPC after error@437432652) -> (continuation of Deferred@1346907905 after retry RPC after error@126685469) -> (continuation of Deferred@495865945 after retry RPC after error@303630965) -> (continuation of Deferred@54005520 after retry RPC after error@1825760147) -> (continuation of Deferred@53574344 after retry RPC after error@1495368313) -> (continuation of Deferred@438458050 after retry RPC after error@1628958830) -> (continuation of Deferred@1777869246 after retry RPC after error@1008686258) -> (continuation of Deferred@872649141 after retry RPC after error@1783202779) -> (continuation of Deferred@1108654845 after retry RPC after error@82365641) -> (continuation of Deferred@743341016 after retry RPC after error@180318929) -> (continuation of Deferred@1838936617 after retry RPC after error@794293719) -> (continuation of Deferred@1889065822 after retry RPC after error@29361766) -> (continuation of Deferred@863549133 after retry RPC after error@588321848) -> (continuation of Deferred@367360303 after retry RPC after error@337096387) -> (continuation of Deferred@1655680082 after retry RPC after error@1236587755)))
18:34:52.366 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
18:34:52.367 [WARN - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27452), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [5ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [50ms] refreshing cache from master, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [170ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [171ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [265ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [268ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [269ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [283ms] refreshing cache from master, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [335ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [336ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [350ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [350ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [351ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [351ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [362ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [402ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [444ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [483ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [483ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [703ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [703ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1080ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1082ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1582ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2821ms] refreshing cache from master, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2823ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2823ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3281ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3282ms] too many traces: truncated at 100 traces, deferred=Deferred@1540455790(state=PENDING, result=null, callback=(continuation of Deferred@1565138677 after retry RPC after error@1352576801) -> (continuation of Deferred@162684123 after retry RPC after error@1507359374) -> (continuation of Deferred@1416129270 after retry RPC after error@1898590461) -> (continuation of Deferred@1785065095 after retry RPC after error@1886643535) -> (continuation of Deferred@1742409325 after retry RPC after error@1196844979) -> (continuation of Deferred@33732616 after retry RPC after error@1840540826) -> (continuation of Deferred@1378070311 after retry RPC after error@641478959) -> (continuation of Deferred@828968728 after retry RPC after error@2138535187) -> (continuation of Deferred@811775821 after retry RPC after error@1997557031) -> (continuation of Deferred@251170066 after retry RPC after error@1256439347) -> (continuation of Deferred@1864278269 after retry RPC after error@437432652) -> (continuation of Deferred@1346907905 after retry RPC after error@126685469) -> (continuation of Deferred@495865945 after retry RPC after error@303630965) -> (continuation of Deferred@54005520 after retry RPC after error@1825760147) -> (continuation of Deferred@53574344 after retry RPC after error@1495368313) -> (continuation of Deferred@438458050 after retry RPC after error@1628958830) -> (continuation of Deferred@1777869246 after retry RPC after error@1008686258) -> (continuation of Deferred@872649141 after retry RPC after error@1783202779) -> (continuation of Deferred@1108654845 after retry RPC after error@82365641) -> (continuation of Deferred@743341016 after retry RPC after error@180318929) -> (continuation of Deferred@1838936617 after retry RPC after error@794293719) -> (continuation of Deferred@1889065822 after retry RPC after error@29361766) -> (continuation of Deferred@863549133 after retry RPC after error@588321848) -> (continuation of Deferred@367360303 after retry RPC after error@337096387) -> (continuation of Deferred@1655680082 after retry RPC after error@1236587755), errback=(continuation of Deferred@1565138677 after retry RPC after error@1352576801) -> (continuation of Deferred@162684123 after retry RPC after error@1507359374) -> (continuation of Deferred@1416129270 after retry RPC after error@1898590461) -> (continuation of Deferred@1785065095 after retry RPC after error@1886643535) -> (continuation of Deferred@1742409325 after retry RPC after error@1196844979) -> (continuation of Deferred@33732616 after retry RPC after error@1840540826) -> (continuation of Deferred@1378070311 after retry RPC after error@641478959) -> (continuation of Deferred@828968728 after retry RPC after error@2138535187) -> (continuation of Deferred@811775821 after retry RPC after error@1997557031) -> (continuation of Deferred@251170066 after retry RPC after error@1256439347) -> (continuation of Deferred@1864278269 after retry RPC after error@437432652) -> (continuation of Deferred@1346907905 after retry RPC after error@126685469) -> (continuation of Deferred@495865945 after retry RPC after error@303630965) -> (continuation of Deferred@54005520 after retry RPC after error@1825760147) -> (continuation of Deferred@53574344 after retry RPC after error@1495368313) -> (continuation of Deferred@438458050 after retry RPC after error@1628958830) -> (continuation of Deferred@1777869246 after retry RPC after error@1008686258) -> (continuation of Deferred@872649141 after retry RPC after error@1783202779) -> (continuation of Deferred@1108654845 after retry RPC after error@82365641) -> (continuation of Deferred@743341016 after retry RPC after error@180318929) -> (continuation of Deferred@1838936617 after retry RPC after error@794293719) -> (continuation of Deferred@1889065822 after retry RPC after error@29361766) -> (continuation of Deferred@863549133 after retry RPC after error@588321848) -> (continuation of Deferred@367360303 after retry RPC after error@337096387) -> (continuation of Deferred@1655680082 after retry RPC after error@1236587755)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:52.367 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#7 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_7).
18:34:52.370 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#7 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_7.
18:34:52.373 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from INITIALIZING to FAILED on f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27452), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [5ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [5ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [50ms] refreshing cache from master, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [170ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [171ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [265ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [268ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [269ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [283ms] refreshing cache from master, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [335ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [336ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [350ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [350ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [351ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [351ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [362ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [362ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [381ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [382ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [402ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [402ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [444ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [483ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [483ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [702ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [703ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [703ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1080ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1082ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1582ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2821ms] refreshing cache from master, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2823ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2823ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3281ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3282ms] too many traces: truncated at 100 traces, deferred=Deferred@1540455790(state=PENDING, result=null, callback=(continuation of Deferred@1565138677 after retry RPC after error@1352576801) -> (continuation of Deferred@162684123 after retry RPC after error@1507359374) -> (continuation of Deferred@1416129270 after retry RPC after error@1898590461) -> (continuation of Deferred@1785065095 after retry RPC after error@1886643535) -> (continuation of Deferred@1742409325 after retry RPC after error@1196844979) -> (continuation of Deferred@33732616 after retry RPC after error@1840540826) -> (continuation of Deferred@1378070311 after retry RPC after error@641478959) -> (continuation of Deferred@828968728 after retry RPC after error@2138535187) -> (continuation of Deferred@811775821 after retry RPC after error@1997557031) -> (continuation of Deferred@251170066 after retry RPC after error@1256439347) -> (continuation of Deferred@1864278269 after retry RPC after error@437432652) -> (continuation of Deferred@1346907905 after retry RPC after error@126685469) -> (continuation of Deferred@495865945 after retry RPC after error@303630965) -> (continuation of Deferred@54005520 after retry RPC after error@1825760147) -> (continuation of Deferred@53574344 after retry RPC after error@1495368313) -> (continuation of Deferred@438458050 after retry RPC after error@1628958830) -> (continuation of Deferred@1777869246 after retry RPC after error@1008686258) -> (continuation of Deferred@872649141 after retry RPC after error@1783202779) -> (continuation of Deferred@1108654845 after retry RPC after error@82365641) -> (continuation of Deferred@743341016 after retry RPC after error@180318929) -> (continuation of Deferred@1838936617 after retry RPC after error@794293719) -> (continuation of Deferred@1889065822 after retry RPC after error@29361766) -> (continuation of Deferred@863549133 after retry RPC after error@588321848) -> (continuation of Deferred@367360303 after retry RPC after error@337096387) -> (continuation of Deferred@1655680082 after retry RPC after error@1236587755), errback=(continuation of Deferred@1565138677 after retry RPC after error@1352576801) -> (continuation of Deferred@162684123 after retry RPC after error@1507359374) -> (continuation of Deferred@1416129270 after retry RPC after error@1898590461) -> (continuation of Deferred@1785065095 after retry RPC after error@1886643535) -> (continuation of Deferred@1742409325 after retry RPC after error@1196844979) -> (continuation of Deferred@33732616 after retry RPC after error@1840540826) -> (continuation of Deferred@1378070311 after retry RPC after error@641478959) -> (continuation of Deferred@828968728 after retry RPC after error@2138535187) -> (continuation of Deferred@811775821 after retry RPC after error@1997557031) -> (continuation of Deferred@251170066 after retry RPC after error@1256439347) -> (continuation of Deferred@1864278269 after retry RPC after error@437432652) -> (continuation of Deferred@1346907905 after retry RPC after error@126685469) -> (continuation of Deferred@495865945 after retry RPC after error@303630965) -> (continuation of Deferred@54005520 after retry RPC after error@1825760147) -> (continuation of Deferred@53574344 after retry RPC after error@1495368313) -> (continuation of Deferred@438458050 after retry RPC after error@1628958830) -> (continuation of Deferred@1777869246 after retry RPC after error@1008686258) -> (continuation of Deferred@872649141 after retry RPC after error@1783202779) -> (continuation of Deferred@1108654845 after retry RPC after error@82365641) -> (continuation of Deferred@743341016 after retry RPC after error@180318929) -> (continuation of Deferred@1838936617 after retry RPC after error@794293719) -> (continuation of Deferred@1889065822 after retry RPC after error@29361766) -> (continuation of Deferred@863549133 after retry RPC after error@588321848) -> (continuation of Deferred@367360303 after retry RPC after error@337096387) -> (continuation of Deferred@1655680082 after retry RPC after error@1236587755)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.250.126:43415
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:52.375 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_7.
18:34:52.375 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RUNNING to RESTARTING.
18:34:52.375 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#7) of source Source: KuduSource.
18:34:52.375 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:52.381 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:52.381 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:52.382 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:52.382 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.382 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.382 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.382 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.382 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.382 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.382 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.382 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.382 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.382 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:52.383 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27440), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [27ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [27ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [172ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [173ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [173ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [174ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [225ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [228ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [229ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [230ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [230ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [241ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [243ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [261ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [262ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [282ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [283ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [283ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [283ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [325ms] refreshing cache from master, [325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [329ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [329ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [336ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [336ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [463ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [464ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [464ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [465ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [606ms] refreshing cache from master, [606ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [606ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [606ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [607ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [607ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [607ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [608ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [903ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [903ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [904ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [904ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1400ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1402ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2161ms] refreshing cache from master, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2162ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2400ms] refreshing cache from master, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2401ms] too many traces: truncated at 100 traces, deferred=Deferred@909740151(state=PENDING, result=null, callback=(continuation of Deferred@2049471778 after retry RPC after error@1580005846) -> (continuation of Deferred@1627365066 after retry RPC after error@452974738) -> (continuation of Deferred@591871882 after retry RPC after error@446468221) -> (continuation of Deferred@101274666 after retry RPC after error@1658206001) -> (continuation of Deferred@2021126030 after retry RPC after error@110528389) -> (continuation of Deferred@1257388921 after retry RPC after error@424600233) -> (continuation of Deferred@1585603985 after retry RPC after error@1813670763) -> (continuation of Deferred@937999458 after retry RPC after error@1499290524) -> (continuation of Deferred@348001227 after retry RPC after error@725639940) -> (continuation of Deferred@1505350050 after retry RPC after error@1787551922) -> (continuation of Deferred@240096867 after retry RPC after error@650087661) -> (continuation of Deferred@823946585 after retry RPC after error@69703096) -> (continuation of Deferred@1990850513 after retry RPC after error@741070093) -> (continuation of Deferred@2123305844 after retry RPC after error@1186841416) -> (continuation of Deferred@2131997489 after retry RPC after error@224559715) -> (continuation of Deferred@191902728 after retry RPC after error@603914669) -> (continuation of Deferred@1100457176 after retry RPC after error@1484736275) -> (continuation of Deferred@1386608736 after retry RPC after error@151812592) -> (continuation of Deferred@1967242605 after retry RPC after error@1461988105) -> (continuation of Deferred@717209461 after retry RPC after error@1083609131) -> (continuation of Deferred@944039809 after retry RPC after error@1313800163) -> (continuation of Deferred@425567560 after retry RPC after error@1841199488) -> (continuation of Deferred@1926886233 after retry RPC after error@1263647494) -> (continuation of Deferred@1070739649 after retry RPC after error@566115522), errback=(continuation of Deferred@2049471778 after retry RPC after error@1580005846) -> (continuation of Deferred@1627365066 after retry RPC after error@452974738) -> (continuation of Deferred@591871882 after retry RPC after error@446468221) -> (continuation of Deferred@101274666 after retry RPC after error@1658206001) -> (continuation of Deferred@2021126030 after retry RPC after error@110528389) -> (continuation of Deferred@1257388921 after retry RPC after error@424600233) -> (continuation of Deferred@1585603985 after retry RPC after error@1813670763) -> (continuation of Deferred@937999458 after retry RPC after error@1499290524) -> (continuation of Deferred@348001227 after retry RPC after error@725639940) -> (continuation of Deferred@1505350050 after retry RPC after error@1787551922) -> (continuation of Deferred@240096867 after retry RPC after error@650087661) -> (continuation of Deferred@823946585 after retry RPC after error@69703096) -> (continuation of Deferred@1990850513 after retry RPC after error@741070093) -> (continuation of Deferred@2123305844 after retry RPC after error@1186841416) -> (continuation of Deferred@2131997489 after retry RPC after error@224559715) -> (continuation of Deferred@191902728 after retry RPC after error@603914669) -> (continuation of Deferred@1100457176 after retry RPC after error@1484736275) -> (continuation of Deferred@1386608736 after retry RPC after error@151812592) -> (continuation of Deferred@1967242605 after retry RPC after error@1461988105) -> (continuation of Deferred@717209461 after retry RPC after error@1083609131) -> (continuation of Deferred@944039809 after retry RPC after error@1313800163) -> (continuation of Deferred@425567560 after retry RPC after error@1841199488) -> (continuation of Deferred@1926886233 after retry RPC after error@1263647494) -> (continuation of Deferred@1070739649 after retry RPC after error@566115522)))
18:34:52.384 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:52.386 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:52.386 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:52.386 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.386 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.387 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.387 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.387 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.387 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.387 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.387 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.387 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.387 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:52.385 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27440), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [27ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [27ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [172ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [173ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [173ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [174ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [225ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [228ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [229ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [230ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [230ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [241ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [243ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [261ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [262ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [282ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [283ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [283ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [283ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [325ms] refreshing cache from master, [325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [329ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [329ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [336ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [336ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [463ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [464ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [464ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [465ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [606ms] refreshing cache from master, [606ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [606ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [606ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [607ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [607ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [607ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [608ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [903ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [903ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [904ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [904ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1400ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1402ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2161ms] refreshing cache from master, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2162ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2400ms] refreshing cache from master, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2401ms] too many traces: truncated at 100 traces, deferred=Deferred@909740151(state=PENDING, result=null, callback=(continuation of Deferred@2049471778 after retry RPC after error@1580005846) -> (continuation of Deferred@1627365066 after retry RPC after error@452974738) -> (continuation of Deferred@591871882 after retry RPC after error@446468221) -> (continuation of Deferred@101274666 after retry RPC after error@1658206001) -> (continuation of Deferred@2021126030 after retry RPC after error@110528389) -> (continuation of Deferred@1257388921 after retry RPC after error@424600233) -> (continuation of Deferred@1585603985 after retry RPC after error@1813670763) -> (continuation of Deferred@937999458 after retry RPC after error@1499290524) -> (continuation of Deferred@348001227 after retry RPC after error@725639940) -> (continuation of Deferred@1505350050 after retry RPC after error@1787551922) -> (continuation of Deferred@240096867 after retry RPC after error@650087661) -> (continuation of Deferred@823946585 after retry RPC after error@69703096) -> (continuation of Deferred@1990850513 after retry RPC after error@741070093) -> (continuation of Deferred@2123305844 after retry RPC after error@1186841416) -> (continuation of Deferred@2131997489 after retry RPC after error@224559715) -> (continuation of Deferred@191902728 after retry RPC after error@603914669) -> (continuation of Deferred@1100457176 after retry RPC after error@1484736275) -> (continuation of Deferred@1386608736 after retry RPC after error@151812592) -> (continuation of Deferred@1967242605 after retry RPC after error@1461988105) -> (continuation of Deferred@717209461 after retry RPC after error@1083609131) -> (continuation of Deferred@944039809 after retry RPC after error@1313800163) -> (continuation of Deferred@425567560 after retry RPC after error@1841199488) -> (continuation of Deferred@1926886233 after retry RPC after error@1263647494) -> (continuation of Deferred@1070739649 after retry RPC after error@566115522), errback=(continuation of Deferred@2049471778 after retry RPC after error@1580005846) -> (continuation of Deferred@1627365066 after retry RPC after error@452974738) -> (continuation of Deferred@591871882 after retry RPC after error@446468221) -> (continuation of Deferred@101274666 after retry RPC after error@1658206001) -> (continuation of Deferred@2021126030 after retry RPC after error@110528389) -> (continuation of Deferred@1257388921 after retry RPC after error@424600233) -> (continuation of Deferred@1585603985 after retry RPC after error@1813670763) -> (continuation of Deferred@937999458 after retry RPC after error@1499290524) -> (continuation of Deferred@348001227 after retry RPC after error@725639940) -> (continuation of Deferred@1505350050 after retry RPC after error@1787551922) -> (continuation of Deferred@240096867 after retry RPC after error@650087661) -> (continuation of Deferred@823946585 after retry RPC after error@69703096) -> (continuation of Deferred@1990850513 after retry RPC after error@741070093) -> (continuation of Deferred@2123305844 after retry RPC after error@1186841416) -> (continuation of Deferred@2131997489 after retry RPC after error@224559715) -> (continuation of Deferred@191902728 after retry RPC after error@603914669) -> (continuation of Deferred@1100457176 after retry RPC after error@1484736275) -> (continuation of Deferred@1386608736 after retry RPC after error@151812592) -> (continuation of Deferred@1967242605 after retry RPC after error@1461988105) -> (continuation of Deferred@717209461 after retry RPC after error@1083609131) -> (continuation of Deferred@944039809 after retry RPC after error@1313800163) -> (continuation of Deferred@425567560 after retry RPC after error@1841199488) -> (continuation of Deferred@1926886233 after retry RPC after error@1263647494) -> (continuation of Deferred@1070739649 after retry RPC after error@566115522)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27440), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [27ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [27ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [172ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [173ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [173ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [174ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [225ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [228ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [229ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [230ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [230ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [241ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [243ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [261ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [262ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [282ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [283ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [283ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [283ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [325ms] refreshing cache from master, [325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [329ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [329ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [336ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [336ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [463ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [464ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [464ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [465ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [606ms] refreshing cache from master, [606ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [606ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [606ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [607ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [607ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [607ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [608ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [903ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [903ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [904ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [904ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1400ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1402ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2161ms] refreshing cache from master, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2162ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2400ms] refreshing cache from master, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2401ms] too many traces: truncated at 100 traces, deferred=Deferred@909740151(state=PENDING, result=null, callback=(continuation of Deferred@2049471778 after retry RPC after error@1580005846) -> (continuation of Deferred@1627365066 after retry RPC after error@452974738) -> (continuation of Deferred@591871882 after retry RPC after error@446468221) -> (continuation of Deferred@101274666 after retry RPC after error@1658206001) -> (continuation of Deferred@2021126030 after retry RPC after error@110528389) -> (continuation of Deferred@1257388921 after retry RPC after error@424600233) -> (continuation of Deferred@1585603985 after retry RPC after error@1813670763) -> (continuation of Deferred@937999458 after retry RPC after error@1499290524) -> (continuation of Deferred@348001227 after retry RPC after error@725639940) -> (continuation of Deferred@1505350050 after retry RPC after error@1787551922) -> (continuation of Deferred@240096867 after retry RPC after error@650087661) -> (continuation of Deferred@823946585 after retry RPC after error@69703096) -> (continuation of Deferred@1990850513 after retry RPC after error@741070093) -> (continuation of Deferred@2123305844 after retry RPC after error@1186841416) -> (continuation of Deferred@2131997489 after retry RPC after error@224559715) -> (continuation of Deferred@191902728 after retry RPC after error@603914669) -> (continuation of Deferred@1100457176 after retry RPC after error@1484736275) -> (continuation of Deferred@1386608736 after retry RPC after error@151812592) -> (continuation of Deferred@1967242605 after retry RPC after error@1461988105) -> (continuation of Deferred@717209461 after retry RPC after error@1083609131) -> (continuation of Deferred@944039809 after retry RPC after error@1313800163) -> (continuation of Deferred@425567560 after retry RPC after error@1841199488) -> (continuation of Deferred@1926886233 after retry RPC after error@1263647494) -> (continuation of Deferred@1070739649 after retry RPC after error@566115522), errback=(continuation of Deferred@2049471778 after retry RPC after error@1580005846) -> (continuation of Deferred@1627365066 after retry RPC after error@452974738) -> (continuation of Deferred@591871882 after retry RPC after error@446468221) -> (continuation of Deferred@101274666 after retry RPC after error@1658206001) -> (continuation of Deferred@2021126030 after retry RPC after error@110528389) -> (continuation of Deferred@1257388921 after retry RPC after error@424600233) -> (continuation of Deferred@1585603985 after retry RPC after error@1813670763) -> (continuation of Deferred@937999458 after retry RPC after error@1499290524) -> (continuation of Deferred@348001227 after retry RPC after error@725639940) -> (continuation of Deferred@1505350050 after retry RPC after error@1787551922) -> (continuation of Deferred@240096867 after retry RPC after error@650087661) -> (continuation of Deferred@823946585 after retry RPC after error@69703096) -> (continuation of Deferred@1990850513 after retry RPC after error@741070093) -> (continuation of Deferred@2123305844 after retry RPC after error@1186841416) -> (continuation of Deferred@2131997489 after retry RPC after error@224559715) -> (continuation of Deferred@191902728 after retry RPC after error@603914669) -> (continuation of Deferred@1100457176 after retry RPC after error@1484736275) -> (continuation of Deferred@1386608736 after retry RPC after error@151812592) -> (continuation of Deferred@1967242605 after retry RPC after error@1461988105) -> (continuation of Deferred@717209461 after retry RPC after error@1083609131) -> (continuation of Deferred@944039809 after retry RPC after error@1313800163) -> (continuation of Deferred@425567560 after retry RPC after error@1841199488) -> (continuation of Deferred@1926886233 after retry RPC after error@1263647494) -> (continuation of Deferred@1070739649 after retry RPC after error@566115522)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.68.189:33753
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:52.393 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27440), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [27ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [27ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [172ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [173ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [173ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [174ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [225ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [228ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [229ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [230ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [230ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [241ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [243ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [261ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [262ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [282ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [283ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [283ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [283ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [325ms] refreshing cache from master, [325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [329ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [329ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [336ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [336ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [463ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [464ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [464ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [465ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [606ms] refreshing cache from master, [606ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [606ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [606ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [607ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [607ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [607ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [608ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [903ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [903ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [904ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [904ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1400ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1402ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2161ms] refreshing cache from master, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2162ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2400ms] refreshing cache from master, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2401ms] too many traces: truncated at 100 traces, deferred=Deferred@909740151(state=PENDING, result=null, callback=(continuation of Deferred@2049471778 after retry RPC after error@1580005846) -> (continuation of Deferred@1627365066 after retry RPC after error@452974738) -> (continuation of Deferred@591871882 after retry RPC after error@446468221) -> (continuation of Deferred@101274666 after retry RPC after error@1658206001) -> (continuation of Deferred@2021126030 after retry RPC after error@110528389) -> (continuation of Deferred@1257388921 after retry RPC after error@424600233) -> (continuation of Deferred@1585603985 after retry RPC after error@1813670763) -> (continuation of Deferred@937999458 after retry RPC after error@1499290524) -> (continuation of Deferred@348001227 after retry RPC after error@725639940) -> (continuation of Deferred@1505350050 after retry RPC after error@1787551922) -> (continuation of Deferred@240096867 after retry RPC after error@650087661) -> (continuation of Deferred@823946585 after retry RPC after error@69703096) -> (continuation of Deferred@1990850513 after retry RPC after error@741070093) -> (continuation of Deferred@2123305844 after retry RPC after error@1186841416) -> (continuation of Deferred@2131997489 after retry RPC after error@224559715) -> (continuation of Deferred@191902728 after retry RPC after error@603914669) -> (continuation of Deferred@1100457176 after retry RPC after error@1484736275) -> (continuation of Deferred@1386608736 after retry RPC after error@151812592) -> (continuation of Deferred@1967242605 after retry RPC after error@1461988105) -> (continuation of Deferred@717209461 after retry RPC after error@1083609131) -> (continuation of Deferred@944039809 after retry RPC after error@1313800163) -> (continuation of Deferred@425567560 after retry RPC after error@1841199488) -> (continuation of Deferred@1926886233 after retry RPC after error@1263647494) -> (continuation of Deferred@1070739649 after retry RPC after error@566115522), errback=(continuation of Deferred@2049471778 after retry RPC after error@1580005846) -> (continuation of Deferred@1627365066 after retry RPC after error@452974738) -> (continuation of Deferred@591871882 after retry RPC after error@446468221) -> (continuation of Deferred@101274666 after retry RPC after error@1658206001) -> (continuation of Deferred@2021126030 after retry RPC after error@110528389) -> (continuation of Deferred@1257388921 after retry RPC after error@424600233) -> (continuation of Deferred@1585603985 after retry RPC after error@1813670763) -> (continuation of Deferred@937999458 after retry RPC after error@1499290524) -> (continuation of Deferred@348001227 after retry RPC after error@725639940) -> (continuation of Deferred@1505350050 after retry RPC after error@1787551922) -> (continuation of Deferred@240096867 after retry RPC after error@650087661) -> (continuation of Deferred@823946585 after retry RPC after error@69703096) -> (continuation of Deferred@1990850513 after retry RPC after error@741070093) -> (continuation of Deferred@2123305844 after retry RPC after error@1186841416) -> (continuation of Deferred@2131997489 after retry RPC after error@224559715) -> (continuation of Deferred@191902728 after retry RPC after error@603914669) -> (continuation of Deferred@1100457176 after retry RPC after error@1484736275) -> (continuation of Deferred@1386608736 after retry RPC after error@151812592) -> (continuation of Deferred@1967242605 after retry RPC after error@1461988105) -> (continuation of Deferred@717209461 after retry RPC after error@1083609131) -> (continuation of Deferred@944039809 after retry RPC after error@1313800163) -> (continuation of Deferred@425567560 after retry RPC after error@1841199488) -> (continuation of Deferred@1926886233 after retry RPC after error@1263647494) -> (continuation of Deferred@1070739649 after retry RPC after error@566115522)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27440), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [21ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [27ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [27ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [172ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [173ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [173ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [174ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [225ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [228ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [229ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [230ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [230ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [241ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [243ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [261ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [262ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [262ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [282ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [283ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [283ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [283ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [325ms] refreshing cache from master, [325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [329ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [329ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [336ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [336ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [463ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [464ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [464ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [465ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [606ms] refreshing cache from master, [606ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [606ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [606ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [607ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [607ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [607ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [608ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [903ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [903ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [904ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [904ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1400ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [1402ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2161ms] refreshing cache from master, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.190:40429: Network error: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.189:33753: Network error: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.28.68.188:38393: Network error: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2162ms] delaying RPC due to: Service unavailable: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393, [2400ms] refreshing cache from master, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.190:40429, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.189:33753, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.68.188:38393, [2401ms] too many traces: truncated at 100 traces, deferred=Deferred@909740151(state=PENDING, result=null, callback=(continuation of Deferred@2049471778 after retry RPC after error@1580005846) -> (continuation of Deferred@1627365066 after retry RPC after error@452974738) -> (continuation of Deferred@591871882 after retry RPC after error@446468221) -> (continuation of Deferred@101274666 after retry RPC after error@1658206001) -> (continuation of Deferred@2021126030 after retry RPC after error@110528389) -> (continuation of Deferred@1257388921 after retry RPC after error@424600233) -> (continuation of Deferred@1585603985 after retry RPC after error@1813670763) -> (continuation of Deferred@937999458 after retry RPC after error@1499290524) -> (continuation of Deferred@348001227 after retry RPC after error@725639940) -> (continuation of Deferred@1505350050 after retry RPC after error@1787551922) -> (continuation of Deferred@240096867 after retry RPC after error@650087661) -> (continuation of Deferred@823946585 after retry RPC after error@69703096) -> (continuation of Deferred@1990850513 after retry RPC after error@741070093) -> (continuation of Deferred@2123305844 after retry RPC after error@1186841416) -> (continuation of Deferred@2131997489 after retry RPC after error@224559715) -> (continuation of Deferred@191902728 after retry RPC after error@603914669) -> (continuation of Deferred@1100457176 after retry RPC after error@1484736275) -> (continuation of Deferred@1386608736 after retry RPC after error@151812592) -> (continuation of Deferred@1967242605 after retry RPC after error@1461988105) -> (continuation of Deferred@717209461 after retry RPC after error@1083609131) -> (continuation of Deferred@944039809 after retry RPC after error@1313800163) -> (continuation of Deferred@425567560 after retry RPC after error@1841199488) -> (continuation of Deferred@1926886233 after retry RPC after error@1263647494) -> (continuation of Deferred@1070739649 after retry RPC after error@566115522), errback=(continuation of Deferred@2049471778 after retry RPC after error@1580005846) -> (continuation of Deferred@1627365066 after retry RPC after error@452974738) -> (continuation of Deferred@591871882 after retry RPC after error@446468221) -> (continuation of Deferred@101274666 after retry RPC after error@1658206001) -> (continuation of Deferred@2021126030 after retry RPC after error@110528389) -> (continuation of Deferred@1257388921 after retry RPC after error@424600233) -> (continuation of Deferred@1585603985 after retry RPC after error@1813670763) -> (continuation of Deferred@937999458 after retry RPC after error@1499290524) -> (continuation of Deferred@348001227 after retry RPC after error@725639940) -> (continuation of Deferred@1505350050 after retry RPC after error@1787551922) -> (continuation of Deferred@240096867 after retry RPC after error@650087661) -> (continuation of Deferred@823946585 after retry RPC after error@69703096) -> (continuation of Deferred@1990850513 after retry RPC after error@741070093) -> (continuation of Deferred@2123305844 after retry RPC after error@1186841416) -> (continuation of Deferred@2131997489 after retry RPC after error@224559715) -> (continuation of Deferred@191902728 after retry RPC after error@603914669) -> (continuation of Deferred@1100457176 after retry RPC after error@1484736275) -> (continuation of Deferred@1386608736 after retry RPC after error@151812592) -> (continuation of Deferred@1967242605 after retry RPC after error@1461988105) -> (continuation of Deferred@717209461 after retry RPC after error@1083609131) -> (continuation of Deferred@944039809 after retry RPC after error@1313800163) -> (continuation of Deferred@425567560 after retry RPC after error@1841199488) -> (continuation of Deferred@1926886233 after retry RPC after error@1263647494) -> (continuation of Deferred@1070739649 after retry RPC after error@566115522)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.28.68.189:33753
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:52.394 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:34:52.394 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#8) of source Source: KuduSource.
18:34:52.394 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from INITIALIZING to CANCELING.
18:34:52.395 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#8) of source Source: KuduSource.
18:34:52.395 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from INITIALIZING to CANCELING.
18:34:52.395 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_8).
18:34:52.395 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from INITIALIZING to CANCELING.
18:34:52.395 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_8).
18:34:52.395 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#8) of source Source: KuduSource.
18:34:52.395 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from INITIALIZING to CANCELING.
18:34:52.398 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (SourceReaderBase.java:338) Closing Source Reader.
18:34:52.398 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from CANCELING to CANCELED.
18:34:52.399 [INFO - Source: KuduSource -> Sink: Writer (4/4)#8] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_8).
18:34:52.400 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_8).
18:34:52.400 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from INITIALIZING to CANCELING.
18:34:52.400 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_8).
18:34:52.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:52.402 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:52.402 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:52.402 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:52.403 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.403 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.403 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.403 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_8).
18:34:52.403 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.403 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.403 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from INITIALIZING to CANCELING.
18:34:52.403 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.404 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.404 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.404 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.404 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:52.406 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (SourceReaderBase.java:338) Closing Source Reader.
18:34:52.406 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from CANCELING to CANCELED.
18:34:52.406 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_8).
18:34:52.403 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_8).
18:34:52.409 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (SourceReaderBase.java:338) Closing Source Reader.
18:34:52.409 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from CANCELING to CANCELED.
18:34:52.409 [INFO - Source: KuduSource -> Sink: Writer (1/4)#8] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_8).
18:34:52.412 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#8 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_8.
18:34:52.413 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#8 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_8.
18:34:52.413 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#8 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_8.
18:34:52.413 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_8) switched from CANCELING to CANCELED.
18:34:52.414 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from CANCELING to CANCELED.
18:34:52.415 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_8) switched from CANCELING to CANCELED.
18:34:52.415 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:34:52.416 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:34:52.420 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:318) Clearing resource requirements of job fa73e37017778341a79e5b3ef3d55eb9
18:34:52.421 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:52.422 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:52.422 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:52.422 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.422 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.422 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.422 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.422 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.422 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.422 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.422 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.422 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.423 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:52.442 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:52.442 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:52.442 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:52.443 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.443 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.443 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.443 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.443 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.443 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.443 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.443 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.443 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.443 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:52.462 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:52.462 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:52.462 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:52.462 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.462 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.462 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.463 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.463 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.463 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.462 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.463 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.463 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.463 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:52.481 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:52.482 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:52.482 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:52.482 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.482 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.482 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.483 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.483 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.483 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.483 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.483 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.483 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.483 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:52.515 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:52.515 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:52.515 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:52.516 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:52.516 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:52.516 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:52.516 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:52.516 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:52.516 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:52.517 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:52.517 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:52.517 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:52.517 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:52.521 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:52.522 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:52.522 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:52.522 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.522 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.522 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.522 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.522 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.522 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.522 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.522 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.522 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.522 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:52.622 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:52.622 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:52.622 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:52.623 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.623 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.623 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.624 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.624 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.624 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.625 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.625 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.625 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.625 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:52.656 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:52.683 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:52.750 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:52.750 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:52.750 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:52.751 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:52.751 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:52.751 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:52.751 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:52.751 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:52.751 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:52.751 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:52.751 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:52.751 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:52.751 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:52.752 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27905), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [34ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [110ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [113ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [135ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [140ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [322ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [322ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [384ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [385ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [388ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [389ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [389ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [389ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [401ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [401ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [426ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [426ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [427ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [440ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [449ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [449ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [483ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [483ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [521ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [522ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [541ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [541ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [561ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [562ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [562ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [801ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [801ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [802ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [802ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1248ms] refreshing cache from master, [1248ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1248ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1248ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1251ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1251ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1253ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1254ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3040ms] refreshing cache from master, [3040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3041ms] too many traces: truncated at 100 traces, deferred=Deferred@538140643(state=PENDING, result=null, callback=(continuation of Deferred@1126210482 after retry RPC after error@530164753) -> (continuation of Deferred@1963056129 after retry RPC after error@1331132677) -> (continuation of Deferred@149788246 after retry RPC after error@1522948734) -> (continuation of Deferred@559703283 after retry RPC after error@1438101132) -> (continuation of Deferred@822926666 after retry RPC after error@1500607679) -> (continuation of Deferred@466151582 after retry RPC after error@1944315557) -> (continuation of Deferred@617779998 after retry RPC after error@1985269687) -> (continuation of Deferred@713315835 after retry RPC after error@1186875584) -> (continuation of Deferred@1984199018 after retry RPC after error@649931106) -> (continuation of Deferred@782146499 after retry RPC after error@441597592) -> (continuation of Deferred@1334348689 after retry RPC after error@3235131) -> (continuation of Deferred@1512803965 after retry RPC after error@1367788894) -> (continuation of Deferred@1524171004 after retry RPC after error@1342920217) -> (continuation of Deferred@1456824835 after retry RPC after error@836676026) -> (continuation of Deferred@596808093 after retry RPC after error@690200680) -> (continuation of Deferred@1419446837 after retry RPC after error@281868901) -> (continuation of Deferred@669360024 after retry RPC after error@326196204) -> (continuation of Deferred@532095253 after retry RPC after error@1759510356) -> (continuation of Deferred@1674421384 after retry RPC after error@2054827302) -> (continuation of Deferred@1558381813 after retry RPC after error@1272014178) -> (continuation of Deferred@1169584500 after retry RPC after error@1854830585) -> (continuation of Deferred@713953905 after retry RPC after error@1781827639) -> (continuation of Deferred@486504916 after retry RPC after error@30667789) -> (continuation of Deferred@1528067036 after retry RPC after error@355413433) -> (continuation of Deferred@1928976145 after retry RPC after error@1813264095), errback=(continuation of Deferred@1126210482 after retry RPC after error@530164753) -> (continuation of Deferred@1963056129 after retry RPC after error@1331132677) -> (continuation of Deferred@149788246 after retry RPC after error@1522948734) -> (continuation of Deferred@559703283 after retry RPC after error@1438101132) -> (continuation of Deferred@822926666 after retry RPC after error@1500607679) -> (continuation of Deferred@466151582 after retry RPC after error@1944315557) -> (continuation of Deferred@617779998 after retry RPC after error@1985269687) -> (continuation of Deferred@713315835 after retry RPC after error@1186875584) -> (continuation of Deferred@1984199018 after retry RPC after error@649931106) -> (continuation of Deferred@782146499 after retry RPC after error@441597592) -> (continuation of Deferred@1334348689 after retry RPC after error@3235131) -> (continuation of Deferred@1512803965 after retry RPC after error@1367788894) -> (continuation of Deferred@1524171004 after retry RPC after error@1342920217) -> (continuation of Deferred@1456824835 after retry RPC after error@836676026) -> (continuation of Deferred@596808093 after retry RPC after error@690200680) -> (continuation of Deferred@1419446837 after retry RPC after error@281868901) -> (continuation of Deferred@669360024 after retry RPC after error@326196204) -> (continuation of Deferred@532095253 after retry RPC after error@1759510356) -> (continuation of Deferred@1674421384 after retry RPC after error@2054827302) -> (continuation of Deferred@1558381813 after retry RPC after error@1272014178) -> (continuation of Deferred@1169584500 after retry RPC after error@1854830585) -> (continuation of Deferred@713953905 after retry RPC after error@1781827639) -> (continuation of Deferred@486504916 after retry RPC after error@30667789) -> (continuation of Deferred@1528067036 after retry RPC after error@355413433) -> (continuation of Deferred@1928976145 after retry RPC after error@1813264095)))
18:34:52.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:52.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535692833 for job 41f18052e8363382138bde77e16b10c3.
18:34:52.841 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:52.842 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:52.842 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:52.842 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.842 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.842 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.843 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.843 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.843 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.843 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.843 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.843 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.843 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:52.846 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:34:52.847 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
18:34:52.901 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:52.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:52.902 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:52.902 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:52.902 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.902 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.902 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:52.902 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.902 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.902 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:52.902 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.902 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.902 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:52.902 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:52.915 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:52.915 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:52.915 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:52.915 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:52.915 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:52.915 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:52.915 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:52.915 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:52.915 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:52.915 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:52.916 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:52.916 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:52.916 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:52.981 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:52.982 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:52.982 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:52.982 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:52.983 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:52.983 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:52.983 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:52.983 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:52.983 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:52.983 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:52.984 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:52.984 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:52.984 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:53.035 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:53.035 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:53.036 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:53.036 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.036 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.036 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.037 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.037 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.037 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.037 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.037 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.037 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.037 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:53.056 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:53.056 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:53.056 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:53.057 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.057 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.057 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.058 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.058 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.058 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.059 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.059 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.059 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.059 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:53.139 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:53.139 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:53.139 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:53.140 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:53.140 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:53.140 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:53.140 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:53.140 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:53.141 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:53.141 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:53.141 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:53.141 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:53.141 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:53.157 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:53.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:53.221 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:53.221 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:53.222 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:53.222 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:53.222 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:53.222 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:53.222 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:53.222 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:53.222 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:53.222 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:53.222 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:53.222 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:53.222 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:53.259 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:53.259 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:53.260 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:53.260 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.260 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.260 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:53.261 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.261 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.261 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.261 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.261 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.261 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.260 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.262 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:53.283 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:53.283 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:53.283 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:53.284 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.284 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.284 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.284 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.284 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.284 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.284 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.285 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.285 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.285 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:53.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535693333 for job 41f18052e8363382138bde77e16b10c3.
18:34:53.340 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:53.340 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:53.340 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:53.341 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:53.341 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:53.341 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:53.341 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:53.341 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:53.342 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:53.342 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:53.342 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:53.342 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:53.342 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:53.367 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=33 ms, finalizationTime=1 ms).
18:34:53.369 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
18:34:53.376 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:53.376 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:53.376 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:53.377 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.377 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.377 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.378 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.378 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.378 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.378 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.378 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.378 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.378 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:53.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:53.445 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:53.445 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:53.445 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:53.446 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:53.446 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:53.446 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:53.447 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:53.447 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:53.447 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:53.447 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:53.447 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:53.447 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:53.447 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:53.536 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:53.536 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:53.536 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:53.536 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.536 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.536 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.536 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.537 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.537 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.536 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.537 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.537 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.537 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:53.657 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:53.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:53.714 [DEBUG - pool-444-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30020), Traces: [0ms] sending RPC to server master-127.6.245.60:46787, [16ms] received response from server master-127.6.245.60:46787: OK, deferred=null) with no deferred attached!
18:34:53.760 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:53.804 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:53.804 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:53.804 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:53.805 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:53.805 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:53.805 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:53.805 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:53.805 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:53.805 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:53.805 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:53.805 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:53.805 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:53.805 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:53.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535693833 for job 41f18052e8363382138bde77e16b10c3.
18:34:53.856 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=22 ms, finalizationTime=1 ms).
18:34:53.858 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
18:34:53.902 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:53.903 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:53.904 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:53.904 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:53.904 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.904 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.904 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:53.905 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.905 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.905 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:53.905 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.905 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.905 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:53.905 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:53.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:51.847110 10420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:53.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:53.248160 10418 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 10359
18:34:53.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:53.960871 10418 kernel_stack_watchdog.cc:198] Thread 10359 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 398ms:
18:34:53.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
18:34:53.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
18:34:53.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
18:34:53.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
18:34:53.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:53.963104 10359 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.118s	user 0.735s	sys 1.214s
18:34:53.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:53.963586 10359 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.118s	user 0.735s	sys 1.214s
18:34:53.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:53.966270 10422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:53.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:53.970858 10421 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2119 milliseconds
18:34:53.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:53.970949 10359 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:34:53.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:53.972975 10359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:34:53.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:53.977456 10359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:34:53.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:53.979063 10359 hybrid_clock.cc:648] HybridClock initialized: now 1783535693979030 us; error 47 us; skew 500 ppm
18:34:53.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:53.980192 10359 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:34:53.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:53.987980 10359 webserver.cc:534] Webserver started at http://127.10.26.254:38171/ using document root <none> and password file <none>
18:34:53.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:53.989152 10359 fs_manager.cc:362] Metadata directory not provided
18:34:53.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:53.989425 10359 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:34:53.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:53.989984 10359 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:34:53.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:53.995533 10359 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/data/instance:
18:34:53.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "59a352fb28734817802dc1543d2a2069"
18:34:53.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:53 on dist-test-slave-dxnw"
18:34:53.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:53.997186 10359 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/wal/instance:
18:34:53.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "59a352fb28734817802dc1543d2a2069"
18:34:53.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:53 on dist-test-slave-dxnw"
18:34:54.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.006649 10359 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.009s	sys 0.001s
18:34:54.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.015281 10440 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.016798 10359 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.017258 10359 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/wal
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "59a352fb28734817802dc1543d2a2069"
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:53 on dist-test-slave-dxnw"
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.017815 10359 fs_report.cc:389] FS layout report
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/wal
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/wal
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/data/data
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:34:54.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:34:54.042 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:54.042 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:54.042 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:54.042 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:54.042 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:54.042 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:54.042 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:54.042 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:54.042 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:54.043 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:54.043 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:54.043 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:54.043 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:54.043 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=29032), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [63ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [69ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [70ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [70ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [243ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [244ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [388ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [389ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [407ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [407ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [414ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [414ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [414ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [415ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [420ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [420ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [421ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [421ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [443ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [461ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [527ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [528ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [581ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [582ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [801ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [801ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [801ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [802ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [920ms] refreshing cache from master, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [921ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [921ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [921ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [922ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1900ms] refreshing cache from master, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1901ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3620ms] refreshing cache from master, [3620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [3620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [3621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [3621ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [3622ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [3624ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [3624ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [5160ms] refreshing cache from master, [5160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [5161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [5161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [5161ms] too many traces: truncated at 100 traces, deferred=Deferred@106061957(state=PENDING, result=null, callback=(continuation of Deferred@940827510 after retry RPC after error@1037712951) -> (continuation of Deferred@590087148 after retry RPC after error@921635140) -> (continuation of Deferred@297817276 after retry RPC after error@2097675061) -> (continuation of Deferred@1056420890 after retry RPC after error@1880899497) -> (continuation of Deferred@1667948706 after retry RPC after error@561406377) -> (continuation of Deferred@581060345 after retry RPC after error@869454963) -> (continuation of Deferred@126442843 after retry RPC after error@367009578) -> (continuation of Deferred@625284833 after retry RPC after error@1130358) -> (continuation of Deferred@1304414634 after retry RPC after error@1479775864) -> (continuation of Deferred@1431069057 after retry RPC after error@1554976465) -> (continuation of Deferred@1877896823 after retry RPC after error@724215204) -> (continuation of Deferred@492607785 after retry RPC after error@966907349) -> (continuation of Deferred@631277888 after retry RPC after error@1532563413) -> (continuation of Deferred@582307910 after retry RPC after error@353187512) -> (continuation of Deferred@885413840 after retry RPC after error@670224698) -> (continuation of Deferred@801997538 after retry RPC after error@1393150293) -> (continuation of Deferred@1433889843 after retry RPC after error@1690115238) -> (continuation of Deferred@656689217 after retry RPC after error@981106321) -> (continuation of Deferred@1417841433 after retry RPC after error@1490482435) -> (continuation of Deferred@1563809816 after retry RPC after error@886225881) -> (continuation of Deferred@1950888985 after retry RPC after error@467253630), errback=(continuation of Deferred@940827510 after retry RPC after error@1037712951) -> (continuation of Deferred@590087148 after retry RPC after error@921635140) -> (continuation of Deferred@297817276 after retry RPC after error@2097675061) -> (continuation of Deferred@1056420890 after retry RPC after error@1880899497) -> (continuation of Deferred@1667948706 after retry RPC after error@561406377) -> (continuation of Deferred@581060345 after retry RPC after error@869454963) -> (continuation of Deferred@126442843 after retry RPC after error@367009578) -> (continuation of Deferred@625284833 after retry RPC after error@1130358) -> (continuation of Deferred@1304414634 after retry RPC after error@1479775864) -> (continuation of Deferred@1431069057 after retry RPC after error@1554976465) -> (continuation of Deferred@1877896823 after retry RPC after error@724215204) -> (continuation of Deferred@492607785 after retry RPC after error@966907349) -> (continuation of Deferred@631277888 after retry RPC after error@1532563413) -> (continuation of Deferred@582307910 after retry RPC after error@353187512) -> (continuation of Deferred@885413840 after retry RPC after error@670224698) -> (continuation of Deferred@801997538 after retry RPC after error@1393150293) -> (continuation of Deferred@1433889843 after retry RPC after error@1690115238) -> (continuation of Deferred@656689217 after retry RPC after error@981106321) -> (continuation of Deferred@1417841433 after retry RPC after error@1490482435) -> (continuation of Deferred@1563809816 after retry RPC after error@886225881) -> (continuation of Deferred@1950888985 after retry RPC after error@467253630)))
18:34:54.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.079025 10359 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:34:54.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.080933 10359 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:34:54.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.081517 10359 kserver.cc:163] Server-wide thread pool size limit: 3276
18:34:54.083 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:54.083 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:54.083 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:54.084 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:54.084 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:54.084 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:54.084 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:54.084 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:54.084 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:54.084 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:54.084 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:54.084 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:54.084 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:54.155 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:54.156 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:54.156 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:54.156 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:54.156 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:54.156 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:54.156 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:54.156 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:54.156 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:54.156 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:54.156 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:54.156 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:54.156 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:54.157 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:54.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.176237 10359 rpc_server.cc:307] RPC server started. Bound to: 127.10.26.254:36869
18:34:54.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.176374 10491 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.26.254:36869 every 8 connection(s)
18:34:54.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.180629 10359 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/data/info.pb
18:34:54.181 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:54.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.184316 10347 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 10359
18:34:54.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.184978 10347 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-0/wal/instance
18:34:54.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.190218 10492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:54.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.190475 10347 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:54.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:54.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/wal
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/data
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/logs
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/data/info.pb
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.26.253:36107
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.26.253
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.26.212:43597
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.26.254:36869,127.10.26.253:36107,127.10.26.252:40435
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:34:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41629/jwks.json with env {}
18:34:54.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.206616 10492 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } has no permanent_uuid. Determining permanent_uuid...
18:34:54.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.241465 10492 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } has no permanent_uuid. Determining permanent_uuid...
18:34:54.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.244998 10441 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.26.253:36107: connect: Connection refused (error 111)
18:34:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.250007 10492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.253:36107: Network error: Client connection negotiation failed: client connection to 127.10.26.253:36107: connect: Connection refused (error 111)
18:34:54.260 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:54.263 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:34:54.263 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:34:54.263 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:34:54.263 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:54.263 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:54.263 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:54.263 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:54.264 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:54.263 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:54.264 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:34:54.264 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:34:54.264 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:34:54.264 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:34:54.264 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29240), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [26ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [213ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [219ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [219ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [294ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [296ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [340ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [355ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [355ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [414ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [414ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [422ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [422ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [441ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [442ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [442ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [461ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [462ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [462ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [482ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [483ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [484ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [542ms] refreshing cache from master, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [543ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [544ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [544ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [582ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [583ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [583ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [621ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [621ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [622ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [622ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [902ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [903ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [903ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [903ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1520ms] refreshing cache from master, [1520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [1520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [1521ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [1521ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [1522ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2160ms] refreshing cache from master, [2160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [2161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.125:38957: Network error: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957, [2161ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.124:38123: Network error: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123, [2162ms] Sub RPC ConnectToMaster: received response from server master-127.28.250.126:43415: Network error: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [2162ms] delaying RPC due to: Service unavailable: Master config (127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415, [4463ms] refreshing cache from master, [4463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.125:38957, [4463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.124:38123, [4463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.250.126:43415, [4464ms] too many traces: truncated at 100 traces, deferred=Deferred@1622106823(state=PENDING, result=null, callback=(continuation of Deferred@1685286608 after retry RPC after error@470040007) -> (continuation of Deferred@1286153496 after retry RPC after error@1468784400) -> (continuation of Deferred@678510303 after retry RPC after error@354862099) -> (continuation of Deferred@270705226 after retry RPC after error@425237505) -> (continuation of Deferred@956223027 after retry RPC after error@467370851) -> (continuation of Deferred@510546592 after retry RPC after error@1133215224) -> (continuation of Deferred@222997740 after retry RPC after error@1255012029) -> (continuation of Deferred@643454486 after retry RPC after error@1042713496) -> (continuation of Deferred@1716743548 after retry RPC after error@1124992789) -> (continuation of Deferred@923796356 after retry RPC after error@1029711029) -> (continuation of Deferred@1084589800 after retry RPC after error@1939871558) -> (continuation of Deferred@1151022741 after retry RPC after error@2019751743) -> (continuation of Deferred@345816093 after retry RPC after error@1744147439) -> (continuation of Deferred@2051489306 after retry RPC after error@359916898) -> (continuation of Deferred@1686036357 after retry RPC after error@794771982) -> (continuation of Deferred@1823149585 after retry RPC after error@1727643155) -> (continuation of Deferred@1953093566 after retry RPC after error@561230863) -> (continuation of Deferred@354221494 after retry RPC after error@1044303904) -> (continuation of Deferred@72361086 after retry RPC after error@952052535) -> (continuation of Deferred@1253867739 after retry RPC after error@46917244) -> (continuation of Deferred@129847695 after retry RPC after error@1176122588) -> (continuation of Deferred@1745800860 after retry RPC after error@892026343) -> (continuation of Deferred@1484207076 after retry RPC after error@1339834594) -> (continuation of Deferred@1371016619 after retry RPC after error@1032902270), errback=(continuation of Deferred@1685286608 after retry RPC after error@470040007) -> (continuation of Deferred@1286153496 after retry RPC after error@1468784400) -> (continuation of Deferred@678510303 after retry RPC after error@354862099) -> (continuation of Deferred@270705226 after retry RPC after error@425237505) -> (continuation of Deferred@956223027 after retry RPC after error@467370851) -> (continuation of Deferred@510546592 after retry RPC after error@1133215224) -> (continuation of Deferred@222997740 after retry RPC after error@1255012029) -> (continuation of Deferred@643454486 after retry RPC after error@1042713496) -> (continuation of Deferred@1716743548 after retry RPC after error@1124992789) -> (continuation of Deferred@923796356 after retry RPC after error@1029711029) -> (continuation of Deferred@1084589800 after retry RPC after error@1939871558) -> (continuation of Deferred@1151022741 after retry RPC after error@2019751743) -> (continuation of Deferred@345816093 after retry RPC after error@1744147439) -> (continuation of Deferred@2051489306 after retry RPC after error@359916898) -> (continuation of Deferred@1686036357 after retry RPC after error@794771982) -> (continuation of Deferred@1823149585 after retry RPC after error@1727643155) -> (continuation of Deferred@1953093566 after retry RPC after error@561230863) -> (continuation of Deferred@354221494 after retry RPC after error@1044303904) -> (continuation of Deferred@72361086 after retry RPC after error@952052535) -> (continuation of Deferred@1253867739 after retry RPC after error@46917244) -> (continuation of Deferred@129847695 after retry RPC after error@1176122588) -> (continuation of Deferred@1745800860 after retry RPC after error@892026343) -> (continuation of Deferred@1484207076 after retry RPC after error@1339834594) -> (continuation of Deferred@1371016619 after retry RPC after error@1032902270)))
18:34:54.288 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:54.289 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:54.289 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:54.289 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:54.289 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:54.289 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:54.289 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:54.289 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:54.289 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:54.289 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:54.289 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:54.289 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:54.289 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:54.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.299868 10492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } attempt: 1
18:34:54.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.305043 10492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.253:36107: Network error: Client connection negotiation failed: client connection to 127.10.26.253:36107: connect: Connection refused (error 111)
18:34:54.307 [DEBUG - pool-452-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30012), Traces: [0ms] sending RPC to server master-127.7.200.188:38999, [11ms] received response from server master-127.7.200.188:38999: OK, deferred=null) with no deferred attached!
18:34:54.307 [DEBUG - pool-452-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.7.200.188:38999, [17ms] received response from server master-127.7.200.188:38999: OK, deferred=null) with no deferred attached!
18:34:54.307 [DEBUG - pool-452-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.7.200.188:38999, [18ms] received response from server master-127.7.200.188:38999: OK, deferred=null) with no deferred attached!
18:34:54.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535694333 for job 41f18052e8363382138bde77e16b10c3.
18:34:54.342 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:34:54.343 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
18:34:54.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.373476 10492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } attempt: 2
18:34:54.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.378944 10492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.253:36107: Network error: Client connection negotiation failed: client connection to 127.10.26.253:36107: connect: Connection refused (error 111)
18:34:54.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:54.439 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:54.439 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:54.440 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:54.440 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:54.440 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:54.440 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:54.440 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:54.440 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:54.440 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:54.440 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:54.440 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:54.440 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:54.441 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:54.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.470474 10492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } attempt: 3
18:34:54.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.477278 10492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.253:36107: Network error: Client connection negotiation failed: client connection to 127.10.26.253:36107: connect: Connection refused (error 111)
18:34:54.507 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:54.507 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:54.507 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:54.507 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:54.507 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:54.508 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:54.508 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:54.508 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:54.508 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:54.508 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:54.508 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:54.508 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:54.508 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:54.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.613323 10494 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:34:54.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.613984 10494 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:34:54.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.614662 10494 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:34:54.617 [DEBUG - pool-450-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30015), Traces: [0ms] sending RPC to server master-127.7.200.188:38999, [7ms] received response from server master-127.7.200.188:38999: OK, deferred=null) with no deferred attached!
18:34:54.618 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:54.618 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:54.618 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:54.619 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:54.619 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:54.619 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:54.619 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:54.619 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:54.619 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:54.619 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:54.619 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:54.619 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:54.619 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:54.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.620867 10492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } attempt: 4
18:34:54.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.626639 10492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.253:36107: Network error: Client connection negotiation failed: client connection to 127.10.26.253:36107: connect: Connection refused (error 111)
18:34:54.657 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:54.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.670245 10494 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:34:54.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.670692 10494 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:34:54.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.671083 10494 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:34:54.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.671345 10494 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:34:54.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.671561 10494 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:34:54.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.671733 10494 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:41629/jwks.json
18:34:54.681 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:54.718 [DEBUG - pool-446-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30015), Traces: [0ms] sending RPC to server master-127.7.200.188:38999, [13ms] received response from server master-127.7.200.188:38999: OK, deferred=null) with no deferred attached!
18:34:54.718 [DEBUG - pool-446-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30015), Traces: [0ms] sending RPC to server master-127.7.200.188:38999, [13ms] received response from server master-127.7.200.188:38999: OK, deferred=null) with no deferred attached!
18:34:54.718 [DEBUG - pool-446-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30015), Traces: [0ms] sending RPC to server master-127.7.200.188:38999, [14ms] received response from server master-127.7.200.188:38999: OK, deferred=null) with no deferred attached!
18:34:54.722 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:54.722 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:54.722 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:54.722 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:54.722 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:54.722 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:54.723 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:54.723 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:54.723 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:54.723 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:54.723 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:54.722 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:54.723 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.723141 10494 master_runner.cc:387] Master server non-default flags:
18:34:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.26.212:43597
18:34:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/data
18:34:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/wal
18:34:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:34:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.26.254:36869,127.10.26.253:36107,127.10.26.252:40435
18:34:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:34:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.26.253:36107
18:34:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:34:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:34:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41629/jwks.json
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/data/info.pb
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.26.253
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/logs
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:34:54.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:34:54.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.724946 10494 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:34:54.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.727164 10494 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:34:54.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.739652 10503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:54.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:54.796 [DEBUG - pool-448-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] sending RPC to server master-127.7.200.188:38999, [4ms] received response from server master-127.7.200.188:38999: OK, deferred=null) with no deferred attached!
18:34:54.819 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:54.820 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:54.820 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:54.820 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:54.820 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:54.820 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:54.821 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:54.821 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:54.821 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:54.821 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:54.821 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:54.821 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:54.821 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:54.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535694833 for job 41f18052e8363382138bde77e16b10c3.
18:34:54.852 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
18:34:54.854 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
18:34:54.902 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:54.914 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:54.914 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:54.914 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:54.915 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:54.915 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:54.915 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:54.915 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:54.915 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:54.915 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:54.916 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:54.916 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:54.916 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:54.916 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:54.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:54.926232 10492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } attempt: 5
18:34:54.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.935014 10492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.253:36107: Network error: Client connection negotiation failed: client connection to 127.10.26.253:36107: connect: Connection refused (error 111)
18:34:55.074 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:55.075 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:55.075 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:55.075 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:55.075 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:55.076 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:55.076 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:55.076 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:55.076 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:55.076 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:55.076 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:55.077 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:55.077 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:55.157 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:55.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:55.235 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:55.236 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:55.236 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:55.236 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:55.236 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:55.236 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:55.237 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:55.237 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:55.237 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:55.237 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:55.237 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:55.237 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:55.237 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:55.248 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:55.248 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:55.249 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:55.249 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:55.249 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:55.249 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:55.249 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:55.249 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:55.249 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:55.249 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:55.249 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:55.249 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:55.250 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:55.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:55.333 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535695333 for job 41f18052e8363382138bde77e16b10c3.
18:34:55.347 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:55.347 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:55.347 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:55.348 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:55.348 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:55.348 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:55.348 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:55.348 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:55.348 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:55.348 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:55.349 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:55.349 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:55.349 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:55.350 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
18:34:55.351 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
18:34:55.382 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:55.382 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:55.383 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:55.384 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:55.384 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:55.384 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:55.384 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:55.384 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:55.384 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:55.385 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:55.385 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:55.385 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:55.385 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:55.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:55.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:55.482628 10492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } attempt: 6
18:34:55.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:55.509850 10492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.253:36107: Network error: Client connection negotiation failed: client connection to 127.10.26.253:36107: connect: Connection refused (error 111)
18:34:55.546 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:55.547 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:55.547 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:55.547 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:55.547 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:55.548 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:55.548 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:55.548 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:55.548 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:55.548 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:55.549 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:55.549 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:55.549 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:55.656 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:55.682 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:55.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:55.824 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:55.824 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:55.824 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:55.825 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:55.825 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:55.825 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:55.825 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:55.825 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:55.825 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:55.825 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:55.825 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:55.825 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:55.826 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:55.833 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535695833 for job 41f18052e8363382138bde77e16b10c3.
18:34:55.846 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:34:55.847 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
18:34:55.902 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:55.938 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:55.938 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:55.938 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:55.938 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:55.938 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:55.939 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:55.939 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:55.939 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:55.939 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:55.939 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:55.939 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:55.939 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:55.939 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:56.015 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:56.015 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:56.016 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:56.016 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:56.017 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:56.017 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:56.017 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:56.017 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:56.017 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:56.018 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:56.018 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:56.018 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:56.018 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:56.034 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:56.035 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:56.035 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:56.035 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:56.035 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:56.035 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:56.036 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:56.036 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:56.036 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:56.036 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:56.036 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:56.036 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:56.036 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:56.140 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:56.140 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:56.140 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:56.141 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:56.141 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:56.141 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:56.141 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:56.141 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:56.141 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:56.141 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:56.141 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:56.141 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:56.141 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:56.156 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:56.182 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:56.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:56.263 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:56.264 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:56.264 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:56.264 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:56.264 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:56.264 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:56.264 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:56.265 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:56.265 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:56.265 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:56.265 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:56.265 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:56.265 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:56.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535696333 for job 41f18052e8363382138bde77e16b10c3.
18:34:56.343 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
18:34:56.344 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
18:34:56.364 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:56.364 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:56.364 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:56.365 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:56.365 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:56.365 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:56.365 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:56.365 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:56.365 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:56.365 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:56.366 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:56.366 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:56.366 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:56.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:56.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:56.144975 10502 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 10494
18:34:56.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:54.742338 10504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:56.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:56.456519 10494 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.715s	user 0.617s	sys 1.068s
18:34:56.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:56.457983 10494 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.717s	user 0.617s	sys 1.068s
18:34:56.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:56.459666 10506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:56.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:56.463339 10505 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1716 milliseconds
18:34:56.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.463375 10494 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:34:56.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.464895 10494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:34:56.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.468108 10494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:34:56.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.469498 10494 hybrid_clock.cc:648] HybridClock initialized: now 1783535696469470 us; error 39 us; skew 500 ppm
18:34:56.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.470427 10494 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:34:56.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.477515 10494 webserver.cc:534] Webserver started at http://127.10.26.253:35193/ using document root <none> and password file <none>
18:34:56.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.478701 10494 fs_manager.cc:362] Metadata directory not provided
18:34:56.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.478994 10494 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:34:56.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.479624 10494 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:34:56.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.484907 10494 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/data/instance:
18:34:56.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bdaac99ecb9d4a919c23a781d44e5500"
18:34:56.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:56 on dist-test-slave-dxnw"
18:34:56.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.486220 10494 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/wal/instance:
18:34:56.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bdaac99ecb9d4a919c23a781d44e5500"
18:34:56.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:56 on dist-test-slave-dxnw"
18:34:56.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.494386 10494 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
18:34:56.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.501230 10517 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:34:56.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.502385 10494 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.003s
18:34:56.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.502825 10494 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/wal
18:34:56.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bdaac99ecb9d4a919c23a781d44e5500"
18:34:56.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:56 on dist-test-slave-dxnw"
18:34:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.503310 10494 fs_report.cc:389] FS layout report
18:34:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:34:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/wal
18:34:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/wal
18:34:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/data/data
18:34:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:34:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:34:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:34:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:34:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:34:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:34:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:34:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:34:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:34:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:34:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:34:56.564 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:56.564 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:56.564 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:56.564 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:56.564 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:56.564 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:56.564 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:56.564 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:56.564 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:56.564 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:56.564 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:56.565 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:56.565 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:56.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.570473 10492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } attempt: 7
18:34:56.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:56.578428 10492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.253:36107: Network error: Client connection negotiation failed: client connection to 127.10.26.253:36107: connect: Connection refused (error 111)
18:34:56.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.580606 10494 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:34:56.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.582401 10494 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:34:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.582988 10494 kserver.cc:163] Server-wide thread pool size limit: 3276
18:34:56.657 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:56.658 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:56.658 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:56.658 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:56.659 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:56.659 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:56.659 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:56.659 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:56.659 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:56.659 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:56.659 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:56.659 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:56.659 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:56.659 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:56.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.672238 10494 rpc_server.cc:307] RPC server started. Bound to: 127.10.26.253:36107
18:34:56.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.672401 10570 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.26.253:36107 every 8 connection(s)
18:34:56.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.675182 10494 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/data/info.pb
18:34:56.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.677727 10347 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 10494
18:34:56.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.678278 10347 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-1/wal/instance
18:34:56.683 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.681959 10347 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/wal
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/data
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/logs
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/data/info.pb
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:34:56.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:34:56.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:34:56.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:34:56.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.26.252:40435
18:34:56.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.26.252
18:34:56.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:56.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.26.212:43597
18:34:56.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:56.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:56.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:56.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:34:56.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.26.254:36869,127.10.26.253:36107,127.10.26.252:40435
18:34:56.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:34:56.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41629/jwks.json with env {}
18:34:56.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.684345 10571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:56.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.708791 10571 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } has no permanent_uuid. Determining permanent_uuid...
18:34:56.718 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:56.719 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:56.719 [DEBUG - pool-502-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:56.719 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:56.719 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:56.719 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:56.719 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:56.719 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:56.720 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:56.720 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:56.720 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:56.720 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:56.720 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:56.721 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=26535), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [24ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [28ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [44ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [73ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [76ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [76ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [76ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [104ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [123ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [123ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [143ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [144ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [162ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [263ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [263ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [302ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [603ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2501ms] refreshing cache from master, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2502ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3760ms] refreshing cache from master, [3761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3761ms] too many traces: truncated at 100 traces, deferred=Deferred@956938908(state=PENDING, result=null, callback=(continuation of Deferred@481673260 after retry RPC after error@1356923411) -> (continuation of Deferred@180754837 after retry RPC after error@2121240331) -> (continuation of Deferred@1290372170 after retry RPC after error@348190302) -> (continuation of Deferred@779112418 after retry RPC after error@753244912) -> (continuation of Deferred@749633778 after retry RPC after error@1070588223) -> (continuation of Deferred@334276219 after retry RPC after error@333356268) -> (continuation of Deferred@1269774197 after retry RPC after error@195682598) -> (continuation of Deferred@2105561430 after retry RPC after error@450796534) -> (continuation of Deferred@687346503 after retry RPC after error@1822189487) -> (continuation of Deferred@334074251 after retry RPC after error@2097588523) -> (continuation of Deferred@361557991 after retry RPC after error@438453222) -> (continuation of Deferred@1167654112 after retry RPC after error@228543113) -> (continuation of Deferred@2141089546 after retry RPC after error@1999322732) -> (continuation of Deferred@1977004949 after retry RPC after error@48915620) -> (continuation of Deferred@234929612 after retry RPC after error@553007678) -> (continuation of Deferred@1627156398 after retry RPC after error@828565585) -> (continuation of Deferred@981982572 after retry RPC after error@724645832) -> (continuation of Deferred@674479135 after retry RPC after error@238418216) -> (continuation of Deferred@173877567 after retry RPC after error@686870731) -> (continuation of Deferred@496386702 after retry RPC after error@1019942061) -> (continuation of Deferred@1597822682 after retry RPC after error@1910780798) -> (continuation of Deferred@1581878782 after retry RPC after error@977507558) -> (continuation of Deferred@66068338 after retry RPC after error@1407165361) -> (continuation of Deferred@1105982025 after retry RPC after error@1730787894) -> (continuation of Deferred@1688285742 after retry RPC after error@1254999840) -> (continuation of Deferred@1420430730 after retry RPC after error@2121856291), errback=(continuation of Deferred@481673260 after retry RPC after error@1356923411) -> (continuation of Deferred@180754837 after retry RPC after error@2121240331) -> (continuation of Deferred@1290372170 after retry RPC after error@348190302) -> (continuation of Deferred@779112418 after retry RPC after error@753244912) -> (continuation of Deferred@749633778 after retry RPC after error@1070588223) -> (continuation of Deferred@334276219 after retry RPC after error@333356268) -> (continuation of Deferred@1269774197 after retry RPC after error@195682598) -> (continuation of Deferred@2105561430 after retry RPC after error@450796534) -> (continuation of Deferred@687346503 after retry RPC after error@1822189487) -> (continuation of Deferred@334074251 after retry RPC after error@2097588523) -> (continuation of Deferred@361557991 after retry RPC after error@438453222) -> (continuation of Deferred@1167654112 after retry RPC after error@228543113) -> (continuation of Deferred@2141089546 after retry RPC after error@1999322732) -> (continuation of Deferred@1977004949 after retry RPC after error@48915620) -> (continuation of Deferred@234929612 after retry RPC after error@553007678) -> (continuation of Deferred@1627156398 after retry RPC after error@828565585) -> (continuation of Deferred@981982572 after retry RPC after error@724645832) -> (continuation of Deferred@674479135 after retry RPC after error@238418216) -> (continuation of Deferred@173877567 after retry RPC after error@686870731) -> (continuation of Deferred@496386702 after retry RPC after error@1019942061) -> (continuation of Deferred@1597822682 after retry RPC after error@1910780798) -> (continuation of Deferred@1581878782 after retry RPC after error@977507558) -> (continuation of Deferred@66068338 after retry RPC after error@1407165361) -> (continuation of Deferred@1105982025 after retry RPC after error@1730787894) -> (continuation of Deferred@1688285742 after retry RPC after error@1254999840) -> (continuation of Deferred@1420430730 after retry RPC after error@2121856291)))
18:34:56.721 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
18:34:56.722 [WARN - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=26535), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [24ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [28ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [44ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [73ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [76ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [76ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [76ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [104ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [123ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [123ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [143ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [144ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [162ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [263ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [263ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [302ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [603ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2501ms] refreshing cache from master, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2502ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3760ms] refreshing cache from master, [3761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3761ms] too many traces: truncated at 100 traces, deferred=Deferred@956938908(state=PENDING, result=null, callback=(continuation of Deferred@481673260 after retry RPC after error@1356923411) -> (continuation of Deferred@180754837 after retry RPC after error@2121240331) -> (continuation of Deferred@1290372170 after retry RPC after error@348190302) -> (continuation of Deferred@779112418 after retry RPC after error@753244912) -> (continuation of Deferred@749633778 after retry RPC after error@1070588223) -> (continuation of Deferred@334276219 after retry RPC after error@333356268) -> (continuation of Deferred@1269774197 after retry RPC after error@195682598) -> (continuation of Deferred@2105561430 after retry RPC after error@450796534) -> (continuation of Deferred@687346503 after retry RPC after error@1822189487) -> (continuation of Deferred@334074251 after retry RPC after error@2097588523) -> (continuation of Deferred@361557991 after retry RPC after error@438453222) -> (continuation of Deferred@1167654112 after retry RPC after error@228543113) -> (continuation of Deferred@2141089546 after retry RPC after error@1999322732) -> (continuation of Deferred@1977004949 after retry RPC after error@48915620) -> (continuation of Deferred@234929612 after retry RPC after error@553007678) -> (continuation of Deferred@1627156398 after retry RPC after error@828565585) -> (continuation of Deferred@981982572 after retry RPC after error@724645832) -> (continuation of Deferred@674479135 after retry RPC after error@238418216) -> (continuation of Deferred@173877567 after retry RPC after error@686870731) -> (continuation of Deferred@496386702 after retry RPC after error@1019942061) -> (continuation of Deferred@1597822682 after retry RPC after error@1910780798) -> (continuation of Deferred@1581878782 after retry RPC after error@977507558) -> (continuation of Deferred@66068338 after retry RPC after error@1407165361) -> (continuation of Deferred@1105982025 after retry RPC after error@1730787894) -> (continuation of Deferred@1688285742 after retry RPC after error@1254999840) -> (continuation of Deferred@1420430730 after retry RPC after error@2121856291), errback=(continuation of Deferred@481673260 after retry RPC after error@1356923411) -> (continuation of Deferred@180754837 after retry RPC after error@2121240331) -> (continuation of Deferred@1290372170 after retry RPC after error@348190302) -> (continuation of Deferred@779112418 after retry RPC after error@753244912) -> (continuation of Deferred@749633778 after retry RPC after error@1070588223) -> (continuation of Deferred@334276219 after retry RPC after error@333356268) -> (continuation of Deferred@1269774197 after retry RPC after error@195682598) -> (continuation of Deferred@2105561430 after retry RPC after error@450796534) -> (continuation of Deferred@687346503 after retry RPC after error@1822189487) -> (continuation of Deferred@334074251 after retry RPC after error@2097588523) -> (continuation of Deferred@361557991 after retry RPC after error@438453222) -> (continuation of Deferred@1167654112 after retry RPC after error@228543113) -> (continuation of Deferred@2141089546 after retry RPC after error@1999322732) -> (continuation of Deferred@1977004949 after retry RPC after error@48915620) -> (continuation of Deferred@234929612 after retry RPC after error@553007678) -> (continuation of Deferred@1627156398 after retry RPC after error@828565585) -> (continuation of Deferred@981982572 after retry RPC after error@724645832) -> (continuation of Deferred@674479135 after retry RPC after error@238418216) -> (continuation of Deferred@173877567 after retry RPC after error@686870731) -> (continuation of Deferred@496386702 after retry RPC after error@1019942061) -> (continuation of Deferred@1597822682 after retry RPC after error@1910780798) -> (continuation of Deferred@1581878782 after retry RPC after error@977507558) -> (continuation of Deferred@66068338 after retry RPC after error@1407165361) -> (continuation of Deferred@1105982025 after retry RPC after error@1730787894) -> (continuation of Deferred@1688285742 after retry RPC after error@1254999840) -> (continuation of Deferred@1420430730 after retry RPC after error@2121856291)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.124:38627
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:56.722 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_6).
18:34:56.753 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#6 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_6.
18:34:56.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.753638 10571 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } has no permanent_uuid. Determining permanent_uuid...
18:34:56.758 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=26535), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [24ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [27ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [28ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [44ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [73ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [76ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [76ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [76ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [104ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [123ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [123ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [143ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [144ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [162ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [263ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [263ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [302ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [302ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [603ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [603ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2501ms] refreshing cache from master, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2502ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3760ms] refreshing cache from master, [3761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3761ms] too many traces: truncated at 100 traces, deferred=Deferred@956938908(state=PENDING, result=null, callback=(continuation of Deferred@481673260 after retry RPC after error@1356923411) -> (continuation of Deferred@180754837 after retry RPC after error@2121240331) -> (continuation of Deferred@1290372170 after retry RPC after error@348190302) -> (continuation of Deferred@779112418 after retry RPC after error@753244912) -> (continuation of Deferred@749633778 after retry RPC after error@1070588223) -> (continuation of Deferred@334276219 after retry RPC after error@333356268) -> (continuation of Deferred@1269774197 after retry RPC after error@195682598) -> (continuation of Deferred@2105561430 after retry RPC after error@450796534) -> (continuation of Deferred@687346503 after retry RPC after error@1822189487) -> (continuation of Deferred@334074251 after retry RPC after error@2097588523) -> (continuation of Deferred@361557991 after retry RPC after error@438453222) -> (continuation of Deferred@1167654112 after retry RPC after error@228543113) -> (continuation of Deferred@2141089546 after retry RPC after error@1999322732) -> (continuation of Deferred@1977004949 after retry RPC after error@48915620) -> (continuation of Deferred@234929612 after retry RPC after error@553007678) -> (continuation of Deferred@1627156398 after retry RPC after error@828565585) -> (continuation of Deferred@981982572 after retry RPC after error@724645832) -> (continuation of Deferred@674479135 after retry RPC after error@238418216) -> (continuation of Deferred@173877567 after retry RPC after error@686870731) -> (continuation of Deferred@496386702 after retry RPC after error@1019942061) -> (continuation of Deferred@1597822682 after retry RPC after error@1910780798) -> (continuation of Deferred@1581878782 after retry RPC after error@977507558) -> (continuation of Deferred@66068338 after retry RPC after error@1407165361) -> (continuation of Deferred@1105982025 after retry RPC after error@1730787894) -> (continuation of Deferred@1688285742 after retry RPC after error@1254999840) -> (continuation of Deferred@1420430730 after retry RPC after error@2121856291), errback=(continuation of Deferred@481673260 after retry RPC after error@1356923411) -> (continuation of Deferred@180754837 after retry RPC after error@2121240331) -> (continuation of Deferred@1290372170 after retry RPC after error@348190302) -> (continuation of Deferred@779112418 after retry RPC after error@753244912) -> (continuation of Deferred@749633778 after retry RPC after error@1070588223) -> (continuation of Deferred@334276219 after retry RPC after error@333356268) -> (continuation of Deferred@1269774197 after retry RPC after error@195682598) -> (continuation of Deferred@2105561430 after retry RPC after error@450796534) -> (continuation of Deferred@687346503 after retry RPC after error@1822189487) -> (continuation of Deferred@334074251 after retry RPC after error@2097588523) -> (continuation of Deferred@361557991 after retry RPC after error@438453222) -> (continuation of Deferred@1167654112 after retry RPC after error@228543113) -> (continuation of Deferred@2141089546 after retry RPC after error@1999322732) -> (continuation of Deferred@1977004949 after retry RPC after error@48915620) -> (continuation of Deferred@234929612 after retry RPC after error@553007678) -> (continuation of Deferred@1627156398 after retry RPC after error@828565585) -> (continuation of Deferred@981982572 after retry RPC after error@724645832) -> (continuation of Deferred@674479135 after retry RPC after error@238418216) -> (continuation of Deferred@173877567 after retry RPC after error@686870731) -> (continuation of Deferred@496386702 after retry RPC after error@1019942061) -> (continuation of Deferred@1597822682 after retry RPC after error@1910780798) -> (continuation of Deferred@1581878782 after retry RPC after error@977507558) -> (continuation of Deferred@66068338 after retry RPC after error@1407165361) -> (continuation of Deferred@1105982025 after retry RPC after error@1730787894) -> (continuation of Deferred@1688285742 after retry RPC after error@1254999840) -> (continuation of Deferred@1420430730 after retry RPC after error@2121856291)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.124:38627
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:56.760 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#6) of source Source: KuduSource.
18:34:56.760 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:56.760 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_6.
18:34:56.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:56.761 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state RUNNING to RESTARTING.
18:34:56.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.772143 10571 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } has no permanent_uuid. Determining permanent_uuid...
18:34:56.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:56.775480 10519 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.26.252:40435: connect: Connection refused (error 111)
18:34:56.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:56.784955 10571 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.252:40435: Network error: Client connection negotiation failed: client connection to 127.10.26.252:40435: connect: Connection refused (error 111)
18:34:56.826 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:56.827 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:56.827 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:56.828 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:56.828 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:56.828 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:56.828 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:56.828 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:56.829 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:56.829 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:56.829 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:56.829 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:56.829 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:56.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535696833 for job 41f18052e8363382138bde77e16b10c3.
18:34:56.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.834551 10571 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } attempt: 1
18:34:56.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:56.841235 10571 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.252:40435: Network error: Client connection negotiation failed: client connection to 127.10.26.252:40435: connect: Connection refused (error 111)
18:34:56.842 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:34:56.843 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
18:34:56.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:56.907 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:56.907 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:56.907 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:56.907 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:56.907 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:56.907 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:56.908 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:56.908 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:56.908 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:56.908 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:56.908 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:56.908 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:56.908 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:56.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:56.909687 10571 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } attempt: 2
18:34:56.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:56.915309 10571 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.252:40435: Network error: Client connection negotiation failed: client connection to 127.10.26.252:40435: connect: Connection refused (error 111)
18:34:57.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:57.006887 10571 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } attempt: 3
18:34:57.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:57.012141 10571 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.252:40435: Network error: Client connection negotiation failed: client connection to 127.10.26.252:40435: connect: Connection refused (error 111)
18:34:57.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:57.117106 10573 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:34:57.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:57.117893 10573 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:34:57.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:57.118567 10573 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:34:57.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:57.155555 10571 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } attempt: 4
18:34:57.157 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:57.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:57.159785 10573 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:34:57.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:57.160228 10573 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:34:57.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:57.160627 10573 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:34:57.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:57.160880 10573 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:34:57.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:57.161199 10573 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:34:57.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:57.161484 10573 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:41629/jwks.json
18:34:57.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:57.161383 10571 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.252:40435: Network error: Client connection negotiation failed: client connection to 127.10.26.252:40435: connect: Connection refused (error 111)
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:57.208143 10573 master_runner.cc:387] Master server non-default flags:
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.26.212:43597
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/data
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/wal
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.26.254:36869,127.10.26.253:36107,127.10.26.252:40435
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.26.252:40435
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41629/jwks.json
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/data/info.pb
18:34:57.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.26.252
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/logs
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:34:57.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:57.209522 10573 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:34:57.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:57.211144 10573 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:34:57.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:57.222904 10583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:57.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:57.264 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:57.264 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:57.264 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:57.264 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:57.264 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:57.264 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:57.264 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:57.264 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:57.265 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:57.264 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:57.264 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:57.265 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:57.265 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:57.283 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:57.284 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:57.284 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:57.284 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:57.284 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:57.284 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:57.284 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:57.284 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:57.284 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:57.284 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:57.284 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:57.284 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:57.284 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:57.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535697333 for job 41f18052e8363382138bde77e16b10c3.
18:34:57.341 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
18:34:57.342 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
18:34:57.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:57.456 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:57.456 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:57.456 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:57.457 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:57.457 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:57.457 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:57.457 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:57.457 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:57.457 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:57.458 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:57.458 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:57.458 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:57.458 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:57.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:57.460856 10571 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } attempt: 5
18:34:57.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:57.473809 10571 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.252:40435: Network error: Client connection negotiation failed: client connection to 127.10.26.252:40435: connect: Connection refused (error 111)
18:34:57.536 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:57.536 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:57.536 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:57.537 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:57.537 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:57.537 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:57.537 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:57.537 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:57.537 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:57.538 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:57.538 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:57.538 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:57.538 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:57.594 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:57.594 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:57.595 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:57.595 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:57.595 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:57.595 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:57.596 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:57.596 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:57.596 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:57.596 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:57.596 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:57.596 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:57.596 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:57.614 [DEBUG - pool-444-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.6.245.60:46787, [4ms] received response from server master-127.6.245.60:46787: OK, deferred=null) with no deferred attached!
18:34:57.639 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:57.640 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:57.640 [DEBUG - pool-506-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:57.640 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:57.640 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:57.640 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:57.640 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:57.640 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:57.640 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:57.641 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:57.641 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:57.641 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:57.641 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:57.642 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=27426), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [8ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [9ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [9ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [30ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [37ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [37ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [37ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [55ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [55ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [55ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [62ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [83ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [182ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [361ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [681ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [681ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [681ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [681ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1321ms] refreshing cache from master, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1322ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [3261ms] refreshing cache from master, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [3262ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [5581ms] refreshing cache from master, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [5582ms] too many traces: truncated at 100 traces, deferred=Deferred@1260959953(state=PENDING, result=null, callback=(continuation of Deferred@1277739544 after retry RPC after error@133377610) -> (continuation of Deferred@363576150 after retry RPC after error@466315010) -> (continuation of Deferred@293162593 after retry RPC after error@266777466) -> (continuation of Deferred@1205848283 after retry RPC after error@132924501) -> (continuation of Deferred@1547507855 after retry RPC after error@1719274769) -> (continuation of Deferred@1599768597 after retry RPC after error@980529479) -> (continuation of Deferred@238825446 after retry RPC after error@949529013) -> (continuation of Deferred@864654483 after retry RPC after error@80076844) -> (continuation of Deferred@1810476109 after retry RPC after error@381773188) -> (continuation of Deferred@1771259587 after retry RPC after error@1123815261) -> (continuation of Deferred@1691441291 after retry RPC after error@2032270544) -> (continuation of Deferred@175573097 after retry RPC after error@684947613) -> (continuation of Deferred@1177057292 after retry RPC after error@815385445) -> (continuation of Deferred@44022111 after retry RPC after error@834354689) -> (continuation of Deferred@878102562 after retry RPC after error@1248522030) -> (continuation of Deferred@901833341 after retry RPC after error@1566808562) -> (continuation of Deferred@1609977252 after retry RPC after error@1115212523) -> (continuation of Deferred@1889078227 after retry RPC after error@838119483) -> (continuation of Deferred@1552040140 after retry RPC after error@1487529509) -> (continuation of Deferred@1616292208 after retry RPC after error@1958193193) -> (continuation of Deferred@989659731 after retry RPC after error@770851815) -> (continuation of Deferred@2025484800 after retry RPC after error@830827486) -> (continuation of Deferred@1664616487 after retry RPC after error@1550484188) -> (continuation of Deferred@2011943203 after retry RPC after error@1839894427) -> (continuation of Deferred@1324403513 after retry RPC after error@1183112281) -> (continuation of Deferred@1867480931 after retry RPC after error@1453384518) -> (continuation of Deferred@515986344 after retry RPC after error@2126979645) -> (continuation of Deferred@1793588961 after retry RPC after error@999066152), errback=(continuation of Deferred@1277739544 after retry RPC after error@133377610) -> (continuation of Deferred@363576150 after retry RPC after error@466315010) -> (continuation of Deferred@293162593 after retry RPC after error@266777466) -> (continuation of Deferred@1205848283 after retry RPC after error@132924501) -> (continuation of Deferred@1547507855 after retry RPC after error@1719274769) -> (continuation of Deferred@1599768597 after retry RPC after error@980529479) -> (continuation of Deferred@238825446 after retry RPC after error@949529013) -> (continuation of Deferred@864654483 after retry RPC after error@80076844) -> (continuation of Deferred@1810476109 after retry RPC after error@381773188) -> (continuation of Deferred@1771259587 after retry RPC after error@1123815261) -> (continuation of Deferred@1691441291 after retry RPC after error@2032270544) -> (continuation of Deferred@175573097 after retry RPC after error@684947613) -> (continuation of Deferred@1177057292 after retry RPC after error@815385445) -> (continuation of Deferred@44022111 after retry RPC after error@834354689) -> (continuation of Deferred@878102562 after retry RPC after error@1248522030) -> (continuation of Deferred@901833341 after retry RPC after error@1566808562) -> (continuation of Deferred@1609977252 after retry RPC after error@1115212523) -> (continuation of Deferred@1889078227 after retry RPC after error@838119483) -> (continuation of Deferred@1552040140 after retry RPC after error@1487529509) -> (continuation of Deferred@1616292208 after retry RPC after error@1958193193) -> (continuation of Deferred@989659731 after retry RPC after error@770851815) -> (continuation of Deferred@2025484800 after retry RPC after error@830827486) -> (continuation of Deferred@1664616487 after retry RPC after error@1550484188) -> (continuation of Deferred@2011943203 after retry RPC after error@1839894427) -> (continuation of Deferred@1324403513 after retry RPC after error@1183112281) -> (continuation of Deferred@1867480931 after retry RPC after error@1453384518) -> (continuation of Deferred@515986344 after retry RPC after error@2126979645) -> (continuation of Deferred@1793588961 after retry RPC after error@999066152)))
18:34:57.644 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
18:34:57.644 [WARN - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=27426), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [8ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [9ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [9ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [30ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [37ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [37ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [37ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [55ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [55ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [55ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [62ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [83ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [182ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [361ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [681ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [681ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [681ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [681ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1321ms] refreshing cache from master, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1322ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [3261ms] refreshing cache from master, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [3262ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [5581ms] refreshing cache from master, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [5582ms] too many traces: truncated at 100 traces, deferred=Deferred@1260959953(state=PENDING, result=null, callback=(continuation of Deferred@1277739544 after retry RPC after error@133377610) -> (continuation of Deferred@363576150 after retry RPC after error@466315010) -> (continuation of Deferred@293162593 after retry RPC after error@266777466) -> (continuation of Deferred@1205848283 after retry RPC after error@132924501) -> (continuation of Deferred@1547507855 after retry RPC after error@1719274769) -> (continuation of Deferred@1599768597 after retry RPC after error@980529479) -> (continuation of Deferred@238825446 after retry RPC after error@949529013) -> (continuation of Deferred@864654483 after retry RPC after error@80076844) -> (continuation of Deferred@1810476109 after retry RPC after error@381773188) -> (continuation of Deferred@1771259587 after retry RPC after error@1123815261) -> (continuation of Deferred@1691441291 after retry RPC after error@2032270544) -> (continuation of Deferred@175573097 after retry RPC after error@684947613) -> (continuation of Deferred@1177057292 after retry RPC after error@815385445) -> (continuation of Deferred@44022111 after retry RPC after error@834354689) -> (continuation of Deferred@878102562 after retry RPC after error@1248522030) -> (continuation of Deferred@901833341 after retry RPC after error@1566808562) -> (continuation of Deferred@1609977252 after retry RPC after error@1115212523) -> (continuation of Deferred@1889078227 after retry RPC after error@838119483) -> (continuation of Deferred@1552040140 after retry RPC after error@1487529509) -> (continuation of Deferred@1616292208 after retry RPC after error@1958193193) -> (continuation of Deferred@989659731 after retry RPC after error@770851815) -> (continuation of Deferred@2025484800 after retry RPC after error@830827486) -> (continuation of Deferred@1664616487 after retry RPC after error@1550484188) -> (continuation of Deferred@2011943203 after retry RPC after error@1839894427) -> (continuation of Deferred@1324403513 after retry RPC after error@1183112281) -> (continuation of Deferred@1867480931 after retry RPC after error@1453384518) -> (continuation of Deferred@515986344 after retry RPC after error@2126979645) -> (continuation of Deferred@1793588961 after retry RPC after error@999066152), errback=(continuation of Deferred@1277739544 after retry RPC after error@133377610) -> (continuation of Deferred@363576150 after retry RPC after error@466315010) -> (continuation of Deferred@293162593 after retry RPC after error@266777466) -> (continuation of Deferred@1205848283 after retry RPC after error@132924501) -> (continuation of Deferred@1547507855 after retry RPC after error@1719274769) -> (continuation of Deferred@1599768597 after retry RPC after error@980529479) -> (continuation of Deferred@238825446 after retry RPC after error@949529013) -> (continuation of Deferred@864654483 after retry RPC after error@80076844) -> (continuation of Deferred@1810476109 after retry RPC after error@381773188) -> (continuation of Deferred@1771259587 after retry RPC after error@1123815261) -> (continuation of Deferred@1691441291 after retry RPC after error@2032270544) -> (continuation of Deferred@175573097 after retry RPC after error@684947613) -> (continuation of Deferred@1177057292 after retry RPC after error@815385445) -> (continuation of Deferred@44022111 after retry RPC after error@834354689) -> (continuation of Deferred@878102562 after retry RPC after error@1248522030) -> (continuation of Deferred@901833341 after retry RPC after error@1566808562) -> (continuation of Deferred@1609977252 after retry RPC after error@1115212523) -> (continuation of Deferred@1889078227 after retry RPC after error@838119483) -> (continuation of Deferred@1552040140 after retry RPC after error@1487529509) -> (continuation of Deferred@1616292208 after retry RPC after error@1958193193) -> (continuation of Deferred@989659731 after retry RPC after error@770851815) -> (continuation of Deferred@2025484800 after retry RPC after error@830827486) -> (continuation of Deferred@1664616487 after retry RPC after error@1550484188) -> (continuation of Deferred@2011943203 after retry RPC after error@1839894427) -> (continuation of Deferred@1324403513 after retry RPC after error@1183112281) -> (continuation of Deferred@1867480931 after retry RPC after error@1453384518) -> (continuation of Deferred@515986344 after retry RPC after error@2126979645) -> (continuation of Deferred@1793588961 after retry RPC after error@999066152)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:57.645 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#6 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_6).
18:34:57.650 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#6 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_6.
18:34:57.653 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=27426), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [4ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [8ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [9ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [9ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [30ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [37ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [37ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [37ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [55ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [55ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [55ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [62ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [83ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [122ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [122ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [182ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [361ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [361ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [681ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [681ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [681ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [681ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1321ms] refreshing cache from master, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1322ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [3261ms] refreshing cache from master, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3262ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [3262ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [5581ms] refreshing cache from master, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [5581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [5582ms] too many traces: truncated at 100 traces, deferred=Deferred@1260959953(state=PENDING, result=null, callback=(continuation of Deferred@1277739544 after retry RPC after error@133377610) -> (continuation of Deferred@363576150 after retry RPC after error@466315010) -> (continuation of Deferred@293162593 after retry RPC after error@266777466) -> (continuation of Deferred@1205848283 after retry RPC after error@132924501) -> (continuation of Deferred@1547507855 after retry RPC after error@1719274769) -> (continuation of Deferred@1599768597 after retry RPC after error@980529479) -> (continuation of Deferred@238825446 after retry RPC after error@949529013) -> (continuation of Deferred@864654483 after retry RPC after error@80076844) -> (continuation of Deferred@1810476109 after retry RPC after error@381773188) -> (continuation of Deferred@1771259587 after retry RPC after error@1123815261) -> (continuation of Deferred@1691441291 after retry RPC after error@2032270544) -> (continuation of Deferred@175573097 after retry RPC after error@684947613) -> (continuation of Deferred@1177057292 after retry RPC after error@815385445) -> (continuation of Deferred@44022111 after retry RPC after error@834354689) -> (continuation of Deferred@878102562 after retry RPC after error@1248522030) -> (continuation of Deferred@901833341 after retry RPC after error@1566808562) -> (continuation of Deferred@1609977252 after retry RPC after error@1115212523) -> (continuation of Deferred@1889078227 after retry RPC after error@838119483) -> (continuation of Deferred@1552040140 after retry RPC after error@1487529509) -> (continuation of Deferred@1616292208 after retry RPC after error@1958193193) -> (continuation of Deferred@989659731 after retry RPC after error@770851815) -> (continuation of Deferred@2025484800 after retry RPC after error@830827486) -> (continuation of Deferred@1664616487 after retry RPC after error@1550484188) -> (continuation of Deferred@2011943203 after retry RPC after error@1839894427) -> (continuation of Deferred@1324403513 after retry RPC after error@1183112281) -> (continuation of Deferred@1867480931 after retry RPC after error@1453384518) -> (continuation of Deferred@515986344 after retry RPC after error@2126979645) -> (continuation of Deferred@1793588961 after retry RPC after error@999066152), errback=(continuation of Deferred@1277739544 after retry RPC after error@133377610) -> (continuation of Deferred@363576150 after retry RPC after error@466315010) -> (continuation of Deferred@293162593 after retry RPC after error@266777466) -> (continuation of Deferred@1205848283 after retry RPC after error@132924501) -> (continuation of Deferred@1547507855 after retry RPC after error@1719274769) -> (continuation of Deferred@1599768597 after retry RPC after error@980529479) -> (continuation of Deferred@238825446 after retry RPC after error@949529013) -> (continuation of Deferred@864654483 after retry RPC after error@80076844) -> (continuation of Deferred@1810476109 after retry RPC after error@381773188) -> (continuation of Deferred@1771259587 after retry RPC after error@1123815261) -> (continuation of Deferred@1691441291 after retry RPC after error@2032270544) -> (continuation of Deferred@175573097 after retry RPC after error@684947613) -> (continuation of Deferred@1177057292 after retry RPC after error@815385445) -> (continuation of Deferred@44022111 after retry RPC after error@834354689) -> (continuation of Deferred@878102562 after retry RPC after error@1248522030) -> (continuation of Deferred@901833341 after retry RPC after error@1566808562) -> (continuation of Deferred@1609977252 after retry RPC after error@1115212523) -> (continuation of Deferred@1889078227 after retry RPC after error@838119483) -> (continuation of Deferred@1552040140 after retry RPC after error@1487529509) -> (continuation of Deferred@1616292208 after retry RPC after error@1958193193) -> (continuation of Deferred@989659731 after retry RPC after error@770851815) -> (continuation of Deferred@2025484800 after retry RPC after error@830827486) -> (continuation of Deferred@1664616487 after retry RPC after error@1550484188) -> (continuation of Deferred@2011943203 after retry RPC after error@1839894427) -> (continuation of Deferred@1324403513 after retry RPC after error@1183112281) -> (continuation of Deferred@1867480931 after retry RPC after error@1453384518) -> (continuation of Deferred@515986344 after retry RPC after error@2126979645) -> (continuation of Deferred@1793588961 after retry RPC after error@999066152)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:57.654 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_6.
18:34:57.655 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#6) of source Source: KuduSource.
18:34:57.655 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:34:57.657 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:57.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:57.803 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:57.803 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:57.803 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:57.804 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:57.804 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:57.804 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:57.804 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:57.804 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:57.804 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:57.805 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:57.805 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:57.805 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:57.805 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:57.834 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535697833 for job 41f18052e8363382138bde77e16b10c3.
18:34:57.842 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:34:57.843 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
18:34:57.902 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:57.999 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:57.999 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:58.000 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:58.000 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:58.000 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:58.000 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:58.001 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:58.001 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:58.001 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:58.001 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:58.001 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:58.001 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:58.002 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:58.002 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:58.002 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:58.002 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:58.002 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:58.003 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:58.003 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:58.003 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:58.003 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:58.003 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:58.003 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:58.003 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:58.004 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:58.004 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:58.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:58.021381 10571 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } attempt: 6
18:34:58.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:58.048344 10571 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.252:40435: Network error: Client connection negotiation failed: client connection to 127.10.26.252:40435: connect: Connection refused (error 111)
18:34:58.087 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:58.087 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:58.087 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:58.087 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:58.088 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:58.088 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:58.088 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:58.088 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:58.088 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:58.089 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:58.089 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:58.089 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:58.089 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:58.139 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:58.139 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:58.139 [DEBUG - pool-504-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:58.140 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:58.140 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:58.140 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:58.140 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:58.140 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:58.140 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:58.141 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:58.141 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:58.141 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:58.141 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:58.142 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27939), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [28ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [30ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [31ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [31ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [47ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [48ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [48ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [48ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [70ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [70ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [71ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [71ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [82ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [101ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [502ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1180ms] refreshing cache from master, [1180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1182ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3081ms] refreshing cache from master, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3083ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [3083ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3083ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3083ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [6000ms] refreshing cache from master, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [6001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [6001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [6001ms] too many traces: truncated at 100 traces, deferred=Deferred@1752936531(state=PENDING, result=null, callback=(continuation of Deferred@411819863 after retry RPC after error@1844819643) -> (continuation of Deferred@2134724695 after retry RPC after error@1248956107) -> (continuation of Deferred@214335925 after retry RPC after error@1279700728) -> (continuation of Deferred@1500307663 after retry RPC after error@523057919) -> (continuation of Deferred@668916614 after retry RPC after error@1578533099) -> (continuation of Deferred@1614965118 after retry RPC after error@382618955) -> (continuation of Deferred@1193129727 after retry RPC after error@761689903) -> (continuation of Deferred@1587339876 after retry RPC after error@987515113) -> (continuation of Deferred@282897155 after retry RPC after error@236808504) -> (continuation of Deferred@933967197 after retry RPC after error@1877522497) -> (continuation of Deferred@437879308 after retry RPC after error@2133359838) -> (continuation of Deferred@298299323 after retry RPC after error@1002907506) -> (continuation of Deferred@1830345700 after retry RPC after error@1374327829) -> (continuation of Deferred@2113688548 after retry RPC after error@2139228062) -> (continuation of Deferred@1424897137 after retry RPC after error@1369528517) -> (continuation of Deferred@1323127398 after retry RPC after error@554435284) -> (continuation of Deferred@82110264 after retry RPC after error@1599664145) -> (continuation of Deferred@2066925566 after retry RPC after error@988373230) -> (continuation of Deferred@420978092 after retry RPC after error@30883559) -> (continuation of Deferred@1823933460 after retry RPC after error@489224060) -> (continuation of Deferred@947385224 after retry RPC after error@15712871) -> (continuation of Deferred@1420620234 after retry RPC after error@241528628), errback=(continuation of Deferred@411819863 after retry RPC after error@1844819643) -> (continuation of Deferred@2134724695 after retry RPC after error@1248956107) -> (continuation of Deferred@214335925 after retry RPC after error@1279700728) -> (continuation of Deferred@1500307663 after retry RPC after error@523057919) -> (continuation of Deferred@668916614 after retry RPC after error@1578533099) -> (continuation of Deferred@1614965118 after retry RPC after error@382618955) -> (continuation of Deferred@1193129727 after retry RPC after error@761689903) -> (continuation of Deferred@1587339876 after retry RPC after error@987515113) -> (continuation of Deferred@282897155 after retry RPC after error@236808504) -> (continuation of Deferred@933967197 after retry RPC after error@1877522497) -> (continuation of Deferred@437879308 after retry RPC after error@2133359838) -> (continuation of Deferred@298299323 after retry RPC after error@1002907506) -> (continuation of Deferred@1830345700 after retry RPC after error@1374327829) -> (continuation of Deferred@2113688548 after retry RPC after error@2139228062) -> (continuation of Deferred@1424897137 after retry RPC after error@1369528517) -> (continuation of Deferred@1323127398 after retry RPC after error@554435284) -> (continuation of Deferred@82110264 after retry RPC after error@1599664145) -> (continuation of Deferred@2066925566 after retry RPC after error@988373230) -> (continuation of Deferred@420978092 after retry RPC after error@30883559) -> (continuation of Deferred@1823933460 after retry RPC after error@489224060) -> (continuation of Deferred@947385224 after retry RPC after error@15712871) -> (continuation of Deferred@1420620234 after retry RPC after error@241528628)))
18:34:58.143 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
18:34:58.143 [WARN - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27939), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [28ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [30ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [31ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [31ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [47ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [48ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [48ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [48ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [70ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [70ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [71ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [71ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [82ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [101ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [502ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1180ms] refreshing cache from master, [1180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1182ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3081ms] refreshing cache from master, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3083ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [3083ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3083ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3083ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [6000ms] refreshing cache from master, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [6001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [6001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [6001ms] too many traces: truncated at 100 traces, deferred=Deferred@1752936531(state=PENDING, result=null, callback=(continuation of Deferred@411819863 after retry RPC after error@1844819643) -> (continuation of Deferred@2134724695 after retry RPC after error@1248956107) -> (continuation of Deferred@214335925 after retry RPC after error@1279700728) -> (continuation of Deferred@1500307663 after retry RPC after error@523057919) -> (continuation of Deferred@668916614 after retry RPC after error@1578533099) -> (continuation of Deferred@1614965118 after retry RPC after error@382618955) -> (continuation of Deferred@1193129727 after retry RPC after error@761689903) -> (continuation of Deferred@1587339876 after retry RPC after error@987515113) -> (continuation of Deferred@282897155 after retry RPC after error@236808504) -> (continuation of Deferred@933967197 after retry RPC after error@1877522497) -> (continuation of Deferred@437879308 after retry RPC after error@2133359838) -> (continuation of Deferred@298299323 after retry RPC after error@1002907506) -> (continuation of Deferred@1830345700 after retry RPC after error@1374327829) -> (continuation of Deferred@2113688548 after retry RPC after error@2139228062) -> (continuation of Deferred@1424897137 after retry RPC after error@1369528517) -> (continuation of Deferred@1323127398 after retry RPC after error@554435284) -> (continuation of Deferred@82110264 after retry RPC after error@1599664145) -> (continuation of Deferred@2066925566 after retry RPC after error@988373230) -> (continuation of Deferred@420978092 after retry RPC after error@30883559) -> (continuation of Deferred@1823933460 after retry RPC after error@489224060) -> (continuation of Deferred@947385224 after retry RPC after error@15712871) -> (continuation of Deferred@1420620234 after retry RPC after error@241528628), errback=(continuation of Deferred@411819863 after retry RPC after error@1844819643) -> (continuation of Deferred@2134724695 after retry RPC after error@1248956107) -> (continuation of Deferred@214335925 after retry RPC after error@1279700728) -> (continuation of Deferred@1500307663 after retry RPC after error@523057919) -> (continuation of Deferred@668916614 after retry RPC after error@1578533099) -> (continuation of Deferred@1614965118 after retry RPC after error@382618955) -> (continuation of Deferred@1193129727 after retry RPC after error@761689903) -> (continuation of Deferred@1587339876 after retry RPC after error@987515113) -> (continuation of Deferred@282897155 after retry RPC after error@236808504) -> (continuation of Deferred@933967197 after retry RPC after error@1877522497) -> (continuation of Deferred@437879308 after retry RPC after error@2133359838) -> (continuation of Deferred@298299323 after retry RPC after error@1002907506) -> (continuation of Deferred@1830345700 after retry RPC after error@1374327829) -> (continuation of Deferred@2113688548 after retry RPC after error@2139228062) -> (continuation of Deferred@1424897137 after retry RPC after error@1369528517) -> (continuation of Deferred@1323127398 after retry RPC after error@554435284) -> (continuation of Deferred@82110264 after retry RPC after error@1599664145) -> (continuation of Deferred@2066925566 after retry RPC after error@988373230) -> (continuation of Deferred@420978092 after retry RPC after error@30883559) -> (continuation of Deferred@1823933460 after retry RPC after error@489224060) -> (continuation of Deferred@947385224 after retry RPC after error@15712871) -> (continuation of Deferred@1420620234 after retry RPC after error@241528628)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:58.143 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_7).
18:34:58.145 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#7 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_7.
18:34:58.148 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from INITIALIZING to FAILED on 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27939), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [28ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [30ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [31ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [31ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [47ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [48ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [48ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [48ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [70ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [70ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [71ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [71ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [82ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [101ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [142ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [201ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [201ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [241ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [322ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [322ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [502ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [502ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1180ms] refreshing cache from master, [1180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1181ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1182ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3081ms] refreshing cache from master, [3081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3083ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [3083ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3083ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [3083ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [6000ms] refreshing cache from master, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [6001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [6001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [6001ms] too many traces: truncated at 100 traces, deferred=Deferred@1752936531(state=PENDING, result=null, callback=(continuation of Deferred@411819863 after retry RPC after error@1844819643) -> (continuation of Deferred@2134724695 after retry RPC after error@1248956107) -> (continuation of Deferred@214335925 after retry RPC after error@1279700728) -> (continuation of Deferred@1500307663 after retry RPC after error@523057919) -> (continuation of Deferred@668916614 after retry RPC after error@1578533099) -> (continuation of Deferred@1614965118 after retry RPC after error@382618955) -> (continuation of Deferred@1193129727 after retry RPC after error@761689903) -> (continuation of Deferred@1587339876 after retry RPC after error@987515113) -> (continuation of Deferred@282897155 after retry RPC after error@236808504) -> (continuation of Deferred@933967197 after retry RPC after error@1877522497) -> (continuation of Deferred@437879308 after retry RPC after error@2133359838) -> (continuation of Deferred@298299323 after retry RPC after error@1002907506) -> (continuation of Deferred@1830345700 after retry RPC after error@1374327829) -> (continuation of Deferred@2113688548 after retry RPC after error@2139228062) -> (continuation of Deferred@1424897137 after retry RPC after error@1369528517) -> (continuation of Deferred@1323127398 after retry RPC after error@554435284) -> (continuation of Deferred@82110264 after retry RPC after error@1599664145) -> (continuation of Deferred@2066925566 after retry RPC after error@988373230) -> (continuation of Deferred@420978092 after retry RPC after error@30883559) -> (continuation of Deferred@1823933460 after retry RPC after error@489224060) -> (continuation of Deferred@947385224 after retry RPC after error@15712871) -> (continuation of Deferred@1420620234 after retry RPC after error@241528628), errback=(continuation of Deferred@411819863 after retry RPC after error@1844819643) -> (continuation of Deferred@2134724695 after retry RPC after error@1248956107) -> (continuation of Deferred@214335925 after retry RPC after error@1279700728) -> (continuation of Deferred@1500307663 after retry RPC after error@523057919) -> (continuation of Deferred@668916614 after retry RPC after error@1578533099) -> (continuation of Deferred@1614965118 after retry RPC after error@382618955) -> (continuation of Deferred@1193129727 after retry RPC after error@761689903) -> (continuation of Deferred@1587339876 after retry RPC after error@987515113) -> (continuation of Deferred@282897155 after retry RPC after error@236808504) -> (continuation of Deferred@933967197 after retry RPC after error@1877522497) -> (continuation of Deferred@437879308 after retry RPC after error@2133359838) -> (continuation of Deferred@298299323 after retry RPC after error@1002907506) -> (continuation of Deferred@1830345700 after retry RPC after error@1374327829) -> (continuation of Deferred@2113688548 after retry RPC after error@2139228062) -> (continuation of Deferred@1424897137 after retry RPC after error@1369528517) -> (continuation of Deferred@1323127398 after retry RPC after error@554435284) -> (continuation of Deferred@82110264 after retry RPC after error@1599664145) -> (continuation of Deferred@2066925566 after retry RPC after error@988373230) -> (continuation of Deferred@420978092 after retry RPC after error@30883559) -> (continuation of Deferred@1823933460 after retry RPC after error@489224060) -> (continuation of Deferred@947385224 after retry RPC after error@15712871) -> (continuation of Deferred@1420620234 after retry RPC after error@241528628)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.195.126:33747
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:58.150 [INFO - flink-pekko.actor.default-dispatcher-10] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:34:58.154 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#7) of source Source: KuduSource.
18:34:58.155 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_7.
18:34:58.157 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:58.260 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:58.276 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:58.276 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:58.277 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:58.277 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:58.277 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:58.277 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:58.278 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:58.278 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:58.278 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:58.278 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:58.278 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:58.278 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:58.278 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:58.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535698333 for job 41f18052e8363382138bde77e16b10c3.
18:34:58.349 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
18:34:58.350 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
18:34:58.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:58.524 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:58.524 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:58.524 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:58.525 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.525 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.525 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.525 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.525 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.526 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.526 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.526 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.526 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.526 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:58.527 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28307), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [4ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [4ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [4ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [28ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [28ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [51ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [51ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [63ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [63ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [83ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [162ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [242ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [441ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [441ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [442ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [783ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1582ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3601ms] refreshing cache from master, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [3602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3602ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [3603ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [3603ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3603ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [6181ms] refreshing cache from master, [6181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [6181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [6182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [6182ms] too many traces: truncated at 100 traces, deferred=Deferred@1718317169(state=PENDING, result=null, callback=(continuation of Deferred@967296284 after retry RPC after error@1246062122) -> (continuation of Deferred@662763979 after retry RPC after error@441839026) -> (continuation of Deferred@492651713 after retry RPC after error@2085098870) -> (continuation of Deferred@1546053013 after retry RPC after error@1772862430) -> (continuation of Deferred@514294118 after retry RPC after error@586728545) -> (continuation of Deferred@1226414054 after retry RPC after error@2102960208) -> (continuation of Deferred@1607905836 after retry RPC after error@996781691) -> (continuation of Deferred@1045080151 after retry RPC after error@111724014) -> (continuation of Deferred@1812287685 after retry RPC after error@443097416) -> (continuation of Deferred@1904880194 after retry RPC after error@827135528) -> (continuation of Deferred@1997073340 after retry RPC after error@616101748) -> (continuation of Deferred@71307675 after retry RPC after error@1575336813) -> (continuation of Deferred@1828777574 after retry RPC after error@249604069) -> (continuation of Deferred@170435435 after retry RPC after error@2053525392) -> (continuation of Deferred@285207908 after retry RPC after error@455847697) -> (continuation of Deferred@1415017700 after retry RPC after error@470137649) -> (continuation of Deferred@1946087704 after retry RPC after error@896244561) -> (continuation of Deferred@1525954892 after retry RPC after error@1805245712) -> (continuation of Deferred@1877706570 after retry RPC after error@104020213) -> (continuation of Deferred@2113294118 after retry RPC after error@1487039701) -> (continuation of Deferred@1807769948 after retry RPC after error@1948981313), errback=(continuation of Deferred@967296284 after retry RPC after error@1246062122) -> (continuation of Deferred@662763979 after retry RPC after error@441839026) -> (continuation of Deferred@492651713 after retry RPC after error@2085098870) -> (continuation of Deferred@1546053013 after retry RPC after error@1772862430) -> (continuation of Deferred@514294118 after retry RPC after error@586728545) -> (continuation of Deferred@1226414054 after retry RPC after error@2102960208) -> (continuation of Deferred@1607905836 after retry RPC after error@996781691) -> (continuation of Deferred@1045080151 after retry RPC after error@111724014) -> (continuation of Deferred@1812287685 after retry RPC after error@443097416) -> (continuation of Deferred@1904880194 after retry RPC after error@827135528) -> (continuation of Deferred@1997073340 after retry RPC after error@616101748) -> (continuation of Deferred@71307675 after retry RPC after error@1575336813) -> (continuation of Deferred@1828777574 after retry RPC after error@249604069) -> (continuation of Deferred@170435435 after retry RPC after error@2053525392) -> (continuation of Deferred@285207908 after retry RPC after error@455847697) -> (continuation of Deferred@1415017700 after retry RPC after error@470137649) -> (continuation of Deferred@1946087704 after retry RPC after error@896244561) -> (continuation of Deferred@1525954892 after retry RPC after error@1805245712) -> (continuation of Deferred@1877706570 after retry RPC after error@104020213) -> (continuation of Deferred@2113294118 after retry RPC after error@1487039701) -> (continuation of Deferred@1807769948 after retry RPC after error@1948981313)))
18:34:58.528 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:58.528 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:58.528 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:58.529 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28307), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [4ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [4ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [4ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [28ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [28ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [51ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [51ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [63ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [63ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [83ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [162ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [242ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [441ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [441ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [442ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [783ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1582ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3601ms] refreshing cache from master, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [3602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3602ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [3603ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [3603ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3603ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [6181ms] refreshing cache from master, [6181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [6181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [6182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [6182ms] too many traces: truncated at 100 traces, deferred=Deferred@1718317169(state=PENDING, result=null, callback=(continuation of Deferred@967296284 after retry RPC after error@1246062122) -> (continuation of Deferred@662763979 after retry RPC after error@441839026) -> (continuation of Deferred@492651713 after retry RPC after error@2085098870) -> (continuation of Deferred@1546053013 after retry RPC after error@1772862430) -> (continuation of Deferred@514294118 after retry RPC after error@586728545) -> (continuation of Deferred@1226414054 after retry RPC after error@2102960208) -> (continuation of Deferred@1607905836 after retry RPC after error@996781691) -> (continuation of Deferred@1045080151 after retry RPC after error@111724014) -> (continuation of Deferred@1812287685 after retry RPC after error@443097416) -> (continuation of Deferred@1904880194 after retry RPC after error@827135528) -> (continuation of Deferred@1997073340 after retry RPC after error@616101748) -> (continuation of Deferred@71307675 after retry RPC after error@1575336813) -> (continuation of Deferred@1828777574 after retry RPC after error@249604069) -> (continuation of Deferred@170435435 after retry RPC after error@2053525392) -> (continuation of Deferred@285207908 after retry RPC after error@455847697) -> (continuation of Deferred@1415017700 after retry RPC after error@470137649) -> (continuation of Deferred@1946087704 after retry RPC after error@896244561) -> (continuation of Deferred@1525954892 after retry RPC after error@1805245712) -> (continuation of Deferred@1877706570 after retry RPC after error@104020213) -> (continuation of Deferred@2113294118 after retry RPC after error@1487039701) -> (continuation of Deferred@1807769948 after retry RPC after error@1948981313), errback=(continuation of Deferred@967296284 after retry RPC after error@1246062122) -> (continuation of Deferred@662763979 after retry RPC after error@441839026) -> (continuation of Deferred@492651713 after retry RPC after error@2085098870) -> (continuation of Deferred@1546053013 after retry RPC after error@1772862430) -> (continuation of Deferred@514294118 after retry RPC after error@586728545) -> (continuation of Deferred@1226414054 after retry RPC after error@2102960208) -> (continuation of Deferred@1607905836 after retry RPC after error@996781691) -> (continuation of Deferred@1045080151 after retry RPC after error@111724014) -> (continuation of Deferred@1812287685 after retry RPC after error@443097416) -> (continuation of Deferred@1904880194 after retry RPC after error@827135528) -> (continuation of Deferred@1997073340 after retry RPC after error@616101748) -> (continuation of Deferred@71307675 after retry RPC after error@1575336813) -> (continuation of Deferred@1828777574 after retry RPC after error@249604069) -> (continuation of Deferred@170435435 after retry RPC after error@2053525392) -> (continuation of Deferred@285207908 after retry RPC after error@455847697) -> (continuation of Deferred@1415017700 after retry RPC after error@470137649) -> (continuation of Deferred@1946087704 after retry RPC after error@896244561) -> (continuation of Deferred@1525954892 after retry RPC after error@1805245712) -> (continuation of Deferred@1877706570 after retry RPC after error@104020213) -> (continuation of Deferred@2113294118 after retry RPC after error@1487039701) -> (continuation of Deferred@1807769948 after retry RPC after error@1948981313)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28307), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [4ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [4ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [4ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [28ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [28ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [51ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [51ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [63ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [63ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [83ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [162ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [242ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [441ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [441ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [442ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [783ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1582ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3601ms] refreshing cache from master, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [3602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3602ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [3603ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [3603ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3603ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [6181ms] refreshing cache from master, [6181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [6181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [6182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [6182ms] too many traces: truncated at 100 traces, deferred=Deferred@1718317169(state=PENDING, result=null, callback=(continuation of Deferred@967296284 after retry RPC after error@1246062122) -> (continuation of Deferred@662763979 after retry RPC after error@441839026) -> (continuation of Deferred@492651713 after retry RPC after error@2085098870) -> (continuation of Deferred@1546053013 after retry RPC after error@1772862430) -> (continuation of Deferred@514294118 after retry RPC after error@586728545) -> (continuation of Deferred@1226414054 after retry RPC after error@2102960208) -> (continuation of Deferred@1607905836 after retry RPC after error@996781691) -> (continuation of Deferred@1045080151 after retry RPC after error@111724014) -> (continuation of Deferred@1812287685 after retry RPC after error@443097416) -> (continuation of Deferred@1904880194 after retry RPC after error@827135528) -> (continuation of Deferred@1997073340 after retry RPC after error@616101748) -> (continuation of Deferred@71307675 after retry RPC after error@1575336813) -> (continuation of Deferred@1828777574 after retry RPC after error@249604069) -> (continuation of Deferred@170435435 after retry RPC after error@2053525392) -> (continuation of Deferred@285207908 after retry RPC after error@455847697) -> (continuation of Deferred@1415017700 after retry RPC after error@470137649) -> (continuation of Deferred@1946087704 after retry RPC after error@896244561) -> (continuation of Deferred@1525954892 after retry RPC after error@1805245712) -> (continuation of Deferred@1877706570 after retry RPC after error@104020213) -> (continuation of Deferred@2113294118 after retry RPC after error@1487039701) -> (continuation of Deferred@1807769948 after retry RPC after error@1948981313), errback=(continuation of Deferred@967296284 after retry RPC after error@1246062122) -> (continuation of Deferred@662763979 after retry RPC after error@441839026) -> (continuation of Deferred@492651713 after retry RPC after error@2085098870) -> (continuation of Deferred@1546053013 after retry RPC after error@1772862430) -> (continuation of Deferred@514294118 after retry RPC after error@586728545) -> (continuation of Deferred@1226414054 after retry RPC after error@2102960208) -> (continuation of Deferred@1607905836 after retry RPC after error@996781691) -> (continuation of Deferred@1045080151 after retry RPC after error@111724014) -> (continuation of Deferred@1812287685 after retry RPC after error@443097416) -> (continuation of Deferred@1904880194 after retry RPC after error@827135528) -> (continuation of Deferred@1997073340 after retry RPC after error@616101748) -> (continuation of Deferred@71307675 after retry RPC after error@1575336813) -> (continuation of Deferred@1828777574 after retry RPC after error@249604069) -> (continuation of Deferred@170435435 after retry RPC after error@2053525392) -> (continuation of Deferred@285207908 after retry RPC after error@455847697) -> (continuation of Deferred@1415017700 after retry RPC after error@470137649) -> (continuation of Deferred@1946087704 after retry RPC after error@896244561) -> (continuation of Deferred@1525954892 after retry RPC after error@1805245712) -> (continuation of Deferred@1877706570 after retry RPC after error@104020213) -> (continuation of Deferred@2113294118 after retry RPC after error@1487039701) -> (continuation of Deferred@1807769948 after retry RPC after error@1948981313)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.11.253:35677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:58.530 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.530 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.530 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.530 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.530 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.530 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.532 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.532 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.532 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.532 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:58.539 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28307), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [4ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [4ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [4ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [28ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [28ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [51ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [51ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [63ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [63ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [83ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [162ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [242ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [441ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [441ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [442ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [783ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1582ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3601ms] refreshing cache from master, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [3602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3602ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [3603ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [3603ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3603ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [6181ms] refreshing cache from master, [6181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [6181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [6182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [6182ms] too many traces: truncated at 100 traces, deferred=Deferred@1718317169(state=PENDING, result=null, callback=(continuation of Deferred@967296284 after retry RPC after error@1246062122) -> (continuation of Deferred@662763979 after retry RPC after error@441839026) -> (continuation of Deferred@492651713 after retry RPC after error@2085098870) -> (continuation of Deferred@1546053013 after retry RPC after error@1772862430) -> (continuation of Deferred@514294118 after retry RPC after error@586728545) -> (continuation of Deferred@1226414054 after retry RPC after error@2102960208) -> (continuation of Deferred@1607905836 after retry RPC after error@996781691) -> (continuation of Deferred@1045080151 after retry RPC after error@111724014) -> (continuation of Deferred@1812287685 after retry RPC after error@443097416) -> (continuation of Deferred@1904880194 after retry RPC after error@827135528) -> (continuation of Deferred@1997073340 after retry RPC after error@616101748) -> (continuation of Deferred@71307675 after retry RPC after error@1575336813) -> (continuation of Deferred@1828777574 after retry RPC after error@249604069) -> (continuation of Deferred@170435435 after retry RPC after error@2053525392) -> (continuation of Deferred@285207908 after retry RPC after error@455847697) -> (continuation of Deferred@1415017700 after retry RPC after error@470137649) -> (continuation of Deferred@1946087704 after retry RPC after error@896244561) -> (continuation of Deferred@1525954892 after retry RPC after error@1805245712) -> (continuation of Deferred@1877706570 after retry RPC after error@104020213) -> (continuation of Deferred@2113294118 after retry RPC after error@1487039701) -> (continuation of Deferred@1807769948 after retry RPC after error@1948981313), errback=(continuation of Deferred@967296284 after retry RPC after error@1246062122) -> (continuation of Deferred@662763979 after retry RPC after error@441839026) -> (continuation of Deferred@492651713 after retry RPC after error@2085098870) -> (continuation of Deferred@1546053013 after retry RPC after error@1772862430) -> (continuation of Deferred@514294118 after retry RPC after error@586728545) -> (continuation of Deferred@1226414054 after retry RPC after error@2102960208) -> (continuation of Deferred@1607905836 after retry RPC after error@996781691) -> (continuation of Deferred@1045080151 after retry RPC after error@111724014) -> (continuation of Deferred@1812287685 after retry RPC after error@443097416) -> (continuation of Deferred@1904880194 after retry RPC after error@827135528) -> (continuation of Deferred@1997073340 after retry RPC after error@616101748) -> (continuation of Deferred@71307675 after retry RPC after error@1575336813) -> (continuation of Deferred@1828777574 after retry RPC after error@249604069) -> (continuation of Deferred@170435435 after retry RPC after error@2053525392) -> (continuation of Deferred@285207908 after retry RPC after error@455847697) -> (continuation of Deferred@1415017700 after retry RPC after error@470137649) -> (continuation of Deferred@1946087704 after retry RPC after error@896244561) -> (continuation of Deferred@1525954892 after retry RPC after error@1805245712) -> (continuation of Deferred@1877706570 after retry RPC after error@104020213) -> (continuation of Deferred@2113294118 after retry RPC after error@1487039701) -> (continuation of Deferred@1807769948 after retry RPC after error@1948981313)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28307), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [4ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [4ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [4ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [28ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [28ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [51ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [51ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [62ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [63ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [63ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [83ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [103ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [161ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [162ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [241ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [242ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [242ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [441ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [441ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [442ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [442ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [782ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [783ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [1582ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3601ms] refreshing cache from master, [3601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [3602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [3602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [3602ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.254:41811: Network error: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811, [3603ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.252:39405: Network error: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405, [3603ms] Sub RPC ConnectToMaster: received response from server master-127.30.11.253:35677: Network error: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [3603ms] delaying RPC due to: Service unavailable: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677, [6181ms] refreshing cache from master, [6181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.254:41811, [6181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.252:39405, [6182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.11.253:35677, [6182ms] too many traces: truncated at 100 traces, deferred=Deferred@1718317169(state=PENDING, result=null, callback=(continuation of Deferred@967296284 after retry RPC after error@1246062122) -> (continuation of Deferred@662763979 after retry RPC after error@441839026) -> (continuation of Deferred@492651713 after retry RPC after error@2085098870) -> (continuation of Deferred@1546053013 after retry RPC after error@1772862430) -> (continuation of Deferred@514294118 after retry RPC after error@586728545) -> (continuation of Deferred@1226414054 after retry RPC after error@2102960208) -> (continuation of Deferred@1607905836 after retry RPC after error@996781691) -> (continuation of Deferred@1045080151 after retry RPC after error@111724014) -> (continuation of Deferred@1812287685 after retry RPC after error@443097416) -> (continuation of Deferred@1904880194 after retry RPC after error@827135528) -> (continuation of Deferred@1997073340 after retry RPC after error@616101748) -> (continuation of Deferred@71307675 after retry RPC after error@1575336813) -> (continuation of Deferred@1828777574 after retry RPC after error@249604069) -> (continuation of Deferred@170435435 after retry RPC after error@2053525392) -> (continuation of Deferred@285207908 after retry RPC after error@455847697) -> (continuation of Deferred@1415017700 after retry RPC after error@470137649) -> (continuation of Deferred@1946087704 after retry RPC after error@896244561) -> (continuation of Deferred@1525954892 after retry RPC after error@1805245712) -> (continuation of Deferred@1877706570 after retry RPC after error@104020213) -> (continuation of Deferred@2113294118 after retry RPC after error@1487039701) -> (continuation of Deferred@1807769948 after retry RPC after error@1948981313), errback=(continuation of Deferred@967296284 after retry RPC after error@1246062122) -> (continuation of Deferred@662763979 after retry RPC after error@441839026) -> (continuation of Deferred@492651713 after retry RPC after error@2085098870) -> (continuation of Deferred@1546053013 after retry RPC after error@1772862430) -> (continuation of Deferred@514294118 after retry RPC after error@586728545) -> (continuation of Deferred@1226414054 after retry RPC after error@2102960208) -> (continuation of Deferred@1607905836 after retry RPC after error@996781691) -> (continuation of Deferred@1045080151 after retry RPC after error@111724014) -> (continuation of Deferred@1812287685 after retry RPC after error@443097416) -> (continuation of Deferred@1904880194 after retry RPC after error@827135528) -> (continuation of Deferred@1997073340 after retry RPC after error@616101748) -> (continuation of Deferred@71307675 after retry RPC after error@1575336813) -> (continuation of Deferred@1828777574 after retry RPC after error@249604069) -> (continuation of Deferred@170435435 after retry RPC after error@2053525392) -> (continuation of Deferred@285207908 after retry RPC after error@455847697) -> (continuation of Deferred@1415017700 after retry RPC after error@470137649) -> (continuation of Deferred@1946087704 after retry RPC after error@896244561) -> (continuation of Deferred@1525954892 after retry RPC after error@1805245712) -> (continuation of Deferred@1877706570 after retry RPC after error@104020213) -> (continuation of Deferred@2113294118 after retry RPC after error@1487039701) -> (continuation of Deferred@1807769948 after retry RPC after error@1948981313)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.30.11.253:35677
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:58.540 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:34:58.540 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#7) of source Source: KuduSource.
18:34:58.541 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from INITIALIZING to CANCELING.
18:34:58.541 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_7).
18:34:58.541 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from INITIALIZING to CANCELING.
18:34:58.541 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_7).
18:34:58.543 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:58.543 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:58.543 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:58.544 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.544 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.544 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.544 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.544 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.544 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.544 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.544 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.544 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.545 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:58.547 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
18:34:58.547 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CANCELING to CANCELED.
18:34:58.547 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_7).
18:34:58.548 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#7 ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_7.
18:34:58.549 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CANCELING to CANCELED.
18:34:58.551 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job f6e63683f34d031c5da392b08baea20c
18:34:58.563 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:58.564 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:58.564 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:58.564 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.564 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.564 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.565 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.565 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.565 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.565 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.565 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.565 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.565 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:58.575 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:34:58.575 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:34:58.575 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:34:58.576 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:58.576 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:58.576 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:34:58.576 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:58.576 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:58.577 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:34:58.577 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:58.577 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:58.577 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:34:58.577 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:34:58.583 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:58.583 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:58.583 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:58.584 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.584 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.584 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.584 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.584 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.584 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.585 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.585 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.585 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.585 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:58.603 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:58.603 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:58.603 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:58.603 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.603 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.603 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.604 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.604 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.604 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.604 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.604 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.604 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.605 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:58.623 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:58.623 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:58.624 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:58.624 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.624 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.624 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.625 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.625 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.625 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.625 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.625 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.625 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.625 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:58.657 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:58.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:58.668810 10492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } attempt: 8
18:34:58.684 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:58.684 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:58.685 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:58.685 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.685 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.685 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.686 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.686 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.686 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.686 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.686 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.686 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.686 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:58.691 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:58.691 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:58.691 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:58.691 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:58.691 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:58.691 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:58.692 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:58.692 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:58.692 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:58.692 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:58.692 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:58.692 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:58.692 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:58.694 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:58.694 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:58.694 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:58.696 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:58.696 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:58.696 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:58.696 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:58.696 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:58.696 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:58.697 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:58.697 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:58.697 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:58.697 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:58.723 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:58.724 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:58.724 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:58.724 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.724 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.724 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.725 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.725 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.725 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.725 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.725 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.725 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.725 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:58.760 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:58.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:58.789951 10492 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } has no permanent_uuid. Determining permanent_uuid...
18:34:58.841 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 69 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535698833 for job 41f18052e8363382138bde77e16b10c3.
18:34:58.853 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 69 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
18:34:58.854 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 69 as completed for source Source: KuduSource.
18:34:58.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:58.871025 10492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.252:40435: Network error: Client connection negotiation failed: client connection to 127.10.26.252:40435: connect: Connection refused (error 111)
18:34:58.902 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:58.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:58.936715 10492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } attempt: 1
18:34:58.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:58.947093 10492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.252:40435: Network error: Client connection negotiation failed: client connection to 127.10.26.252:40435: connect: Connection refused (error 111)
18:34:58.963 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:58.964 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:58.964 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:58.964 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.964 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.964 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:58.965 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.965 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.965 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:58.965 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.965 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.965 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:58.965 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:58.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:58.637929 10582 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 10573
18:34:58.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:58.978451 10573 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.755s	user 0.002s	sys 0.000s
18:34:58.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:57.224738 10584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:58.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:58.978953 10573 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.755s	user 0.002s	sys 0.001s
18:34:58.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:58.978782 10585 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1753 milliseconds
18:34:58.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:58.980767 10586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:34:58.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:58.980722 10573 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:34:58.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:58.985381 10573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:34:58.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:58.988293 10573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:34:58.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:58.989675 10573 hybrid_clock.cc:648] HybridClock initialized: now 1783535698989600 us; error 82 us; skew 500 ppm
18:34:58.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:58.990428 10573 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:34:59.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.000257 10573 webserver.cc:534] Webserver started at http://127.10.26.252:36251/ using document root <none> and password file <none>
18:34:59.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.000712 10492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } attempt: 2
18:34:59.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.001336 10573 fs_manager.cc:362] Metadata directory not provided
18:34:59.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.001597 10573 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:34:59.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.002152 10573 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:34:59.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:59.005431 10492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.252:40435: Network error: Client connection negotiation failed: client connection to 127.10.26.252:40435: connect: Connection refused (error 111)
18:34:59.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.007045 10573 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/data/instance:
18:34:59.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fc271ac084814e3c8dd50b755ec7badb"
18:34:59.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:58 on dist-test-slave-dxnw"
18:34:59.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.008320 10573 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/wal/instance:
18:34:59.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fc271ac084814e3c8dd50b755ec7badb"
18:34:59.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:58 on dist-test-slave-dxnw"
18:34:59.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.016166 10573 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
18:34:59.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.022939 10604 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:34:59.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.024085 10573 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
18:34:59.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.024345 10573 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/wal
18:34:59.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fc271ac084814e3c8dd50b755ec7badb"
18:34:59.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:34:58 on dist-test-slave-dxnw"
18:34:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.024703 10573 fs_report.cc:389] FS layout report
18:34:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:34:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/wal
18:34:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/wal
18:34:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/data/data
18:34:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:34:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:34:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:34:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:34:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:34:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:34:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:34:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:34:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:34:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:34:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:34:59.047 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:59.047 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:59.047 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:59.048 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:59.048 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:59.048 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:59.048 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:59.048 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:59.048 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:59.048 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:59.048 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:59.048 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:59.048 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:59.054 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:59.055 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:59.055 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:59.055 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:59.055 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:59.055 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:59.055 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:59.055 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:59.055 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:59.055 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:59.055 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:59.055 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:59.055 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:59.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.081921 10492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } attempt: 3
18:34:59.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:59.088989 10492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.252:40435: Network error: Client connection negotiation failed: client connection to 127.10.26.252:40435: connect: Connection refused (error 111)
18:34:59.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.109908 10571 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } attempt: 7
18:34:59.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.123109 10573 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:34:59.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.126019 10573 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:34:59.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.126614 10573 kserver.cc:163] Server-wide thread pool size limit: 3276
18:34:59.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:59.129106 10571 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.26.252:40435: Network error: Client connection negotiation failed: client connection to 127.10.26.252:40435: connect: Connection refused (error 111)
18:34:59.140 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:34:59.140 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:34:59.140 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:34:59.140 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:59.140 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:59.140 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:59.140 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:59.140 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:59.140 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:59.140 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:34:59.140 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:34:59.140 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:34:59.141 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:34:59.144 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:59.144 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:59.144 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:59.145 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:59.145 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:59.145 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:59.145 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:59.145 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:59.145 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:59.145 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:59.145 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:59.145 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:59.145 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:59.156 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:59.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.229362 10573 rpc_server.cc:307] RPC server started. Bound to: 127.10.26.252:40435
18:34:59.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.229555 10657 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.26.252:40435 every 8 connection(s)
18:34:59.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.232620 10573 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/data/info.pb
18:34:59.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.238013 10347 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 10573
18:34:59.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.238477 10347 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/master-2/wal/instance
18:34:59.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.240700 10658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:34:59.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.246227 10492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } attempt: 4
18:34:59.260 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:59.261 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:34:59.261 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:34:59.261 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:34:59.262 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:59.262 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:59.262 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:59.262 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:34:59.262 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:59.262 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:34:59.262 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:59.262 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:59.262 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:34:59.262 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:34:59.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.268430 10658 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } has no permanent_uuid. Determining permanent_uuid...
18:34:59.283 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:34:59.283 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:34:59.283 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:34:59.284 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:59.284 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:59.284 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:34:59.284 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:59.284 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:59.284 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:34:59.284 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:59.284 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:59.284 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:34:59.285 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:34:59.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.287865 10492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069: Bootstrap starting.
18:34:59.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.292507 10658 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } has no permanent_uuid. Determining permanent_uuid...
18:34:59.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.296943 10492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069: Neither blocks nor log segments found. Creating new log.
18:34:59.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.299360 10492 log.cc:826] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069: Log is configured to *not* fsync() on all Append() calls
18:34:59.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.306067 10658 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } has no permanent_uuid. Determining permanent_uuid...
18:34:59.307 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:34:59.307 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:34:59.307 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:34:59.308 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:59.308 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:59.308 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:34:59.308 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:59.308 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:59.308 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:34:59.308 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:59.308 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:59.308 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:34:59.308 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:34:59.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.311862 10492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069: No bootstrap required, opened a new log
18:34:59.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.328490 10658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb: Bootstrap starting.
18:34:59.334 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 70 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535699333 for job 41f18052e8363382138bde77e16b10c3.
18:34:59.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.337138 10658 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb: Neither blocks nor log segments found. Creating new log.
18:34:59.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.339401 10658 log.cc:826] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb: Log is configured to *not* fsync() on all Append() calls
18:34:59.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.340188 10492 raft_consensus.cc:359] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } }
18:34:59.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.341068 10492 raft_consensus.cc:385] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:59.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.341382 10492 raft_consensus.cc:740] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59a352fb28734817802dc1543d2a2069, State: Initialized, Role: FOLLOWER
18:34:59.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.342514 10492 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } }
18:34:59.344 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 70 for job 41f18052e8363382138bde77e16b10c3 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:34:59.346 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 70 as completed for source Source: KuduSource.
18:34:59.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.358300 10658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb: No bootstrap required, opened a new log
18:34:59.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.358491 10667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } } }
18:34:59.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.359300 10667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069 [sys.catalog]: This master's current role is: FOLLOWER
18:34:59.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.360721 10492 sys_catalog.cc:565] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069 [sys.catalog]: configured and running, proceeding with master startup.
18:34:59.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.385571 10658 raft_consensus.cc:359] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } }
18:34:59.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.386395 10658 raft_consensus.cc:385] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:34:59.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.386787 10658 raft_consensus.cc:740] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc271ac084814e3c8dd50b755ec7badb, State: Initialized, Role: FOLLOWER
18:34:59.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.387827 10658 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } }
18:34:59.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.393553 10658 sys_catalog.cc:565] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [sys.catalog]: configured and running, proceeding with master startup.
18:34:59.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.391304 10678 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } } }
18:34:59.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.395624 10678 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [sys.catalog]: This master's current role is: FOLLOWER
18:34:59.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:59.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:59.432250 10679 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:34:59.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:59.432830 10679 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:34:59.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.401535 10359 master_runner.cc:187] Error getting master registration for 127.10.26.253:36107: OK, instance_id { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" instance_seqno: 1783535696645860 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:34:59.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.454181 10359 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:34:59.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:59.463480 10691 catalog_manager.cc:1593] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:34:59.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:59.464284 10691 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:34:59.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.451363 10573 master_runner.cc:187] Error getting master registration for 127.10.26.253:36107: OK, instance_id { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" instance_seqno: 1783535696645860 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:34:59.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.479286 10573 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:34:59.494 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:59.494 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:59.494 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:59.494 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.494 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.494 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.494 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.494 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.494 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.495 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.495 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.495 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.495 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:59.495 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=27902), Traces: [0ms] sending RPC to server master-127.6.245.60:46787, [1ms] received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [22ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [23ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [24ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [24ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [24ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [42ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [43ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [43ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [43ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [43ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [63ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [63ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [63ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [64ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [82ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [82ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [83ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [83ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [103ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [103ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [103ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [103ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [121ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [122ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [122ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [122ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [123ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [162ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [162ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [162ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [162ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [302ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [303ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [462ms] refreshing cache from master, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [463ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [463ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [463ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [463ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [621ms] refreshing cache from master, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [623ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [623ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [623ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [624ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [1082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [1082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [1083ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [3562ms] refreshing cache from master, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [3563ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [3564ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [3564ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [7402ms] refreshing cache from master, [7402ms] too many traces: truncated at 100 traces, deferred=Deferred@180487390(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@2e895351 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1547030930 after retry RPC after error@1643464493) -> (continuation of Deferred@2072726329 after retry RPC after error@528256194) -> (continuation of Deferred@1832347646 after retry RPC after error@649103706) -> (continuation of Deferred@121887798 after retry RPC after error@2082626176) -> (continuation of Deferred@721209965 after retry RPC after error@144997425) -> (continuation of Deferred@287290239 after retry RPC after error@2139561350) -> (continuation of Deferred@862199737 after retry RPC after error@403351568) -> (continuation of Deferred@1952605221 after retry RPC after error@860765186) -> (continuation of Deferred@549741573 after retry RPC after error@1841500709) -> (continuation of Deferred@174522612 after retry RPC after error@1208714134) -> (continuation of Deferred@1265382110 after retry RPC after error@1053512620) -> (continuation of Deferred@211387425 after retry RPC after error@404402455) -> (continuation of Deferred@852134408 after retry RPC after error@1450764750) -> (continuation of Deferred@377538476 after retry RPC after error@1541361250) -> (continuation of Deferred@1025709531 after retry RPC after error@738508072) -> (continuation of Deferred@1009361571 after retry RPC after error@488916762) -> (continuation of Deferred@948700328 after retry RPC after error@828904300) -> (continuation of Deferred@1084592984 after retry RPC after error@2139488449) -> (continuation of Deferred@662172381 after retry RPC after error@1458923052) -> (continuation of Deferred@975573241 after retry RPC after error@1969856372) -> (continuation of Deferred@1838184990 after retry RPC after error@271164806) -> (continuation of Deferred@444780194 after retry RPC after error@598307001), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1547030930 after retry RPC after error@1643464493) -> (continuation of Deferred@2072726329 after retry RPC after error@528256194) -> (continuation of Deferred@1832347646 after retry RPC after error@649103706) -> (continuation of Deferred@121887798 after retry RPC after error@2082626176) -> (continuation of Deferred@721209965 after retry RPC after error@144997425) -> (continuation of Deferred@287290239 after retry RPC after error@2139561350) -> (continuation of Deferred@862199737 after retry RPC after error@403351568) -> (continuation of Deferred@1952605221 after retry RPC after error@860765186) -> (continuation of Deferred@549741573 after retry RPC after error@1841500709) -> (continuation of Deferred@174522612 after retry RPC after error@1208714134) -> (continuation of Deferred@1265382110 after retry RPC after error@1053512620) -> (continuation of Deferred@211387425 after retry RPC after error@404402455) -> (continuation of Deferred@852134408 after retry RPC after error@1450764750) -> (continuation of Deferred@377538476 after retry RPC after error@1541361250) -> (continuation of Deferred@1025709531 after retry RPC after error@738508072) -> (continuation of Deferred@1009361571 after retry RPC after error@488916762) -> (continuation of Deferred@948700328 after retry RPC after error@828904300) -> (continuation of Deferred@1084592984 after retry RPC after error@2139488449) -> (continuation of Deferred@662172381 after retry RPC after error@1458923052) -> (continuation of Deferred@975573241 after retry RPC after error@1969856372) -> (continuation of Deferred@1838184990 after retry RPC after error@271164806) -> (continuation of Deferred@444780194 after retry RPC after error@598307001)))
18:34:59.496 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:59.496 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:59.496 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:59.496 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=27902), Traces: [0ms] sending RPC to server master-127.6.245.60:46787, [1ms] received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [22ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [23ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [24ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [24ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [24ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [42ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [43ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [43ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [43ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [43ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [63ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [63ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [63ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [64ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [82ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [82ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [83ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [83ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [103ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [103ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [103ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [103ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [121ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [122ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [122ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [122ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [123ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [162ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [162ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [162ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [162ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [302ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [303ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [462ms] refreshing cache from master, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [463ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [463ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [463ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [463ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [621ms] refreshing cache from master, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [623ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [623ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [623ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [624ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [1082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [1082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [1083ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [3562ms] refreshing cache from master, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [3563ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [3564ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [3564ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [7402ms] refreshing cache from master, [7402ms] too many traces: truncated at 100 traces, deferred=Deferred@180487390(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@2e895351 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1547030930 after retry RPC after error@1643464493) -> (continuation of Deferred@2072726329 after retry RPC after error@528256194) -> (continuation of Deferred@1832347646 after retry RPC after error@649103706) -> (continuation of Deferred@121887798 after retry RPC after error@2082626176) -> (continuation of Deferred@721209965 after retry RPC after error@144997425) -> (continuation of Deferred@287290239 after retry RPC after error@2139561350) -> (continuation of Deferred@862199737 after retry RPC after error@403351568) -> (continuation of Deferred@1952605221 after retry RPC after error@860765186) -> (continuation of Deferred@549741573 after retry RPC after error@1841500709) -> (continuation of Deferred@174522612 after retry RPC after error@1208714134) -> (continuation of Deferred@1265382110 after retry RPC after error@1053512620) -> (continuation of Deferred@211387425 after retry RPC after error@404402455) -> (continuation of Deferred@852134408 after retry RPC after error@1450764750) -> (continuation of Deferred@377538476 after retry RPC after error@1541361250) -> (continuation of Deferred@1025709531 after retry RPC after error@738508072) -> (continuation of Deferred@1009361571 after retry RPC after error@488916762) -> (continuation of Deferred@948700328 after retry RPC after error@828904300) -> (continuation of Deferred@1084592984 after retry RPC after error@2139488449) -> (continuation of Deferred@662172381 after retry RPC after error@1458923052) -> (continuation of Deferred@975573241 after retry RPC after error@1969856372) -> (continuation of Deferred@1838184990 after retry RPC after error@271164806) -> (continuation of Deferred@444780194 after retry RPC after error@598307001), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1547030930 after retry RPC after error@1643464493) -> (continuation of Deferred@2072726329 after retry RPC after error@528256194) -> (continuation of Deferred@1832347646 after retry RPC after error@649103706) -> (continuation of Deferred@121887798 after retry RPC after error@2082626176) -> (continuation of Deferred@721209965 after retry RPC after error@144997425) -> (continuation of Deferred@287290239 after retry RPC after error@2139561350) -> (continuation of Deferred@862199737 after retry RPC after error@403351568) -> (continuation of Deferred@1952605221 after retry RPC after error@860765186) -> (continuation of Deferred@549741573 after retry RPC after error@1841500709) -> (continuation of Deferred@174522612 after retry RPC after error@1208714134) -> (continuation of Deferred@1265382110 after retry RPC after error@1053512620) -> (continuation of Deferred@211387425 after retry RPC after error@404402455) -> (continuation of Deferred@852134408 after retry RPC after error@1450764750) -> (continuation of Deferred@377538476 after retry RPC after error@1541361250) -> (continuation of Deferred@1025709531 after retry RPC after error@738508072) -> (continuation of Deferred@1009361571 after retry RPC after error@488916762) -> (continuation of Deferred@948700328 after retry RPC after error@828904300) -> (continuation of Deferred@1084592984 after retry RPC after error@2139488449) -> (continuation of Deferred@662172381 after retry RPC after error@1458923052) -> (continuation of Deferred@975573241 after retry RPC after error@1969856372) -> (continuation of Deferred@1838184990 after retry RPC after error@271164806) -> (continuation of Deferred@444780194 after retry RPC after error@598307001)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=27902), Traces: [0ms] sending RPC to server master-127.6.245.60:46787, [1ms] received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [22ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [23ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [24ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [24ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [24ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [42ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [43ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [43ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [43ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [43ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [63ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [63ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [63ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [64ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [82ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [82ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [83ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [83ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [103ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [103ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [103ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [103ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [121ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [122ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [122ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [122ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [123ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [162ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [162ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [162ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [162ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [302ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [303ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [462ms] refreshing cache from master, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [463ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [463ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [463ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [463ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [621ms] refreshing cache from master, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [623ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [623ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [623ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [624ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [1082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [1082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [1083ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [3562ms] refreshing cache from master, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [3563ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [3564ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [3564ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [7402ms] refreshing cache from master, [7402ms] too many traces: truncated at 100 traces, deferred=Deferred@180487390(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@2e895351 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1547030930 after retry RPC after error@1643464493) -> (continuation of Deferred@2072726329 after retry RPC after error@528256194) -> (continuation of Deferred@1832347646 after retry RPC after error@649103706) -> (continuation of Deferred@121887798 after retry RPC after error@2082626176) -> (continuation of Deferred@721209965 after retry RPC after error@144997425) -> (continuation of Deferred@287290239 after retry RPC after error@2139561350) -> (continuation of Deferred@862199737 after retry RPC after error@403351568) -> (continuation of Deferred@1952605221 after retry RPC after error@860765186) -> (continuation of Deferred@549741573 after retry RPC after error@1841500709) -> (continuation of Deferred@174522612 after retry RPC after error@1208714134) -> (continuation of Deferred@1265382110 after retry RPC after error@1053512620) -> (continuation of Deferred@211387425 after retry RPC after error@404402455) -> (continuation of Deferred@852134408 after retry RPC after error@1450764750) -> (continuation of Deferred@377538476 after retry RPC after error@1541361250) -> (continuation of Deferred@1025709531 after retry RPC after error@738508072) -> (continuation of Deferred@1009361571 after retry RPC after error@488916762) -> (continuation of Deferred@948700328 after retry RPC after error@828904300) -> (continuation of Deferred@1084592984 after retry RPC after error@2139488449) -> (continuation of Deferred@662172381 after retry RPC after error@1458923052) -> (continuation of Deferred@975573241 after retry RPC after error@1969856372) -> (continuation of Deferred@1838184990 after retry RPC after error@271164806) -> (continuation of Deferred@444780194 after retry RPC after error@598307001), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1547030930 after retry RPC after error@1643464493) -> (continuation of Deferred@2072726329 after retry RPC after error@528256194) -> (continuation of Deferred@1832347646 after retry RPC after error@649103706) -> (continuation of Deferred@121887798 after retry RPC after error@2082626176) -> (continuation of Deferred@721209965 after retry RPC after error@144997425) -> (continuation of Deferred@287290239 after retry RPC after error@2139561350) -> (continuation of Deferred@862199737 after retry RPC after error@403351568) -> (continuation of Deferred@1952605221 after retry RPC after error@860765186) -> (continuation of Deferred@549741573 after retry RPC after error@1841500709) -> (continuation of Deferred@174522612 after retry RPC after error@1208714134) -> (continuation of Deferred@1265382110 after retry RPC after error@1053512620) -> (continuation of Deferred@211387425 after retry RPC after error@404402455) -> (continuation of Deferred@852134408 after retry RPC after error@1450764750) -> (continuation of Deferred@377538476 after retry RPC after error@1541361250) -> (continuation of Deferred@1025709531 after retry RPC after error@738508072) -> (continuation of Deferred@1009361571 after retry RPC after error@488916762) -> (continuation of Deferred@948700328 after retry RPC after error@828904300) -> (continuation of Deferred@1084592984 after retry RPC after error@2139488449) -> (continuation of Deferred@662172381 after retry RPC after error@1458923052) -> (continuation of Deferred@975573241 after retry RPC after error@1969856372) -> (continuation of Deferred@1838184990 after retry RPC after error@271164806) -> (continuation of Deferred@444780194 after retry RPC after error@598307001)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.6.245.62:36853
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:59.497 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.497 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.497 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.497 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.497 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.497 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.498 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.498 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.498 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.498 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:59.502 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=27902), Traces: [0ms] sending RPC to server master-127.6.245.60:46787, [1ms] received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [22ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [23ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [24ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [24ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [24ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [42ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [43ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [43ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [43ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [43ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [63ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [63ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [63ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [64ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [82ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [82ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [83ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [83ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [103ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [103ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [103ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [103ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [121ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [122ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [122ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [122ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [123ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [162ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [162ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [162ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [162ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [302ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [303ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [462ms] refreshing cache from master, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [463ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [463ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [463ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [463ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [621ms] refreshing cache from master, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [623ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [623ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [623ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [624ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [1082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [1082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [1083ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [3562ms] refreshing cache from master, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [3563ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [3564ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [3564ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [7402ms] refreshing cache from master, [7402ms] too many traces: truncated at 100 traces, deferred=Deferred@180487390(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@2e895351 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1547030930 after retry RPC after error@1643464493) -> (continuation of Deferred@2072726329 after retry RPC after error@528256194) -> (continuation of Deferred@1832347646 after retry RPC after error@649103706) -> (continuation of Deferred@121887798 after retry RPC after error@2082626176) -> (continuation of Deferred@721209965 after retry RPC after error@144997425) -> (continuation of Deferred@287290239 after retry RPC after error@2139561350) -> (continuation of Deferred@862199737 after retry RPC after error@403351568) -> (continuation of Deferred@1952605221 after retry RPC after error@860765186) -> (continuation of Deferred@549741573 after retry RPC after error@1841500709) -> (continuation of Deferred@174522612 after retry RPC after error@1208714134) -> (continuation of Deferred@1265382110 after retry RPC after error@1053512620) -> (continuation of Deferred@211387425 after retry RPC after error@404402455) -> (continuation of Deferred@852134408 after retry RPC after error@1450764750) -> (continuation of Deferred@377538476 after retry RPC after error@1541361250) -> (continuation of Deferred@1025709531 after retry RPC after error@738508072) -> (continuation of Deferred@1009361571 after retry RPC after error@488916762) -> (continuation of Deferred@948700328 after retry RPC after error@828904300) -> (continuation of Deferred@1084592984 after retry RPC after error@2139488449) -> (continuation of Deferred@662172381 after retry RPC after error@1458923052) -> (continuation of Deferred@975573241 after retry RPC after error@1969856372) -> (continuation of Deferred@1838184990 after retry RPC after error@271164806) -> (continuation of Deferred@444780194 after retry RPC after error@598307001), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1547030930 after retry RPC after error@1643464493) -> (continuation of Deferred@2072726329 after retry RPC after error@528256194) -> (continuation of Deferred@1832347646 after retry RPC after error@649103706) -> (continuation of Deferred@121887798 after retry RPC after error@2082626176) -> (continuation of Deferred@721209965 after retry RPC after error@144997425) -> (continuation of Deferred@287290239 after retry RPC after error@2139561350) -> (continuation of Deferred@862199737 after retry RPC after error@403351568) -> (continuation of Deferred@1952605221 after retry RPC after error@860765186) -> (continuation of Deferred@549741573 after retry RPC after error@1841500709) -> (continuation of Deferred@174522612 after retry RPC after error@1208714134) -> (continuation of Deferred@1265382110 after retry RPC after error@1053512620) -> (continuation of Deferred@211387425 after retry RPC after error@404402455) -> (continuation of Deferred@852134408 after retry RPC after error@1450764750) -> (continuation of Deferred@377538476 after retry RPC after error@1541361250) -> (continuation of Deferred@1025709531 after retry RPC after error@738508072) -> (continuation of Deferred@1009361571 after retry RPC after error@488916762) -> (continuation of Deferred@948700328 after retry RPC after error@828904300) -> (continuation of Deferred@1084592984 after retry RPC after error@2139488449) -> (continuation of Deferred@662172381 after retry RPC after error@1458923052) -> (continuation of Deferred@975573241 after retry RPC after error@1969856372) -> (continuation of Deferred@1838184990 after retry RPC after error@271164806) -> (continuation of Deferred@444780194 after retry RPC after error@598307001)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=27902), Traces: [0ms] sending RPC to server master-127.6.245.60:46787, [1ms] received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [22ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [23ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [24ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [24ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [24ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [42ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [43ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [43ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [43ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [43ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [63ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [63ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [63ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [64ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [82ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [82ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [83ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [83ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [103ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [103ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [103ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [103ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [121ms] refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [122ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [122ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [122ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [123ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [162ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [162ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [162ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [162ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [302ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [303ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [303ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [462ms] refreshing cache from master, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [463ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [463ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [463ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [463ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [621ms] refreshing cache from master, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [623ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [623ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [623ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [624ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [1082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [1082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [1083ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [1083ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [3562ms] refreshing cache from master, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.61:44495, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.60:46787, [3563ms] Sub RPC ConnectToMaster: sending RPC to server master-127.6.245.62:36853, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.60:46787: Network error: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787, [3563ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.61:44495: Network error: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495, [3564ms] Sub RPC ConnectToMaster: received response from server master-127.6.245.62:36853: Network error: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [3564ms] delaying RPC due to: Service unavailable: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853, [7402ms] refreshing cache from master, [7402ms] too many traces: truncated at 100 traces, deferred=Deferred@180487390(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$223/0x00007ff32432f750@2e895351 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1547030930 after retry RPC after error@1643464493) -> (continuation of Deferred@2072726329 after retry RPC after error@528256194) -> (continuation of Deferred@1832347646 after retry RPC after error@649103706) -> (continuation of Deferred@121887798 after retry RPC after error@2082626176) -> (continuation of Deferred@721209965 after retry RPC after error@144997425) -> (continuation of Deferred@287290239 after retry RPC after error@2139561350) -> (continuation of Deferred@862199737 after retry RPC after error@403351568) -> (continuation of Deferred@1952605221 after retry RPC after error@860765186) -> (continuation of Deferred@549741573 after retry RPC after error@1841500709) -> (continuation of Deferred@174522612 after retry RPC after error@1208714134) -> (continuation of Deferred@1265382110 after retry RPC after error@1053512620) -> (continuation of Deferred@211387425 after retry RPC after error@404402455) -> (continuation of Deferred@852134408 after retry RPC after error@1450764750) -> (continuation of Deferred@377538476 after retry RPC after error@1541361250) -> (continuation of Deferred@1025709531 after retry RPC after error@738508072) -> (continuation of Deferred@1009361571 after retry RPC after error@488916762) -> (continuation of Deferred@948700328 after retry RPC after error@828904300) -> (continuation of Deferred@1084592984 after retry RPC after error@2139488449) -> (continuation of Deferred@662172381 after retry RPC after error@1458923052) -> (continuation of Deferred@975573241 after retry RPC after error@1969856372) -> (continuation of Deferred@1838184990 after retry RPC after error@271164806) -> (continuation of Deferred@444780194 after retry RPC after error@598307001), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1547030930 after retry RPC after error@1643464493) -> (continuation of Deferred@2072726329 after retry RPC after error@528256194) -> (continuation of Deferred@1832347646 after retry RPC after error@649103706) -> (continuation of Deferred@121887798 after retry RPC after error@2082626176) -> (continuation of Deferred@721209965 after retry RPC after error@144997425) -> (continuation of Deferred@287290239 after retry RPC after error@2139561350) -> (continuation of Deferred@862199737 after retry RPC after error@403351568) -> (continuation of Deferred@1952605221 after retry RPC after error@860765186) -> (continuation of Deferred@549741573 after retry RPC after error@1841500709) -> (continuation of Deferred@174522612 after retry RPC after error@1208714134) -> (continuation of Deferred@1265382110 after retry RPC after error@1053512620) -> (continuation of Deferred@211387425 after retry RPC after error@404402455) -> (continuation of Deferred@852134408 after retry RPC after error@1450764750) -> (continuation of Deferred@377538476 after retry RPC after error@1541361250) -> (continuation of Deferred@1025709531 after retry RPC after error@738508072) -> (continuation of Deferred@1009361571 after retry RPC after error@488916762) -> (continuation of Deferred@948700328 after retry RPC after error@828904300) -> (continuation of Deferred@1084592984 after retry RPC after error@2139488449) -> (continuation of Deferred@662172381 after retry RPC after error@1458923052) -> (continuation of Deferred@975573241 after retry RPC after error@1969856372) -> (continuation of Deferred@1838184990 after retry RPC after error@271164806) -> (continuation of Deferred@444780194 after retry RPC after error@598307001)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.6.245.62:36853
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:34:59.502 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:34:59.502 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (41f18052e8363382138bde77e16b10c3) switched from state RUNNING to RESTARTING.
18:34:59.503 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
18:34:59.503 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
18:34:59.503 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
18:34:59.503 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
18:34:59.503 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
18:34:59.503 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
18:34:59.503 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
18:34:59.504 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
18:34:59.504 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
18:34:59.504 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
18:34:59.504 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.7.200.189:42349(127.7.200.189:42349)] disconnecting while in state TERMINATED
18:34:59.505 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.7.200.190:40077(127.7.200.190:40077)] disconnecting while in state TERMINATED
18:34:59.505 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
18:34:59.505 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)] disconnecting while in state TERMINATED
18:34:59.505 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.7.200.188:38999(127.7.200.188:38999)] disconnecting while in state TERMINATED
18:34:59.505 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:59.506 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:34:59.512 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-2
18:34:59.513 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-3
18:34:59.513 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:59.513 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:59.513 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:59.514 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.514 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.514 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.514 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.514 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.514 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.515 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.515 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.515 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.515 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:59.517 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
18:34:59.517 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
18:34:59.517 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
18:34:59.519 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.7.200.189:42349(127.7.200.189:42349)] disconnecting while in state TERMINATED
18:34:59.519 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.7.200.190:40077(127.7.200.190:40077)] disconnecting while in state TERMINATED
18:34:59.519 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer b47d36a83f4440eaac9ce006765394d3(127.7.200.130:45405)] disconnecting while in state TERMINATED
18:34:59.519 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.7.200.188:38999(127.7.200.188:38999)] disconnecting while in state TERMINATED
18:34:59.519 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:59.519 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
18:34:59.520 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
18:34:59.520 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:34:59.521 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
18:34:59.521 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
18:34:59.521 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
18:34:59.527 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
18:34:59.527 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:34:59.528 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
18:34:59.528 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
18:34:59.528 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
18:34:59.528 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:34:59.529 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
18:34:59.529 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
18:34:59.535 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:59.535 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:59.535 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:59.536 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.536 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.536 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.536 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.536 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.536 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.536 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.537 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.537 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.537 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:59.543 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.7.200.189:42349(127.7.200.189:42349)] disconnecting while in state TERMINATED
18:34:59.543 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.7.200.190:40077(127.7.200.190:40077)] disconnecting while in state TERMINATED
18:34:59.543 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)] disconnecting while in state TERMINATED
18:34:59.543 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.7.200.188:38999(127.7.200.188:38999)] disconnecting while in state TERMINATED
18:34:59.543 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:59.543 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
18:34:59.543 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:34:59.544 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
18:34:59.545 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
18:34:59.545 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
18:34:59.545 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
18:34:59.546 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
18:34:59.546 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.7.200.189:42349(127.7.200.189:42349)] disconnecting while in state TERMINATED
18:34:59.546 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.7.200.190:40077(127.7.200.190:40077)] disconnecting while in state TERMINATED
18:34:59.546 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer d916cabe36cb45ccb545d9fc771a4651(127.7.200.129:33899)] disconnecting while in state TERMINATED
18:34:59.546 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:34:59.548 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
18:34:59.548 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
18:34:59.546 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.7.200.188:38999(127.7.200.188:38999)] disconnecting while in state TERMINATED
18:34:59.548 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:34:59.548 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
18:34:59.549 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
18:34:59.549 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
18:34:59.549 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
18:34:59.550 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
18:34:59.550 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
18:34:59.550 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
18:34:59.551 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
18:34:59.551 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-2
18:34:59.551 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
18:34:59.552 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 41f18052e8363382138bde77e16b10c3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:34:59.552 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 41f18052e8363382138bde77e16b10c3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:34:59.552 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 41f18052e8363382138bde77e16b10c3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:34:59.552 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
18:34:59.553 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
18:34:59.553 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
18:34:59.553 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
18:34:59.553 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
18:34:59.554 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 41f18052e8363382138bde77e16b10c3
18:34:59.554 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:59.554 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:59.554 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:59.555 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.555 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.555 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.555 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.555 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.555 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.555 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.555 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.555 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.556 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:59.574 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:59.574 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:59.574 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.574 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.574 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.574 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.574 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.574 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.574 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:59.575 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.575 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.575 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.575 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:59.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:59.601648 10446 tablet.cc:2406] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:34:59.614 [DEBUG - pool-444-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.6.245.60:46787, [6ms] received response from server master-127.6.245.60:46787: OK, deferred=null) with no deferred attached!
18:34:59.614 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:59.614 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:59.614 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:59.615 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.615 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.615 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.615 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.615 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.615 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.616 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.616 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.616 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.616 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:59.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:34:59.633039 10612 tablet.cc:2406] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:34:59.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.638538 10678 raft_consensus.cc:493] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:34:59.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.639209 10678 raft_consensus.cc:515] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } }
18:34:59.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.643154 10467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc271ac084814e3c8dd50b755ec7badb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59a352fb28734817802dc1543d2a2069" is_pre_election: true
18:34:59.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.644096 10467 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc271ac084814e3c8dd50b755ec7badb in term 0.
18:34:59.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.646133 10678 leader_election.cc:290] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59a352fb28734817802dc1543d2a2069 (127.10.26.254:36869), bdaac99ecb9d4a919c23a781d44e5500 (127.10.26.253:36107)
18:34:59.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.645812 10607 leader_election.cc:304] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59a352fb28734817802dc1543d2a2069, fc271ac084814e3c8dd50b755ec7badb; no voters: 
18:34:59.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.648983 10678 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [term 0 FOLLOWER]: Leader pre-election won for term 1
18:34:59.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.649354 10678 raft_consensus.cc:493] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:34:59.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.649683 10678 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [term 0 FOLLOWER]: Advancing to term 1
18:34:59.654 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:59.654 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:59.654 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:59.655 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.655 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.655 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.655 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.655 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.655 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.655 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.655 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.656 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.656 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:59.656 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:59.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.656988 10678 raft_consensus.cc:515] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } }
18:34:59.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.659754 10467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc271ac084814e3c8dd50b755ec7badb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59a352fb28734817802dc1543d2a2069"
18:34:59.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.660303 10467 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069 [term 0 FOLLOWER]: Advancing to term 1
18:34:59.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.668294 10467 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc271ac084814e3c8dd50b755ec7badb in term 1.
18:34:59.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.670969 10678 leader_election.cc:290] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [CANDIDATE]: Term 1 election: Requested vote from peers 59a352fb28734817802dc1543d2a2069 (127.10.26.254:36869), bdaac99ecb9d4a919c23a781d44e5500 (127.10.26.253:36107)
18:34:59.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.672863 10607 leader_election.cc:304] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59a352fb28734817802dc1543d2a2069, fc271ac084814e3c8dd50b755ec7badb; no voters: 
18:34:59.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.673715 10678 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [term 1 FOLLOWER]: Leader election won for term 1
18:34:59.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.685050 10678 raft_consensus.cc:697] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [term 1 LEADER]: Becoming Leader. State: Replica: fc271ac084814e3c8dd50b755ec7badb, State: Running, Role: LEADER
18:34:59.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.686838 10678 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } }
18:34:59.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.718070 10713 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc271ac084814e3c8dd50b755ec7badb. Latest consensus state: current_term: 1 leader_uuid: "fc271ac084814e3c8dd50b755ec7badb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } } }
18:34:59.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.723459 10713 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [sys.catalog]: This master's current role is: LEADER
18:34:59.734 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:59.734 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:59.734 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:59.734 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.734 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.734 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.735 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.735 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.735 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.734 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.735 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.735 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.735 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:59.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.739030 10715 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:34:59.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.746872 10715 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:34:59.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:59.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.784152 10467 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069 [term 1 FOLLOWER]: Refusing update from remote peer fc271ac084814e3c8dd50b755ec7badb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:34:59.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.785851 10713 consensus_queue.cc:1048] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [LEADER]: Connected to new peer: Peer: permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:34:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.832237 10667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc271ac084814e3c8dd50b755ec7badb. Latest consensus state: current_term: 1 leader_uuid: "fc271ac084814e3c8dd50b755ec7badb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } } }
18:34:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.832911 10667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069 [sys.catalog]: This master's current role is: FOLLOWER
18:34:59.838 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:34:59.838 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:34:59.838 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:34:59.839 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:59.839 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:59.839 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:34:59.839 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:59.839 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:59.839 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:34:59.839 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:59.839 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:59.839 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:34:59.839 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:34:59.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.840408 10717 mvcc.cc:204] Tried to move back new op lower bound from 7305362226290442240 to 7305362225959763968. Current Snapshot: MvccSnapshot[applied={T|T < 7305362226290442240}]
18:34:59.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.848685 10667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fc271ac084814e3c8dd50b755ec7badb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } } }
18:34:59.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.849371 10667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069 [sys.catalog]: This master's current role is: FOLLOWER
18:34:59.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.849018 10678 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fc271ac084814e3c8dd50b755ec7badb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } } }
18:34:59.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.849699 10678 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [sys.catalog]: This master's current role is: LEADER
18:34:59.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.854295 10715 catalog_manager.cc:1382] Generated new cluster ID: 783e1b784a8943e9b46db9a83dc4e04d
18:34:59.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.854600 10715 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:34:59.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.895933 10715 catalog_manager.cc:1405] Generated new certificate authority record
18:34:59.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.898276 10715 catalog_manager.cc:1539] Loading token signing keys...
18:34:59.903 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:34:59.913 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:59.914 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:59.914 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:59.914 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.914 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.915 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.915 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.915 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.915 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.915 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.915 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.915 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.915 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:34:59.923 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:34:59.923 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:34:59.923 [DEBUG - pool-508-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:34:59.924 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:59.924 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:59.924 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:34:59.924 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:59.924 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:59.924 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:34:59.925 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:59.925 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:59.925 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:34:59.925 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:34:59.925 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29695), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [6ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [7ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [7ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [7ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [25ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [27ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [28ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [28ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [49ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [50ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [51ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [60ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [61ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [61ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [61ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [81ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [81ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [81ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [81ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [121ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [121ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [141ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [142ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [280ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [281ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [281ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [281ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [481ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [481ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [661ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [662ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [662ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1340ms] refreshing cache from master, [1340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [1340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [1340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [1341ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [1341ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [1341ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [1341ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2640ms] refreshing cache from master, [2640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [2641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [2641ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.125:40423: Network error: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423, [2641ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.126:33747: Network error: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747, [2642ms] Sub RPC ConnectToMaster: received response from server master-127.30.195.124:38627: Network error: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [2642ms] delaying RPC due to: Service unavailable: Master config (127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627, [3640ms] refreshing cache from master, [3640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.125:40423, [3640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.124:38627, [3640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.195.126:33747, [3640ms] too many traces: truncated at 100 traces, deferred=Deferred@560280950(state=PENDING, result=null, callback=(continuation of Deferred@271556916 after retry RPC after error@343691603) -> (continuation of Deferred@1055296171 after retry RPC after error@916506244) -> (continuation of Deferred@1542190949 after retry RPC after error@770429826) -> (continuation of Deferred@659732294 after retry RPC after error@393658830) -> (continuation of Deferred@329407642 after retry RPC after error@1621551791) -> (continuation of Deferred@1392281978 after retry RPC after error@1940216410) -> (continuation of Deferred@1927450168 after retry RPC after error@625406297) -> (continuation of Deferred@331811794 after retry RPC after error@1248453754) -> (continuation of Deferred@740044865 after retry RPC after error@1044566178) -> (continuation of Deferred@359716131 after retry RPC after error@272611779) -> (continuation of Deferred@1575751101 after retry RPC after error@1963135330) -> (continuation of Deferred@1724455724 after retry RPC after error@190142359) -> (continuation of Deferred@912859813 after retry RPC after error@1527557387) -> (continuation of Deferred@1974656317 after retry RPC after error@1417336307) -> (continuation of Deferred@729393619 after retry RPC after error@363019586) -> (continuation of Deferred@1981497854 after retry RPC after error@1951192963) -> (continuation of Deferred@312332264 after retry RPC after error@509127124) -> (continuation of Deferred@853548880 after retry RPC after error@545400384) -> (continuation of Deferred@1553751863 after retry RPC after error@131156857) -> (continuation of Deferred@905563724 after retry RPC after error@83386005) -> (continuation of Deferred@975424730 after retry RPC after error@925155940) -> (continuation of Deferred@1280635234 after retry RPC after error@169738891), errback=(continuation of Deferred@271556916 after retry RPC after error@343691603) -> (continuation of Deferred@1055296171 after retry RPC after error@916506244) -> (continuation of Deferred@1542190949 after retry RPC after error@770429826) -> (continuation of Deferred@659732294 after retry RPC after error@393658830) -> (continuation of Deferred@329407642 after retry RPC after error@1621551791) -> (continuation of Deferred@1392281978 after retry RPC after error@1940216410) -> (continuation of Deferred@1927450168 after retry RPC after error@625406297) -> (continuation of Deferred@331811794 after retry RPC after error@1248453754) -> (continuation of Deferred@740044865 after retry RPC after error@1044566178) -> (continuation of Deferred@359716131 after retry RPC after error@272611779) -> (continuation of Deferred@1575751101 after retry RPC after error@1963135330) -> (continuation of Deferred@1724455724 after retry RPC after error@190142359) -> (continuation of Deferred@912859813 after retry RPC after error@1527557387) -> (continuation of Deferred@1974656317 after retry RPC after error@1417336307) -> (continuation of Deferred@729393619 after retry RPC after error@363019586) -> (continuation of Deferred@1981497854 after retry RPC after error@1951192963) -> (continuation of Deferred@312332264 after retry RPC after error@509127124) -> (continuation of Deferred@853548880 after retry RPC after error@545400384) -> (continuation of Deferred@1553751863 after retry RPC after error@131156857) -> (continuation of Deferred@905563724 after retry RPC after error@83386005) -> (continuation of Deferred@975424730 after retry RPC after error@925155940) -> (continuation of Deferred@1280635234 after retry RPC after error@169738891)))
18:34:59.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.933439 10715 catalog_manager.cc:6069] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb: Generated new TSK 0
18:34:59.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.934544 10715 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:34:59.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:34:59.952399 10347 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:59.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/wal
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/data
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/logs
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/data/info.pb
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.26.193:0
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.26.193
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.26.193
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.26.254:36869,127.10.26.253:36107,127.10.26.252:40435
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.26.212:43597
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:34:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:34:59.987 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:34:59.987 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:34:59.987 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:34:59.988 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:59.988 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:59.988 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:34:59.988 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:59.988 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:59.988 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:34:59.988 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:59.989 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:59.989 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:34:59.989 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:34:59.993 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:34:59.994 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:34:59.994 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:34:59.994 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.994 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.994 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:34:59.994 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.995 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.995 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:34:59.995 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.995 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.995 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:34:59.995 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:00.019 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:00.020 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:00.020 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:00.023 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:00.023 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:00.023 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:00.023 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:00.023 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:00.023 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:00.024 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:00.024 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:00.024 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:00.024 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:00.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:00.105747 10184 debug-util.cc:398] Leaking SignalData structure 0x7b08000adfc0 after lost signal to thread 10058
18:35:00.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:00.107450 10184 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad660 after lost signal to thread 10187
18:35:00.156 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:00.163 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:00.163 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:00.163 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:00.163 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:00.164 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:00.164 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:00.164 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:00.164 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:00.164 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:00.164 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:00.164 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:00.164 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:00.164 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:00.183 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:00.183 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:00.183 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:00.184 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:00.184 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:00.184 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:00.184 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:00.184 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:00.184 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:00.185 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:00.185 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:00.185 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:00.185 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:00.214 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:00.215 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:00.215 [DEBUG - pool-444-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:00.215 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:00.215 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:00.215 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:00.216 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:00.216 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:00.216 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:00.216 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:00.216 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:00.216 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:00.216 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:00.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:00.362 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:00.362 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:00.362 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:00.362 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:00.362 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:00.363 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:00.363 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:00.363 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:00.363 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:00.363 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:00.363 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:00.363 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:00.363 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:00.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:00.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:00.441742 10679 catalog_manager.cc:1294] Loaded cluster ID: 783e1b784a8943e9b46db9a83dc4e04d
18:35:00.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:00.442061 10679 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069: loading cluster ID for follower catalog manager: success
18:35:00.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:00.456027 10679 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069: acquiring CA information for follower catalog manager: success
18:35:00.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:00.469426 10679 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 59a352fb28734817802dc1543d2a2069: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:35:00.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:00.509730 10721 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:35:00.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:00.510457 10721 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:35:00.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:00.511282 10721 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:35:00.544 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (41f18052e8363382138bde77e16b10c3) switched from state RESTARTING to RUNNING.
18:35:00.545 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 41f18052e8363382138bde77e16b10c3 from Checkpoint 70 @ 1783535699333 for 41f18052e8363382138bde77e16b10c3 located at file:/tmp/junit14319925403673159781/checkpoints/41f18052e8363382138bde77e16b10c3/chk-70.
18:35:00.546 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
18:35:00.546 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:35:00.564 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
18:35:00.566 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
18:35:00.566 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 18348981-93aa-4f9b-8ccb-9c57cd0bda38 @ 127.0.0.1 (dataPort=-1) with allocation id 7a0ffa37add86fcce9866592db26034c
18:35:00.566 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
18:35:00.566 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 7a0ffa37add86fcce9866592db26034c.
18:35:00.567 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 41f18052e8363382138bde77e16b10c3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:35:00.567 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 41f18052e8363382138bde77e16b10c3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:35:00.567 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 7a0ffa37add86fcce9866592db26034c.
18:35:00.569 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
18:35:00.569 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 18348981-93aa-4f9b-8ccb-9c57cd0bda38 @ 127.0.0.1 (dataPort=-1) with allocation id 6fa98963f3433621a126e6db77ad5f3b
18:35:00.571 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
18:35:00.572 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 41f18052e8363382138bde77e16b10c3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:35:00.574 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
18:35:00.574 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id 5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 18348981-93aa-4f9b-8ccb-9c57cd0bda38 @ 127.0.0.1 (dataPort=-1) with allocation id 3ab80748f81d56605b604d6b67a52227
18:35:00.575 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 6fa98963f3433621a126e6db77ad5f3b.
18:35:00.576 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
18:35:00.576 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
18:35:00.577 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1e32f08e
18:35:00.577 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:00.577 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id 6fa98963f3433621a126e6db77ad5f3b.
18:35:00.578 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit14319925403673159781/checkpoints")
18:35:00.578 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
18:35:00.581 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
18:35:00.585 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 41f18052e8363382138bde77e16b10c3: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:35:00.586 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@557a93c8
18:35:00.586 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
18:35:00.587 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id 5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 18348981-93aa-4f9b-8ccb-9c57cd0bda38 @ 127.0.0.1 (dataPort=-1) with allocation id 1fb92e44b6a0ec833400217bb7150056
18:35:00.588 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
18:35:00.588 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:00.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:00.590302 10721 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:35:00.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:00.592118 10721 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.26.193
18:35:00.606 [INFO - Thread-72] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:35:00.607 [DEBUG - Thread-72] (Connection.java:575) [peer master-127.6.245.62:36853(127.6.245.62:36853)] disconnecting while in state TERMINATED
18:35:00.608 [DEBUG - Thread-72] (Connection.java:575) [peer master-127.6.245.60:46787(127.6.245.60:46787)] disconnecting while in state TERMINATED
18:35:00.609 [DEBUG - Thread-72] (Connection.java:575) [peer master-127.6.245.61:44495(127.6.245.61:44495)] disconnecting while in state TERMINATED
18:35:00.610 [DEBUG - Thread-72] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:35:00.612 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
18:35:00.613 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
18:35:00.613 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
18:35:00.616 [INFO - Thread-72] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:35:00.617 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 3ab80748f81d56605b604d6b67a52227.
18:35:00.618 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 3ab80748f81d56605b604d6b67a52227.
18:35:00.621 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
18:35:00.622 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
18:35:00.622 [INFO - Thread-72] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:35:00.626 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:00.625 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:00.628 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:00.628 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:00.629 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:00.629 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:00.629 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:00.629 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:00.629 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:00.629 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:00.629 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:00.629 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:00.629 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:00.629 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:00.641 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2213fe01
18:35:00.642 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:00.645 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit14319925403673159781/checkpoints")
18:35:00.656 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:00.655 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
18:35:00.660 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
18:35:00.669 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 1fb92e44b6a0ec833400217bb7150056.
18:35:00.670 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id 1fb92e44b6a0ec833400217bb7150056.
18:35:00.671 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
18:35:00.671 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
18:35:00.672 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3f640b1e
18:35:00.672 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:00.672 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit14319925403673159781/checkpoints")
18:35:00.672 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
18:35:00.672 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
18:35:00.676 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:00.679 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@240983a7
18:35:00.681 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:00.684 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:00.696 [DEBUG - Thread-72] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:00.703 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.703 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.703 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.704 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:00.700668 10721 tablet_server_runner.cc:78] Tablet server non-default flags:
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.26.212:43597
18:35:00.704 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.704 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.704 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/data
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/wal
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.26.193:0
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/data/info.pb
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.26.193
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.26.254:36869,127.10.26.253:36107,127.10.26.252:40435
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:35:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:35:00.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:35:00.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.26.193
18:35:00.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/logs
18:35:00.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:35:00.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:35:00.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:35:00.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:35:00.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:35:00.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:35:00.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:35:00.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:35:00.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:35:00.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:35:00.705 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.705 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.705 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:00.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:00.711176 10721 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:35:00.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:00.713521 10721 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:35:00.714 [INFO - Thread-72] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:35:00.715 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
18:35:00.715 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
18:35:00.715 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3cdcd33a
18:35:00.715 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:00.718 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit14319925403673159781/checkpoints")
18:35:00.718 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
18:35:00.718 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (5d44d8e07885a93bb0f8ac0099104fe1_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
18:35:00.723 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:00.725 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:00.726 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@620dc13f
18:35:00.728 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:00.728 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.728 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.728 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.731 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:00.739 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3c0a4cc4
18:35:00.742 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:00.740 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:35:00.743 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:35:00.743 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:35:00.743 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:35:00.747 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:00.748 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.748 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.748 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.748 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:00.748 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:00.749 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:00.749 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:00.749 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:00.749 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:00.749 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:00.749 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:00.749 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:00.749 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:00.749 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:00.749 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:00.749 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:00.755 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:00.755 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.755 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.756 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:00.756 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:00.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:00.766448 10744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:35:00.775 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:00.776 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.776 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.776 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.777 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.777 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.777 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.777 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:00.784 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.784 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.784 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.784 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:00.785 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:00.789 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:00.790 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.790 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.790 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.792 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:00.799 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:00.803 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:00.804 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:00.804 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.804 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.804 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.804 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:00.805 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.805 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.805 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.805 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.805 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.805 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.805 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:00.818 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:00.818 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:00.818 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:00.819 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.819 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.819 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.819 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.819 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.819 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.820 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.820 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.820 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.820 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:00.821 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26822), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [29ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [70ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [70ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [96ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [109ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [119ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [119ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [127ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [128ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [128ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [128ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [143ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [162ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [163ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [163ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [163ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [203ms] refreshing cache from master, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [204ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [204ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [205ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [205ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [205ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [243ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [303ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [303ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [481ms] refreshing cache from master, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [483ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [484ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [484ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [485ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [485ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [662ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [663ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [663ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [663ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1183ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2181ms] refreshing cache from master, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2183ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2183ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2184ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [3324ms] refreshing cache from master, [3324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [3324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [3324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [3328ms] too many traces: truncated at 100 traces, deferred=Deferred@1332056413(state=PENDING, result=null, callback=(continuation of Deferred@1045779338 after retry RPC after error@1451548874) -> (continuation of Deferred@2049612270 after retry RPC after error@430309519) -> (continuation of Deferred@234604850 after retry RPC after error@2080959223) -> (continuation of Deferred@1388575089 after retry RPC after error@2068330974) -> (continuation of Deferred@682216924 after retry RPC after error@323868012) -> (continuation of Deferred@1586015749 after retry RPC after error@1689582275) -> (continuation of Deferred@43326628 after retry RPC after error@2131648303) -> (continuation of Deferred@1684880973 after retry RPC after error@667726561) -> (continuation of Deferred@227994240 after retry RPC after error@15477562) -> (continuation of Deferred@226419260 after retry RPC after error@1340539592) -> (continuation of Deferred@1964979038 after retry RPC after error@348873532) -> (continuation of Deferred@1851661467 after retry RPC after error@425239258) -> (continuation of Deferred@366081900 after retry RPC after error@1523364969) -> (continuation of Deferred@1156104559 after retry RPC after error@419095898) -> (continuation of Deferred@42601406 after retry RPC after error@1037731962) -> (continuation of Deferred@1069270295 after retry RPC after error@1881417615) -> (continuation of Deferred@572589518 after retry RPC after error@1272041640) -> (continuation of Deferred@715335608 after retry RPC after error@2078958908) -> (continuation of Deferred@1364136186 after retry RPC after error@341757675) -> (continuation of Deferred@670278975 after retry RPC after error@253294456) -> (continuation of Deferred@645525153 after retry RPC after error@1144149267) -> (continuation of Deferred@2127747831 after retry RPC after error@909721954) -> (continuation of Deferred@1608297954 after retry RPC after error@160489927), errback=(continuation of Deferred@1045779338 after retry RPC after error@1451548874) -> (continuation of Deferred@2049612270 after retry RPC after error@430309519) -> (continuation of Deferred@234604850 after retry RPC after error@2080959223) -> (continuation of Deferred@1388575089 after retry RPC after error@2068330974) -> (continuation of Deferred@682216924 after retry RPC after error@323868012) -> (continuation of Deferred@1586015749 after retry RPC after error@1689582275) -> (continuation of Deferred@43326628 after retry RPC after error@2131648303) -> (continuation of Deferred@1684880973 after retry RPC after error@667726561) -> (continuation of Deferred@227994240 after retry RPC after error@15477562) -> (continuation of Deferred@226419260 after retry RPC after error@1340539592) -> (continuation of Deferred@1964979038 after retry RPC after error@348873532) -> (continuation of Deferred@1851661467 after retry RPC after error@425239258) -> (continuation of Deferred@366081900 after retry RPC after error@1523364969) -> (continuation of Deferred@1156104559 after retry RPC after error@419095898) -> (continuation of Deferred@42601406 after retry RPC after error@1037731962) -> (continuation of Deferred@1069270295 after retry RPC after error@1881417615) -> (continuation of Deferred@572589518 after retry RPC after error@1272041640) -> (continuation of Deferred@715335608 after retry RPC after error@2078958908) -> (continuation of Deferred@1364136186 after retry RPC after error@341757675) -> (continuation of Deferred@670278975 after retry RPC after error@253294456) -> (continuation of Deferred@645525153 after retry RPC after error@1144149267) -> (continuation of Deferred@2127747831 after retry RPC after error@909721954) -> (continuation of Deferred@1608297954 after retry RPC after error@160489927)))
18:35:00.821 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:00.821 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:00.821 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:00.822 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.822 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.822 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.822 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26822), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [29ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [70ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [70ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [96ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [109ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [119ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [119ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [127ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [128ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [128ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [128ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [143ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [162ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [163ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [163ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [163ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [203ms] refreshing cache from master, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [204ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [204ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [205ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [205ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [205ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [243ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [303ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [303ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [481ms] refreshing cache from master, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [483ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [484ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [484ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [485ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [485ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [662ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [663ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [663ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [663ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1183ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2181ms] refreshing cache from master, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2183ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2183ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2184ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [3324ms] refreshing cache from master, [3324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [3324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [3324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [3328ms] too many traces: truncated at 100 traces, deferred=Deferred@1332056413(state=PENDING, result=null, callback=(continuation of Deferred@1045779338 after retry RPC after error@1451548874) -> (continuation of Deferred@2049612270 after retry RPC after error@430309519) -> (continuation of Deferred@234604850 after retry RPC after error@2080959223) -> (continuation of Deferred@1388575089 after retry RPC after error@2068330974) -> (continuation of Deferred@682216924 after retry RPC after error@323868012) -> (continuation of Deferred@1586015749 after retry RPC after error@1689582275) -> (continuation of Deferred@43326628 after retry RPC after error@2131648303) -> (continuation of Deferred@1684880973 after retry RPC after error@667726561) -> (continuation of Deferred@227994240 after retry RPC after error@15477562) -> (continuation of Deferred@226419260 after retry RPC after error@1340539592) -> (continuation of Deferred@1964979038 after retry RPC after error@348873532) -> (continuation of Deferred@1851661467 after retry RPC after error@425239258) -> (continuation of Deferred@366081900 after retry RPC after error@1523364969) -> (continuation of Deferred@1156104559 after retry RPC after error@419095898) -> (continuation of Deferred@42601406 after retry RPC after error@1037731962) -> (continuation of Deferred@1069270295 after retry RPC after error@1881417615) -> (continuation of Deferred@572589518 after retry RPC after error@1272041640) -> (continuation of Deferred@715335608 after retry RPC after error@2078958908) -> (continuation of Deferred@1364136186 after retry RPC after error@341757675) -> (continuation of Deferred@670278975 after retry RPC after error@253294456) -> (continuation of Deferred@645525153 after retry RPC after error@1144149267) -> (continuation of Deferred@2127747831 after retry RPC after error@909721954) -> (continuation of Deferred@1608297954 after retry RPC after error@160489927), errback=(continuation of Deferred@1045779338 after retry RPC after error@1451548874) -> (continuation of Deferred@2049612270 after retry RPC after error@430309519) -> (continuation of Deferred@234604850 after retry RPC after error@2080959223) -> (continuation of Deferred@1388575089 after retry RPC after error@2068330974) -> (continuation of Deferred@682216924 after retry RPC after error@323868012) -> (continuation of Deferred@1586015749 after retry RPC after error@1689582275) -> (continuation of Deferred@43326628 after retry RPC after error@2131648303) -> (continuation of Deferred@1684880973 after retry RPC after error@667726561) -> (continuation of Deferred@227994240 after retry RPC after error@15477562) -> (continuation of Deferred@226419260 after retry RPC after error@1340539592) -> (continuation of Deferred@1964979038 after retry RPC after error@348873532) -> (continuation of Deferred@1851661467 after retry RPC after error@425239258) -> (continuation of Deferred@366081900 after retry RPC after error@1523364969) -> (continuation of Deferred@1156104559 after retry RPC after error@419095898) -> (continuation of Deferred@42601406 after retry RPC after error@1037731962) -> (continuation of Deferred@1069270295 after retry RPC after error@1881417615) -> (continuation of Deferred@572589518 after retry RPC after error@1272041640) -> (continuation of Deferred@715335608 after retry RPC after error@2078958908) -> (continuation of Deferred@1364136186 after retry RPC after error@341757675) -> (continuation of Deferred@670278975 after retry RPC after error@253294456) -> (continuation of Deferred@645525153 after retry RPC after error@1144149267) -> (continuation of Deferred@2127747831 after retry RPC after error@909721954) -> (continuation of Deferred@1608297954 after retry RPC after error@160489927)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26822), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [29ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [70ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [70ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [96ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [109ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [119ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [119ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [127ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [128ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [128ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [128ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [143ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [162ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [163ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [163ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [163ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [203ms] refreshing cache from master, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [204ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [204ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [205ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [205ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [205ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [243ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [303ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [303ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [481ms] refreshing cache from master, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [483ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [484ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [484ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [485ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [485ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [662ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [663ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [663ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [663ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1183ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2181ms] refreshing cache from master, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2183ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2183ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2184ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [3324ms] refreshing cache from master, [3324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [3324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [3324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [3328ms] too many traces: truncated at 100 traces, deferred=Deferred@1332056413(state=PENDING, result=null, callback=(continuation of Deferred@1045779338 after retry RPC after error@1451548874) -> (continuation of Deferred@2049612270 after retry RPC after error@430309519) -> (continuation of Deferred@234604850 after retry RPC after error@2080959223) -> (continuation of Deferred@1388575089 after retry RPC after error@2068330974) -> (continuation of Deferred@682216924 after retry RPC after error@323868012) -> (continuation of Deferred@1586015749 after retry RPC after error@1689582275) -> (continuation of Deferred@43326628 after retry RPC after error@2131648303) -> (continuation of Deferred@1684880973 after retry RPC after error@667726561) -> (continuation of Deferred@227994240 after retry RPC after error@15477562) -> (continuation of Deferred@226419260 after retry RPC after error@1340539592) -> (continuation of Deferred@1964979038 after retry RPC after error@348873532) -> (continuation of Deferred@1851661467 after retry RPC after error@425239258) -> (continuation of Deferred@366081900 after retry RPC after error@1523364969) -> (continuation of Deferred@1156104559 after retry RPC after error@419095898) -> (continuation of Deferred@42601406 after retry RPC after error@1037731962) -> (continuation of Deferred@1069270295 after retry RPC after error@1881417615) -> (continuation of Deferred@572589518 after retry RPC after error@1272041640) -> (continuation of Deferred@715335608 after retry RPC after error@2078958908) -> (continuation of Deferred@1364136186 after retry RPC after error@341757675) -> (continuation of Deferred@670278975 after retry RPC after error@253294456) -> (continuation of Deferred@645525153 after retry RPC after error@1144149267) -> (continuation of Deferred@2127747831 after retry RPC after error@909721954) -> (continuation of Deferred@1608297954 after retry RPC after error@160489927), errback=(continuation of Deferred@1045779338 after retry RPC after error@1451548874) -> (continuation of Deferred@2049612270 after retry RPC after error@430309519) -> (continuation of Deferred@234604850 after retry RPC after error@2080959223) -> (continuation of Deferred@1388575089 after retry RPC after error@2068330974) -> (continuation of Deferred@682216924 after retry RPC after error@323868012) -> (continuation of Deferred@1586015749 after retry RPC after error@1689582275) -> (continuation of Deferred@43326628 after retry RPC after error@2131648303) -> (continuation of Deferred@1684880973 after retry RPC after error@667726561) -> (continuation of Deferred@227994240 after retry RPC after error@15477562) -> (continuation of Deferred@226419260 after retry RPC after error@1340539592) -> (continuation of Deferred@1964979038 after retry RPC after error@348873532) -> (continuation of Deferred@1851661467 after retry RPC after error@425239258) -> (continuation of Deferred@366081900 after retry RPC after error@1523364969) -> (continuation of Deferred@1156104559 after retry RPC after error@419095898) -> (continuation of Deferred@42601406 after retry RPC after error@1037731962) -> (continuation of Deferred@1069270295 after retry RPC after error@1881417615) -> (continuation of Deferred@572589518 after retry RPC after error@1272041640) -> (continuation of Deferred@715335608 after retry RPC after error@2078958908) -> (continuation of Deferred@1364136186 after retry RPC after error@341757675) -> (continuation of Deferred@670278975 after retry RPC after error@253294456) -> (continuation of Deferred@645525153 after retry RPC after error@1144149267) -> (continuation of Deferred@2127747831 after retry RPC after error@909721954) -> (continuation of Deferred@1608297954 after retry RPC after error@160489927)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.0.106.252:46705
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:35:00.822 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.823 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.823 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.823 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.823 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.823 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.823 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:00.826 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:00.826 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:00.826 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:00.826 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.826 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.826 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.826 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.826 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.826 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.827 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.827 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.827 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.827 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:00.828 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26822), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [29ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [70ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [70ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [96ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [109ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [119ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [119ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [127ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [128ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [128ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [128ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [143ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [162ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [163ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [163ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [163ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [203ms] refreshing cache from master, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [204ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [204ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [205ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [205ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [205ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [243ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [303ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [303ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [481ms] refreshing cache from master, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [483ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [484ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [484ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [485ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [485ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [662ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [663ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [663ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [663ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1183ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2181ms] refreshing cache from master, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2183ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2183ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2184ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [3324ms] refreshing cache from master, [3324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [3324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [3324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [3328ms] too many traces: truncated at 100 traces, deferred=Deferred@1332056413(state=PENDING, result=null, callback=(continuation of Deferred@1045779338 after retry RPC after error@1451548874) -> (continuation of Deferred@2049612270 after retry RPC after error@430309519) -> (continuation of Deferred@234604850 after retry RPC after error@2080959223) -> (continuation of Deferred@1388575089 after retry RPC after error@2068330974) -> (continuation of Deferred@682216924 after retry RPC after error@323868012) -> (continuation of Deferred@1586015749 after retry RPC after error@1689582275) -> (continuation of Deferred@43326628 after retry RPC after error@2131648303) -> (continuation of Deferred@1684880973 after retry RPC after error@667726561) -> (continuation of Deferred@227994240 after retry RPC after error@15477562) -> (continuation of Deferred@226419260 after retry RPC after error@1340539592) -> (continuation of Deferred@1964979038 after retry RPC after error@348873532) -> (continuation of Deferred@1851661467 after retry RPC after error@425239258) -> (continuation of Deferred@366081900 after retry RPC after error@1523364969) -> (continuation of Deferred@1156104559 after retry RPC after error@419095898) -> (continuation of Deferred@42601406 after retry RPC after error@1037731962) -> (continuation of Deferred@1069270295 after retry RPC after error@1881417615) -> (continuation of Deferred@572589518 after retry RPC after error@1272041640) -> (continuation of Deferred@715335608 after retry RPC after error@2078958908) -> (continuation of Deferred@1364136186 after retry RPC after error@341757675) -> (continuation of Deferred@670278975 after retry RPC after error@253294456) -> (continuation of Deferred@645525153 after retry RPC after error@1144149267) -> (continuation of Deferred@2127747831 after retry RPC after error@909721954) -> (continuation of Deferred@1608297954 after retry RPC after error@160489927), errback=(continuation of Deferred@1045779338 after retry RPC after error@1451548874) -> (continuation of Deferred@2049612270 after retry RPC after error@430309519) -> (continuation of Deferred@234604850 after retry RPC after error@2080959223) -> (continuation of Deferred@1388575089 after retry RPC after error@2068330974) -> (continuation of Deferred@682216924 after retry RPC after error@323868012) -> (continuation of Deferred@1586015749 after retry RPC after error@1689582275) -> (continuation of Deferred@43326628 after retry RPC after error@2131648303) -> (continuation of Deferred@1684880973 after retry RPC after error@667726561) -> (continuation of Deferred@227994240 after retry RPC after error@15477562) -> (continuation of Deferred@226419260 after retry RPC after error@1340539592) -> (continuation of Deferred@1964979038 after retry RPC after error@348873532) -> (continuation of Deferred@1851661467 after retry RPC after error@425239258) -> (continuation of Deferred@366081900 after retry RPC after error@1523364969) -> (continuation of Deferred@1156104559 after retry RPC after error@419095898) -> (continuation of Deferred@42601406 after retry RPC after error@1037731962) -> (continuation of Deferred@1069270295 after retry RPC after error@1881417615) -> (continuation of Deferred@572589518 after retry RPC after error@1272041640) -> (continuation of Deferred@715335608 after retry RPC after error@2078958908) -> (continuation of Deferred@1364136186 after retry RPC after error@341757675) -> (continuation of Deferred@670278975 after retry RPC after error@253294456) -> (continuation of Deferred@645525153 after retry RPC after error@1144149267) -> (continuation of Deferred@2127747831 after retry RPC after error@909721954) -> (continuation of Deferred@1608297954 after retry RPC after error@160489927)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=26822), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [29ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [70ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [70ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [96ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [109ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [119ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [119ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [127ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [128ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [128ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [128ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [142ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [143ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [162ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [163ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [163ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [163ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [203ms] refreshing cache from master, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [204ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [204ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [205ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [205ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [205ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [243ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [243ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [302ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [303ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [303ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [481ms] refreshing cache from master, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [483ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [484ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [484ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [485ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [485ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [662ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [663ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [663ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [663ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [1182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [1183ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2181ms] refreshing cache from master, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [2182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [2182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.254:32967: Network error: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967, [2183ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.253:45189: Network error: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189, [2183ms] Sub RPC ConnectToMaster: received response from server master-127.0.106.252:46705: Network error: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [2184ms] delaying RPC due to: Service unavailable: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705, [3324ms] refreshing cache from master, [3324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.254:32967, [3324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.253:45189, [3324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.106.252:46705, [3328ms] too many traces: truncated at 100 traces, deferred=Deferred@1332056413(state=PENDING, result=null, callback=(continuation of Deferred@1045779338 after retry RPC after error@1451548874) -> (continuation of Deferred@2049612270 after retry RPC after error@430309519) -> (continuation of Deferred@234604850 after retry RPC after error@2080959223) -> (continuation of Deferred@1388575089 after retry RPC after error@2068330974) -> (continuation of Deferred@682216924 after retry RPC after error@323868012) -> (continuation of Deferred@1586015749 after retry RPC after error@1689582275) -> (continuation of Deferred@43326628 after retry RPC after error@2131648303) -> (continuation of Deferred@1684880973 after retry RPC after error@667726561) -> (continuation of Deferred@227994240 after retry RPC after error@15477562) -> (continuation of Deferred@226419260 after retry RPC after error@1340539592) -> (continuation of Deferred@1964979038 after retry RPC after error@348873532) -> (continuation of Deferred@1851661467 after retry RPC after error@425239258) -> (continuation of Deferred@366081900 after retry RPC after error@1523364969) -> (continuation of Deferred@1156104559 after retry RPC after error@419095898) -> (continuation of Deferred@42601406 after retry RPC after error@1037731962) -> (continuation of Deferred@1069270295 after retry RPC after error@1881417615) -> (continuation of Deferred@572589518 after retry RPC after error@1272041640) -> (continuation of Deferred@715335608 after retry RPC after error@2078958908) -> (continuation of Deferred@1364136186 after retry RPC after error@341757675) -> (continuation of Deferred@670278975 after retry RPC after error@253294456) -> (continuation of Deferred@645525153 after retry RPC after error@1144149267) -> (continuation of Deferred@2127747831 after retry RPC after error@909721954) -> (continuation of Deferred@1608297954 after retry RPC after error@160489927), errback=(continuation of Deferred@1045779338 after retry RPC after error@1451548874) -> (continuation of Deferred@2049612270 after retry RPC after error@430309519) -> (continuation of Deferred@234604850 after retry RPC after error@2080959223) -> (continuation of Deferred@1388575089 after retry RPC after error@2068330974) -> (continuation of Deferred@682216924 after retry RPC after error@323868012) -> (continuation of Deferred@1586015749 after retry RPC after error@1689582275) -> (continuation of Deferred@43326628 after retry RPC after error@2131648303) -> (continuation of Deferred@1684880973 after retry RPC after error@667726561) -> (continuation of Deferred@227994240 after retry RPC after error@15477562) -> (continuation of Deferred@226419260 after retry RPC after error@1340539592) -> (continuation of Deferred@1964979038 after retry RPC after error@348873532) -> (continuation of Deferred@1851661467 after retry RPC after error@425239258) -> (continuation of Deferred@366081900 after retry RPC after error@1523364969) -> (continuation of Deferred@1156104559 after retry RPC after error@419095898) -> (continuation of Deferred@42601406 after retry RPC after error@1037731962) -> (continuation of Deferred@1069270295 after retry RPC after error@1881417615) -> (continuation of Deferred@572589518 after retry RPC after error@1272041640) -> (continuation of Deferred@715335608 after retry RPC after error@2078958908) -> (continuation of Deferred@1364136186 after retry RPC after error@341757675) -> (continuation of Deferred@670278975 after retry RPC after error@253294456) -> (continuation of Deferred@645525153 after retry RPC after error@1144149267) -> (continuation of Deferred@2127747831 after retry RPC after error@909721954) -> (continuation of Deferred@1608297954 after retry RPC after error@160489927)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.0.106.252:46705
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:35:00.829 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:35:00.829 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9) switched from state RUNNING to RESTARTING.
18:35:00.829 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#6) of source Source: KuduSource.
18:35:00.829 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to CANCELING.
18:35:00.830 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_6).
18:35:00.830 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to CANCELING.
18:35:00.830 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_6).
18:35:00.830 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#6) of source Source: KuduSource.
18:35:00.830 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from INITIALIZING to CANCELING.
18:35:00.830 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#6) of source Source: KuduSource.
18:35:00.830 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to CANCELING.
18:35:00.830 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#6) of source Source: KuduSource.
18:35:00.831 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to CANCELING.
18:35:00.838 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:00.838 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:00.838 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:00.838 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.838 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.839 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.839 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.839 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.839 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.839 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.839 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.839 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.839 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:00.843 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:00.843 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:00.843 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:00.843 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:00.843 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:00.843 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:00.843 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:00.844 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:00.844 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:00.844 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:00.844 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:00.844 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:00.844 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:00.846 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:00.846 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:00.846 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:00.847 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.847 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.847 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.847 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.847 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.847 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.847 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.847 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.847 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.848 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:00.851 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:00.858 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:00.859 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:00.859 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:00.859 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.859 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.859 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.859 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:00.860 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.860 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.860 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.860 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.860 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.860 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.860 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:00.860 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:00.860 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:00.860 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:00.866 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:00.866 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:00.866 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:00.867 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:00.867 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:00.867 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:00.867 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:00.867 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:00.867 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:00.867 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:00.867 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:00.867 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:00.868 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:00.868 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:00.868 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.868 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.868 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.871 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.871 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.872 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.872 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:00.876 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:00.878 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:00.878 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:00.878 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:00.879 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.879 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.879 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.879 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.879 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.879 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.880 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.880 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.880 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.880 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:00.886 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:00.886 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:00.886 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:00.886 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.886 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.886 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.886 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.887 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.887 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.887 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.887 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.887 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.887 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:00.894 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:00.894 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:00.894 [DEBUG - pool-514-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:00.895 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:00.895 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:00.895 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:00.895 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:00.895 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:00.895 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:00.896 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:00.896 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:00.896 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:00.896 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:00.896 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26880), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [12ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [13ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [15ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [15ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [40ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [46ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [52ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [52ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [81ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [103ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [106ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [106ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [121ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [122ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [141ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [141ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [141ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [141ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [194ms] refreshing cache from master, [194ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [194ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [195ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [195ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [196ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [196ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [196ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [203ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [203ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [323ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [323ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [403ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [403ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [842ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [842ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [843ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [843ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1160ms] refreshing cache from master, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1162ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [3100ms] refreshing cache from master, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [3101ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [3103ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [4981ms] refreshing cache from master, [4981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [4981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [4982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [4982ms] too many traces: truncated at 100 traces, deferred=Deferred@310459211(state=PENDING, result=null, callback=(continuation of Deferred@1988886487 after retry RPC after error@732557367) -> (continuation of Deferred@1720376795 after retry RPC after error@2110449954) -> (continuation of Deferred@1419170827 after retry RPC after error@819642086) -> (continuation of Deferred@9361699 after retry RPC after error@707240937) -> (continuation of Deferred@1223892010 after retry RPC after error@758883932) -> (continuation of Deferred@1527391513 after retry RPC after error@1277558138) -> (continuation of Deferred@476555928 after retry RPC after error@1822352910) -> (continuation of Deferred@1723217001 after retry RPC after error@85707752) -> (continuation of Deferred@604603065 after retry RPC after error@1069330080) -> (continuation of Deferred@1761529922 after retry RPC after error@870384190) -> (continuation of Deferred@1528119985 after retry RPC after error@25571037) -> (continuation of Deferred@535073391 after retry RPC after error@615486303) -> (continuation of Deferred@1432243633 after retry RPC after error@1704882433) -> (continuation of Deferred@1590878263 after retry RPC after error@104838617) -> (continuation of Deferred@564876138 after retry RPC after error@925579303) -> (continuation of Deferred@2117182893 after retry RPC after error@98256591) -> (continuation of Deferred@2123396381 after retry RPC after error@278171880) -> (continuation of Deferred@1669026714 after retry RPC after error@1011452932) -> (continuation of Deferred@1099709965 after retry RPC after error@1974203652) -> (continuation of Deferred@1291165608 after retry RPC after error@1009517470) -> (continuation of Deferred@477113920 after retry RPC after error@911866655) -> (continuation of Deferred@1446062755 after retry RPC after error@173925128), errback=(continuation of Deferred@1988886487 after retry RPC after error@732557367) -> (continuation of Deferred@1720376795 after retry RPC after error@2110449954) -> (continuation of Deferred@1419170827 after retry RPC after error@819642086) -> (continuation of Deferred@9361699 after retry RPC after error@707240937) -> (continuation of Deferred@1223892010 after retry RPC after error@758883932) -> (continuation of Deferred@1527391513 after retry RPC after error@1277558138) -> (continuation of Deferred@476555928 after retry RPC after error@1822352910) -> (continuation of Deferred@1723217001 after retry RPC after error@85707752) -> (continuation of Deferred@604603065 after retry RPC after error@1069330080) -> (continuation of Deferred@1761529922 after retry RPC after error@870384190) -> (continuation of Deferred@1528119985 after retry RPC after error@25571037) -> (continuation of Deferred@535073391 after retry RPC after error@615486303) -> (continuation of Deferred@1432243633 after retry RPC after error@1704882433) -> (continuation of Deferred@1590878263 after retry RPC after error@104838617) -> (continuation of Deferred@564876138 after retry RPC after error@925579303) -> (continuation of Deferred@2117182893 after retry RPC after error@98256591) -> (continuation of Deferred@2123396381 after retry RPC after error@278171880) -> (continuation of Deferred@1669026714 after retry RPC after error@1011452932) -> (continuation of Deferred@1099709965 after retry RPC after error@1974203652) -> (continuation of Deferred@1291165608 after retry RPC after error@1009517470) -> (continuation of Deferred@477113920 after retry RPC after error@911866655) -> (continuation of Deferred@1446062755 after retry RPC after error@173925128)))
18:35:00.898 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:00.898 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:00.898 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:00.898 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
18:35:00.899 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.899 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.899 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.899 [WARN - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26880), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [12ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [13ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [15ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [15ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [40ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [46ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [52ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [52ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [81ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [103ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [106ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [106ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [121ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [122ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [141ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [141ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [141ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [141ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [194ms] refreshing cache from master, [194ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [194ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [195ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [195ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [196ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [196ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [196ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [202ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [203ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [203ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [322ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [323ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [323ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [403ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [403ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [841ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [842ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [842ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [843ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [843ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1160ms] refreshing cache from master, [1160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1162ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [3100ms] refreshing cache from master, [3100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [3101ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [3103ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [4981ms] refreshing cache from master, [4981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [4981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [4982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [4982ms] too many traces: truncated at 100 traces, deferred=Deferred@310459211(state=PENDING, result=null, callback=(continuation of Deferred@1988886487 after retry RPC after error@732557367) -> (continuation of Deferred@1720376795 after retry RPC after error@2110449954) -> (continuation of Deferred@1419170827 after retry RPC after error@819642086) -> (continuation of Deferred@9361699 after retry RPC after error@707240937) -> (continuation of Deferred@1223892010 after retry RPC after error@758883932) -> (continuation of Deferred@1527391513 after retry RPC after error@1277558138) -> (continuation of Deferred@476555928 after retry RPC after error@1822352910) -> (continuation of Deferred@1723217001 after retry RPC after error@85707752) -> (continuation of Deferred@604603065 after retry RPC after error@1069330080) -> (continuation of Deferred@1761529922 after retry RPC after error@870384190) -> (continuation of Deferred@1528119985 after retry RPC after error@25571037) -> (continuation of Deferred@535073391 after retry RPC after error@615486303) -> (continuation of Deferred@1432243633 after retry RPC after error@1704882433) -> (continuation of Deferred@1590878263 after retry RPC after error@104838617) -> (continuation of Deferred@564876138 after retry RPC after error@925579303) -> (continuation of Deferred@2117182893 after retry RPC after error@98256591) -> (continuation of Deferred@2123396381 after retry RPC after error@278171880) -> (continuation of Deferred@1669026714 after retry RPC after error@1011452932) -> (continuation of Deferred@1099709965 after retry RPC after error@1974203652) -> (continuation of Deferred@1291165608 after retry RPC after error@1009517470) -> (continuation of Deferred@477113920 after retry RPC after error@911866655) -> (continuation of Deferred@1446062755 after retry RPC after error@173925128), errback=(continuation of Deferred@1988886487 after retry RPC after error@732557367) -> (continuation of Deferred@1720376795 after retry RPC after error@2110449954) -> (continuation of Deferred@1419170827 after retry RPC after error@819642086) -> (continuation of Deferred@9361699 after retry RPC after error@707240937) -> (continuation of Deferred@1223892010 after retry RPC after error@758883932) -> (continuation of Deferred@1527391513 after retry RPC after error@1277558138) -> (continuation of Deferred@476555928 after retry RPC after error@1822352910) -> (continuation of Deferred@1723217001 after retry RPC after error@85707752) -> (continuation of Deferred@604603065 after retry RPC after error@1069330080) -> (continuation of Deferred@1761529922 after retry RPC after error@870384190) -> (continuation of Deferred@1528119985 after retry RPC after error@25571037) -> (continuation of Deferred@535073391 after retry RPC after error@615486303) -> (continuation of Deferred@1432243633 after retry RPC after error@1704882433) -> (continuation of Deferred@1590878263 after retry RPC after error@104838617) -> (continuation of Deferred@564876138 after retry RPC after error@925579303) -> (continuation of Deferred@2117182893 after retry RPC after error@98256591) -> (continuation of Deferred@2123396381 after retry RPC after error@278171880) -> (continuation of Deferred@1669026714 after retry RPC after error@1011452932) -> (continuation of Deferred@1099709965 after retry RPC after error@1974203652) -> (continuation of Deferred@1291165608 after retry RPC after error@1009517470) -> (continuation of Deferred@477113920 after retry RPC after error@911866655) -> (continuation of Deferred@1446062755 after retry RPC after error@173925128)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.1.59.188:33901
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:35:00.899 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_6).
18:35:00.899 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.899 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.899 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.899 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.899 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.900 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.900 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:00.902 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:00.903 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:00.903 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:00.903 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:00.903 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:00.903 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:00.903 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:00.904 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:00.904 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:00.904 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:00.904 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:00.904 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:00.904 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:00.904 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:00.915 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
18:35:00.916 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CANCELING to CANCELED.
18:35:00.916 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_6).
18:35:00.925 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:00.925 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:00.926 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:00.926 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.926 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.926 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.926 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.926 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.926 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.926 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.927 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.927 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:00.927 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:00.932 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:00.932 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:00.932 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:00.933 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:00.938 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:00.938 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:00.938 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:00.938 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.938 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.938 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.939 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.939 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.939 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.939 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.939 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.939 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.939 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:00.940 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:00.941 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.941 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.941 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.946 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:00.947 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.947 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.947 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:00.958 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:00.959 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:00.959 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:00.959 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.959 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.959 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:00.959 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.960 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.960 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:00.960 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.960 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.960 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:00.960 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:00.969 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:00.976 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.976 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.976 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:00.992 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.000 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.000 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.000 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.005 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.005 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.005 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.006 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.006 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.006 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.006 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.006 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.006 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.006 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.006 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.006 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.006 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.027 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_6).
18:35:01.027 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1190) Task Source: KuduSource -> Sink: Writer (3/4)#6 is already in state FAILED
18:35:01.027 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
18:35:01.027 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to CANCELING.
18:35:01.027 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
18:35:01.028 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.030 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.031 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.032 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.033 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
18:35:01.033 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CANCELING to CANCELED.
18:35:01.033 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
18:35:01.040 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_6).
18:35:01.040 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to CANCELING.
18:35:01.040 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_6).
18:35:01.044 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.044 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.044 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.045 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.046 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.046 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.047 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.047 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.048 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.049 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.049 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.049 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.051 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.055 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.055 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.055 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.055 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.056 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.059 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.059 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.059 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.059 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:01.064 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.067 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
18:35:01.068 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CANCELING to CANCELED.
18:35:01.068 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#6 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_6).
18:35:01.078 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:01.079 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:01.079 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:01.079 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:01.079 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:01.079 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:01.079 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:01.080 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:01.080 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:01.080 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:01.080 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:01.080 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:01.080 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:01.080 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:01.088 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.095 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.095 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.095 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.095 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.096 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.097 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.107 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.107 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.108 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.108 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.108 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.108 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.108 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.108 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.109 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.116 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.116 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.116 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.116 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.116 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.117 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.117 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.117 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#6 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_6.
18:35:01.117 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.117 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.117 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.119 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:01.119 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:01.119 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#6 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_6.
18:35:01.119 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:01.119 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#6 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_6.
18:35:01.119 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:01.119 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:01.119 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:01.120 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:01.117 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.120 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:01.120 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:01.120 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.120 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.119 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#6 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_6.
18:35:01.120 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CANCELING to CANCELED.
18:35:01.120 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:01.120 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:01.120 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:01.120 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:01.120 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:01.121 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:35:01.121 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1318) Discarding the results produced by task execution 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_6.
18:35:01.121 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CANCELING to CANCELED.
18:35:01.121 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.121 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.121 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.121 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:35:01.122 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CANCELING to CANCELED.
18:35:01.122 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:35:01.122 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CANCELING to CANCELED.
18:35:01.124 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 4cd649562a0f5305571102b5c888c5a9
18:35:01.125 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.125 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.125 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.125 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.125 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.126 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.126 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.126 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.126 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.126 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.126 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.126 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.126 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.137 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.137 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.137 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.137 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.137 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.137 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.137 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.137 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.137 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.137 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.138 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.138 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.138 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.156 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.156 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.156 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.157 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.157 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.157 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.157 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.157 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.157 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.157 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.158 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.158 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.158 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.162 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:01.171 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.172 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.172 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.175 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:01.175 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:01.175 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:01.175 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:01.175 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:01.175 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:01.176 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:01.176 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:01.176 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:01.176 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:01.176 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:01.176 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:01.176 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:01.184 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.184 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.185 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.185 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.196 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.196 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.196 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.196 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.196 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.196 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.197 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.197 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.197 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.197 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.197 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.197 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.197 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.206 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.207 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.207 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.207 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.211 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.211 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.212 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.212 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:01.212 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.213 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.215 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.216 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.219 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:01.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.219631 10571 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } attempt: 8
18:35:01.236 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.237 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.237 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.237 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.237 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.237 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.237 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.238 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.238 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.238 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.238 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.238 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.238 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.241 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.242 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:01.243 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.244 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.244 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.244 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.244 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.244 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.244 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.244 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.245 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.245 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.245 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.245 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.245 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.248 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.250 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.251 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:01.264 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.264 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.264 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.264 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.264 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.265 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.265 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.265 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.265 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.265 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.265 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.265 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.265 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.267 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.268 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.270 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.271 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.274694 10571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500: Bootstrap starting.
18:35:01.278 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:01.287 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.289 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.290 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.291 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.299 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:01.299 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.299 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.299 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.304 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.304 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.304 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.304 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.304 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.304 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.304 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.304 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.304 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.305 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.305 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.305 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.305 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.307 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.308 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.310 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.311 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:01.319 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.319 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:01.319 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:01.319 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:01.319 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.319 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.319 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.320 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.320 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.320 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.320 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.320 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.320 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.320 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:01.324 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.324 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.324 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:01.323385 10605 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.26.253:36107 timed out after 1.653s (SENT)
18:35:01.324 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.325 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.325 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.325 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.325 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.325 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.325 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.325 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.325 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.325 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.326 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.327 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.328 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.336 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.337 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.337 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.337 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.338 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:01.338 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:01.338 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:01.338 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:01.338 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:01.339 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:01.339 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:01.339 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:01.339 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:01.339 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:01.339 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:01.339 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:01.339 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:01.339 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:01.339 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:01.340 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:01.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.322791 10571 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500: Neither blocks nor log segments found. Creating new log.
18:35:01.340 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.340 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.340 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.340 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.340 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.340 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.340 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.340 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.340 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.340 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:01.343 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.344 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.345 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.345 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.345 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.346 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.346 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.346 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.346 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.346 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.346 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.346 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.347 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.347 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.347 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.347 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.347 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.349058 10571 log.cc:826] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500: Log is configured to *not* fsync() on all Append() calls
18:35:01.371 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.371 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.371 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.372 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.372 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.372 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.372 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.372 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.372 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.372 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.372 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.372 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.373 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.379 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:01.379 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:01.379 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:01.379 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.379 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.379 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.380 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.380 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.380 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.380 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.380 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.380 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.380 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:01.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.383435 10571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500: No bootstrap required, opened a new log
18:35:01.391 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.392 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.392 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.392 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.392 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.392 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.392 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.392 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.392 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.393 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.393 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.393 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.393 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.399 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:01.400 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:01.400 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:01.400 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.400 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.400 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.400 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.400 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.400 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.401 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.401 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.401 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.401 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:01.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:01.416 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:01.416 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:01.416 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:01.416 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:01.416 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:01.416 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:01.417 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:01.417 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:01.417 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:01.417 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:01.417 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:01.417 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:01.417 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:01.424 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.424 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.424 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.424 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.424 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.424 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.424 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.424 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.424 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.425 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.425 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.425 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.425 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.431 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.431 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.431 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.431 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.432 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.432 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.432 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.432 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.432 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.432 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.432 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.432 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.432 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.443 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.443 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.444 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.444 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.444 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.444 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.444 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.444 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.444 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.445 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.445 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.445 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.445 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.459 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:01.459 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:01.459 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:01.460 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.460 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.460 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.460 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.460 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.460 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.461 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.461 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.461 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.461 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:01.466 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:01.466 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:01.466 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:01.466 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:01.466 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:01.467 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:01.467 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:01.467 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:01.467 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:01.467 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:01.467 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:01.467 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:01.467 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:01.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.473922 10571 raft_consensus.cc:359] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } }
18:35:01.476 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:01.476 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:01.476 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:01.476 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:01.476 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:01.476 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:01.477 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:01.477 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:01.477 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:01.477 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:01.477 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:01.477 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:01.477 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:01.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.478989 10571 raft_consensus.cc:385] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:35:01.480 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:01.480 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:01.480 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:01.480 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.480 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.480 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.480 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.481 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.481 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.481 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.481 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.481 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.481 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:01.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.480095 10571 raft_consensus.cc:740] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdaac99ecb9d4a919c23a781d44e5500, State: Initialized, Role: FOLLOWER
18:35:01.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.482191 10571 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } }
18:35:01.483 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:01.483 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:01.483 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:01.483 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:01.483 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:01.484 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:01.484 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:01.484 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:01.484 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:01.484 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:01.484 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:01.484 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:01.484 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:01.491 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.491 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.491 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.491 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.491 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.491 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.491 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.491 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.491 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.492 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.492 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.492 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.492 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.493153 10800 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } } }
18:35:01.497 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.497 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.497 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.497 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.497 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.497 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.498 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.497699 10800 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500 [sys.catalog]: This master's current role is: FOLLOWER
18:35:01.498 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.498 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.498 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.498 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.498 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.498 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.504303 10571 sys_catalog.cc:565] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500 [sys.catalog]: configured and running, proceeding with master startup.
18:35:01.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.504479 10546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc271ac084814e3c8dd50b755ec7badb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdaac99ecb9d4a919c23a781d44e5500" is_pre_election: true
18:35:01.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.505724 10546 raft_consensus.cc:2468] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc271ac084814e3c8dd50b755ec7badb in term 0.
18:35:01.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:01.510761 10546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38810 (request call id 2) took 1862 ms (client timeout 2233 ms). Trace:
18:35:01.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.511840 10543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc271ac084814e3c8dd50b755ec7badb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdaac99ecb9d4a919c23a781d44e5500"
18:35:01.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.515394 10545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc271ac084814e3c8dd50b755ec7badb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdaac99ecb9d4a919c23a781d44e5500"
18:35:01.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:01.517177 10545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38810 (request call id 3) took 1847 ms (client timeout 1653 ms). Trace:
18:35:01.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:01.517616 10545 rpcz_store.cc:269] 0708 18:34:59.670103 (+     0us) service_pool.cc:167] Inserting onto call queue
18:35:01.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:34:59.670267 (+   164us) service_pool.cc:224] Handling call
18:35:01.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:35:01.517041 (+1846774us) inbound_call.cc:177] Queueing success response
18:35:01.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
18:35:01.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.520296 10544 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500 [term 0 FOLLOWER]: Advancing to term 1
18:35:01.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:01.511387 10546 rpcz_store.cc:269] 0708 18:34:59.648042 (+     0us) service_pool.cc:167] Inserting onto call queue
18:35:01.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:34:59.648177 (+   135us) service_pool.cc:224] Handling call
18:35:01.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:35:01.510678 (+1862501us) inbound_call.cc:177] Queueing success response
18:35:01.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
18:35:01.521 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:01.521 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:01.522 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:01.522 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:01.522 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:01.522 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:01.522 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:01.522 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:01.522 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:01.523 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:01.523 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:01.523 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:01.523 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:01.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.533114 10544 raft_consensus.cc:1275] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500 [term 1 FOLLOWER]: Refusing update from remote peer fc271ac084814e3c8dd50b755ec7badb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:35:01.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.538046 10544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38810 (request call id 4) took 1757 ms. Trace:
18:35:01.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.541947 10544 rpcz_store.cc:276] 0708 18:34:59.781068 (+     0us) service_pool.cc:167] Inserting onto call queue
18:35:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:34:59.781727 (+   659us) service_pool.cc:224] Handling call
18:35:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:35:01.519858 (+1738131us) raft_consensus.cc:1471] Updating replica for 0 ops
18:35:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:35:01.537642 (+ 17784us) raft_consensus.cc:1697] Filling consensus response to leader.
18:35:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 18:35:01.537968 (+   326us) inbound_call.cc:177] Queueing success response
18:35:01.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
18:35:01.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.548280 10727 consensus_queue.cc:1048] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
18:35:01.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:01.600811 10525 tablet.cc:2406] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:35:01.612 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.612 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.612 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.612 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.612 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.612 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.613 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.613 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.613 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.613 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.613 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.613 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.613 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.676 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.677 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.677 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.677 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.677 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.677 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.678 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.678 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.678 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.678 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.678 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.678 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.678 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.688 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:01.689 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:01.689 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:01.689 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:01.689 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:01.689 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:01.689 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:01.689 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:01.689 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:01.689 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:01.689 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:01.689 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:01.689 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:01.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.725037 10800 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc271ac084814e3c8dd50b755ec7badb. Latest consensus state: current_term: 1 leader_uuid: "fc271ac084814e3c8dd50b755ec7badb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } } }
18:35:01.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.725909 10800 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500 [sys.catalog]: This master's current role is: FOLLOWER
18:35:01.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.727592 10813 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fc271ac084814e3c8dd50b755ec7badb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } } }
18:35:01.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.728749 10813 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500 [sys.catalog]: This master's current role is: FOLLOWER
18:35:01.731 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.732 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.732 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.732 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.732 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.732 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.732 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.733 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.733 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.733 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.733 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.733 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.733 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.743 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:01.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:01.764 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.764 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.765 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.765 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.765 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.765 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.765 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.765 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.766 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.766 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.766 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.766 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.766 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.818763 10819 catalog_manager.cc:1294] Loaded cluster ID: 783e1b784a8943e9b46db9a83dc4e04d
18:35:01.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.819125 10819 catalog_manager.cc:1587] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500: loading cluster ID for follower catalog manager: success
18:35:01.825 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:01.826 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:01.826 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:01.826 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.826 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.826 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:01.826 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.826 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.827 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:01.827 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.827 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.827 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:01.827 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:01.840 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:01.840 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:01.840 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:01.840 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.840 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.840 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:01.841 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.841 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.841 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:01.841 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.841 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.841 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:01.841 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:01.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.877110 10819 catalog_manager.cc:1609] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500: acquiring CA information for follower catalog manager: success
18:35:01.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:01.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:01.919293 10819 catalog_manager.cc:1637] T 00000000000000000000000000000000 P bdaac99ecb9d4a919c23a781d44e5500: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:35:02.019 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:02.019 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:02.019 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:02.020 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:02.020 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:02.020 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:02.020 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:02.020 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:02.020 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:02.020 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:02.020 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:02.020 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:02.021 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:02.023 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:02.023 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:02.024 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:02.024 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.024 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.024 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.024 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.024 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.024 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.025 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.025 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.025 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.025 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:02.031 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:02.031 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:02.031 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:02.032 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.032 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.032 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.032 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.032 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.032 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.033 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.033 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.033 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.033 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:02.127 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:02.127 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:02.127 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:02.128 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:02.128 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:02.128 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:02.128 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:02.128 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:02.128 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:02.128 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:02.128 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:02.128 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:02.129 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:02.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:02.165334 10727 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fc271ac084814e3c8dd50b755ec7badb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a352fb28734817802dc1543d2a2069" member_type: VOTER last_known_addr { host: "127.10.26.254" port: 36869 } } peers { permanent_uuid: "bdaac99ecb9d4a919c23a781d44e5500" member_type: VOTER last_known_addr { host: "127.10.26.253" port: 36107 } } peers { permanent_uuid: "fc271ac084814e3c8dd50b755ec7badb" member_type: VOTER last_known_addr { host: "127.10.26.252" port: 40435 } } }
18:35:02.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:02.167145 10727 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc271ac084814e3c8dd50b755ec7badb [sys.catalog]: This master's current role is: LEADER
18:35:02.196 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:02.196 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:02.196 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:02.197 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.197 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.197 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.197 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.197 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.197 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.198 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.198 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.198 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.198 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:02.227 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:02.227 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:02.227 [DEBUG - pool-512-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:02.228 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:02.228 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:02.228 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:02.228 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:02.228 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:02.228 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:02.228 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:02.228 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:02.228 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:02.229 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:02.229 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28219), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [19ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [38ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [39ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [70ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [71ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [86ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [86ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [114ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [115ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [116ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [116ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [121ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [121ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [121ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [121ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [141ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [141ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [142ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [142ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [162ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [164ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [164ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [164ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [196ms] refreshing cache from master, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [196ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [197ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [197ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [197ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [281ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [281ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [282ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [282ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [401ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [401ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [402ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [402ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [882ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [882ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [883ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [884ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1060ms] refreshing cache from master, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1062ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2861ms] refreshing cache from master, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2863ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2863ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [3161ms] refreshing cache from master, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [3162ms] too many traces: truncated at 100 traces, deferred=Deferred@635820043(state=PENDING, result=null, callback=(continuation of Deferred@1943322660 after retry RPC after error@453579107) -> (continuation of Deferred@967103268 after retry RPC after error@839545243) -> (continuation of Deferred@1737118238 after retry RPC after error@886818181) -> (continuation of Deferred@737742281 after retry RPC after error@1251878788) -> (continuation of Deferred@2133952107 after retry RPC after error@355242981) -> (continuation of Deferred@1985500108 after retry RPC after error@1304557700) -> (continuation of Deferred@1043344777 after retry RPC after error@1332883985) -> (continuation of Deferred@2063650304 after retry RPC after error@960957500) -> (continuation of Deferred@103031544 after retry RPC after error@1477995159) -> (continuation of Deferred@630579034 after retry RPC after error@607256888) -> (continuation of Deferred@61265060 after retry RPC after error@410081941) -> (continuation of Deferred@320158158 after retry RPC after error@664453461) -> (continuation of Deferred@304882422 after retry RPC after error@1800148) -> (continuation of Deferred@981136720 after retry RPC after error@1268452131) -> (continuation of Deferred@953396020 after retry RPC after error@1663950381) -> (continuation of Deferred@235960173 after retry RPC after error@490846111) -> (continuation of Deferred@946746632 after retry RPC after error@901728414) -> (continuation of Deferred@941222491 after retry RPC after error@687099784) -> (continuation of Deferred@1643899371 after retry RPC after error@776972018) -> (continuation of Deferred@1500764754 after retry RPC after error@1408325371) -> (continuation of Deferred@1845189087 after retry RPC after error@1053821604) -> (continuation of Deferred@2042033766 after retry RPC after error@539570469) -> (continuation of Deferred@388739422 after retry RPC after error@697306165), errback=(continuation of Deferred@1943322660 after retry RPC after error@453579107) -> (continuation of Deferred@967103268 after retry RPC after error@839545243) -> (continuation of Deferred@1737118238 after retry RPC after error@886818181) -> (continuation of Deferred@737742281 after retry RPC after error@1251878788) -> (continuation of Deferred@2133952107 after retry RPC after error@355242981) -> (continuation of Deferred@1985500108 after retry RPC after error@1304557700) -> (continuation of Deferred@1043344777 after retry RPC after error@1332883985) -> (continuation of Deferred@2063650304 after retry RPC after error@960957500) -> (continuation of Deferred@103031544 after retry RPC after error@1477995159) -> (continuation of Deferred@630579034 after retry RPC after error@607256888) -> (continuation of Deferred@61265060 after retry RPC after error@410081941) -> (continuation of Deferred@320158158 after retry RPC after error@664453461) -> (continuation of Deferred@304882422 after retry RPC after error@1800148) -> (continuation of Deferred@981136720 after retry RPC after error@1268452131) -> (continuation of Deferred@953396020 after retry RPC after error@1663950381) -> (continuation of Deferred@235960173 after retry RPC after error@490846111) -> (continuation of Deferred@946746632 after retry RPC after error@901728414) -> (continuation of Deferred@941222491 after retry RPC after error@687099784) -> (continuation of Deferred@1643899371 after retry RPC after error@776972018) -> (continuation of Deferred@1500764754 after retry RPC after error@1408325371) -> (continuation of Deferred@1845189087 after retry RPC after error@1053821604) -> (continuation of Deferred@2042033766 after retry RPC after error@539570469) -> (continuation of Deferred@388739422 after retry RPC after error@697306165)))
18:35:02.243 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:02.260 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:02.263 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:02.264 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:02.264 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:02.264 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:02.264 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:02.264 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:02.264 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:02.264 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:02.264 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:02.264 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:02.264 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:02.264 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:02.264 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:02.298 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:02.298 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:02.298 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:02.299 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:02.299 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:02.299 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:02.299 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:02.299 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:02.299 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:02.300 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:02.300 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:02.300 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:02.300 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:02.386 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:02.386 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:02.386 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:02.387 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.387 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.387 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.387 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.387 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.387 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.387 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.388 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.388 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.388 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:02.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:02.527 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:02.528 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:02.528 [DEBUG - pool-518-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:02.528 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:02.528 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:02.528 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:02.528 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:02.529 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:02.528 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:02.529 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:02.529 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:02.529 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:02.529 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:02.529 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28485), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [10ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [12ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [12ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [12ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [34ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [35ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [46ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [46ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [83ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [83ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [102ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [103ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [103ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [125ms] refreshing cache from master, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [125ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [126ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [126ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [126ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [151ms] refreshing cache from master, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [152ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [153ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [154ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [154ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [223ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [223ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [223ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [362ms] refreshing cache from master, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [363ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [363ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [364ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [364ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [442ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [443ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [443ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [762ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [763ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [763ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [764ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [963ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [964ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [964ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [964ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2361ms] refreshing cache from master, [2361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [2361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [2361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [2362ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [2362ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [2363ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [2363ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [5301ms] refreshing cache from master, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [5302ms] too many traces: truncated at 100 traces, deferred=Deferred@1132238471(state=PENDING, result=null, callback=(continuation of Deferred@643755685 after retry RPC after error@363705415) -> (continuation of Deferred@1174422207 after retry RPC after error@1643064406) -> (continuation of Deferred@815123720 after retry RPC after error@1214400721) -> (continuation of Deferred@204734168 after retry RPC after error@346488468) -> (continuation of Deferred@180722821 after retry RPC after error@1346075084) -> (continuation of Deferred@1139644461 after retry RPC after error@1612483738) -> (continuation of Deferred@1176180136 after retry RPC after error@1306915262) -> (continuation of Deferred@1650861279 after retry RPC after error@1721375829) -> (continuation of Deferred@2024993659 after retry RPC after error@448300498) -> (continuation of Deferred@1227557510 after retry RPC after error@2145767234) -> (continuation of Deferred@279171822 after retry RPC after error@1315652413) -> (continuation of Deferred@1594171212 after retry RPC after error@239813681) -> (continuation of Deferred@15848372 after retry RPC after error@337058364) -> (continuation of Deferred@1663015053 after retry RPC after error@924918291) -> (continuation of Deferred@960703280 after retry RPC after error@355008734) -> (continuation of Deferred@183314694 after retry RPC after error@878879730) -> (continuation of Deferred@349701349 after retry RPC after error@1235933520) -> (continuation of Deferred@711748730 after retry RPC after error@196093942) -> (continuation of Deferred@1604052297 after retry RPC after error@1088739251) -> (continuation of Deferred@161639529 after retry RPC after error@52917564) -> (continuation of Deferred@51800508 after retry RPC after error@1697214242) -> (continuation of Deferred@2146604746 after retry RPC after error@1195676317) -> (continuation of Deferred@1999591488 after retry RPC after error@1506896376) -> (continuation of Deferred@855564494 after retry RPC after error@1372408950), errback=(continuation of Deferred@643755685 after retry RPC after error@363705415) -> (continuation of Deferred@1174422207 after retry RPC after error@1643064406) -> (continuation of Deferred@815123720 after retry RPC after error@1214400721) -> (continuation of Deferred@204734168 after retry RPC after error@346488468) -> (continuation of Deferred@180722821 after retry RPC after error@1346075084) -> (continuation of Deferred@1139644461 after retry RPC after error@1612483738) -> (continuation of Deferred@1176180136 after retry RPC after error@1306915262) -> (continuation of Deferred@1650861279 after retry RPC after error@1721375829) -> (continuation of Deferred@2024993659 after retry RPC after error@448300498) -> (continuation of Deferred@1227557510 after retry RPC after error@2145767234) -> (continuation of Deferred@279171822 after retry RPC after error@1315652413) -> (continuation of Deferred@1594171212 after retry RPC after error@239813681) -> (continuation of Deferred@15848372 after retry RPC after error@337058364) -> (continuation of Deferred@1663015053 after retry RPC after error@924918291) -> (continuation of Deferred@960703280 after retry RPC after error@355008734) -> (continuation of Deferred@183314694 after retry RPC after error@878879730) -> (continuation of Deferred@349701349 after retry RPC after error@1235933520) -> (continuation of Deferred@711748730 after retry RPC after error@196093942) -> (continuation of Deferred@1604052297 after retry RPC after error@1088739251) -> (continuation of Deferred@161639529 after retry RPC after error@52917564) -> (continuation of Deferred@51800508 after retry RPC after error@1697214242) -> (continuation of Deferred@2146604746 after retry RPC after error@1195676317) -> (continuation of Deferred@1999591488 after retry RPC after error@1506896376) -> (continuation of Deferred@855564494 after retry RPC after error@1372408950)))
18:35:02.743 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:02.760 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:02.902 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:02.924 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:02.924 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:02.925 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:02.926 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.926 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.926 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.926 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.927 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.927 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.927 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.927 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.927 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.927 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:02.971 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:02.971 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:02.971 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:02.972 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.972 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.972 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:02.972 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.972 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.972 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:02.973 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.973 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.973 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:02.973 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:02.999 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:03.000 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:03.000 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:03.000 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:03.000 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:03.000 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:03.000 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:03.001 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:03.001 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:03.001 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:03.001 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:03.001 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:03.001 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:03.024 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:03.025 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:03.025 [DEBUG - pool-516-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:03.025 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:03.025 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:03.025 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:03.025 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:03.026 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:03.026 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:03.026 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:03.026 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:03.026 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:03.026 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:03.027 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29001), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [13ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [32ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [34ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [34ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [77ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [80ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [81ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [81ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [107ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [108ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [109ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [109ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [122ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [123ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [126ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [126ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [143ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [144ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [150ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [151ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [187ms] refreshing cache from master, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [189ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [189ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [190ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [190ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [221ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [222ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [222ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [262ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [263ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [263ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [382ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [383ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [387ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [388ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [682ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [683ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [684ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [684ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1680ms] refreshing cache from master, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [1682ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [3560ms] refreshing cache from master, [3560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.190:46863: Network error: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.189:42073: Network error: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.1.59.188:33901: Network error: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [3563ms] delaying RPC due to: Service unavailable: Master config (127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901, [6742ms] refreshing cache from master, [6742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.190:46863, [6743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.189:42073, [6743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.59.188:33901, [6743ms] too many traces: truncated at 100 traces, deferred=Deferred@1422953946(state=PENDING, result=null, callback=(continuation of Deferred@407671397 after retry RPC after error@2022740899) -> (continuation of Deferred@1856164429 after retry RPC after error@1045183518) -> (continuation of Deferred@1122983432 after retry RPC after error@1050595453) -> (continuation of Deferred@1188453721 after retry RPC after error@421868881) -> (continuation of Deferred@553793379 after retry RPC after error@1775703558) -> (continuation of Deferred@488612592 after retry RPC after error@765498303) -> (continuation of Deferred@489226311 after retry RPC after error@1277117122) -> (continuation of Deferred@754409875 after retry RPC after error@98771673) -> (continuation of Deferred@1352474906 after retry RPC after error@1713528985) -> (continuation of Deferred@1909354039 after retry RPC after error@1839693629) -> (continuation of Deferred@1410008674 after retry RPC after error@559452882) -> (continuation of Deferred@602271512 after retry RPC after error@1970090702) -> (continuation of Deferred@2044269079 after retry RPC after error@477282812) -> (continuation of Deferred@274948165 after retry RPC after error@210033605) -> (continuation of Deferred@1039940072 after retry RPC after error@931881610) -> (continuation of Deferred@1021398390 after retry RPC after error@378659804) -> (continuation of Deferred@1249815455 after retry RPC after error@646782824) -> (continuation of Deferred@271678514 after retry RPC after error@153608939) -> (continuation of Deferred@909808131 after retry RPC after error@2021834227) -> (continuation of Deferred@1665769021 after retry RPC after error@1431242757) -> (continuation of Deferred@923218469 after retry RPC after error@1518828563) -> (continuation of Deferred@1972414728 after retry RPC after error@1479706783) -> (continuation of Deferred@1453989798 after retry RPC after error@925664900) -> (continuation of Deferred@1191489920 after retry RPC after error@188657551) -> (continuation of Deferred@233817697 after retry RPC after error@1587837438) -> (continuation of Deferred@1020152603 after retry RPC after error@1123207642), errback=(continuation of Deferred@407671397 after retry RPC after error@2022740899) -> (continuation of Deferred@1856164429 after retry RPC after error@1045183518) -> (continuation of Deferred@1122983432 after retry RPC after error@1050595453) -> (continuation of Deferred@1188453721 after retry RPC after error@421868881) -> (continuation of Deferred@553793379 after retry RPC after error@1775703558) -> (continuation of Deferred@488612592 after retry RPC after error@765498303) -> (continuation of Deferred@489226311 after retry RPC after error@1277117122) -> (continuation of Deferred@754409875 after retry RPC after error@98771673) -> (continuation of Deferred@1352474906 after retry RPC after error@1713528985) -> (continuation of Deferred@1909354039 after retry RPC after error@1839693629) -> (continuation of Deferred@1410008674 after retry RPC after error@559452882) -> (continuation of Deferred@602271512 after retry RPC after error@1970090702) -> (continuation of Deferred@2044269079 after retry RPC after error@477282812) -> (continuation of Deferred@274948165 after retry RPC after error@210033605) -> (continuation of Deferred@1039940072 after retry RPC after error@931881610) -> (continuation of Deferred@1021398390 after retry RPC after error@378659804) -> (continuation of Deferred@1249815455 after retry RPC after error@646782824) -> (continuation of Deferred@271678514 after retry RPC after error@153608939) -> (continuation of Deferred@909808131 after retry RPC after error@2021834227) -> (continuation of Deferred@1665769021 after retry RPC after error@1431242757) -> (continuation of Deferred@923218469 after retry RPC after error@1518828563) -> (continuation of Deferred@1972414728 after retry RPC after error@1479706783) -> (continuation of Deferred@1453989798 after retry RPC after error@925664900) -> (continuation of Deferred@1191489920 after retry RPC after error@188657551) -> (continuation of Deferred@233817697 after retry RPC after error@1587837438) -> (continuation of Deferred@1020152603 after retry RPC after error@1123207642)))
18:35:03.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:02.160745 10742 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 10721
18:35:03.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:03.147352 10721 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.385s	user 0.380s	sys 0.606s
18:35:03.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:03.154878 10721 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.392s	user 0.381s	sys 0.606s
18:35:03.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:00.768404 10747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:35:03.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.165195 10721 server_base.cc:1061] running on GCE node
18:35:03.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:03.165383 10826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:35:03.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.172712 10721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:35:03.176 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:03.176 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:03.176 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:03.176 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:03.177 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:03.177 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:03.177 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:03.177 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:03.177 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:03.177 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:03.177 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:03.177 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:03.178 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:03.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.181239 10721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:35:03.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.189008 10721 hybrid_clock.cc:648] HybridClock initialized: now 1783535703188950 us; error 50 us; skew 500 ppm
18:35:03.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.190122 10721 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:35:03.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.226056 10721 webserver.cc:534] Webserver started at http://127.10.26.193:38039/ using document root <none> and password file <none>
18:35:03.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.227746 10721 fs_manager.cc:362] Metadata directory not provided
18:35:03.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.228200 10721 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:35:03.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.228892 10721 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:35:03.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.240392 10721 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/data/instance:
18:35:03.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39ef161cd5894a1b981405d458a84b3c"
18:35:03.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:35:03 on dist-test-slave-dxnw"
18:35:03.243 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:03.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.243165 10721 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/wal/instance:
18:35:03.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39ef161cd5894a1b981405d458a84b3c"
18:35:03.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:35:03 on dist-test-slave-dxnw"
18:35:03.260 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:03.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.278767 10721 fs_manager.cc:696] Time spent creating directory manager: real 0.031s	user 0.010s	sys 0.001s
18:35:03.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.302381 10831 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:35:03.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.305789 10721 fs_manager.cc:730] Time spent opening block manager: real 0.014s	user 0.003s	sys 0.002s
18:35:03.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.306684 10721 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/wal
18:35:03.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39ef161cd5894a1b981405d458a84b3c"
18:35:03.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:35:03 on dist-test-slave-dxnw"
18:35:03.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.307384 10721 fs_report.cc:389] FS layout report
18:35:03.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:35:03.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/wal
18:35:03.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/wal
18:35:03.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/data/data
18:35:03.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:35:03.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:35:03.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:35:03.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:35:03.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:35:03.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:35:03.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:35:03.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:35:03.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:35:03.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:35:03.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:35:03.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:03.459 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:03.459 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:03.459 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:03.460 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:03.460 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:03.460 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:03.460 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:03.460 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:03.460 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:03.460 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:03.460 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:03.460 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:03.460 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:03.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.509922 10721 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:35:03.512 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:03.512 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:03.512 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:03.513 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:03.513 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:03.513 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:03.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.513327 10721 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:35:03.513 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:03.513 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:03.514 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:03.513 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:03.514 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:03.514 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:03.514 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:03.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.514143 10721 kserver.cc:163] Server-wide thread pool size limit: 3276
18:35:03.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.525617 10721 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:35:03.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.538798 10721 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:35:03.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.539323 10721 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
18:35:03.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.539822 10721 ts_tablet_manager.cc:616] Registered 0 tablets
18:35:03.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:03.540184 10721 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:35:03.603 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:03.603 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:03.603 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:03.604 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:03.604 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:03.604 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:03.604 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:03.604 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:03.604 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:03.605 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:03.605 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:03.605 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:03.605 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:03.742 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:03.760 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:03.843 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:03.844 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:03.844 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:03.844 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:03.844 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:03.844 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:03.844 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:03.844 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:03.845 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:03.845 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:03.845 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:03.845 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:03.845 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:03.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:03.997 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:03.997 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:03.997 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:03.997 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:03.998 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:03.998 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:03.998 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:03.998 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:03.998 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:03.998 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:03.998 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:03.998 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:03.998 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:04.115 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:04.115 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:04.115 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:04.116 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:04.116 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:04.116 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:04.116 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:04.116 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:04.116 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:04.116 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:04.116 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:04.116 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:04.117 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:04.146 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:04.146 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:04.146 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:04.147 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:04.147 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:04.147 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:04.147 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:04.148 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:04.148 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:04.147 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:04.148 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:04.148 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:04.148 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:04.238 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:04.239 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:04.239 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:04.239 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:04.239 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:04.239 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:04.239 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:04.240 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:04.240 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:04.240 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:04.240 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:04.240 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:04.240 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:04.242 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:04.260 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:04.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.376263 10721 rpc_server.cc:307] RPC server started. Bound to: 127.10.26.193:37959
18:35:04.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.380384 10945 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.26.193:37959 every 8 connection(s)
18:35:04.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.381403 10721 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/data/info.pb
18:35:04.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.386085 10347 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 10721
18:35:04.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.386833 10347 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-0/wal/instance
18:35:04.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.401072 10347 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:35:04.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:35:04.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/wal
18:35:04.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/data
18:35:04.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:04.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:35:04.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:35:04.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:35:04.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:35:04.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:35:04.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/logs
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/data/info.pb
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.26.194:0
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.26.194
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.26.194
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.26.254:36869,127.10.26.253:36107,127.10.26.252:40435
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.26.212:43597
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:35:04.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:35:04.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.477206 10946 heartbeater.cc:344] Connected to a master server at 127.10.26.252:40435
18:35:04.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.477734 10946 heartbeater.cc:461] Registering TS with master...
18:35:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.479159 10946 heartbeater.cc:507] Master 127.10.26.252:40435 requested a full tablet report, sending...
18:35:04.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.482182 10623 ts_manager.cc:194] Registered new tserver with Master: 39ef161cd5894a1b981405d458a84b3c (127.10.26.193:37959)
18:35:04.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.485162 10623 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.26.193:55077
18:35:04.502 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:04.502 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:04.502 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:04.503 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:04.503 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:04.503 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:04.503 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:04.503 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:04.503 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:04.503 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:04.503 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:04.503 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:04.503 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:04.504 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:04.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.504428 10949 heartbeater.cc:344] Connected to a master server at 127.10.26.253:36107
18:35:04.504 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:04.504 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:04.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.504940 10949 heartbeater.cc:461] Registering TS with master...
18:35:04.505 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:04.505 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:04.505 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:04.505 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:04.505 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:04.505 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:04.505 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:04.505 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:04.505 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:04.505 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:04.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.506880 10949 heartbeater.cc:507] Master 127.10.26.253:36107 requested a full tablet report, sending...
18:35:04.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.511085 10536 ts_manager.cc:194] Registered new tserver with Master: 39ef161cd5894a1b981405d458a84b3c (127.10.26.193:37959)
18:35:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.517375 10951 heartbeater.cc:344] Connected to a master server at 127.10.26.254:36869
18:35:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.517745 10951 heartbeater.cc:461] Registering TS with master...
18:35:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.518404 10951 heartbeater.cc:507] Master 127.10.26.254:36869 requested a full tablet report, sending...
18:35:04.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:04.522713 10457 ts_manager.cc:194] Registered new tserver with Master: 39ef161cd5894a1b981405d458a84b3c (127.10.26.193:37959)
18:35:04.525 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:04.525 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:04.525 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:04.526 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:04.526 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:04.526 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:04.526 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:04.526 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:04.526 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:04.526 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:04.526 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:04.527 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:04.527 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:04.541 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:04.542 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:04.542 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:04.542 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:04.542 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:04.542 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:04.542 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:04.542 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:04.542 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:04.542 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:04.542 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:04.542 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:04.542 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:04.655 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:04.656 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:04.656 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:04.656 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:04.656 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:04.656 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:04.657 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:04.657 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:04.657 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:04.657 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:04.657 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:04.657 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:04.657 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:04.742 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:04.762 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:04.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:04.935 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:04.935 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:04.935 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:04.936 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:04.936 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:04.936 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:04.936 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:04.936 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:04.936 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:04.936 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:04.936 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:04.936 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:04.936 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:04.988 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:04.988 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:04.988 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:04.989 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:04.989 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:04.989 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:04.989 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:04.989 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:04.989 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:04.989 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:04.989 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:04.989 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:04.989 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:05.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:05.133133 10950 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:35:05.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:05.133788 10950 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:35:05.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:05.134469 10950 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:35:05.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:05.201581 10950 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:35:05.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:05.203127 10950 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.26.194
18:35:05.243 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:05.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:05.275025 10950 tablet_server_runner.cc:78] Tablet server non-default flags:
18:35:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:35:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.26.212:43597
18:35:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:35:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:35:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/data
18:35:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/wal
18:35:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:35:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:35:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.26.194:0
18:35:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:35:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/data/info.pb
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.26.194
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.26.254:36869,127.10.26.253:36107,127.10.26.252:40435
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.26.194
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/logs
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:35:05.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:35:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:05.276726 10950 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:35:05.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:05.279069 10950 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:35:05.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:05.336961 10963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:35:05.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:05.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:05.502393 10946 heartbeater.cc:499] Master 127.10.26.252:40435 was elected leader, sending a full tablet report...
18:35:05.584 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:05.584 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:05.584 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:05.584 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:05.584 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:05.584 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:05.585 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:05.585 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:05.585 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:05.585 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:05.585 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:05.585 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:05.585 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:05.743 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:05.743 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:05.743 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:05.743 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:05.744 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:05.744 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:05.744 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:05.744 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:05.744 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:05.744 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:05.744 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:05.744 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:05.744 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:05.744 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:05.762 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:05.779 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:05.780 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:05.780 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:05.783 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:05.783 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:05.783 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:05.783 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:05.783 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:05.783 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:05.784 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:05.784 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:05.784 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:05.784 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:05.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:06.203 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:06.204 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:06.204 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:06.204 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:06.204 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:06.204 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:06.204 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:06.204 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:06.204 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:06.204 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:06.205 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:06.205 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:06.205 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:06.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:06.261 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:06.284 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:06.284 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:06.284 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:06.284 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:06.285 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:06.285 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:06.285 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:06.285 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:06.285 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:06.285 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:06.285 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:06.285 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:06.285 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:06.339 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:06.339 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:06.340 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:06.340 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:06.340 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:06.340 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:06.341 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:06.341 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:06.341 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:06.341 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:06.341 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:06.341 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:06.341 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:06.358 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:06.359 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:06.359 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:06.359 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:06.359 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:06.360 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:06.360 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:06.360 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:06.360 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:06.360 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:06.360 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:06.360 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:06.360 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:06.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:06.479 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:06.479 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:06.480 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:06.480 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:06.480 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:06.480 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:06.480 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:06.481 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:06.481 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:06.481 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:06.481 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:06.481 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:06.481 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:06.543 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:06.544 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:06.544 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:06.544 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:06.544 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:06.544 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:06.544 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:06.544 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:06.544 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:06.544 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:06.544 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:06.545 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:06.545 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:06.689 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:06.689 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:06.689 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:06.693 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:06.693 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:06.693 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:06.694 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:06.694 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:06.694 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:06.694 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:06.694 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:06.698 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:06.698 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:06.724 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:06.725 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:06.725 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:06.725 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:06.725 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:06.725 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:06.726 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:06.726 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:06.726 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:06.726 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:06.727 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:06.727 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:06.727 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:06.743 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:06.761 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:06.783 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:06.783 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:06.783 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:06.784 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:06.784 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:06.784 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:06.784 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:06.784 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:06.784 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:06.784 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:06.784 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:06.784 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:06.785 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:06.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:06.948 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:06.949 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:06.949 [DEBUG - pool-522-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:06.949 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:06.949 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:06.949 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:06.949 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:06.949 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:06.949 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:06.949 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:06.949 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:06.949 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:06.950 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:06.950 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29192), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [12ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [26ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [27ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [28ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [45ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [45ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [46ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [46ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [63ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [64ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [64ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [64ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [83ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [83ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [83ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [83ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [101ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [102ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [102ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [102ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [122ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [122ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [122ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [122ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [182ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [183ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [241ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [242ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [242ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [242ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [402ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [402ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [403ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [403ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [862ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [862ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [863ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [863ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [962ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [962ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [963ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [963ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [1022ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [3821ms] refreshing cache from master, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [3822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [3822ms] too many traces: truncated at 100 traces, deferred=Deferred@1649434458(state=PENDING, result=null, callback=(continuation of Deferred@1102829580 after retry RPC after error@1891586359) -> (continuation of Deferred@561912439 after retry RPC after error@1093942157) -> (continuation of Deferred@1582358559 after retry RPC after error@1416373259) -> (continuation of Deferred@84947283 after retry RPC after error@1704495663) -> (continuation of Deferred@1016188571 after retry RPC after error@157874558) -> (continuation of Deferred@225893289 after retry RPC after error@740221402) -> (continuation of Deferred@508102612 after retry RPC after error@1344581226) -> (continuation of Deferred@1798605908 after retry RPC after error@813670617) -> (continuation of Deferred@1717466789 after retry RPC after error@335336442) -> (continuation of Deferred@1550171133 after retry RPC after error@298951104) -> (continuation of Deferred@78579201 after retry RPC after error@1907975789) -> (continuation of Deferred@7504372 after retry RPC after error@481427355) -> (continuation of Deferred@1616014594 after retry RPC after error@1516430699) -> (continuation of Deferred@1317774066 after retry RPC after error@1565901215) -> (continuation of Deferred@782015818 after retry RPC after error@1662544975) -> (continuation of Deferred@1889001196 after retry RPC after error@62759000) -> (continuation of Deferred@1224805288 after retry RPC after error@1767599315) -> (continuation of Deferred@662028202 after retry RPC after error@1235510396) -> (continuation of Deferred@146373291 after retry RPC after error@976663195) -> (continuation of Deferred@808764056 after retry RPC after error@1524221798) -> (continuation of Deferred@427197108 after retry RPC after error@383474027) -> (continuation of Deferred@7170346 after retry RPC after error@337345718) -> (continuation of Deferred@961884067 after retry RPC after error@1963534819) -> (continuation of Deferred@507914833 after retry RPC after error@1375144931), errback=(continuation of Deferred@1102829580 after retry RPC after error@1891586359) -> (continuation of Deferred@561912439 after retry RPC after error@1093942157) -> (continuation of Deferred@1582358559 after retry RPC after error@1416373259) -> (continuation of Deferred@84947283 after retry RPC after error@1704495663) -> (continuation of Deferred@1016188571 after retry RPC after error@157874558) -> (continuation of Deferred@225893289 after retry RPC after error@740221402) -> (continuation of Deferred@508102612 after retry RPC after error@1344581226) -> (continuation of Deferred@1798605908 after retry RPC after error@813670617) -> (continuation of Deferred@1717466789 after retry RPC after error@335336442) -> (continuation of Deferred@1550171133 after retry RPC after error@298951104) -> (continuation of Deferred@78579201 after retry RPC after error@1907975789) -> (continuation of Deferred@7504372 after retry RPC after error@481427355) -> (continuation of Deferred@1616014594 after retry RPC after error@1516430699) -> (continuation of Deferred@1317774066 after retry RPC after error@1565901215) -> (continuation of Deferred@782015818 after retry RPC after error@1662544975) -> (continuation of Deferred@1889001196 after retry RPC after error@62759000) -> (continuation of Deferred@1224805288 after retry RPC after error@1767599315) -> (continuation of Deferred@662028202 after retry RPC after error@1235510396) -> (continuation of Deferred@146373291 after retry RPC after error@976663195) -> (continuation of Deferred@808764056 after retry RPC after error@1524221798) -> (continuation of Deferred@427197108 after retry RPC after error@383474027) -> (continuation of Deferred@7170346 after retry RPC after error@337345718) -> (continuation of Deferred@961884067 after retry RPC after error@1963534819) -> (continuation of Deferred@507914833 after retry RPC after error@1375144931)))
18:35:06.951 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:35:06.951 [WARN - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#2 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29192), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [12ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [26ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [27ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [28ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [45ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [45ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [46ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [46ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [63ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [64ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [64ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [64ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [83ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [83ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [83ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [83ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [101ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [102ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [102ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [102ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [122ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [122ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [122ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [122ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [182ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [183ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [241ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [242ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [242ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [242ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [402ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [402ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [403ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [403ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [862ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [862ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [863ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [863ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [962ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [962ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [963ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [963ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [1022ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [3821ms] refreshing cache from master, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [3822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [3822ms] too many traces: truncated at 100 traces, deferred=Deferred@1649434458(state=PENDING, result=null, callback=(continuation of Deferred@1102829580 after retry RPC after error@1891586359) -> (continuation of Deferred@561912439 after retry RPC after error@1093942157) -> (continuation of Deferred@1582358559 after retry RPC after error@1416373259) -> (continuation of Deferred@84947283 after retry RPC after error@1704495663) -> (continuation of Deferred@1016188571 after retry RPC after error@157874558) -> (continuation of Deferred@225893289 after retry RPC after error@740221402) -> (continuation of Deferred@508102612 after retry RPC after error@1344581226) -> (continuation of Deferred@1798605908 after retry RPC after error@813670617) -> (continuation of Deferred@1717466789 after retry RPC after error@335336442) -> (continuation of Deferred@1550171133 after retry RPC after error@298951104) -> (continuation of Deferred@78579201 after retry RPC after error@1907975789) -> (continuation of Deferred@7504372 after retry RPC after error@481427355) -> (continuation of Deferred@1616014594 after retry RPC after error@1516430699) -> (continuation of Deferred@1317774066 after retry RPC after error@1565901215) -> (continuation of Deferred@782015818 after retry RPC after error@1662544975) -> (continuation of Deferred@1889001196 after retry RPC after error@62759000) -> (continuation of Deferred@1224805288 after retry RPC after error@1767599315) -> (continuation of Deferred@662028202 after retry RPC after error@1235510396) -> (continuation of Deferred@146373291 after retry RPC after error@976663195) -> (continuation of Deferred@808764056 after retry RPC after error@1524221798) -> (continuation of Deferred@427197108 after retry RPC after error@383474027) -> (continuation of Deferred@7170346 after retry RPC after error@337345718) -> (continuation of Deferred@961884067 after retry RPC after error@1963534819) -> (continuation of Deferred@507914833 after retry RPC after error@1375144931), errback=(continuation of Deferred@1102829580 after retry RPC after error@1891586359) -> (continuation of Deferred@561912439 after retry RPC after error@1093942157) -> (continuation of Deferred@1582358559 after retry RPC after error@1416373259) -> (continuation of Deferred@84947283 after retry RPC after error@1704495663) -> (continuation of Deferred@1016188571 after retry RPC after error@157874558) -> (continuation of Deferred@225893289 after retry RPC after error@740221402) -> (continuation of Deferred@508102612 after retry RPC after error@1344581226) -> (continuation of Deferred@1798605908 after retry RPC after error@813670617) -> (continuation of Deferred@1717466789 after retry RPC after error@335336442) -> (continuation of Deferred@1550171133 after retry RPC after error@298951104) -> (continuation of Deferred@78579201 after retry RPC after error@1907975789) -> (continuation of Deferred@7504372 after retry RPC after error@481427355) -> (continuation of Deferred@1616014594 after retry RPC after error@1516430699) -> (continuation of Deferred@1317774066 after retry RPC after error@1565901215) -> (continuation of Deferred@782015818 after retry RPC after error@1662544975) -> (continuation of Deferred@1889001196 after retry RPC after error@62759000) -> (continuation of Deferred@1224805288 after retry RPC after error@1767599315) -> (continuation of Deferred@662028202 after retry RPC after error@1235510396) -> (continuation of Deferred@146373291 after retry RPC after error@976663195) -> (continuation of Deferred@808764056 after retry RPC after error@1524221798) -> (continuation of Deferred@427197108 after retry RPC after error@383474027) -> (continuation of Deferred@7170346 after retry RPC after error@337345718) -> (continuation of Deferred@961884067 after retry RPC after error@1963534819) -> (continuation of Deferred@507914833 after retry RPC after error@1375144931)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.5.136.62:42905
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:35:06.952 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
18:35:06.953 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
18:35:06.955 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED on 1bed232f-62eb-42dc-858c-7139d8e062d6 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29192), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [12ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [26ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [27ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [28ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [45ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [45ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [46ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [46ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [63ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [64ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [64ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [64ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [83ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [83ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [83ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [83ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [101ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [102ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [102ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [102ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [122ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [122ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [122ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [122ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [182ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [183ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [241ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [242ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [242ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [242ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [402ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [402ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [403ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [403ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [862ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [862ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [863ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [863ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [962ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [962ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [963ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [963ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [1022ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [3821ms] refreshing cache from master, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [3821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [3822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [3822ms] too many traces: truncated at 100 traces, deferred=Deferred@1649434458(state=PENDING, result=null, callback=(continuation of Deferred@1102829580 after retry RPC after error@1891586359) -> (continuation of Deferred@561912439 after retry RPC after error@1093942157) -> (continuation of Deferred@1582358559 after retry RPC after error@1416373259) -> (continuation of Deferred@84947283 after retry RPC after error@1704495663) -> (continuation of Deferred@1016188571 after retry RPC after error@157874558) -> (continuation of Deferred@225893289 after retry RPC after error@740221402) -> (continuation of Deferred@508102612 after retry RPC after error@1344581226) -> (continuation of Deferred@1798605908 after retry RPC after error@813670617) -> (continuation of Deferred@1717466789 after retry RPC after error@335336442) -> (continuation of Deferred@1550171133 after retry RPC after error@298951104) -> (continuation of Deferred@78579201 after retry RPC after error@1907975789) -> (continuation of Deferred@7504372 after retry RPC after error@481427355) -> (continuation of Deferred@1616014594 after retry RPC after error@1516430699) -> (continuation of Deferred@1317774066 after retry RPC after error@1565901215) -> (continuation of Deferred@782015818 after retry RPC after error@1662544975) -> (continuation of Deferred@1889001196 after retry RPC after error@62759000) -> (continuation of Deferred@1224805288 after retry RPC after error@1767599315) -> (continuation of Deferred@662028202 after retry RPC after error@1235510396) -> (continuation of Deferred@146373291 after retry RPC after error@976663195) -> (continuation of Deferred@808764056 after retry RPC after error@1524221798) -> (continuation of Deferred@427197108 after retry RPC after error@383474027) -> (continuation of Deferred@7170346 after retry RPC after error@337345718) -> (continuation of Deferred@961884067 after retry RPC after error@1963534819) -> (continuation of Deferred@507914833 after retry RPC after error@1375144931), errback=(continuation of Deferred@1102829580 after retry RPC after error@1891586359) -> (continuation of Deferred@561912439 after retry RPC after error@1093942157) -> (continuation of Deferred@1582358559 after retry RPC after error@1416373259) -> (continuation of Deferred@84947283 after retry RPC after error@1704495663) -> (continuation of Deferred@1016188571 after retry RPC after error@157874558) -> (continuation of Deferred@225893289 after retry RPC after error@740221402) -> (continuation of Deferred@508102612 after retry RPC after error@1344581226) -> (continuation of Deferred@1798605908 after retry RPC after error@813670617) -> (continuation of Deferred@1717466789 after retry RPC after error@335336442) -> (continuation of Deferred@1550171133 after retry RPC after error@298951104) -> (continuation of Deferred@78579201 after retry RPC after error@1907975789) -> (continuation of Deferred@7504372 after retry RPC after error@481427355) -> (continuation of Deferred@1616014594 after retry RPC after error@1516430699) -> (continuation of Deferred@1317774066 after retry RPC after error@1565901215) -> (continuation of Deferred@782015818 after retry RPC after error@1662544975) -> (continuation of Deferred@1889001196 after retry RPC after error@62759000) -> (continuation of Deferred@1224805288 after retry RPC after error@1767599315) -> (continuation of Deferred@662028202 after retry RPC after error@1235510396) -> (continuation of Deferred@146373291 after retry RPC after error@976663195) -> (continuation of Deferred@808764056 after retry RPC after error@1524221798) -> (continuation of Deferred@427197108 after retry RPC after error@383474027) -> (continuation of Deferred@7170346 after retry RPC after error@337345718) -> (continuation of Deferred@961884067 after retry RPC after error@1963534819) -> (continuation of Deferred@507914833 after retry RPC after error@1375144931)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.5.136.62:42905
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:35:06.956 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 2f0efe0c81addbcaea565a6248e4a915: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:35:06.957 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
18:35:06.957 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
18:35:06.957 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2f0efe0c81addbcaea565a6248e4a915) switched from state RUNNING to RESTARTING.
18:35:06.976 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:06.976 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:06.976 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:06.976 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:06.976 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:06.976 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:06.976 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:06.976 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:06.976 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:06.977 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:06.977 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:06.977 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:06.977 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:07.031 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:07.032 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:07.032 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:07.032 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:07.032 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:07.032 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:07.032 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:07.033 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:07.033 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:07.033 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:07.033 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:07.033 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:07.033 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:07.076 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:07.076 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:07.076 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:07.076 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:07.076 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:07.076 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:07.077 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:07.077 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:07.077 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:07.077 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:07.077 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:07.077 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:07.077 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:07.082 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:07.082 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:07.082 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:07.082 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:07.082 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:07.082 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:07.083 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:07.083 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:07.083 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:07.083 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:07.083 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:07.083 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:07.083 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:07.176 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:07.176 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:07.176 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:07.177 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:07.177 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:07.177 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:07.177 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:07.177 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:07.177 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:07.178 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:07.178 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:07.178 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:07.178 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:07.243 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:07.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:05.344089 10964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:35:07.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:06.709558 10962 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 10950
18:35:07.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:07.253840 10950 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.913s	user 0.469s	sys 0.965s
18:35:07.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:07.255132 10950 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.915s	user 0.469s	sys 0.966s
18:35:07.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:07.263628 10975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:35:07.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.263999 10950 server_base.cc:1061] running on GCE node
18:35:07.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.265463 10950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:35:07.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.268181 10950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:35:07.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.269681 10950 hybrid_clock.cc:648] HybridClock initialized: now 1783535707269638 us; error 36 us; skew 500 ppm
18:35:07.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.270649 10950 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:35:07.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.278527 10950 webserver.cc:534] Webserver started at http://127.10.26.194:37885/ using document root <none> and password file <none>
18:35:07.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.279991 10950 fs_manager.cc:362] Metadata directory not provided
18:35:07.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.280325 10950 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:35:07.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.280917 10950 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:35:07.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.286191 10950 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/data/instance:
18:35:07.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9b9757a0654c4616bbce35ab01010513"
18:35:07.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:35:07 on dist-test-slave-dxnw"
18:35:07.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.287612 10950 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/wal/instance:
18:35:07.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9b9757a0654c4616bbce35ab01010513"
18:35:07.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:35:07 on dist-test-slave-dxnw"
18:35:07.295 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:07.295 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:07.295 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:07.295 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:07.295 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:07.295 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:07.295 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:07.295 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:07.295 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:07.295 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:07.295 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:07.296 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:07.296 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:07.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.296207 10950 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.002s
18:35:07.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.302922 10980 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:35:07.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.304347 10950 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
18:35:07.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.304742 10950 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/wal
18:35:07.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9b9757a0654c4616bbce35ab01010513"
18:35:07.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:35:07 on dist-test-slave-dxnw"
18:35:07.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.305204 10950 fs_report.cc:389] FS layout report
18:35:07.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:35:07.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/wal
18:35:07.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/wal
18:35:07.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/data/data
18:35:07.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:35:07.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:35:07.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:35:07.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:35:07.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:35:07.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:35:07.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:35:07.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:35:07.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:35:07.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:35:07.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:35:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.393843 10950 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:35:07.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.395927 10950 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:35:07.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.396543 10950 kserver.cc:163] Server-wide thread pool size limit: 3276
18:35:07.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.400127 10950 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:35:07.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:07.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.405755 10950 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:35:07.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.406004 10950 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:35:07.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.406343 10950 ts_tablet_manager.cc:616] Registered 0 tablets
18:35:07.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.406591 10950 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:35:07.451 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:07.451 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:07.451 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:07.452 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:07.452 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:07.452 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:07.452 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:07.452 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:07.452 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:07.453 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:07.453 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:07.453 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:07.453 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:07.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.588207 10950 rpc_server.cc:307] RPC server started. Bound to: 127.10.26.194:34279
18:35:07.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.588318 11092 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.26.194:34279 every 8 connection(s)
18:35:07.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.591509 10950 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/data/info.pb
18:35:07.595 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:07.595 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:07.595 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:07.596 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:07.596 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:07.596 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:07.599 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:07.599 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:07.599 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:07.599 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:07.599 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:07.599 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:07.599 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:07.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.601253 10347 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 10950
18:35:07.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.601917 10347 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-1/wal/instance
18:35:07.647 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:07.647 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:07.647 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:07.647 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:07.647 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:07.648 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:07.648 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:07.648 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:07.648 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:07.648 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:07.648 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:07.648 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:07.648 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:07.649 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29907), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [5ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [7ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [9ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [9ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [30ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [31ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [31ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [32ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [41ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [42ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [42ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [42ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [61ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [61ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [61ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [61ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [82ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [83ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [83ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [83ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [121ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [121ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [122ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [122ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [161ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [161ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [161ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [161ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [182ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [321ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [321ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [322ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [322ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [681ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [681ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [681ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [682ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [1480ms] refreshing cache from master, [1480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [1482ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [2200ms] refreshing cache from master, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [2201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [2201ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [2820ms] refreshing cache from master, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [2821ms] too many traces: truncated at 100 traces, deferred=Deferred@603708968(state=PENDING, result=null, callback=(continuation of Deferred@1142513592 after retry RPC after error@1167627261) -> (continuation of Deferred@1794700554 after retry RPC after error@386886883) -> (continuation of Deferred@434439461 after retry RPC after error@409168543) -> (continuation of Deferred@899587132 after retry RPC after error@1494914584) -> (continuation of Deferred@1751612467 after retry RPC after error@1800651826) -> (continuation of Deferred@711842328 after retry RPC after error@659174171) -> (continuation of Deferred@1948210469 after retry RPC after error@18378176) -> (continuation of Deferred@1164040929 after retry RPC after error@868608957) -> (continuation of Deferred@1031612061 after retry RPC after error@2135505567) -> (continuation of Deferred@884232517 after retry RPC after error@674286701) -> (continuation of Deferred@2091732536 after retry RPC after error@1241911024) -> (continuation of Deferred@1554927756 after retry RPC after error@1918086352) -> (continuation of Deferred@1679417388 after retry RPC after error@512889809) -> (continuation of Deferred@815143615 after retry RPC after error@1607210321) -> (continuation of Deferred@1954518532 after retry RPC after error@2055016385) -> (continuation of Deferred@2050925011 after retry RPC after error@1172788568) -> (continuation of Deferred@1302344790 after retry RPC after error@1597061412) -> (continuation of Deferred@1351494440 after retry RPC after error@792525300) -> (continuation of Deferred@1668442817 after retry RPC after error@903649170) -> (continuation of Deferred@338312554 after retry RPC after error@1553040706) -> (continuation of Deferred@751163507 after retry RPC after error@2113186430) -> (continuation of Deferred@955259335 after retry RPC after error@1746612238) -> (continuation of Deferred@1788836670 after retry RPC after error@845192009) -> (continuation of Deferred@182883043 after retry RPC after error@1003243761) -> (continuation of Deferred@714838589 after retry RPC after error@479719156) -> (continuation of Deferred@584586767 after retry RPC after error@2072664421), errback=(continuation of Deferred@1142513592 after retry RPC after error@1167627261) -> (continuation of Deferred@1794700554 after retry RPC after error@386886883) -> (continuation of Deferred@434439461 after retry RPC after error@409168543) -> (continuation of Deferred@899587132 after retry RPC after error@1494914584) -> (continuation of Deferred@1751612467 after retry RPC after error@1800651826) -> (continuation of Deferred@711842328 after retry RPC after error@659174171) -> (continuation of Deferred@1948210469 after retry RPC after error@18378176) -> (continuation of Deferred@1164040929 after retry RPC after error@868608957) -> (continuation of Deferred@1031612061 after retry RPC after error@2135505567) -> (continuation of Deferred@884232517 after retry RPC after error@674286701) -> (continuation of Deferred@2091732536 after retry RPC after error@1241911024) -> (continuation of Deferred@1554927756 after retry RPC after error@1918086352) -> (continuation of Deferred@1679417388 after retry RPC after error@512889809) -> (continuation of Deferred@815143615 after retry RPC after error@1607210321) -> (continuation of Deferred@1954518532 after retry RPC after error@2055016385) -> (continuation of Deferred@2050925011 after retry RPC after error@1172788568) -> (continuation of Deferred@1302344790 after retry RPC after error@1597061412) -> (continuation of Deferred@1351494440 after retry RPC after error@792525300) -> (continuation of Deferred@1668442817 after retry RPC after error@903649170) -> (continuation of Deferred@338312554 after retry RPC after error@1553040706) -> (continuation of Deferred@751163507 after retry RPC after error@2113186430) -> (continuation of Deferred@955259335 after retry RPC after error@1746612238) -> (continuation of Deferred@1788836670 after retry RPC after error@845192009) -> (continuation of Deferred@182883043 after retry RPC after error@1003243761) -> (continuation of Deferred@714838589 after retry RPC after error@479719156) -> (continuation of Deferred@584586767 after retry RPC after error@2072664421)))
18:35:07.650 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
18:35:07.650 [WARN - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#2 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29907), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [5ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [7ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [9ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [9ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [30ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [31ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [31ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [32ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [41ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [42ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [42ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [42ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [61ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [61ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [61ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [61ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [82ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [83ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [83ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [83ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [121ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [121ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [122ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [122ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [161ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [161ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [161ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [161ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [182ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [321ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [321ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [322ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [322ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [681ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [681ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [681ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [682ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [1480ms] refreshing cache from master, [1480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [1482ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [2200ms] refreshing cache from master, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [2201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [2201ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [2820ms] refreshing cache from master, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [2821ms] too many traces: truncated at 100 traces, deferred=Deferred@603708968(state=PENDING, result=null, callback=(continuation of Deferred@1142513592 after retry RPC after error@1167627261) -> (continuation of Deferred@1794700554 after retry RPC after error@386886883) -> (continuation of Deferred@434439461 after retry RPC after error@409168543) -> (continuation of Deferred@899587132 after retry RPC after error@1494914584) -> (continuation of Deferred@1751612467 after retry RPC after error@1800651826) -> (continuation of Deferred@711842328 after retry RPC after error@659174171) -> (continuation of Deferred@1948210469 after retry RPC after error@18378176) -> (continuation of Deferred@1164040929 after retry RPC after error@868608957) -> (continuation of Deferred@1031612061 after retry RPC after error@2135505567) -> (continuation of Deferred@884232517 after retry RPC after error@674286701) -> (continuation of Deferred@2091732536 after retry RPC after error@1241911024) -> (continuation of Deferred@1554927756 after retry RPC after error@1918086352) -> (continuation of Deferred@1679417388 after retry RPC after error@512889809) -> (continuation of Deferred@815143615 after retry RPC after error@1607210321) -> (continuation of Deferred@1954518532 after retry RPC after error@2055016385) -> (continuation of Deferred@2050925011 after retry RPC after error@1172788568) -> (continuation of Deferred@1302344790 after retry RPC after error@1597061412) -> (continuation of Deferred@1351494440 after retry RPC after error@792525300) -> (continuation of Deferred@1668442817 after retry RPC after error@903649170) -> (continuation of Deferred@338312554 after retry RPC after error@1553040706) -> (continuation of Deferred@751163507 after retry RPC after error@2113186430) -> (continuation of Deferred@955259335 after retry RPC after error@1746612238) -> (continuation of Deferred@1788836670 after retry RPC after error@845192009) -> (continuation of Deferred@182883043 after retry RPC after error@1003243761) -> (continuation of Deferred@714838589 after retry RPC after error@479719156) -> (continuation of Deferred@584586767 after retry RPC after error@2072664421), errback=(continuation of Deferred@1142513592 after retry RPC after error@1167627261) -> (continuation of Deferred@1794700554 after retry RPC after error@386886883) -> (continuation of Deferred@434439461 after retry RPC after error@409168543) -> (continuation of Deferred@899587132 after retry RPC after error@1494914584) -> (continuation of Deferred@1751612467 after retry RPC after error@1800651826) -> (continuation of Deferred@711842328 after retry RPC after error@659174171) -> (continuation of Deferred@1948210469 after retry RPC after error@18378176) -> (continuation of Deferred@1164040929 after retry RPC after error@868608957) -> (continuation of Deferred@1031612061 after retry RPC after error@2135505567) -> (continuation of Deferred@884232517 after retry RPC after error@674286701) -> (continuation of Deferred@2091732536 after retry RPC after error@1241911024) -> (continuation of Deferred@1554927756 after retry RPC after error@1918086352) -> (continuation of Deferred@1679417388 after retry RPC after error@512889809) -> (continuation of Deferred@815143615 after retry RPC after error@1607210321) -> (continuation of Deferred@1954518532 after retry RPC after error@2055016385) -> (continuation of Deferred@2050925011 after retry RPC after error@1172788568) -> (continuation of Deferred@1302344790 after retry RPC after error@1597061412) -> (continuation of Deferred@1351494440 after retry RPC after error@792525300) -> (continuation of Deferred@1668442817 after retry RPC after error@903649170) -> (continuation of Deferred@338312554 after retry RPC after error@1553040706) -> (continuation of Deferred@751163507 after retry RPC after error@2113186430) -> (continuation of Deferred@955259335 after retry RPC after error@1746612238) -> (continuation of Deferred@1788836670 after retry RPC after error@845192009) -> (continuation of Deferred@182883043 after retry RPC after error@1003243761) -> (continuation of Deferred@714838589 after retry RPC after error@479719156) -> (continuation of Deferred@584586767 after retry RPC after error@2072664421)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.5.136.61:43625
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:35:07.651 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
18:35:07.653 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
18:35:07.654 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to FAILED on 1bed232f-62eb-42dc-858c-7139d8e062d6 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29907), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [5ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [7ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [9ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [9ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [30ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [31ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [31ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [32ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [41ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [42ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [42ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [42ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [61ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [61ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [61ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [61ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [82ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [83ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [83ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [83ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [121ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [121ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [122ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [122ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [161ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [161ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [161ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [161ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [182ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [182ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [321ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [321ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [322ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [322ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [681ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [681ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [681ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [682ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [1480ms] refreshing cache from master, [1480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [1482ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [2200ms] refreshing cache from master, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [2200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [2201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.60:39171: Network error: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.62:42905: Network error: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905, [2201ms] Sub RPC ConnectToMaster: received response from server master-127.5.136.61:43625: Network error: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [2201ms] delaying RPC due to: Service unavailable: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625, [2820ms] refreshing cache from master, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.60:39171, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.62:42905, [2820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.5.136.61:43625, [2821ms] too many traces: truncated at 100 traces, deferred=Deferred@603708968(state=PENDING, result=null, callback=(continuation of Deferred@1142513592 after retry RPC after error@1167627261) -> (continuation of Deferred@1794700554 after retry RPC after error@386886883) -> (continuation of Deferred@434439461 after retry RPC after error@409168543) -> (continuation of Deferred@899587132 after retry RPC after error@1494914584) -> (continuation of Deferred@1751612467 after retry RPC after error@1800651826) -> (continuation of Deferred@711842328 after retry RPC after error@659174171) -> (continuation of Deferred@1948210469 after retry RPC after error@18378176) -> (continuation of Deferred@1164040929 after retry RPC after error@868608957) -> (continuation of Deferred@1031612061 after retry RPC after error@2135505567) -> (continuation of Deferred@884232517 after retry RPC after error@674286701) -> (continuation of Deferred@2091732536 after retry RPC after error@1241911024) -> (continuation of Deferred@1554927756 after retry RPC after error@1918086352) -> (continuation of Deferred@1679417388 after retry RPC after error@512889809) -> (continuation of Deferred@815143615 after retry RPC after error@1607210321) -> (continuation of Deferred@1954518532 after retry RPC after error@2055016385) -> (continuation of Deferred@2050925011 after retry RPC after error@1172788568) -> (continuation of Deferred@1302344790 after retry RPC after error@1597061412) -> (continuation of Deferred@1351494440 after retry RPC after error@792525300) -> (continuation of Deferred@1668442817 after retry RPC after error@903649170) -> (continuation of Deferred@338312554 after retry RPC after error@1553040706) -> (continuation of Deferred@751163507 after retry RPC after error@2113186430) -> (continuation of Deferred@955259335 after retry RPC after error@1746612238) -> (continuation of Deferred@1788836670 after retry RPC after error@845192009) -> (continuation of Deferred@182883043 after retry RPC after error@1003243761) -> (continuation of Deferred@714838589 after retry RPC after error@479719156) -> (continuation of Deferred@584586767 after retry RPC after error@2072664421), errback=(continuation of Deferred@1142513592 after retry RPC after error@1167627261) -> (continuation of Deferred@1794700554 after retry RPC after error@386886883) -> (continuation of Deferred@434439461 after retry RPC after error@409168543) -> (continuation of Deferred@899587132 after retry RPC after error@1494914584) -> (continuation of Deferred@1751612467 after retry RPC after error@1800651826) -> (continuation of Deferred@711842328 after retry RPC after error@659174171) -> (continuation of Deferred@1948210469 after retry RPC after error@18378176) -> (continuation of Deferred@1164040929 after retry RPC after error@868608957) -> (continuation of Deferred@1031612061 after retry RPC after error@2135505567) -> (continuation of Deferred@884232517 after retry RPC after error@674286701) -> (continuation of Deferred@2091732536 after retry RPC after error@1241911024) -> (continuation of Deferred@1554927756 after retry RPC after error@1918086352) -> (continuation of Deferred@1679417388 after retry RPC after error@512889809) -> (continuation of Deferred@815143615 after retry RPC after error@1607210321) -> (continuation of Deferred@1954518532 after retry RPC after error@2055016385) -> (continuation of Deferred@2050925011 after retry RPC after error@1172788568) -> (continuation of Deferred@1302344790 after retry RPC after error@1597061412) -> (continuation of Deferred@1351494440 after retry RPC after error@792525300) -> (continuation of Deferred@1668442817 after retry RPC after error@903649170) -> (continuation of Deferred@338312554 after retry RPC after error@1553040706) -> (continuation of Deferred@751163507 after retry RPC after error@2113186430) -> (continuation of Deferred@955259335 after retry RPC after error@1746612238) -> (continuation of Deferred@1788836670 after retry RPC after error@845192009) -> (continuation of Deferred@182883043 after retry RPC after error@1003243761) -> (continuation of Deferred@714838589 after retry RPC after error@479719156) -> (continuation of Deferred@584586767 after retry RPC after error@2072664421)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.5.136.61:43625
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:35:07.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.654189 11093 heartbeater.cc:344] Connected to a master server at 127.10.26.252:40435
18:35:07.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.654791 11093 heartbeater.cc:461] Registering TS with master...
18:35:07.656 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
18:35:07.656 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 2f0efe0c81addbcaea565a6248e4a915: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:35:07.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.656394 11093 heartbeater.cc:507] Master 127.10.26.252:40435 requested a full tablet report, sending...
18:35:07.657 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
18:35:07.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.668912 10623 ts_manager.cc:194] Registered new tserver with Master: 9b9757a0654c4616bbce35ab01010513 (127.10.26.194:34279)
18:35:07.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.672302 10623 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.26.194:32927
18:35:07.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.682953 10347 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/wal
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/data
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/logs
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/data/info.pb
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.26.195:0
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.26.195
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.26.195
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.26.254:36869,127.10.26.253:36107,127.10.26.252:40435
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.26.212:43597
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:35:07.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:35:07.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:35:07.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.691944 11094 heartbeater.cc:344] Connected to a master server at 127.10.26.253:36107
18:35:07.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.692338 11094 heartbeater.cc:461] Registering TS with master...
18:35:07.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.693029 11094 heartbeater.cc:507] Master 127.10.26.253:36107 requested a full tablet report, sending...
18:35:07.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.696974 10536 ts_manager.cc:194] Registered new tserver with Master: 9b9757a0654c4616bbce35ab01010513 (127.10.26.194:34279)
18:35:07.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.727396 11095 heartbeater.cc:344] Connected to a master server at 127.10.26.254:36869
18:35:07.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.727784 11095 heartbeater.cc:461] Registering TS with master...
18:35:07.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.728448 11095 heartbeater.cc:507] Master 127.10.26.254:36869 requested a full tablet report, sending...
18:35:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:07.731331 10457 ts_manager.cc:194] Registered new tserver with Master: 9b9757a0654c4616bbce35ab01010513 (127.10.26.194:34279)
18:35:07.743 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:07.795 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:07.795 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:07.795 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:07.795 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:07.795 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:07.796 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:07.796 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:07.796 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:07.796 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:07.796 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:07.796 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:07.796 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:07.796 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:07.902 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:07.916 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:07.916 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:07.916 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:07.916 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:07.916 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:07.916 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:07.916 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:07.916 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:07.916 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:07.916 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:07.916 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:07.916 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:07.917 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:07.964 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:07.964 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:07.964 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:07.964 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:07.964 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:07.964 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:07.964 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:07.964 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:07.964 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:07.964 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:07.964 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:07.964 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:07.964 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:08.046 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:08.046 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:08.046 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:08.046 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:08.046 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:08.046 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:08.046 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:08.047 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:08.047 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:08.047 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:08.047 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:08.047 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:08.047 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:08.055 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:08.055 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:08.055 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:08.055 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:08.055 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:08.055 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:08.055 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:08.055 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:08.056 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:08.055 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:08.056 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:08.056 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:08.056 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:08.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:08.106226 11103 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:35:08.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:08.106894 11103 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:35:08.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:08.107653 11103 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:35:08.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:08.151674 11103 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:35:08.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:08.152794 11103 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.26.195
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:08.201009 11103 tablet_server_runner.cc:78] Tablet server non-default flags:
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.26.212:43597
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/data
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/wal
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.26.195:0
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/data/info.pb
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.26.195
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.26.254:36869,127.10.26.253:36107,127.10.26.252:40435
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:35:08.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:35:08.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.26.195
18:35:08.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/logs
18:35:08.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:35:08.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:35:08.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:35:08.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:35:08.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:35:08.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:35:08.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:35:08.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:05:40 UTC on e7f111948823
18:35:08.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16871
18:35:08.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
18:35:08.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:08.202642 11103 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:35:08.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:08.204437 11103 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:35:08.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:08.223009 11109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:35:08.243 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:08.283 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:08.283 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:08.283 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:08.284 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:08.284 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:08.284 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:08.284 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:08.284 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:08.284 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:08.284 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:08.284 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:08.284 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:08.284 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:08.291 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:08.291 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:08.292 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:08.292 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:08.292 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:08.292 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:08.292 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:08.292 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:08.292 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:08.293 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:08.293 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:08.293 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:08.293 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:08.396 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:08.396 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:08.396 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:08.397 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:08.397 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:08.397 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:08.398 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:08.398 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:08.398 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:08.398 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:08.398 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:08.398 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:08.398 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:08.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:08.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:08.677789 11093 heartbeater.cc:499] Master 127.10.26.252:40435 was elected leader, sending a full tablet report...
18:35:08.742 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:08.846 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:08.846 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:08.846 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:08.847 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:08.847 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:08.847 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:08.847 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:08.847 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:08.847 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:08.847 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:08.848 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:08.848 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:08.848 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:08.879 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:08.880 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:08.880 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:08.880 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:08.880 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:08.880 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:08.880 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:08.880 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:08.881 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:08.881 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:08.881 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:08.881 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:08.881 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:08.902 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:08.936 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:08.936 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:08.936 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:08.936 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:08.936 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:08.937 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:08.937 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:08.937 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:08.937 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:08.937 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:08.937 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:08.937 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:08.937 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:08.944 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:08.944 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:08.944 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:08.944 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:08.945 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:08.945 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:08.945 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:08.945 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:08.945 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:08.945 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:08.945 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:08.945 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:08.945 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:08.995 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:08.996 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:08.996 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:08.996 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:08.996 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:08.996 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:08.996 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:08.997 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:08.997 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:08.997 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:08.997 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:08.997 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:08.997 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:09.043 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:09.043 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:09.043 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:09.044 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:09.044 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:09.044 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:09.044 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:09.044 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:09.044 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:09.044 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:09.045 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:09.045 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:09.045 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:09.242 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:09.262 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:09.262 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:09.262 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:09.263 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:09.263 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:09.263 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:09.263 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:09.263 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:09.263 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:09.263 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:09.263 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:09.263 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:09.263 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:09.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:09.491 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:09.491 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:09.491 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:09.492 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:09.492 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:09.492 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:09.492 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:09.492 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:09.492 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:09.492 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:09.493 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:09.493 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:09.493 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:09.656 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:09.656 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:09.656 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:09.656 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:09.656 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:09.656 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:09.657 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:09.657 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:09.657 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:09.656 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:09.657 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:09.657 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:09.657 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:09.742 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:09.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:09.956 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:09.956 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:09.956 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:09.957 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:09.957 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:09.957 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:09.957 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:09.958 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:09.958 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:09.958 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:09.958 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:09.958 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:09.958 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:10.018 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:10.019 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:10.019 [DEBUG - pool-510-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:10.019 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:10.019 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:10.019 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:10.020 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:10.020 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:10.020 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:10.020 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:10.020 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:10.020 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:10.020 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:10.242 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:10.280 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:10.280 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:10.280 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:10.281 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:10.281 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:10.281 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:10.281 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:10.281 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:10.281 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:10.282 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:10.282 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:10.282 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:10.282 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:10.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:10.381410 11103 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.158s	user 0.764s	sys 1.201s
18:35:10.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:10.381903 11103 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.159s	user 0.764s	sys 1.201s
18:35:10.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:08.225127 11110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:35:10.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:09.625598 11108 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 11103
18:35:10.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:10.383845 11112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:35:10.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:10.391842 11111 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2167 milliseconds
18:35:10.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.391891 11103 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
18:35:10.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.393499 11103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:35:10.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.396311 11103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:35:10.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.397780 11103 hybrid_clock.cc:648] HybridClock initialized: now 1783535710397721 us; error 44 us; skew 500 ppm
18:35:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.399056 11103 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:35:10.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:10.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.407821 11103 webserver.cc:534] Webserver started at http://127.10.26.195:46215/ using document root <none> and password file <none>
18:35:10.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.408931 11103 fs_manager.cc:362] Metadata directory not provided
18:35:10.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.409206 11103 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:35:10.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.409787 11103 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:35:10.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.415539 11103 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/data/instance:
18:35:10.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "98a8eded6bca4187b80c3aa15ab74cb7"
18:35:10.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:35:10 on dist-test-slave-dxnw"
18:35:10.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.417039 11103 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/wal/instance:
18:35:10.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "98a8eded6bca4187b80c3aa15ab74cb7"
18:35:10.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:35:10 on dist-test-slave-dxnw"
18:35:10.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.426553 11103 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.008s	sys 0.000s
18:35:10.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.433578 11125 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:35:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.434808 11103 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.002s
18:35:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.435329 11103 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/data,/tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/wal
18:35:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "98a8eded6bca4187b80c3aa15ab74cb7"
18:35:10.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:35:10 on dist-test-slave-dxnw"
18:35:10.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.435756 11103 fs_report.cc:389] FS layout report
18:35:10.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:35:10.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/wal
18:35:10.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/wal
18:35:10.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/data/data
18:35:10.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:35:10.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:35:10.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:35:10.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:35:10.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:35:10.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:35:10.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:35:10.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:35:10.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:35:10.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:35:10.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:35:10.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.493127 11103 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:35:10.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.494835 11103 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:35:10.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.495412 11103 kserver.cc:163] Server-wide thread pool size limit: 3276
18:35:10.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.498733 11103 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:35:10.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.504081 11103 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:35:10.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.504361 11103 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:35:10.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.504586 11103 ts_tablet_manager.cc:616] Registered 0 tablets
18:35:10.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.504805 11103 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:35:10.655 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 2f0efe0c81addbcaea565a6248e4a915 from Checkpoint 68 @ 1783535644646 for 2f0efe0c81addbcaea565a6248e4a915 located at file:/tmp/junit6432019912241751994/checkpoints/2f0efe0c81addbcaea565a6248e4a915/chk-68.
18:35:10.656 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
18:35:10.656 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 68 for source Source: KuduSource to checkpoint.
18:35:10.656 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
18:35:10.657 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 2f0efe0c81addbcaea565a6248e4a915: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:35:10.657 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
18:35:10.657 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 1bed232f-62eb-42dc-858c-7139d8e062d6 @ 127.0.0.1 (dataPort=-1) with allocation id cac6830ea48c76d0f02fea2daf2d606e
18:35:10.658 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (2f0efe0c81addbcaea565a6248e4a915) switched from state RESTARTING to RUNNING.
18:35:10.658 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskSlotTableImpl.java:391) Activate slot cac6830ea48c76d0f02fea2daf2d606e.
18:35:10.658 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 2f0efe0c81addbcaea565a6248e4a915 from Checkpoint 68 @ 1783535644646 for 2f0efe0c81addbcaea565a6248e4a915 located at file:/tmp/junit6432019912241751994/checkpoints/2f0efe0c81addbcaea565a6248e4a915/chk-68.
18:35:10.659 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
18:35:10.659 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to SCHEDULED.
18:35:10.659 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 2 to checkpoint 68 for source Source: KuduSource to checkpoint.
18:35:10.659 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 2f0efe0c81addbcaea565a6248e4a915: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:35:10.659 [INFO - flink-pekko.actor.default-dispatcher-10] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id cac6830ea48c76d0f02fea2daf2d606e.
18:35:10.660 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
18:35:10.660 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
18:35:10.661 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@39ddcd78
18:35:10.661 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:10.661 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit6432019912241751994/checkpoints")
18:35:10.662 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
18:35:10.663 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from SCHEDULED to DEPLOYING.
18:35:10.663 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #3) with attempt id 64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 1bed232f-62eb-42dc-858c-7139d8e062d6 @ 127.0.0.1 (dataPort=-1) with allocation id 724a237c36a82d0d22572c72ade5813d
18:35:10.663 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 724a237c36a82d0d22572c72ade5813d.
18:35:10.663 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
18:35:10.664 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#3 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_3), deploy into slot with allocation id 724a237c36a82d0d22572c72ade5813d.
18:35:10.666 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6a72a63f
18:35:10.668 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:10.668 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to DEPLOYING.
18:35:10.669 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.669 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#3 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_3) [DEPLOYING].
18:35:10.669 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.669 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4e0138bf
18:35:10.669 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:10.669 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit6432019912241751994/checkpoints")
18:35:10.670 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
18:35:10.670 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.670 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.670 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (64d733c18b826c46b5739fcbca8e3700_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
18:35:10.670 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.670 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.671 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.671 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.671 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.672 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@d4c97c1
18:35:10.673 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:10.688 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.688 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.688 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.688 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.698 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.699 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.700 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.700 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.700 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.701 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.701 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.701 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.701 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.702 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.702 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.702 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.702 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.709 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.710 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.711 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.711 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.711 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.715 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.716 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.716 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.716 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.716 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.719 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:10.719 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:10.719 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:10.720 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:10.720 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:10.720 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:10.720 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.720 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.720 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.720 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.720 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:10.720 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:10.720 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:10.721 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:10.721 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:10.721 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:10.721 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:10.723 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.723 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.723 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.723 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.724 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.725 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.725 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.725 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.725 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.725 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.725 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.725 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.729 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.729 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.730 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.730 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.730 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.737 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.737 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.738 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.738 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.738 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.738 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.738 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.738 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.738 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.739 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.739 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.739 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.739 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.739 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.740 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.740 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.740 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.740 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.740 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.740 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.740 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.742 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:10.744 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:10.744 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:10.744 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:10.744 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:10.744 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:10.744 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:10.744 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:10.744 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:10.744 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:10.744 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:10.744 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:10.745 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:10.745 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:10.749 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.749 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.749 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.749 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.749 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.749 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.749 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.749 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.749 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.749 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.749 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.749 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.749 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.753328 11103 rpc_server.cc:307] RPC server started. Bound to: 127.10.26.195:33405
18:35:10.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.753520 11258 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.26.195:33405 every 8 connection(s)
18:35:10.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.756495 11103 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/data/info.pb
18:35:10.757 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.757 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.757 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.757 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.757 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.757 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.757 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.757 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.757 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.757 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.757 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.757 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.757 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.757076 10347 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu as pid 11103
18:35:10.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.757604 10347 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSwO0Je/test-tmp/mini-kudu-cluster14158157091376201911/ts-2/wal/instance
18:35:10.769 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.769 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.769 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.769 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.769 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.770 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.770 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.770 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.770 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.770 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.770 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.770 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.770 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.777 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.777 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.777 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.777 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.778 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.778 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.778 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.778 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.778 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.778 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.778 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.778 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.778 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.780 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:10.780 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:10.780 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:10.780 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:10.780 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:10.780 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:10.781 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:10.781 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:10.781 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:10.781 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:10.781 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:10.781 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:10.781 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:10.809 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.809 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.810 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.810 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.810 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.810 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.810 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.810 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.810 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.810 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.810 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.810 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.810 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.817 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.817 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.817 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.817 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.817 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.817 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.817 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.817 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.817 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.817 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.817 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.817 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.818 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.819 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:10.819 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:10.819 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:10.820 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:10.820 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:10.820 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:10.820 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:10.820 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:10.820 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:10.820 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:10.820 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:10.820 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:10.820 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:10.837 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.837 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.838 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.838 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.838 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.838 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.838 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.838 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.838 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.838 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.838 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.838 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.838 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.855141 11260 heartbeater.cc:344] Connected to a master server at 127.10.26.253:36107
18:35:10.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.855742 11260 heartbeater.cc:461] Registering TS with master...
18:35:10.857 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.857 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.857 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.857 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.858 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.858 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.858 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.858 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.858 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.858 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.858 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.858 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.858 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.857836 11260 heartbeater.cc:507] Master 127.10.26.253:36107 requested a full tablet report, sending...
18:35:10.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.862375 10536 ts_manager.cc:194] Registered new tserver with Master: 98a8eded6bca4187b80c3aa15ab74cb7 (127.10.26.195:33405)
18:35:10.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.864792 11263 heartbeater.cc:344] Connected to a master server at 127.10.26.254:36869
18:35:10.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.865161 11263 heartbeater.cc:461] Registering TS with master...
18:35:10.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.866238 11263 heartbeater.cc:507] Master 127.10.26.254:36869 requested a full tablet report, sending...
18:35:10.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.868665 11259 heartbeater.cc:344] Connected to a master server at 127.10.26.252:40435
18:35:10.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.869078 11259 heartbeater.cc:461] Registering TS with master...
18:35:10.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.869048 10457 ts_manager.cc:194] Registered new tserver with Master: 98a8eded6bca4187b80c3aa15ab74cb7 (127.10.26.195:33405)
18:35:10.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.870100 11259 heartbeater.cc:507] Master 127.10.26.252:40435 requested a full tablet report, sending...
18:35:10.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.872324 10623 ts_manager.cc:194] Registered new tserver with Master: 98a8eded6bca4187b80c3aa15ab74cb7 (127.10.26.195:33405)
18:35:10.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.873812 10623 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.26.195:54191
18:35:10.889 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.889 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.890 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.890 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.890 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.890 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.890 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.890 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.890 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.890 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.890 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.890161 10347 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
18:35:10.890 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.890 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.897 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.897 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.897 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.897 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.897 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.897 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.897 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.897 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.897 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.897 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.897 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.897 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.897 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:10.905 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:35:10.905 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

18:35:10.907 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.10.26.254"
      port: 36869
    }
    bound_http_address {
      host: "127.10.26.254"
      port: 38171
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.10.26.253"
      port: 36107
    }
    bound_http_address {
      host: "127.10.26.253"
      port: 35193
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.10.26.252"
      port: 40435
    }
    bound_http_address {
      host: "127.10.26.252"
      port: 36251
    }
  }
}

18:35:10.907 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

18:35:10.908 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.10.26.193"
      port: 37959
    }
    bound_http_address {
      host: "127.10.26.193"
      port: 38039
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.10.26.194"
      port: 34279
    }
    bound_http_address {
      host: "127.10.26.194"
      port: 37885
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.10.26.195"
      port: 33405
    }
    bound_http_address {
      host: "127.10.26.195"
      port: 46215
    }
  }
}

18:35:10.908 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
18:35:10.909 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:10.912 [DEBUG - main] (Connection.java:748) [peer master-127.9.79.252:38727(127.9.79.252:38727)] connecting to peer
18:35:10.913 [DEBUG - main] (Connection.java:748) [peer master-127.9.79.253:36577(127.9.79.253:36577)] connecting to peer
18:35:10.913 [DEBUG - main] (Connection.java:748) [peer master-127.9.79.254:42669(127.9.79.254:42669)] connecting to peer
18:35:10.913 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.79.252:38727(127.9.79.252:38727)] Successfully connected to peer
18:35:10.914 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.79.253:36577(127.9.79.253:36577)] Successfully connected to peer
18:35:10.914 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:10.917 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.79.254:42669(127.9.79.254:42669)] Successfully connected to peer
18:35:10.921 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.79.254
18:35:10.921 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.79.252
18:35:10.929 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.79.253
18:35:10.931 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:10.932 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:10.934 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9da6726e, L:/127.0.0.1:54784 - R:/127.9.79.252:38727] using SASL/PLAIN
18:35:10.936 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x30143309, L:/127.0.0.1:60238 - R:/127.9.79.254:42669] using SASL/PLAIN
18:35:10.937 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:10.940 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:35:10.940 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x301a21b8, L:/127.0.0.1:40882 - R:/127.9.79.253:36577] using SASL/PLAIN
18:35:10.941 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=28), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.79.252:38727, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.79.253:36577, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.79.254:42669, [26ms] Sub RPC ConnectToMaster: received response from server master-127.9.79.252:38727: OK, [28ms] Sub RPC ConnectToMaster: received response from server master-127.9.79.254:42669: OK, deferred=null) after lookup
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:10.945751  9633 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60238:
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int8"
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT8
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int16"
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT16
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:10.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int32"
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int64"
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT64
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "bool"
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "float"
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: FLOAT
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "double"
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DOUBLE
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "string"
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:35:10.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-array"
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:10.949 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-bytebuffer"
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:10.949 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "null"
18:35:10.949 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "timestamp"
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: UNIXTIME_MICROS
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "decimal"
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DECIMAL32
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       precision: 5
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       scale: 3
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:35:10.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "varchar"
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: VARCHAR
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
18:35:10.950 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.950 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.950 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.950 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.950 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.950 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.949 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.950 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       length: 10
18:35:10.950 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.950 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "date"
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DATE
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:10.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:10.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:10.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:10.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:10.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:35:10.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
18:35:10.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
18:35:10.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:35:10.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "int8"
18:35:10.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:35:10.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:10.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:35:10.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:10.953131  9633 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
18:35:10.969 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:10.970 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:10.970 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:10.970 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.970 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.970 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:10.971 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.971 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.971 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:10.971 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.971 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.971 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:10.971 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:11.000 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 644dfa4bfb534206927890c17fbcab2f
18:35:11.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.044618 10123 tablet_service.cc:1511] Processing CreateTablet for tablet 04a712669e0b47419a4fcec8d7685a67 (DEFAULT_TABLE table=replication_test_table [id=644dfa4bfb534206927890c17fbcab2f]), partition=RANGE (int8) PARTITION UNBOUNDED
18:35:11.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.047044 10123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a712669e0b47419a4fcec8d7685a67. 1 dirs total, 0 dirs full, 0 dirs failed
18:35:11.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.085865  9976 tablet_service.cc:1511] Processing CreateTablet for tablet 04a712669e0b47419a4fcec8d7685a67 (DEFAULT_TABLE table=replication_test_table [id=644dfa4bfb534206927890c17fbcab2f]), partition=RANGE (int8) PARTITION UNBOUNDED
18:35:11.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.088234  9976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a712669e0b47419a4fcec8d7685a67. 1 dirs total, 0 dirs full, 0 dirs failed
18:35:11.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.094558 11292 tablet_bootstrap.cc:492] T 04a712669e0b47419a4fcec8d7685a67 P 1efcebc990364b10942ae70571022125: Bootstrap starting.
18:35:11.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.096737 10272 tablet_service.cc:1511] Processing CreateTablet for tablet 04a712669e0b47419a4fcec8d7685a67 (DEFAULT_TABLE table=replication_test_table [id=644dfa4bfb534206927890c17fbcab2f]), partition=RANGE (int8) PARTITION UNBOUNDED
18:35:11.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.099089 10272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a712669e0b47419a4fcec8d7685a67. 1 dirs total, 0 dirs full, 0 dirs failed
18:35:11.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.123550 11293 tablet_bootstrap.cc:492] T 04a712669e0b47419a4fcec8d7685a67 P 7574f138ca2d45388a7343688d429edf: Bootstrap starting.
18:35:11.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.127265 11292 tablet_bootstrap.cc:654] T 04a712669e0b47419a4fcec8d7685a67 P 1efcebc990364b10942ae70571022125: Neither blocks nor log segments found. Creating new log.
18:35:11.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.129868 11292 log.cc:826] T 04a712669e0b47419a4fcec8d7685a67 P 1efcebc990364b10942ae70571022125: Log is configured to *not* fsync() on all Append() calls
18:35:11.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.133384 11294 tablet_bootstrap.cc:492] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c: Bootstrap starting.
18:35:11.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.136773 11293 tablet_bootstrap.cc:654] T 04a712669e0b47419a4fcec8d7685a67 P 7574f138ca2d45388a7343688d429edf: Neither blocks nor log segments found. Creating new log.
18:35:11.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.140753 11293 log.cc:826] T 04a712669e0b47419a4fcec8d7685a67 P 7574f138ca2d45388a7343688d429edf: Log is configured to *not* fsync() on all Append() calls
18:35:11.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.140884 11292 tablet_bootstrap.cc:492] T 04a712669e0b47419a4fcec8d7685a67 P 1efcebc990364b10942ae70571022125: No bootstrap required, opened a new log
18:35:11.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.142427 11294 tablet_bootstrap.cc:654] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c: Neither blocks nor log segments found. Creating new log.
18:35:11.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.141474 11292 ts_tablet_manager.cc:1403] T 04a712669e0b47419a4fcec8d7685a67 P 1efcebc990364b10942ae70571022125: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.007s
18:35:11.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.145305 11294 log.cc:826] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c: Log is configured to *not* fsync() on all Append() calls
18:35:11.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.150926 11293 tablet_bootstrap.cc:492] T 04a712669e0b47419a4fcec8d7685a67 P 7574f138ca2d45388a7343688d429edf: No bootstrap required, opened a new log
18:35:11.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.151784 11293 ts_tablet_manager.cc:1403] T 04a712669e0b47419a4fcec8d7685a67 P 7574f138ca2d45388a7343688d429edf: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.004s
18:35:11.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.153688 11294 tablet_bootstrap.cc:492] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c: No bootstrap required, opened a new log
18:35:11.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.154263 11294 ts_tablet_manager.cc:1403] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.008s
18:35:11.157 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:11.158 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:11.158 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:11.158 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:11.158 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:11.158 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:11.158 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:11.158 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:11.158 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:11.158 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:11.158 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:11.158 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:11.158 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:11.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.178242 11292 raft_consensus.cc:359] T 04a712669e0b47419a4fcec8d7685a67 P 1efcebc990364b10942ae70571022125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1efcebc990364b10942ae70571022125" member_type: VOTER last_known_addr { host: "127.9.79.194" port: 36053 } } peers { permanent_uuid: "7574f138ca2d45388a7343688d429edf" member_type: VOTER last_known_addr { host: "127.9.79.193" port: 42499 } } peers { permanent_uuid: "dd6b79d156f3425f9339508e1f01df9c" member_type: VOTER last_known_addr { host: "127.9.79.195" port: 41625 } }
18:35:11.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.180346 11292 raft_consensus.cc:385] T 04a712669e0b47419a4fcec8d7685a67 P 1efcebc990364b10942ae70571022125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:35:11.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.180797 11292 raft_consensus.cc:740] T 04a712669e0b47419a4fcec8d7685a67 P 1efcebc990364b10942ae70571022125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1efcebc990364b10942ae70571022125, State: Initialized, Role: FOLLOWER
18:35:11.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.181902 11292 consensus_queue.cc:260] T 04a712669e0b47419a4fcec8d7685a67 P 1efcebc990364b10942ae70571022125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1efcebc990364b10942ae70571022125" member_type: VOTER last_known_addr { host: "127.9.79.194" port: 36053 } } peers { permanent_uuid: "7574f138ca2d45388a7343688d429edf" member_type: VOTER last_known_addr { host: "127.9.79.193" port: 42499 } } peers { permanent_uuid: "dd6b79d156f3425f9339508e1f01df9c" member_type: VOTER last_known_addr { host: "127.9.79.195" port: 41625 } }
18:35:11.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.185484 11293 raft_consensus.cc:359] T 04a712669e0b47419a4fcec8d7685a67 P 7574f138ca2d45388a7343688d429edf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1efcebc990364b10942ae70571022125" member_type: VOTER last_known_addr { host: "127.9.79.194" port: 36053 } } peers { permanent_uuid: "7574f138ca2d45388a7343688d429edf" member_type: VOTER last_known_addr { host: "127.9.79.193" port: 42499 } } peers { permanent_uuid: "dd6b79d156f3425f9339508e1f01df9c" member_type: VOTER last_known_addr { host: "127.9.79.195" port: 41625 } }
18:35:11.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.186558 11293 raft_consensus.cc:385] T 04a712669e0b47419a4fcec8d7685a67 P 7574f138ca2d45388a7343688d429edf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:35:11.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.187001 11293 raft_consensus.cc:740] T 04a712669e0b47419a4fcec8d7685a67 P 7574f138ca2d45388a7343688d429edf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7574f138ca2d45388a7343688d429edf, State: Initialized, Role: FOLLOWER
18:35:11.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.188064 11294 raft_consensus.cc:359] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1efcebc990364b10942ae70571022125" member_type: VOTER last_known_addr { host: "127.9.79.194" port: 36053 } } peers { permanent_uuid: "7574f138ca2d45388a7343688d429edf" member_type: VOTER last_known_addr { host: "127.9.79.193" port: 42499 } } peers { permanent_uuid: "dd6b79d156f3425f9339508e1f01df9c" member_type: VOTER last_known_addr { host: "127.9.79.195" port: 41625 } }
18:35:11.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.188189 11293 consensus_queue.cc:260] T 04a712669e0b47419a4fcec8d7685a67 P 7574f138ca2d45388a7343688d429edf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1efcebc990364b10942ae70571022125" member_type: VOTER last_known_addr { host: "127.9.79.194" port: 36053 } } peers { permanent_uuid: "7574f138ca2d45388a7343688d429edf" member_type: VOTER last_known_addr { host: "127.9.79.193" port: 42499 } } peers { permanent_uuid: "dd6b79d156f3425f9339508e1f01df9c" member_type: VOTER last_known_addr { host: "127.9.79.195" port: 41625 } }
18:35:11.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.189333 11294 raft_consensus.cc:385] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:35:11.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.189802 11294 raft_consensus.cc:740] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd6b79d156f3425f9339508e1f01df9c, State: Initialized, Role: FOLLOWER
18:35:11.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.191150 11294 consensus_queue.cc:260] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1efcebc990364b10942ae70571022125" member_type: VOTER last_known_addr { host: "127.9.79.194" port: 36053 } } peers { permanent_uuid: "7574f138ca2d45388a7343688d429edf" member_type: VOTER last_known_addr { host: "127.9.79.193" port: 42499 } } peers { permanent_uuid: "dd6b79d156f3425f9339508e1f01df9c" member_type: VOTER last_known_addr { host: "127.9.79.195" port: 41625 } }
18:35:11.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.207917 11294 ts_tablet_manager.cc:1434] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c: Time spent starting tablet: real 0.053s	user 0.033s	sys 0.014s
18:35:11.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.227751 11292 ts_tablet_manager.cc:1434] T 04a712669e0b47419a4fcec8d7685a67 P 1efcebc990364b10942ae70571022125: Time spent starting tablet: real 0.084s	user 0.026s	sys 0.016s
18:35:11.243 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:11.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.248034 11293 ts_tablet_manager.cc:1434] T 04a712669e0b47419a4fcec8d7685a67 P 7574f138ca2d45388a7343688d429edf: Time spent starting tablet: real 0.096s	user 0.045s	sys 0.026s
18:35:11.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:11.248625 10344 tablet.cc:2406] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:35:11.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:11.255854 10054 tablet.cc:2406] T 04a712669e0b47419a4fcec8d7685a67 P 7574f138ca2d45388a7343688d429edf: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:35:11.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.268468 11300 raft_consensus.cc:493] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:35:11.269 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (4cd649562a0f5305571102b5c888c5a9) switched from state RESTARTING to RUNNING.
18:35:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.269064 11300 raft_consensus.cc:515] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1efcebc990364b10942ae70571022125" member_type: VOTER last_known_addr { host: "127.9.79.194" port: 36053 } } peers { permanent_uuid: "7574f138ca2d45388a7343688d429edf" member_type: VOTER last_known_addr { host: "127.9.79.193" port: 42499 } } peers { permanent_uuid: "dd6b79d156f3425f9339508e1f01df9c" member_type: VOTER last_known_addr { host: "127.9.79.195" port: 41625 } }
18:35:11.269 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job 4cd649562a0f5305571102b5c888c5a9 from Checkpoint 65 @ 1783535546001 for 4cd649562a0f5305571102b5c888c5a9 located at file:/tmp/junit5514029058471043739/checkpoints/4cd649562a0f5305571102b5c888c5a9/chk-65.
18:35:11.270 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
18:35:11.270 [INFO - flink-pekko.actor.default-dispatcher-9] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:35:11.271 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from CREATED to SCHEDULED.
18:35:11.272 [INFO - Thread-73] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:35:11.272 [DEBUG - Thread-73] (Connection.java:575) [peer master-127.0.106.253:45189(127.0.106.253:45189)] disconnecting while in state TERMINATED
18:35:11.272 [DEBUG - Thread-73] (Connection.java:575) [peer master-127.0.106.254:32967(127.0.106.254:32967)] disconnecting while in state TERMINATED
18:35:11.272 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:35:11.272 [DEBUG - Thread-73] (Connection.java:575) [peer master-127.0.106.252:46705(127.0.106.252:46705)] disconnecting while in state TERMINATED
18:35:11.273 [DEBUG - Thread-73] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:35:11.275 [INFO - Thread-73] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:35:11.275 [INFO - Thread-73] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:35:11.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.272796 11300 leader_election.cc:290] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1efcebc990364b10942ae70571022125 (127.9.79.194:36053), 7574f138ca2d45388a7343688d429edf (127.9.79.193:42499)
18:35:11.278 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from SCHEDULED to DEPLOYING.
18:35:11.278 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #7) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id d0320e7b86362daa97e494337af6f333
18:35:11.278 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot d0320e7b86362daa97e494337af6f333.
18:35:11.278 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CREATED to SCHEDULED.
18:35:11.279 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:35:11.279 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#7 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_7), deploy into slot with allocation id d0320e7b86362daa97e494337af6f333.
18:35:11.279 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from SCHEDULED to DEPLOYING.
18:35:11.280 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #7) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id 0abd8d1f15ad274a5029e6ed83960f8c
18:35:11.280 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CREATED to SCHEDULED.
18:35:11.281 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:35:11.282 [DEBUG - Thread-73] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:11.282 [INFO - Thread-73] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:35:11.283 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from SCHEDULED to DEPLOYING.
18:35:11.283 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #7) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id c230971fad26d6cfa2b63ff44e7a1af5
18:35:11.283 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CREATED to SCHEDULED.
18:35:11.283 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 4cd649562a0f5305571102b5c888c5a9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:35:11.284 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from SCHEDULED to DEPLOYING.
18:35:11.284 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #7) with attempt id 98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 1d03ac8f-9014-4e11-a73d-f29e736712bb @ 127.0.0.1 (dataPort=-1) with allocation id 163e6d56962e3a45c0e4353eb3be3a9b
18:35:11.285 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 0abd8d1f15ad274a5029e6ed83960f8c.
18:35:11.286 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#7 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_7), deploy into slot with allocation id 0abd8d1f15ad274a5029e6ed83960f8c.
18:35:11.289 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#7 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from CREATED to DEPLOYING.
18:35:11.289 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#7 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_7) [DEPLOYING].
18:35:11.289 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2a4598c2
18:35:11.289 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:11.289 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:35:11.290 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#7 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from DEPLOYING to INITIALIZING.
18:35:11.290 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from DEPLOYING to INITIALIZING.
18:35:11.293 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot c230971fad26d6cfa2b63ff44e7a1af5.
18:35:11.293 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@280e5865
18:35:11.293 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CREATED to DEPLOYING.
18:35:11.293 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#7 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_7) [DEPLOYING].
18:35:11.294 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@21a5304b
18:35:11.294 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:11.294 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#7 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_7), deploy into slot with allocation id c230971fad26d6cfa2b63ff44e7a1af5.
18:35:11.294 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:35:11.294 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from DEPLOYING to INITIALIZING.
18:35:11.295 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from DEPLOYING to INITIALIZING.
18:35:11.295 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:11.296 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:35:11.296 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:35:11.296 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:35:11.296 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:35:11.297 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot 163e6d56962e3a45c0e4353eb3be3a9b.
18:35:11.298 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#7 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_7), deploy into slot with allocation id 163e6d56962e3a45c0e4353eb3be3a9b.
18:35:11.298 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CREATED to DEPLOYING.
18:35:11.298 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#7 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_7) [DEPLOYING].
18:35:11.299 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@456c6e09
18:35:11.299 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:11.299 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:35:11.299 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1b26e9c1
18:35:11.299 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from DEPLOYING to INITIALIZING.
18:35:11.299 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from DEPLOYING to INITIALIZING.
18:35:11.302 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6798f110
18:35:11.303 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:11.304 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:11.304 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CREATED to DEPLOYING.
18:35:11.305 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#7 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_7) [DEPLOYING].
18:35:11.305 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:11.305 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@32f14f41
18:35:11.305 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:11.305 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5514029058471043739/checkpoints")
18:35:11.306 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from DEPLOYING to INITIALIZING.
18:35:11.306 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (98e5c1d86bc65faceedd09bcb151d258_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from DEPLOYING to INITIALIZING.
18:35:11.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.307099  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a712669e0b47419a4fcec8d7685a67" candidate_uuid: "dd6b79d156f3425f9339508e1f01df9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7574f138ca2d45388a7343688d429edf" is_pre_election: true
18:35:11.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.307988  9999 raft_consensus.cc:2468] T 04a712669e0b47419a4fcec8d7685a67 P 7574f138ca2d45388a7343688d429edf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd6b79d156f3425f9339508e1f01df9c in term 0.
18:35:11.308 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@e0c5cd6
18:35:11.309 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.309643 10228 leader_election.cc:304] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7574f138ca2d45388a7343688d429edf, dd6b79d156f3425f9339508e1f01df9c; no voters: 
18:35:11.310 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:11.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.310690 11300 raft_consensus.cc:2804] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [term 0 FOLLOWER]: Leader pre-election won for term 1
18:35:11.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.311189 11300 raft_consensus.cc:493] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:35:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.311570 11300 raft_consensus.cc:3060] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [term 0 FOLLOWER]: Advancing to term 1
18:35:11.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.320811 11300 raft_consensus.cc:515] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1efcebc990364b10942ae70571022125" member_type: VOTER last_known_addr { host: "127.9.79.194" port: 36053 } } peers { permanent_uuid: "7574f138ca2d45388a7343688d429edf" member_type: VOTER last_known_addr { host: "127.9.79.193" port: 42499 } } peers { permanent_uuid: "dd6b79d156f3425f9339508e1f01df9c" member_type: VOTER last_known_addr { host: "127.9.79.195" port: 41625 } }
18:35:11.322 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.324 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.324256 11300 leader_election.cc:290] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [CANDIDATE]: Term 1 election: Requested vote from peers 1efcebc990364b10942ae70571022125 (127.9.79.194:36053), 7574f138ca2d45388a7343688d429edf (127.9.79.193:42499)
18:35:11.325 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:11.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.324702 10143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a712669e0b47419a4fcec8d7685a67" candidate_uuid: "dd6b79d156f3425f9339508e1f01df9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1efcebc990364b10942ae70571022125" is_pre_election: true
18:35:11.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.325713 10143 raft_consensus.cc:2468] T 04a712669e0b47419a4fcec8d7685a67 P 1efcebc990364b10942ae70571022125 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd6b79d156f3425f9339508e1f01df9c in term 0.
18:35:11.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.325775  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a712669e0b47419a4fcec8d7685a67" candidate_uuid: "dd6b79d156f3425f9339508e1f01df9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7574f138ca2d45388a7343688d429edf"
18:35:11.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.326195  9999 raft_consensus.cc:3060] T 04a712669e0b47419a4fcec8d7685a67 P 7574f138ca2d45388a7343688d429edf [term 0 FOLLOWER]: Advancing to term 1
18:35:11.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.327224 10142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a712669e0b47419a4fcec8d7685a67" candidate_uuid: "dd6b79d156f3425f9339508e1f01df9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1efcebc990364b10942ae70571022125"
18:35:11.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.327908 10142 raft_consensus.cc:3060] T 04a712669e0b47419a4fcec8d7685a67 P 1efcebc990364b10942ae70571022125 [term 0 FOLLOWER]: Advancing to term 1
18:35:11.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.333896  9999 raft_consensus.cc:2468] T 04a712669e0b47419a4fcec8d7685a67 P 7574f138ca2d45388a7343688d429edf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd6b79d156f3425f9339508e1f01df9c in term 1.
18:35:11.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.334128 10142 raft_consensus.cc:2468] T 04a712669e0b47419a4fcec8d7685a67 P 1efcebc990364b10942ae70571022125 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd6b79d156f3425f9339508e1f01df9c in term 1.
18:35:11.335 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.335 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.336 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.336 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.335095 10228 leader_election.cc:304] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7574f138ca2d45388a7343688d429edf, dd6b79d156f3425f9339508e1f01df9c; no voters: 
18:35:11.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.336055 11300 raft_consensus.cc:2804] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [term 1 FOLLOWER]: Leader election won for term 1
18:35:11.336 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.336 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.336 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.337 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.337 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.337 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.337 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.337 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.338 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.338 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.338 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.338 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.339 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.339 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.339 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.339 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.340 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.339497 11300 raft_consensus.cc:697] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [term 1 LEADER]: Becoming Leader. State: Replica: dd6b79d156f3425f9339508e1f01df9c, State: Running, Role: LEADER
18:35:11.341 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.341 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:11.341 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.341 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.341 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.341 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.342 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.342 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.342 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:11.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.341509 11300 consensus_queue.cc:237] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1efcebc990364b10942ae70571022125" member_type: VOTER last_known_addr { host: "127.9.79.194" port: 36053 } } peers { permanent_uuid: "7574f138ca2d45388a7343688d429edf" member_type: VOTER last_known_addr { host: "127.9.79.193" port: 42499 } } peers { permanent_uuid: "dd6b79d156f3425f9339508e1f01df9c" member_type: VOTER last_known_addr { host: "127.9.79.195" port: 41625 } }
18:35:11.343 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.343 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.343 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.343 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.343 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.343 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.343 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.343 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.344 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.344 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.344 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:11.344 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.344 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.344 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.344 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.345 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.345 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.345 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.345 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:11.345 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.346 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.346 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.346 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.346 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.347 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.347 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.347 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.347 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.347 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:11.347 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.348 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.348 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.348 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.348 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:11.348 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.348 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.348 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.349 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.349 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.349 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.349 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.349 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.349 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.349 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:11.350 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.355 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.355 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.355 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.355 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.362 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.363 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.365 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.367 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:11.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.367966  9633 catalog_manager.cc:5696] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c reported cstate change: term changed from 0 to 1, leader changed from <none> to dd6b79d156f3425f9339508e1f01df9c (127.9.79.195). New cstate: current_term: 1 leader_uuid: "dd6b79d156f3425f9339508e1f01df9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1efcebc990364b10942ae70571022125" member_type: VOTER last_known_addr { host: "127.9.79.194" port: 36053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7574f138ca2d45388a7343688d429edf" member_type: VOTER last_known_addr { host: "127.9.79.193" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd6b79d156f3425f9339508e1f01df9c" member_type: VOTER last_known_addr { host: "127.9.79.195" port: 41625 } health_report { overall_health: HEALTHY } } }
18:35:11.376 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.376 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.377 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.377 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.392 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.392 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.392 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.392 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.396 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.397 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.397 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.397 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:11.403 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.403 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.403 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.403 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.404 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.404 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.404 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.404 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.404 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.405 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.405 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.405 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.405 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.406 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.406 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.406 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.406 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.407 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.407 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.407 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.407 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.407 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.407 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.407 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.407 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:11.407 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.407 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.408 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.410 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.414 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.414 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:11.415 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.415 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.415 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.415 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.416 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.416 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.416 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.415 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.416 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.416 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.416 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.416 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.416 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.417 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.417 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.417 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.417 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.417 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.417 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.417 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:11.417 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.417 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.417 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.418 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.418 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.418 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.418 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:11.421 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.422 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.422 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.422 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.422 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.422 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.422 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.423 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.423 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.423 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.423 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.423 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.423 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.423 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.423 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.423 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.423 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.423 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.423 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.424 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.424 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.424 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.424 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.424 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.424 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.424 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.425 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.425 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.425 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:11.425 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:11.426 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:11.426 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.426 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.426 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.426 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.426 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.426 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.426 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.426 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.426 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.426 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.426 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.426 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:11.426 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.427 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.427 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.427 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.427 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.427 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.427 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.427 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.427 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.429 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:11.429 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:11.429 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:11.429 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:11.429 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:11.429 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:11.429 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:11.429 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:11.429 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:11.429 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.429 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:11.430 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:11.430 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:11.430 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:11.430 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.430 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.430 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.430 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.430 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.430 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.430 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.430 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.430 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.430 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.430 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.430 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.441 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.441 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.441 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.442 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.442 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.442 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.442 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.442 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.442 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.442 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.442 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.442 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.442 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.442 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.442 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.442 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.442 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.443 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.443 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.443 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.443 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.443 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.443 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.443 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.443 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.443 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.445 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.445 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.445 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.445 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.445 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.445 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.446 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.446 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.446 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.446 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.446 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.446 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.446 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.446 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:11.446 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:11.446 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:11.446 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.446 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.446 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.447 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.447 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.447 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.447 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.447 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.447 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.447 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:11.450 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.450 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.450 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.450 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.451 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.451 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.451 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.451 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.451 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.451 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.451 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.451 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.451 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.456 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:11.457 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:11.457 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:11.457 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:11.457 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:11.457 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:11.457 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:11.457 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:11.457 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:11.457 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:11.457 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:11.457 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:11.457 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:11.461 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.461 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.461 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.461 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.461 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.461 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.461 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.461 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.461 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.461 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.461 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.461 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.461 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.463 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.463 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.463 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.463 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.463 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.463 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.463 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.463 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.463 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.463 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.463 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.463 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.463 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.465 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.465 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.465 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.465 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.465 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.465 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.465 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.465 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.465 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.465 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.465 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.465 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.465 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.470 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.470 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.470 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.470 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.470 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.470 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.470 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.470 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.470 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.471 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.471 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.471 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.471 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:11.473548 10195 tablet.cc:2406] T 04a712669e0b47419a4fcec8d7685a67 P 1efcebc990364b10942ae70571022125: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:35:11.481 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.481 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.481 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.481 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.481 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.482 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.482 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.482 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.482 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.482 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.482 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.482 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.482 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.485 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.485 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.485 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.485 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.485 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.485 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.485 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.485 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.485 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.485 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.485 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.486 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:11.486 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.486 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.486 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:11.486 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:11.486 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.486 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.486 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.486 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.486 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.486 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.486 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.486 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.486 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.486 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:11.495 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:11.495 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:11.495 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:11.495 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:11.495 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:11.496 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:11.496 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:11.496 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:11.495 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:11.496 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:11.496 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:11.496 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:11.496 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:11.502 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.503 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.503 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.503 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.503 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.503 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.503 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.503 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.503 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.503 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.503 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.503 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.503 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.525 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.525 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.525 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.525 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:11.525 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.525 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.525 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.525 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:11.525 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.525 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.525 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:11.526 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.526 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.526 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.526 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.526 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.526 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.526 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.526 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.526 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.526 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.526 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:11.526 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.526 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.526 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.526 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.530 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.531 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.531 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.531 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.531 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.531 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.531 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.531 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.531 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.531 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.531 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.531 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.531 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.542 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.542 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.542 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.542 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.543 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.543 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.543 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.543 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.543 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.543 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.543 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.543 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.543 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.550 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.550 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.550 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.550 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.551 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.551 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.550 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.551 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.551 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.551 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.551 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.551 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.551 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.561 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.561 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.561 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.561 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.561 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.561 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.561 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.561 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.561 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.561 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.561 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.561 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.561 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.580 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:11.580 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:11.580 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:11.580 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:11.580 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:11.580 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:11.580 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:11.580 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:11.580 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:11.581 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:11.581 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:11.581 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:11.581 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:11.586 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:11.586 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:11.586 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:11.586 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.586 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.586 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.586 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.586 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.586 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.586 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.586 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.586 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.587 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:11.603 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:11.603 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:11.603 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:11.603 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:11.603 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:11.604 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:11.604 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:11.604 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:11.604 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:11.604 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:11.604 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:11.604 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:11.604 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:11.639 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 644dfa4bfb534206927890c17fbcab2f
18:35:11.642 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.642 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.642 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.643 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.643 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.643 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.643 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.643 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.643 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.644 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.644 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.644 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.645 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.645 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.645 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.645 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.645 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.645 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.645 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.645 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.645 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.645 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.647 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.648 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.648 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.648 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.650 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.650 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.650 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.651 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.651 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.651 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.651 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.651 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.651 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.651 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.651 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.651 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.651 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.655 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 04a712669e0b47419a4fcec8d7685a67 for table 'replication_test_table' with partition [<start>, <end>)
18:35:11.655 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=04a712669e0b47419a4fcec8d7685a67@[1efcebc990364b10942ae70571022125(127.9.79.194:36053),7574f138ca2d45388a7343688d429edf(127.9.79.193:42499),dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)[L]]}]
18:35:11.655 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.79.254:42669, [4ms] Sub RPC GetTableLocations: received response from server master-127.9.79.254:42669: OK, deferred=null) after lookup
18:35:11.655 [DEBUG - kudu-nio-2] (Connection.java:748) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] connecting to peer
18:35:11.657 [DEBUG - kudu-nio-3] (Connection.java:757) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] Successfully connected to peer
18:35:11.661 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.661 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.661 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.661 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.661 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.661 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.661 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.661 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.661 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.661 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.661 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.661 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.661 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.679 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:11.683 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x198ee786, L:/127.0.0.1:42632 - R:/127.9.79.195:41625] using TOKEN/null
18:35:11.685 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.685 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.685 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.685 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.686 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.686 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.686 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.686 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.686 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.686 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.686 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.686 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.686 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.719163  9999 raft_consensus.cc:1275] T 04a712669e0b47419a4fcec8d7685a67 P 7574f138ca2d45388a7343688d429edf [term 1 FOLLOWER]: Refusing update from remote peer dd6b79d156f3425f9339508e1f01df9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:35:11.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.719791 10142 raft_consensus.cc:1275] T 04a712669e0b47419a4fcec8d7685a67 P 1efcebc990364b10942ae70571022125 [term 1 FOLLOWER]: Refusing update from remote peer dd6b79d156f3425f9339508e1f01df9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:35:11.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.721125 11300 consensus_queue.cc:1048] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7574f138ca2d45388a7343688d429edf" member_type: VOTER last_known_addr { host: "127.9.79.193" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:35:11.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.721834 11320 consensus_queue.cc:1048] T 04a712669e0b47419a4fcec8d7685a67 P dd6b79d156f3425f9339508e1f01df9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1efcebc990364b10942ae70571022125" member_type: VOTER last_known_addr { host: "127.9.79.194" port: 36053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:35:11.742 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:11.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.758220 11361 mvcc.cc:204] Tried to move back new op lower bound from 7305362275170783232 to 7305362273668890624. Current Snapshot: MvccSnapshot[applied={T|T < 7305362275170783232}]
18:35:11.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.763355 11364 mvcc.cc:204] Tried to move back new op lower bound from 7305362275170783232 to 7305362273668890624. Current Snapshot: MvccSnapshot[applied={T|T < 7305362275170783232}]
18:35:11.790 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.790 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.790 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.790 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.791 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.791 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.791 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.791 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.791 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.791 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.791 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.791 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.791 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.803 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:11.806 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:11.806 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:11.806 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:11.806 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.806 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.806 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:11.807 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.807 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.807 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:11.807 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.807 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.807 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:11.807 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:11.862 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.862 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.862 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.863 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.863 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.863 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.863 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.863 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.863 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.863 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.863 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.864 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.864 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:11.877493 11259 heartbeater.cc:499] Master 127.10.26.252:40435 was elected leader, sending a full tablet report...
18:35:11.883 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:11.883 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:11.883 [DEBUG - pool-500-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:11.884 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:11.884 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:11.884 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:11.884 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:11.884 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:11.884 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:11.884 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:11.884 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:11.884 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:11.884 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:11.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:11.902 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.902 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.903 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.903 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.903 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.903 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.903 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.903 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.903 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.903 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.903 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.903 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.903 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.921 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:11.929 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:11.929 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:11.929 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:11.930 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:11.930 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:11.930 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:11.930 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:11.930 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:11.930 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:11.930 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:11.931 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:11.931 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:11.931 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:11.964 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:11.965 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:11.965 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:11.965 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.965 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.965 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:11.965 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.965 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.965 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:11.965 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.965 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.965 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:11.965 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:11.977 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:11.977 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:11.977 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:11.977 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:11.977 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:11.978 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:11.978 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:11.978 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:11.978 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:11.978 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:11.978 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:11.978 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:11.978 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:12.010 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:12.010 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:12.010 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:12.010 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.010 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.010 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.010 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.011 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.011 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.011 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.011 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.011 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.011 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:12.022 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:12.023 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:12.023 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:12.023 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.023 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.023 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.023 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.023 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.023 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.023 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.023 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.023 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.023 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:12.103 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:12.104 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:12.106 [DEBUG - main] (Connection.java:748) [peer master-127.10.26.252:40435(127.10.26.252:40435)] connecting to peer
18:35:12.107 [DEBUG - main] (Connection.java:748) [peer master-127.10.26.253:36107(127.10.26.253:36107)] connecting to peer
18:35:12.107 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.10.26.252:40435(127.10.26.252:40435)] Successfully connected to peer
18:35:12.111 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.26.252
18:35:12.119 [DEBUG - main] (Connection.java:748) [peer master-127.10.26.254:36869(127.10.26.254:36869)] connecting to peer
18:35:12.121 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.10.26.253:36107(127.10.26.253:36107)] Successfully connected to peer
18:35:12.124 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.26.253
18:35:12.127 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:12.131 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4aa5e511, L:/127.0.0.1:46190 - R:/127.10.26.252:40435] using SASL/PLAIN
18:35:12.132 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:12.135 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.10.26.254:36869(127.10.26.254:36869)] Successfully connected to peer
18:35:12.135 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x09d6f1c4, L:/127.0.0.1:48282 - R:/127.10.26.253:36107] using SASL/PLAIN
18:35:12.135 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:35:12.135 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=30), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.252:40435, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.253:36107, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.254:36869, [29ms] Sub RPC ConnectToMaster: received response from server master-127.10.26.252:40435: OK, deferred=null) after lookup
18:35:12.142 [DEBUG - main] (Connection.java:748) [peer master-127.9.79.252:38727(127.9.79.252:38727)] connecting to peer
18:35:12.147 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:12.151 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x16f6c863, L:/127.0.0.1:39120 - R:/127.10.26.254:36869] using TOKEN/null
18:35:12.163 [DEBUG - main] (Connection.java:748) [peer master-127.9.79.253:36577(127.9.79.253:36577)] connecting to peer
18:35:12.164 [DEBUG - main] (Connection.java:748) [peer master-127.9.79.254:42669(127.9.79.254:42669)] connecting to peer
18:35:12.164 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.79.252:38727(127.9.79.252:38727)] Successfully connected to peer
18:35:12.166 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.79.253:36577(127.9.79.253:36577)] Successfully connected to peer
18:35:12.169 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.79.252
18:35:12.174 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.79.254:42669(127.9.79.254:42669)] Successfully connected to peer
18:35:12.183 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:12.186 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.79.254
18:35:12.187 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.79.253
18:35:12.196 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:12.196 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:12.198 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe2a3e95b, L:/127.0.0.1:60414 - R:/127.9.79.252:38727] using SASL/PLAIN
18:35:12.200 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x8502f2e2, L:/127.0.0.1:37330 - R:/127.9.79.254:42669] using SASL/PLAIN
18:35:12.202 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc738b574, L:/127.0.0.1:54708 - R:/127.9.79.253:36577] using SASL/PLAIN
18:35:12.219 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:35:12.219 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=80), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.79.252:38727, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.79.253:36577, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.79.254:42669, [60ms] Sub RPC ConnectToMaster: received response from server master-127.9.79.252:38727: OK, [66ms] Sub RPC ConnectToMaster: received response from server master-127.9.79.253:36577: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.9.79.254:42669: OK, deferred=null) after lookup
18:35:12.223 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:12.223 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:12.223 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:12.223 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.223 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.223 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.223 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.223 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.223 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 644dfa4bfb534206927890c17fbcab2f
18:35:12.223 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.223 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.224 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.224 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.224 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:12.227 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 04a712669e0b47419a4fcec8d7685a67 for table 'replication_test_table' with partition [<start>, <end>)
18:35:12.227 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=04a712669e0b47419a4fcec8d7685a67@[1efcebc990364b10942ae70571022125(127.9.79.194:36053),7574f138ca2d45388a7343688d429edf(127.9.79.193:42499),dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)[L]]}]
18:35:12.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.234020 10622 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46190:
18:35:12.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int8"
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT8
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int16"
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT16
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int32"
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int64"
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT64
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "bool"
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:35:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "float"
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: FLOAT
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "double"
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DOUBLE
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "string"
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-array"
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-bytebuffer"
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "null"
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "timestamp"
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: UNIXTIME_MICROS
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "decimal"
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DECIMAL32
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       precision: 5
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       scale: 3
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "varchar"
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: VARCHAR
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       length: 10
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "date"
18:35:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DATE
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\000\000\000\007\000\000\000\000"
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "int8"
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:35:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
18:35:12.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:12.241268 10622 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
18:35:12.242 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:12.265 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:12.265 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:12.265 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:12.266 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.266 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.266 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.266 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.266 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.266 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.266 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.266 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.266 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.267 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:12.286 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:12.286 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:12.286 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:12.287 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:12.287 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:12.287 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:12.287 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:12.287 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:12.287 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:12.287 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:12.288 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:12.288 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:12.288 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:12.296 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:12.296 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:12.296 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:12.297 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:12.297 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:12.297 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:12.297 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:12.297 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:12.297 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:12.298 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:12.298 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:12.298 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:12.298 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:12.302 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:12.304 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 716932bc7b984d3e9e9cffe98fdc8066
18:35:12.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.365341 11028 tablet_service.cc:1511] Processing CreateTablet for tablet 25738d17842d46a38a6a374a71afdb3a (DEFAULT_TABLE table=replication_test_table [id=716932bc7b984d3e9e9cffe98fdc8066]), partition=RANGE (int8) PARTITION UNBOUNDED
18:35:12.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.367734 11028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25738d17842d46a38a6a374a71afdb3a. 1 dirs total, 0 dirs full, 0 dirs failed
18:35:12.403 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:12.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.401975 11174 tablet_service.cc:1511] Processing CreateTablet for tablet 25738d17842d46a38a6a374a71afdb3a (DEFAULT_TABLE table=replication_test_table [id=716932bc7b984d3e9e9cffe98fdc8066]), partition=RANGE (int8) PARTITION UNBOUNDED
18:35:12.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.403545 11409 tablet_bootstrap.cc:492] T 25738d17842d46a38a6a374a71afdb3a P 9b9757a0654c4616bbce35ab01010513: Bootstrap starting.
18:35:12.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.404168 11174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25738d17842d46a38a6a374a71afdb3a. 1 dirs total, 0 dirs full, 0 dirs failed
18:35:12.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.411906 11409 tablet_bootstrap.cc:654] T 25738d17842d46a38a6a374a71afdb3a P 9b9757a0654c4616bbce35ab01010513: Neither blocks nor log segments found. Creating new log.
18:35:12.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.409849 10880 tablet_service.cc:1511] Processing CreateTablet for tablet 25738d17842d46a38a6a374a71afdb3a (DEFAULT_TABLE table=replication_test_table [id=716932bc7b984d3e9e9cffe98fdc8066]), partition=RANGE (int8) PARTITION UNBOUNDED
18:35:12.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.414012 10880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25738d17842d46a38a6a374a71afdb3a. 1 dirs total, 0 dirs full, 0 dirs failed
18:35:12.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.414520 11409 log.cc:826] T 25738d17842d46a38a6a374a71afdb3a P 9b9757a0654c4616bbce35ab01010513: Log is configured to *not* fsync() on all Append() calls
18:35:12.415 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:12.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.421977 11409 tablet_bootstrap.cc:492] T 25738d17842d46a38a6a374a71afdb3a P 9b9757a0654c4616bbce35ab01010513: No bootstrap required, opened a new log
18:35:12.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.422504 11409 ts_tablet_manager.cc:1403] T 25738d17842d46a38a6a374a71afdb3a P 9b9757a0654c4616bbce35ab01010513: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.005s
18:35:12.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.437337 11411 tablet_bootstrap.cc:492] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7: Bootstrap starting.
18:35:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.442724 11412 tablet_bootstrap.cc:492] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c: Bootstrap starting.
18:35:12.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.446318 11411 tablet_bootstrap.cc:654] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7: Neither blocks nor log segments found. Creating new log.
18:35:12.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.449226 11411 log.cc:826] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7: Log is configured to *not* fsync() on all Append() calls
18:35:12.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.452895 11409 raft_consensus.cc:359] T 25738d17842d46a38a6a374a71afdb3a P 9b9757a0654c4616bbce35ab01010513 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9757a0654c4616bbce35ab01010513" member_type: VOTER last_known_addr { host: "127.10.26.194" port: 34279 } } peers { permanent_uuid: "39ef161cd5894a1b981405d458a84b3c" member_type: VOTER last_known_addr { host: "127.10.26.193" port: 37959 } } peers { permanent_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" member_type: VOTER last_known_addr { host: "127.10.26.195" port: 33405 } }
18:35:12.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.453776 11409 raft_consensus.cc:385] T 25738d17842d46a38a6a374a71afdb3a P 9b9757a0654c4616bbce35ab01010513 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:35:12.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.454185 11409 raft_consensus.cc:740] T 25738d17842d46a38a6a374a71afdb3a P 9b9757a0654c4616bbce35ab01010513 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b9757a0654c4616bbce35ab01010513, State: Initialized, Role: FOLLOWER
18:35:12.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.455515 11411 tablet_bootstrap.cc:492] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7: No bootstrap required, opened a new log
18:35:12.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.455153 11409 consensus_queue.cc:260] T 25738d17842d46a38a6a374a71afdb3a P 9b9757a0654c4616bbce35ab01010513 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9757a0654c4616bbce35ab01010513" member_type: VOTER last_known_addr { host: "127.10.26.194" port: 34279 } } peers { permanent_uuid: "39ef161cd5894a1b981405d458a84b3c" member_type: VOTER last_known_addr { host: "127.10.26.193" port: 37959 } } peers { permanent_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" member_type: VOTER last_known_addr { host: "127.10.26.195" port: 33405 } }
18:35:12.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.456060 11411 ts_tablet_manager.cc:1403] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
18:35:12.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.459218 11409 ts_tablet_manager.cc:1434] T 25738d17842d46a38a6a374a71afdb3a P 9b9757a0654c4616bbce35ab01010513: Time spent starting tablet: real 0.036s	user 0.037s	sys 0.000s
18:35:12.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:12.474110 11100 tablet.cc:2406] T 25738d17842d46a38a6a374a71afdb3a P 9b9757a0654c4616bbce35ab01010513: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:35:12.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.480152 11412 tablet_bootstrap.cc:654] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c: Neither blocks nor log segments found. Creating new log.
18:35:12.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.482810 11412 log.cc:826] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c: Log is configured to *not* fsync() on all Append() calls
18:35:12.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.489116 11411 raft_consensus.cc:359] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9757a0654c4616bbce35ab01010513" member_type: VOTER last_known_addr { host: "127.10.26.194" port: 34279 } } peers { permanent_uuid: "39ef161cd5894a1b981405d458a84b3c" member_type: VOTER last_known_addr { host: "127.10.26.193" port: 37959 } } peers { permanent_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" member_type: VOTER last_known_addr { host: "127.10.26.195" port: 33405 } }
18:35:12.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.489907 11411 raft_consensus.cc:385] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:35:12.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.490213 11411 raft_consensus.cc:740] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98a8eded6bca4187b80c3aa15ab74cb7, State: Initialized, Role: FOLLOWER
18:35:12.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.491174 11411 consensus_queue.cc:260] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9757a0654c4616bbce35ab01010513" member_type: VOTER last_known_addr { host: "127.10.26.194" port: 34279 } } peers { permanent_uuid: "39ef161cd5894a1b981405d458a84b3c" member_type: VOTER last_known_addr { host: "127.10.26.193" port: 37959 } } peers { permanent_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" member_type: VOTER last_known_addr { host: "127.10.26.195" port: 33405 } }
18:35:12.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.495180 11411 ts_tablet_manager.cc:1434] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7: Time spent starting tablet: real 0.039s	user 0.029s	sys 0.005s
18:35:12.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.499352 11412 tablet_bootstrap.cc:492] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c: No bootstrap required, opened a new log
18:35:12.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.500090 11412 ts_tablet_manager.cc:1403] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.000s
18:35:12.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.524821 11412 raft_consensus.cc:359] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9757a0654c4616bbce35ab01010513" member_type: VOTER last_known_addr { host: "127.10.26.194" port: 34279 } } peers { permanent_uuid: "39ef161cd5894a1b981405d458a84b3c" member_type: VOTER last_known_addr { host: "127.10.26.193" port: 37959 } } peers { permanent_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" member_type: VOTER last_known_addr { host: "127.10.26.195" port: 33405 } }
18:35:12.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.525550 11412 raft_consensus.cc:385] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:35:12.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.525760 11412 raft_consensus.cc:740] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39ef161cd5894a1b981405d458a84b3c, State: Initialized, Role: FOLLOWER
18:35:12.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.526566 11412 consensus_queue.cc:260] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9757a0654c4616bbce35ab01010513" member_type: VOTER last_known_addr { host: "127.10.26.194" port: 34279 } } peers { permanent_uuid: "39ef161cd5894a1b981405d458a84b3c" member_type: VOTER last_known_addr { host: "127.10.26.193" port: 37959 } } peers { permanent_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" member_type: VOTER last_known_addr { host: "127.10.26.195" port: 33405 } }
18:35:12.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.531482 11412 ts_tablet_manager.cc:1434] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c: Time spent starting tablet: real 0.031s	user 0.024s	sys 0.004s
18:35:12.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.572775 11416 raft_consensus.cc:493] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:35:12.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.573285 11416 raft_consensus.cc:515] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9757a0654c4616bbce35ab01010513" member_type: VOTER last_known_addr { host: "127.10.26.194" port: 34279 } } peers { permanent_uuid: "39ef161cd5894a1b981405d458a84b3c" member_type: VOTER last_known_addr { host: "127.10.26.193" port: 37959 } } peers { permanent_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" member_type: VOTER last_known_addr { host: "127.10.26.195" port: 33405 } }
18:35:12.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.576654 11416 leader_election.cc:290] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b9757a0654c4616bbce35ab01010513 (127.10.26.194:34279), 39ef161cd5894a1b981405d458a84b3c (127.10.26.193:37959)
18:35:12.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.579337 11417 raft_consensus.cc:493] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:35:12.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.579989 11417 raft_consensus.cc:515] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9757a0654c4616bbce35ab01010513" member_type: VOTER last_known_addr { host: "127.10.26.194" port: 34279 } } peers { permanent_uuid: "39ef161cd5894a1b981405d458a84b3c" member_type: VOTER last_known_addr { host: "127.10.26.193" port: 37959 } } peers { permanent_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" member_type: VOTER last_known_addr { host: "127.10.26.195" port: 33405 } }
18:35:12.590 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:12.590 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:12.590 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:12.590 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.590 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.590 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.591 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.591 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.591 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.591 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.591 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.591 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.591 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:12.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.584894 11417 leader_election.cc:290] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b9757a0654c4616bbce35ab01010513 (127.10.26.194:34279), 98a8eded6bca4187b80c3aa15ab74cb7 (127.10.26.195:33405)
18:35:12.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.597369 11048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25738d17842d46a38a6a374a71afdb3a" candidate_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b9757a0654c4616bbce35ab01010513" is_pre_election: true
18:35:12.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.598347 11048 raft_consensus.cc:2468] T 25738d17842d46a38a6a374a71afdb3a P 9b9757a0654c4616bbce35ab01010513 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98a8eded6bca4187b80c3aa15ab74cb7 in term 0.
18:35:12.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.600091 11128 leader_election.cc:304] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98a8eded6bca4187b80c3aa15ab74cb7, 9b9757a0654c4616bbce35ab01010513; no voters: 
18:35:12.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.601249 11416 raft_consensus.cc:2804] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:35:12.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.601686 11416 raft_consensus.cc:493] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:35:12.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.602068 11416 raft_consensus.cc:3060] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [term 0 FOLLOWER]: Advancing to term 1
18:35:12.605 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:12.606 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:12.606 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:12.606 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:12.606 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:12.606 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:12.607 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:12.607 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:12.607 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:12.607 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:12.607 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:12.607 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:12.607 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:12.607 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:12.607 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:12.607 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:12.607 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:12.607 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:12.607 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:12.607 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:12.607 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:12.607 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:12.607 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:12.608 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:12.608 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:12.608 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:12.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:12.612633 11266 tablet.cc:2406] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:35:12.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.613046 10901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25738d17842d46a38a6a374a71afdb3a" candidate_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39ef161cd5894a1b981405d458a84b3c" is_pre_election: true
18:35:12.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.613933 10901 raft_consensus.cc:2468] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98a8eded6bca4187b80c3aa15ab74cb7 in term 0.
18:35:12.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.610702 11416 raft_consensus.cc:515] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9757a0654c4616bbce35ab01010513" member_type: VOTER last_known_addr { host: "127.10.26.194" port: 34279 } } peers { permanent_uuid: "39ef161cd5894a1b981405d458a84b3c" member_type: VOTER last_known_addr { host: "127.10.26.193" port: 37959 } } peers { permanent_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" member_type: VOTER last_known_addr { host: "127.10.26.195" port: 33405 } }
18:35:12.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.617944 11048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25738d17842d46a38a6a374a71afdb3a" candidate_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b9757a0654c4616bbce35ab01010513"
18:35:12.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.617763 11416 leader_election.cc:290] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [CANDIDATE]: Term 1 election: Requested vote from peers 9b9757a0654c4616bbce35ab01010513 (127.10.26.194:34279), 39ef161cd5894a1b981405d458a84b3c (127.10.26.193:37959)
18:35:12.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.618798 11048 raft_consensus.cc:3060] T 25738d17842d46a38a6a374a71afdb3a P 9b9757a0654c4616bbce35ab01010513 [term 0 FOLLOWER]: Advancing to term 1
18:35:12.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.623301 10901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25738d17842d46a38a6a374a71afdb3a" candidate_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39ef161cd5894a1b981405d458a84b3c"
18:35:12.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.623797 10901 raft_consensus.cc:3060] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c [term 0 FOLLOWER]: Advancing to term 1
18:35:12.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.627949 11194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25738d17842d46a38a6a374a71afdb3a" candidate_uuid: "39ef161cd5894a1b981405d458a84b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" is_pre_election: true
18:35:12.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.628790 11194 raft_consensus.cc:2393] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39ef161cd5894a1b981405d458a84b3c in current term 1: Already voted for candidate 98a8eded6bca4187b80c3aa15ab74cb7 in this term.
18:35:12.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.634056 11048 raft_consensus.cc:2468] T 25738d17842d46a38a6a374a71afdb3a P 9b9757a0654c4616bbce35ab01010513 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98a8eded6bca4187b80c3aa15ab74cb7 in term 1.
18:35:12.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.637589 11128 leader_election.cc:304] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98a8eded6bca4187b80c3aa15ab74cb7, 9b9757a0654c4616bbce35ab01010513; no voters: 
18:35:12.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.638497 11416 raft_consensus.cc:2804] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [term 1 FOLLOWER]: Leader election won for term 1
18:35:12.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.638489 11048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25738d17842d46a38a6a374a71afdb3a" candidate_uuid: "39ef161cd5894a1b981405d458a84b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b9757a0654c4616bbce35ab01010513" is_pre_election: true
18:35:12.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.637831 10901 raft_consensus.cc:2468] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98a8eded6bca4187b80c3aa15ab74cb7 in term 1.
18:35:12.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.639884 11048 raft_consensus.cc:2393] T 25738d17842d46a38a6a374a71afdb3a P 9b9757a0654c4616bbce35ab01010513 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39ef161cd5894a1b981405d458a84b3c in current term 1: Already voted for candidate 98a8eded6bca4187b80c3aa15ab74cb7 in this term.
18:35:12.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.641528 10834 leader_election.cc:304] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39ef161cd5894a1b981405d458a84b3c; no voters: 98a8eded6bca4187b80c3aa15ab74cb7, 9b9757a0654c4616bbce35ab01010513
18:35:12.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.642516 11417 raft_consensus.cc:2749] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
18:35:12.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.645295 11416 raft_consensus.cc:697] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [term 1 LEADER]: Becoming Leader. State: Replica: 98a8eded6bca4187b80c3aa15ab74cb7, State: Running, Role: LEADER
18:35:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.648540 11416 consensus_queue.cc:237] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9757a0654c4616bbce35ab01010513" member_type: VOTER last_known_addr { host: "127.10.26.194" port: 34279 } } peers { permanent_uuid: "39ef161cd5894a1b981405d458a84b3c" member_type: VOTER last_known_addr { host: "127.10.26.193" port: 37959 } } peers { permanent_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" member_type: VOTER last_known_addr { host: "127.10.26.195" port: 33405 } }
18:35:12.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:12.681218 10622 catalog_manager.cc:5696] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98a8eded6bca4187b80c3aa15ab74cb7 (127.10.26.195). New cstate: current_term: 1 leader_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b9757a0654c4616bbce35ab01010513" member_type: VOTER last_known_addr { host: "127.10.26.194" port: 34279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39ef161cd5894a1b981405d458a84b3c" member_type: VOTER last_known_addr { host: "127.10.26.193" port: 37959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98a8eded6bca4187b80c3aa15ab74cb7" member_type: VOTER last_known_addr { host: "127.10.26.195" port: 33405 } health_report { overall_health: HEALTHY } } }
18:35:12.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:12.699316 10956 tablet.cc:2406] T 25738d17842d46a38a6a374a71afdb3a P 39ef161cd5894a1b981405d458a84b3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:35:12.701 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:12.701 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:12.701 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:12.702 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.702 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.702 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.702 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.702 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.702 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.703 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.703 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.703 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.703 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:12.722 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:12.722 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:12.722 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:12.723 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.723 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.723 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.723 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.723 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.723 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.723 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.723 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.724 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.724 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:12.743 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:12.760 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:12.760 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:12.760 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:12.760 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:12.760 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:12.760 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:12.760 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:12.760 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:12.760 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:12.760 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:12.761 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:12.761 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:12.761 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:12.765 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:12.765 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:12.766 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:12.766 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:12.766 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:12.766 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:12.766 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:12.766 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:12.766 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:12.766 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:12.766 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:12.766 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:12.766 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:12.802 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:12.810 [DEBUG - main] (Connection.java:575) [peer master-127.9.79.254:42669(127.9.79.254:42669)] disconnecting while in state READY
18:35:12.810 [DEBUG - main] (Connection.java:575) [peer master-127.9.79.253:36577(127.9.79.253:36577)] disconnecting while in state READY
18:35:12.810 [DEBUG - main] (Connection.java:575) [peer master-127.9.79.252:38727(127.9.79.252:38727)] disconnecting while in state READY
18:35:12.811 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.79.253:36577(127.9.79.253:36577)] handling channelInactive
18:35:12.811 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.79.254:42669(127.9.79.254:42669)] handling channelInactive
18:35:12.811 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.79.254:42669(127.9.79.254:42669)] cleaning up while in state READY due to: connection closed
18:35:12.811 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.79.253:36577(127.9.79.253:36577)] cleaning up while in state READY due to: connection closed
18:35:12.811 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:35:12.812 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
18:35:12.812 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
18:35:12.822 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:12.823 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:12.823 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:12.823 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.823 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.823 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.823 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.824 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.824 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.824 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.824 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.824 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.824 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:12.840 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.79.252:38727(127.9.79.252:38727)] handling channelInactive
18:35:12.840 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.79.252:38727(127.9.79.252:38727)] cleaning up while in state READY due to: connection closed
18:35:12.841 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:35:12.841 [DEBUG - main] (Connection.java:575) [peer master-127.10.26.253:36107(127.10.26.253:36107)] disconnecting while in state READY
18:35:12.841 [DEBUG - main] (Connection.java:575) [peer master-127.10.26.252:40435(127.10.26.252:40435)] disconnecting while in state READY
18:35:12.841 [DEBUG - main] (Connection.java:575) [peer master-127.10.26.254:36869(127.10.26.254:36869)] disconnecting while in state READY
18:35:12.841 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.10.26.253:36107(127.10.26.253:36107)] handling channelInactive
18:35:12.841 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.26.253:36107(127.10.26.253:36107)] cleaning up while in state READY due to: connection closed
18:35:12.842 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:35:12.841 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.10.26.252:40435(127.10.26.252:40435)] handling channelInactive
18:35:12.843 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.26.252:40435(127.10.26.252:40435)] cleaning up while in state READY due to: connection closed
18:35:12.844 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
18:35:12.844 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
18:35:12.851 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.10.26.254:36869(127.10.26.254:36869)] handling channelInactive
18:35:12.851 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.26.254:36869(127.10.26.254:36869)] cleaning up while in state READY due to: connection closed
18:35:12.851 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
18:35:12.853 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:35:12.853 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
18:35:12.853 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
18:35:12.853 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:35:12.853 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:35:12.853 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
18:35:12.861 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
18:35:12.861 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
18:35:12.861 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
18:35:12.861 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
18:35:12.861 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
18:35:12.861 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
18:35:12.861 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
18:35:12.901 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:12.901 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:12.902 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:12.902 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.902 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.902 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:12.902 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:12.903 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.903 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.903 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:12.903 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.903 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.903 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:12.903 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:12.915 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:12.977 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:12.977 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:12.977 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:12.977 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:12.977 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:12.977 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:12.977 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:12.977 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:12.977 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:12.977 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:12.977 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:12.978 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:12.978 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:13.063 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:13.064 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:13.064 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:13.064 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:13.064 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:13.064 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:13.064 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:13.064 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:13.064 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:13.064 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:13.064 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:13.064 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:13.064 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:13.085 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:13.085 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:13.085 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:13.085 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:13.085 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:13.085 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:13.085 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:13.085 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:13.085 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:13.086 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:13.086 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:13.086 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:13.086 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:13.116 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:13.116 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:13.117 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:13.117 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:13.117 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:13.117 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:13.117 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:13.117 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:13.117 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:13.117 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:13.117 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:13.117 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:13.117 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:13.158 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
18:35:13.162 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:13.162 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:13.162 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:13.163 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:13.163 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:13.163 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:13.164 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:13.164 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:13.164 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:13.164 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:13.164 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:13.164 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:13.164 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:13.179811 11416 consensus_queue.cc:1048] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b9757a0654c4616bbce35ab01010513" member_type: VOTER last_known_addr { host: "127.10.26.194" port: 34279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:35:13.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:13.186465 11416 consensus_queue.cc:1048] T 25738d17842d46a38a6a374a71afdb3a P 98a8eded6bca4187b80c3aa15ab74cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39ef161cd5894a1b981405d458a84b3c" member_type: VOTER last_known_addr { host: "127.10.26.193" port: 37959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:35:13.235 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:13.235 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:13.235 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:13.235 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:13.235 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:13.235 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:13.235 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:13.235 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:13.235 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:13.235 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:13.235 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:13.236 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:13.236 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:13.239 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
18:35:13.239 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
18:35:13.239 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
18:35:13.243 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:13.246 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:13.246 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:13.246 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:13.247 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:13.247 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:13.247 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:13.247 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:13.247 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:13.247 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:13.248 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:13.248 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:13.248 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:13.248 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:13.259 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
18:35:13.281 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:13.282 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:13.282 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:13.282 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:13.282 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:13.282 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:13.282 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:13.282 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:13.282 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:13.283 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:13.283 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:13.283 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:13.283 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:13.302 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:13.303 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:13.303 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:13.303 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:13.303 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:13.303 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:13.303 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:13.304 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:13.304 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:13.304 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:13.304 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:13.304 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:13.304 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:13.304 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:13.359 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:13.359 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:13.360 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:13.360 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:13.360 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:13.360 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:13.360 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:13.360 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:13.360 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:13.360 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:13.360 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:13.360 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:13.360 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:13.419 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:13.419 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:13.535 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:13.536 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:13.536 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:13.536 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:13.536 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:13.536 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:13.536 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:13.536 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:13.536 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:13.536 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:13.536 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:13.536 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:13.537 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:13.571 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:13.571 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:13.571 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:13.571 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:13.571 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:13.571 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:13.572 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:13.572 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:13.572 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:13.572 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:13.572 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:13.572 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:13.572 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:13.602 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:13.602 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:13.602 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:13.602 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:13.602 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:13.603 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:13.603 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:13.603 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:13.603 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:13.603 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:13.603 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:13.603 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:13.603 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:13.742 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:13.802 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:13.835 [INFO - flink-pekko.actor.default-dispatcher-10] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (f6e63683f34d031c5da392b08baea20c) switched from state RESTARTING to RUNNING.
18:35:13.836 [INFO - flink-pekko.actor.default-dispatcher-10] (CheckpointCoordinator.java:1805) Restoring job f6e63683f34d031c5da392b08baea20c from Checkpoint 74 @ 1783535501335 for f6e63683f34d031c5da392b08baea20c located at file:/tmp/junit4154231101817438778/checkpoints/f6e63683f34d031c5da392b08baea20c/chk-74.
18:35:13.837 [INFO - flink-pekko.actor.default-dispatcher-10] (MasterHooks.java:201) No master state to restore
18:35:13.837 [INFO - flink-pekko.actor.default-dispatcher-10] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:35:13.842 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from CREATED to SCHEDULED.
18:35:13.843 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:35:13.844 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from SCHEDULED to DEPLOYING.
18:35:13.844 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #7) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 13a0441c1420d35b57a28ebd584f9846
18:35:13.844 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from CREATED to SCHEDULED.
18:35:13.845 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from SCHEDULED to DEPLOYING.
18:35:13.845 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #8) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_8 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id e5ed6e64fe4e0a504f52a2cb8573a359
18:35:13.845 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from CREATED to SCHEDULED.
18:35:13.846 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from SCHEDULED to DEPLOYING.
18:35:13.846 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #8) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_8 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8c518d750e8767059e15b0e0577096dd
18:35:13.846 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CREATED to SCHEDULED.
18:35:13.846 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from SCHEDULED to DEPLOYING.
18:35:13.846 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #7) with attempt id ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 6e26636a-a315-4138-a87e-a0f639187247 @ 127.0.0.1 (dataPort=-1) with allocation id 8ff5a8fd5a1d7f8775f563b9a37bf60a
18:35:13.847 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:35:13.847 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:35:13.847 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job f6e63683f34d031c5da392b08baea20c: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:35:13.848 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 13a0441c1420d35b57a28ebd584f9846.
18:35:13.849 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_7), deploy into slot with allocation id 13a0441c1420d35b57a28ebd584f9846.
18:35:13.849 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot e5ed6e64fe4e0a504f52a2cb8573a359.
18:35:13.850 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#8 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_8), deploy into slot with allocation id e5ed6e64fe4e0a504f52a2cb8573a359.
18:35:13.850 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 8c518d750e8767059e15b0e0577096dd.
18:35:13.851 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#8 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_8), deploy into slot with allocation id 8c518d750e8767059e15b0e0577096dd.
18:35:13.854 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:35:13.855 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_7), deploy into slot with allocation id 8ff5a8fd5a1d7f8775f563b9a37bf60a.
18:35:13.856 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CREATED to DEPLOYING.
18:35:13.856 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_7) [DEPLOYING].
18:35:13.857 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@308ddd32
18:35:13.857 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:13.857 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:35:13.858 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from DEPLOYING to INITIALIZING.
18:35:13.858 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from DEPLOYING to INITIALIZING.
18:35:13.859 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from CREATED to DEPLOYING.
18:35:13.859 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_7) [DEPLOYING].
18:35:13.862 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#8 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from CREATED to DEPLOYING.
18:35:13.862 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#8 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_8) [DEPLOYING].
18:35:13.859 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#8 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from CREATED to DEPLOYING.
18:35:13.862 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#8 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_8) [DEPLOYING].
18:35:13.860 [INFO - Thread-74] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:35:13.863 [DEBUG - Thread-74] (Connection.java:575) [peer master-127.30.11.253:35677(127.30.11.253:35677)] disconnecting while in state TERMINATED
18:35:13.863 [DEBUG - Thread-74] (Connection.java:575) [peer master-127.30.11.252:39405(127.30.11.252:39405)] disconnecting while in state TERMINATED
18:35:13.864 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@31166047
18:35:13.864 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@71a19b56
18:35:13.866 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:13.866 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:35:13.866 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#7 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from DEPLOYING to INITIALIZING.
18:35:13.866 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from DEPLOYING to INITIALIZING.
18:35:13.870 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5e94c9b7
18:35:13.870 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:13.870 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:35:13.872 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@82b81fd
18:35:13.872 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:13.872 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit4154231101817438778/checkpoints")
18:35:13.872 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#8 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from DEPLOYING to INITIALIZING.
18:35:13.872 [INFO - flink-pekko.actor.default-dispatcher-10] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_1_8) switched from DEPLOYING to INITIALIZING.
18:35:13.874 [INFO - Source: KuduSource -> Sink: Writer (2/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5215c805
18:35:13.875 [DEBUG - Thread-74] (Connection.java:575) [peer master-127.30.11.254:41811(127.30.11.254:41811)] disconnecting while in state TERMINATED
18:35:13.876 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#8 (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from DEPLOYING to INITIALIZING.
18:35:13.876 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:35:13.877 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ae82f75004e34cafb8ece16bc6587e70_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from DEPLOYING to INITIALIZING.
18:35:13.877 [INFO - Thread-74] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:35:13.878 [INFO - Thread-74] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:35:13.883 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4adb76a4
18:35:13.884 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2f1047e9
18:35:13.890 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:13.891 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:13.892 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:13.893 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:13.897 [DEBUG - Thread-74] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:13.897 [INFO - Thread-74] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:35:13.899 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.902 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:13.910 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.915 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:13.916 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#8] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.916 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.916 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#8] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.917 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.917 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:35:13.917 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.917 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:35:13.917 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.917 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:35:13.917 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:35:13.918 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#8] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.918 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.918 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.918 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.919 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.919 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#8] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.919 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.919 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.919 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.919 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.919 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.919 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.920 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#8] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.920 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.920 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.920 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.920 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.920 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.920 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.920 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.920 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.921 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#8] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.921 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.921 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.921 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.921 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.921 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.921 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.921 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.923 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.923 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.923 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.923 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.924 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.924 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.924 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.924 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.924 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.924 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.924 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.926 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:13.926 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.926 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.926 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.926 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.926 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:13.926 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:13.926 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:13.926 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:13.927 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:13.927 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:13.927 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:13.927 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:13.927 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:13.927 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:13.927 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:13.927 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:13.930 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.931 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.931 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.931 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.931 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.932 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.932 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.932 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.932 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.933 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.933 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.933 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.933 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.936 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.936 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.937 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.937 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.937 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.937 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.938 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.938 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.938 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.938 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.938 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.938 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.939 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.939 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.939 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.939 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.939 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.939 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.939 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.939 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.939 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.939 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.939 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.939 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.939 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.939 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.940 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.940 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.940 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.940 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.940 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.940 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.941 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.941 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.941 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.941 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.941 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.941 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.941 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.944 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:13.946 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:13.947 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:13.947 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:13.947 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:13.947 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:13.947 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:13.947 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:13.948 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:13.948 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:13.948 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:13.948 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:13.948 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:13.948 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:13.949 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:13.949 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:13.949 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:13.949 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:13.949 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:13.949 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:13.949 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:13.949 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:13.949 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:13.950 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:13.950 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:13.950 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:13.950 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:13.950 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.951 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.951 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.951 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.951 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.951 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.951 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.952 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.952 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.952 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.952 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.952 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.952 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.956 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.957 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.957 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.957 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.957 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.958 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.958 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.958 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.958 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.958 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.958 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.958 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.958 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.958 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.958 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.958 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.958 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.958 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.959 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.959 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.959 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.959 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.959 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.959 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.959 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.959 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.960 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.960 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.960 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.961 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.961 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.961 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.961 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.961 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.961 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.961 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.961 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.961 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.961 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.966 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:13.966 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:13.967 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:13.967 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:13.967 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:13.971 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.971 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.971 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.971 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.971 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.971 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.971 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.971 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.971 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.971 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.971 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.971 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.971 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.971 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:13.972 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:13.972 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:13.972 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:13.972 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:13.972 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:13.972 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:13.972 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:13.977 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.977 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.977 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.977 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.977 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.977 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.977 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.977 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.977 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.977 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.977 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.977 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.977 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.977 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.977 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.977 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.977 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.978 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.978 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.978 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.977 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.978 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.978 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.978 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.978 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.978 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.980 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.980 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.980 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.980 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.980 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.980 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.980 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.980 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.980 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.981 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.981 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.981 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.981 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.986 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:13.986 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:13.986 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:13.986 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:13.986 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:13.986 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:13.986 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:13.986 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:13.986 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:13.987 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:13.987 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:13.987 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:13.987 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:13.990 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.990 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.990 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.991 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.991 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.991 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.991 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.991 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.991 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.991 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.991 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.991 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.991 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.996 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.996 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.996 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.996 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.996 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:13.997 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.997 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.997 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.997 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.997 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:13.997 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.997 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:13.997 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.997 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.997 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.997 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:13.997 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.997 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.997 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:13.997 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.997 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.997 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:13.998 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.998 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.998 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:13.998 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.000 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.000 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.001 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.001 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.001 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.001 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.001 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.001 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.001 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.001 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.001 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.001 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.001 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.006 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:14.007 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:14.007 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.007 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:14.007 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.007 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.007 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.007 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.007 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.007 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.007 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.007 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.007 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:14.017 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.017 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.017 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.017 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.017 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.017 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.017 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.017 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.017 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.017 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.017 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.017 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.017 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.017 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.018 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.018 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.018 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.018 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.018 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.018 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.018 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.018 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.018 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.018 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.018 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.018 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.020 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.020 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.020 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.020 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.020 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.020 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.020 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.020 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.020 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.020 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.020 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.021 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.021 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.026 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:14.026 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:14.026 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:14.026 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.026 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.027 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.027 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.027 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.027 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.027 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.027 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.027 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.027 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:14.030 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.030 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.030 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.030 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.030 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.030 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.030 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.030 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.030 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.031 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.031 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.031 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.031 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.036 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.036 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.036 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.037 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.037 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.037 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.037 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.037 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.037 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.037 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.037 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.037 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.037 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.037 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.037 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.037 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.037 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.037 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.037 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.038 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.038 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.038 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.038 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.038 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.038 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.038 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.059 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.060 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.060 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.060 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.060 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.060 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.060 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.060 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.060 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.060 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.060 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.060 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.060 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.086 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:14.086 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:14.086 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:14.087 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.087 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.087 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.088 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.088 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.088 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.088 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.088 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.088 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.088 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:14.091 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.091 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.091 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.091 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.091 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.091 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.091 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.091 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.091 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.091 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.091 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.091 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.091 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.097 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.097 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.097 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.098 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.098 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.098 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.098 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.098 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.098 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.098 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.098 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.098 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.098 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.107 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:14.107 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:14.107 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:14.107 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.107 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.107 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.107 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.107 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.107 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.108 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.108 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.108 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.108 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:14.120 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.121 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.121 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.121 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.121 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.121 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.121 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.121 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.121 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.121 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.121 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.121 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.121 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.131 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
18:35:14.156 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.156 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.156 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.157 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.157 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.157 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.157 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.157 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.157 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.157 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.157 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.157 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.157 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.171 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.171 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.171 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.172 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.172 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.172 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.172 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.172 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.172 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.172 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.172 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.172 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.172 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.194 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:14.195 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:14.195 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:14.195 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:14.195 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:14.195 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:14.195 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:14.195 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:14.195 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:14.196 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:14.196 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:14.196 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:14.196 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:14.237 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.237 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.237 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.237 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.237 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.237 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.237 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.237 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.237 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.237 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.237 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.237 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.237 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.242 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:14.280 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.280 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.280 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.280 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.280 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.280 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.281 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.281 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.281 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.281 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.281 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.281 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.281 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.295 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
18:35:14.296 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.297 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.297 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.297 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.297 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.297 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.297 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.297 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.297 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.297 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.297 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.297 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.297 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.304 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:14.316 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.316 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.317 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.317 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.317 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.317 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.317 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.317 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.317 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.317 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.317 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.317 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.317 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
18:35:14.317 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.323 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:14.324 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:14.324 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:14.324 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:14.324 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:14.324 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:14.324 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:14.324 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:14.324 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:14.324 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:14.324 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:14.324 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:14.325 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:14.346 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:14.346 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:14.346 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:14.347 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.347 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.347 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.347 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.347 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.347 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.347 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.347 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.347 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.347 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:14.357 [INFO - flink-metrics-4] (Slf4jLogger.scala:117) Slf4jLogger started
18:35:14.362 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:14.362 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:14.363 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:14.363 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:14.363 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:14.363 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:14.363 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:14.364 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:14.364 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:14.364 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:14.364 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:14.364 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:14.364 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:14.376 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:14.376 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:14.376 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:14.376 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:14.376 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:14.376 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:14.376 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:14.376 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:14.376 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:14.377 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:14.377 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:14.377 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:14.377 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:14.397 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
18:35:14.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:14.415 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:14.415 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
18:35:14.424 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
18:35:14.425 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
18:35:14.425 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
18:35:14.426 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
18:35:14.426 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
18:35:14.426 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
18:35:14.426 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
18:35:14.426 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
18:35:14.427 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
18:35:14.427 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
18:35:14.428 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
18:35:14.428 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
18:35:14.428 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
18:35:14.428 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
18:35:14.428 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
18:35:14.428 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
18:35:14.428 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
18:35:14.428 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
18:35:14.428 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
18:35:14.429 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
18:35:14.429 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
18:35:14.429 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
18:35:14.429 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
18:35:14.429 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
18:35:14.429 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_6e00fcf985cb3f2e70fb949b459359b1/blobStorage
18:35:14.430 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:43561 - max concurrent requests: 50 - max backlog: 1000
18:35:14.431 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.431 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.431 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.431 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_6e00fcf985cb3f2e70fb949b459359b1/blobStorage
18:35:14.431 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.431 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.431 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.431 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.431 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.431 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.432 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.432 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.432 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.432 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.432 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_6e00fcf985cb3f2e70fb949b459359b1/blobStorage
18:35:14.433 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
18:35:14.433 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 0f2d942e-a3e6-4cab-a460-16d4d351b929
18:35:14.436 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 32 GB (66.67% usable)
18:35:14.437 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-acfbcaad-cb57-4377-acce-7d0ae4c86bbb
18:35:14.439 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-2b4599e7-0923-4dd0-a23a-d51752372aa3
18:35:14.445 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:14.456 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.457 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.457 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.457 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.457 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.457 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.457 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.457 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.457 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.457 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.458 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.458 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.458 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.532 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
18:35:14.533 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
18:35:14.533 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
18:35:14.533 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
18:35:14.534 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
18:35:14.536 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_24 .
18:35:14.541 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
18:35:14.541 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-195831b2-6e75-43ab-8c75-72087b235ad3
18:35:14.542 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
18:35:14.543 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
18:35:14.556 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
18:35:14.556 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
18:35:14.562 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:43291
18:35:14.563 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
18:35:14.575 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
18:35:14.575 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:43291 was granted leadership with leaderSessionID=dae2c91e-87be-400f-8cb1-6417fd830f4d
18:35:14.576 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:43291 , session=dae2c91e-87be-400f-8cb1-6417fd830f4d
18:35:14.591 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
18:35:14.591 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 106037e0-63db-467d-9568-26afb6cad57c. Creating new DispatcherLeaderProcess.
18:35:14.591 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
18:35:14.592 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
18:35:14.599 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
18:35:14.608 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
18:35:14.608 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
18:35:14.610 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_25 .
18:35:14.612 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.612 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.613 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.613 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.613 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.613 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.613 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.613 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.614 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.614 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.614 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.614 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.614 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.617 [INFO - pool-577-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 84122ee9-f616-4bea-9298-ab22a0b2eb86.
18:35:14.617 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_25 , session=106037e0-63db-467d-9568-26afb6cad57c
18:35:14.626 [INFO - pool-577-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_26 .
18:35:14.640 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:253) Starting the resource manager.
18:35:14.647 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:212) Starting the slot manager.
18:35:14.648 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:308) Starting tokens update task
18:35:14.648 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
18:35:14.648 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
18:35:14.648 [INFO - mini-cluster-io-thread-3] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_26 , session=84122ee9-f616-4bea-9298-ab22a0b2eb86
18:35:14.650 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_26(9298ab22a0b2eb8684122ee9f6164bea).
18:35:14.680 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.680 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.680 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.681 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.681 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.681 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.681 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.681 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.681 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.681 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.681 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.682 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.682 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.691 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
18:35:14.702 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:1080) Registering TaskManager with ResourceID 0f2d942e-a3e6-4cab-a460-16d4d351b929 (pekko://flink/user/rpc/taskmanager_24) at ResourceManager
18:35:14.705 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_26 under registration id d3993d08ef9778bedc43ba86d74982e4.
18:35:14.706 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:14.706 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:14.706 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:14.706 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.706 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.706 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.707 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.707 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.707 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.707 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.707 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.707 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.707 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:14.707 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (44da982c06b461d5d727b866dc4fd1ed).
18:35:14.707 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (44da982c06b461d5d727b866dc4fd1ed).
18:35:14.708 [INFO - flink-pekko.actor.default-dispatcher-7] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-44da982c06b461d5d727b866dc4fd1ed'.
18:35:14.708 [INFO - mini-cluster-io-thread-3] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 44da982c06b461d5d727b866dc4fd1ed was granted leadership with leader id b5dffe44-763b-4f23-bb91-e6be64ce1c46. Creating new JobMasterServiceProcess.
18:35:14.709 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:344) Registering task executor 0f2d942e-a3e6-4cab-a460-16d4d351b929 under d3993d08ef9778bedc43ba86d74982e4 at the slot manager.
18:35:14.717 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_27 .
18:35:14.731 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (44da982c06b461d5d727b866dc4fd1ed).
18:35:14.733 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (44da982c06b461d5d727b866dc4fd1ed).
18:35:14.734 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 31c3987d59438cf2a81772f892f95813 for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:14.734 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (44da982c06b461d5d727b866dc4fd1ed).
18:35:14.734 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
18:35:14.736 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
18:35:14.736 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1abcb4a8
18:35:14.736 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:14.736 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12761810908214812439/checkpoints")
18:35:14.736 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.736 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.737 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.737 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.737 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.737 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.737 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.737 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.737 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.737 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.737 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.737 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.737 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.742 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:14.742 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
18:35:14.743 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@bc57738 for Flink Streaming Job (44da982c06b461d5d727b866dc4fd1ed).
18:35:14.744 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_27 , session=b5dffe44-763b-4f23-bb91-e6be64ce1c46
18:35:14.751 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (44da982c06b461d5d727b866dc4fd1ed) under job master id bb91e6be64ce1c46b5dffe44763b4f23.
18:35:14.752 [INFO - flink-pekko.actor.default-dispatcher-8] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:35:14.753 [DEBUG - flink-pekko.actor.default-dispatcher-8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:14.754 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
18:35:14.754 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (44da982c06b461d5d727b866dc4fd1ed) switched from state CREATED to RUNNING.
18:35:14.755 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
18:35:14.755 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
18:35:14.755 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
18:35:14.756 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
18:35:14.759 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_26(9298ab22a0b2eb8684122ee9f6164bea)
18:35:14.760 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.79.252:38727(127.9.79.252:38727)] connecting to peer
18:35:14.761 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.79.253:36577(127.9.79.253:36577)] connecting to peer
18:35:14.761 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
18:35:14.763 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:390) Registering job manager bb91e6be64ce1c46b5dffe44763b4f23@pekko://flink/user/rpc/jobmanager_27 for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:14.765 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.9.79.254:42669(127.9.79.254:42669)] connecting to peer
18:35:14.766 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.79.253:36577(127.9.79.253:36577)] Successfully connected to peer
18:35:14.771 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:1015) Registered job manager bb91e6be64ce1c46b5dffe44763b4f23@pekko://flink/user/rpc/jobmanager_27 for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:14.775 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.79.252:38727(127.9.79.252:38727)] Successfully connected to peer
18:35:14.778 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.79.254:42669(127.9.79.254:42669)] Successfully connected to peer
18:35:14.779 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.79.253
18:35:14.782 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.79.252
18:35:14.790 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.79.254
18:35:14.790 [DEBUG - main] (Connection.java:748) [peer master-127.10.26.252:40435(127.10.26.252:40435)] connecting to peer
18:35:14.794 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: 9298ab22a0b2eb8684122ee9f6164bea.
18:35:14.794 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 44da982c06b461d5d727b866dc4fd1ed: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:35:14.799 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:14.802 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xd3694f3d, L:/127.0.0.1:54710 - R:/127.9.79.253:36577] using SASL/PLAIN
18:35:14.803 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:14.803 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:14.806 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7f9775a7, L:/127.0.0.1:60416 - R:/127.9.79.252:38727] using SASL/PLAIN
18:35:14.807 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:14.811 [DEBUG - main] (Connection.java:748) [peer master-127.10.26.253:36107(127.10.26.253:36107)] connecting to peer
18:35:14.812 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x3bfb72ca, L:/127.0.0.1:37342 - R:/127.9.79.254:42669] using SASL/PLAIN
18:35:14.812 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.10.26.252:40435(127.10.26.252:40435)] Successfully connected to peer
18:35:14.813 [DEBUG - main] (Connection.java:748) [peer master-127.10.26.254:36869(127.10.26.254:36869)] connecting to peer
18:35:14.814 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.10.26.253:36107(127.10.26.253:36107)] Successfully connected to peer
18:35:14.818 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.10.26.254:36869(127.10.26.254:36869)] Successfully connected to peer
18:35:14.832 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:35:14.833 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=73), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.79.252:38727, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.79.253:36577, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.79.254:42669, [53ms] Sub RPC ConnectToMaster: received response from server master-127.9.79.252:38727: OK, [55ms] Sub RPC ConnectToMaster: received response from server master-127.9.79.253:36577: OK, [71ms] Sub RPC ConnectToMaster: received response from server master-127.9.79.254:42669: OK, deferred=null) after lookup
18:35:14.840 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.840 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.840 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.841 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.841 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.841 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.841 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.841 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.841 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.841 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.841 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.841 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.841 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.843 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 644dfa4bfb534206927890c17fbcab2f
18:35:14.847 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.26.254
18:35:14.851 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:14.851 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:14.852 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:14.852 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:14.852 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:14.852 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:14.852 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:14.852 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:14.852 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:14.852 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:14.852 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:14.852 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:14.853 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:14.855 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 04a712669e0b47419a4fcec8d7685a67 for table 'replication_test_table' with partition [<start>, <end>)
18:35:14.855 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=04a712669e0b47419a4fcec8d7685a67@[1efcebc990364b10942ae70571022125(127.9.79.194:36053),7574f138ca2d45388a7343688d429edf(127.9.79.193:42499),dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)[L]]}]
18:35:14.859 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.26.253
18:35:14.862 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 44da982c06b461d5d727b866dc4fd1ed
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 0f2d942e-a3e6-4cab-a460-16d4d351b929
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
18:35:14.863 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot ca446671eb55a38043c35e22b214b639 from 0f2d942e-a3e6-4cab-a460-16d4d351b929 for job 44da982c06b461d5d727b866dc4fd1ed with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:35:14.863 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot a9a1680e4537c70cec4cc4421cba5e71 from 0f2d942e-a3e6-4cab-a460-16d4d351b929 for job 44da982c06b461d5d727b866dc4fd1ed with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:35:14.863 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot efaa8b47e00c91fda3a6d632c8fcf66a from 0f2d942e-a3e6-4cab-a460-16d4d351b929 for job 44da982c06b461d5d727b866dc4fd1ed with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:35:14.864 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot c9d1d8e4959d50384ea2661554d117bc from 0f2d942e-a3e6-4cab-a460-16d4d351b929 for job 44da982c06b461d5d727b866dc4fd1ed with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:35:14.864 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request ca446671eb55a38043c35e22b214b639 for job 44da982c06b461d5d727b866dc4fd1ed from resource manager with leader id 9298ab22a0b2eb8684122ee9f6164bea.
18:35:14.864 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for ca446671eb55a38043c35e22b214b639 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:35:14.866 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:14.866 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:14.866 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:14.866 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.866 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.867 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:14.867 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.867 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.867 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:14.867 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.867 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.867 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:14.867 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:14.869 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:192) Add job 44da982c06b461d5d727b866dc4fd1ed for job leader monitoring.
18:35:14.869 [INFO - mini-cluster-io-thread-3] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_27 with leader id b5dffe44-763b-4f23-bb91-e6be64ce1c46.
18:35:14.869 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request a9a1680e4537c70cec4cc4421cba5e71 for job 44da982c06b461d5d727b866dc4fd1ed from resource manager with leader id 9298ab22a0b2eb8684122ee9f6164bea.
18:35:14.870 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for a9a1680e4537c70cec4cc4421cba5e71 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:35:14.870 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request efaa8b47e00c91fda3a6d632c8fcf66a for job 44da982c06b461d5d727b866dc4fd1ed from resource manager with leader id 9298ab22a0b2eb8684122ee9f6164bea.
18:35:14.870 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for efaa8b47e00c91fda3a6d632c8fcf66a with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:35:14.870 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request c9d1d8e4959d50384ea2661554d117bc for job 44da982c06b461d5d727b866dc4fd1ed from resource manager with leader id 9298ab22a0b2eb8684122ee9f6164bea.
18:35:14.870 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for c9d1d8e4959d50384ea2661554d117bc with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
18:35:14.871 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
18:35:14.873 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_27 for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:14.873 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1783) Establish JobManager connection for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:14.873 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 44da982c06b461d5d727b866dc4fd1ed.
18:35:14.874 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
18:35:14.874 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 0f2d942e-a3e6-4cab-a460-16d4d351b929 @ 127.0.0.1 (dataPort=-1) with allocation id a9a1680e4537c70cec4cc4421cba5e71
18:35:14.874 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot a9a1680e4537c70cec4cc4421cba5e71.
18:35:14.875 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:14.876 [INFO - flink-pekko.actor.default-dispatcher-5] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
18:35:14.876 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 44da982c06b461d5d727b866dc4fd1ed
18:35:14.876 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id a9a1680e4537c70cec4cc4421cba5e71.
18:35:14.881 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:14.883 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc8363151, L:/127.0.0.1:48290 - R:/127.10.26.253:36107] using SASL/PLAIN
18:35:14.885 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:14.888 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.26.252
18:35:14.888 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x31de03fe, L:/127.0.0.1:39134 - R:/127.10.26.254:36869] using SASL/PLAIN
18:35:14.888 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
18:35:14.888 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 0f2d942e-a3e6-4cab-a460-16d4d351b929 @ 127.0.0.1 (dataPort=-1) with allocation id c9d1d8e4959d50384ea2661554d117bc
18:35:14.890 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
18:35:14.890 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 0f2d942e-a3e6-4cab-a460-16d4d351b929 @ 127.0.0.1 (dataPort=-1) with allocation id ca446671eb55a38043c35e22b214b639
18:35:14.892 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
18:35:14.892 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 0f2d942e-a3e6-4cab-a460-16d4d351b929 @ 127.0.0.1 (dataPort=-1) with allocation id efaa8b47e00c91fda3a6d632c8fcf66a
18:35:14.893 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot c9d1d8e4959d50384ea2661554d117bc.
18:35:14.894 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:14.895 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id c9d1d8e4959d50384ea2661554d117bc.
18:35:14.896 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
18:35:14.896 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
18:35:14.897 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot ca446671eb55a38043c35e22b214b639.
18:35:14.897 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7401014f
18:35:14.898 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:14.898 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12761810908214812439/checkpoints")
18:35:14.898 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
18:35:14.898 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
18:35:14.898 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id ca446671eb55a38043c35e22b214b639.
18:35:14.900 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot a9a1680e4537c70cec4cc4421cba5e71.
18:35:14.901 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot c9d1d8e4959d50384ea2661554d117bc.
18:35:14.901 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot ca446671eb55a38043c35e22b214b639.
18:35:14.901 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot efaa8b47e00c91fda3a6d632c8fcf66a.
18:35:14.901 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@e26a315
18:35:14.901 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskSlotTableImpl.java:391) Activate slot efaa8b47e00c91fda3a6d632c8fcf66a.
18:35:14.902 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id efaa8b47e00c91fda3a6d632c8fcf66a.
18:35:14.903 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:14.903 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:14.904 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
18:35:14.904 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
18:35:14.904 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5b574fef, L:/127.0.0.1:46204 - R:/127.10.26.252:40435] using SASL/PLAIN
18:35:14.904 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@15f6e6ff
18:35:14.904 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:14.904 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12761810908214812439/checkpoints")
18:35:14.906 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
18:35:14.906 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
18:35:14.905 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
18:35:14.907 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
18:35:14.907 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@163dc00a
18:35:14.907 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:14.907 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12761810908214812439/checkpoints")
18:35:14.907 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
18:35:14.908 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
18:35:14.910 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2abb0f7f
18:35:14.911 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:14.911 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:35:14.911 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=142), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.252:40435, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.253:36107, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.254:36869, [98ms] Sub RPC ConnectToMaster: received response from server master-127.10.26.253:36107: OK, [101ms] Sub RPC ConnectToMaster: received response from server master-127.10.26.254:36869: OK, [121ms] Sub RPC ConnectToMaster: received response from server master-127.10.26.252:40435: OK, deferred=null) after lookup
18:35:14.912 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@441bc39d
18:35:14.913 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
18:35:14.913 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
18:35:14.913 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5afcf8c5
18:35:14.913 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:14.914 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12761810908214812439/checkpoints")
18:35:14.914 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
18:35:14.914 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
18:35:14.914 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:14.914 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 716932bc7b984d3e9e9cffe98fdc8066
18:35:14.915 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:14.918 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5b4cfb01
18:35:14.919 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:14.921 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 25738d17842d46a38a6a374a71afdb3a for table 'replication_test_table' with partition [<start>, <end>)
18:35:14.921 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=25738d17842d46a38a6a374a71afdb3a@[39ef161cd5894a1b981405d458a84b3c(127.10.26.193:37959),98a8eded6bca4187b80c3aa15ab74cb7(127.10.26.195:33405)[L],9b9757a0654c4616bbce35ab01010513(127.10.26.194:34279)]}]
18:35:14.922 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.26.252:40435, [5ms] Sub RPC GetTableLocations: received response from server master-127.10.26.252:40435: OK, deferred=null)) after lookup
18:35:14.922 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 98a8eded6bca4187b80c3aa15ab74cb7(127.10.26.195:33405)] connecting to peer
18:35:14.924 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.10.26.252:40435(127.10.26.252:40435)] connecting to peer
18:35:14.924 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.10.26.252:40435(127.10.26.252:40435)] connecting to peer
18:35:14.925 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.10.26.252:40435(127.10.26.252:40435)] connecting to peer
18:35:14.925 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.10.26.253:36107(127.10.26.253:36107)] connecting to peer
18:35:14.925 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.10.26.252:40435(127.10.26.252:40435)] connecting to peer
18:35:14.926 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.10.26.253:36107(127.10.26.253:36107)] connecting to peer
18:35:14.926 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.10.26.252:40435(127.10.26.252:40435)] Successfully connected to peer
18:35:14.927 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.10.26.254:36869(127.10.26.254:36869)] connecting to peer
18:35:14.928 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.10.26.253:36107(127.10.26.253:36107)] Successfully connected to peer
18:35:14.932 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.26.253
18:35:14.935 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.10.26.252:40435(127.10.26.252:40435)] Successfully connected to peer
18:35:14.938 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:14.938 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:14.938 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:14.938 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.938 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.938 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:14.939 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.939 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.939 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:14.939 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.939 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.939 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:14.939 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:14.940 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.26.252
18:35:14.942 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:14.944 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:14.946 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc20d4325, L:/127.0.0.1:48306 - R:/127.10.26.253:36107] using SASL/PLAIN
18:35:14.949 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 98a8eded6bca4187b80c3aa15ab74cb7(127.10.26.195:33405)] Successfully connected to peer
18:35:14.954 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:14.959 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x37d2c848, L:/127.0.0.1:46208 - R:/127.10.26.252:40435] using SASL/PLAIN
18:35:14.959 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.10.26.254:36869(127.10.26.254:36869)] Successfully connected to peer
18:35:14.960 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.26.252
18:35:14.961 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 44da982c06b461d5d727b866dc4fd1ed since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 44da982c06b461d5d727b866dc4fd1ed is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:14.962 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.10.26.253:36107(127.10.26.253:36107)] connecting to peer
18:35:14.963 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.10.26.252:40435(127.10.26.252:40435)] Successfully connected to peer
18:35:14.965 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.26.252
18:35:14.965 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.26.254
18:35:14.969 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:14.970 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:14.972 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x79882d20, L:/127.0.0.1:46216 - R:/127.10.26.252:40435] using SASL/PLAIN
18:35:14.973 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x313ec1d2, L:/127.0.0.1:51434 - R:/127.10.26.195:33405] using TOKEN/null
18:35:14.974 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.10.26.254:36869(127.10.26.254:36869)] connecting to peer
18:35:14.974 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.10.26.253:36107(127.10.26.253:36107)] Successfully connected to peer
18:35:14.977 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.26.253
18:35:14.978 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:14.979 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:35:14.979 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=64), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.252:40435, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.253:36107, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.254:36869, [24ms] Sub RPC ConnectToMaster: received response from server master-127.10.26.253:36107: OK, [54ms] Sub RPC ConnectToMaster: received response from server master-127.10.26.252:40435: OK, deferred=null) after lookup
18:35:14.985 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:14.987 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 716932bc7b984d3e9e9cffe98fdc8066
18:35:14.988 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:14.990 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xf79624b9, L:/127.0.0.1:39144 - R:/127.10.26.254:36869] using SASL/PLAIN
18:35:14.990 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 716932bc7b984d3e9e9cffe98fdc8066
18:35:14.991 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1ef88ab8
18:35:14.992 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.10.26.254:36869(127.10.26.254:36869)] Successfully connected to peer
18:35:14.992 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x563683ae, L:/127.0.0.1:46218 - R:/127.10.26.252:40435] using SASL/PLAIN
18:35:14.992 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.10.26.254:36869(127.10.26.254:36869)] connecting to peer
18:35:14.994 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.10.26.253:36107(127.10.26.253:36107)] Successfully connected to peer
18:35:14.995 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:35:14.995 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=75), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.252:40435, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.253:36107, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.254:36869, [69ms] Sub RPC ConnectToMaster: received response from server master-127.10.26.252:40435: OK, deferred=null) after lookup
18:35:14.995 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
18:35:14.995 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
18:35:14.997 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.26.254
18:35:14.998 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x2b64a7e0, L:/127.0.0.1:48322 - R:/127.10.26.253:36107] using SASL/PLAIN
18:35:15.003 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 716932bc7b984d3e9e9cffe98fdc8066
18:35:15.007 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:35:15.007 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=103), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.252:40435, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.253:36107, [38ms] Sub RPC ConnectToMaster: received response from server master-127.10.26.252:40435: OK, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.254:36869, deferred=null) after lookup
18:35:15.007 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 716932bc7b984d3e9e9cffe98fdc8066
18:35:15.007 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@71f7c98
18:35:15.008 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.10.26.254:36869(127.10.26.254:36869)] Successfully connected to peer
18:35:15.009 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
18:35:15.009 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
18:35:15.014 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 716932bc7b984d3e9e9cffe98fdc8066
18:35:15.015 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=25738d17842d46a38a6a374a71afdb3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:35:15.017 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:15.019 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5e97ab59, L:/127.0.0.1:39150 - R:/127.10.26.254:36869] using SASL/PLAIN
18:35:15.021 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 716932bc7b984d3e9e9cffe98fdc8066
18:35:15.021 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@51d39977
18:35:15.022 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.26.253
18:35:15.022 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
18:35:15.023 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
18:35:15.026 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
18:35:15.027 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d6ab62cfed0fae0e4b06dbb6a07ee39ea6fdac90c2e31c8a538ab0813c9a5bb7'}]
18:35:15.028 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:15.028 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:15.028 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:15.029 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:15.030 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:15.030 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:15.030 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:15.030 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:15.030 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:15.030 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:15.031 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:15.031 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:15.031 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:15.031 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:15.033 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:35:15.034 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299998, tablet=04a712669e0b47419a4fcec8d7685a67@[1efcebc990364b10942ae70571022125(127.9.79.194:36053),7574f138ca2d45388a7343688d429edf(127.9.79.193:42499),dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)[L]]}]
18:35:15.035 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:15.038 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x729e5490, L:/127.0.0.1:48338 - R:/127.10.26.253:36107] using SASL/PLAIN
18:35:15.041 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:15.043 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xe762e7ed, L:/127.0.0.1:39168 - R:/127.10.26.254:36869] using TOKEN/null
18:35:15.045 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
18:35:15.047 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.10.26.253:36107(127.10.26.253:36107)] connecting to peer
18:35:15.048 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.10.26.254:36869(127.10.26.254:36869)] connecting to peer
18:35:15.048 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.10.26.252:40435(127.10.26.252:40435)] Successfully connected to peer
18:35:15.049 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.10.26.253:36107(127.10.26.253:36107)] Successfully connected to peer
18:35:15.050 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
18:35:15.051 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.26.252
18:35:15.054 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.26.253
18:35:15.058 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
18:35:15.062 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:15.063 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:15.064 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] connecting to peer
18:35:15.064 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc15080ee, L:/127.0.0.1:46222 - R:/127.10.26.252:40435] using SASL/PLAIN
18:35:15.065 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
18:35:15.067 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.10.26.254:36869(127.10.26.254:36869)] Successfully connected to peer
18:35:15.068 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x18ccbd8f, L:/127.0.0.1:48342 - R:/127.10.26.253:36107] using SASL/PLAIN
18:35:15.071 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=25738d17842d46a38a6a374a71afdb3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:35:15.072 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:35:15.073 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=161), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.252:40435, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.253:36107, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.26.254:36869, [148ms] Sub RPC ConnectToMaster: received response from server master-127.10.26.253:36107: OK, [148ms] Sub RPC ConnectToMaster: received response from server master-127.10.26.252:40435: OK, deferred=null) after lookup
18:35:15.078 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 716932bc7b984d3e9e9cffe98fdc8066
18:35:15.079 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.26.254
18:35:15.083 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 716932bc7b984d3e9e9cffe98fdc8066
18:35:15.083 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@693de46e
18:35:15.084 [DEBUG - kudu-nio-0] (Connection.java:757) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] Successfully connected to peer
18:35:15.085 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
18:35:15.086 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
18:35:15.086 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
18:35:15.089 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.79.195
18:35:15.089 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:15.093 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x242798b0, L:/127.0.0.1:39174 - R:/127.10.26.254:36869] using SASL/PLAIN
18:35:15.097 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
18:35:15.097 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:15.098 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (31c3987d59438cf2a81772f892f95813_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
18:35:15.107 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb8529626, L:/127.0.0.1:42638 - R:/127.9.79.195:41625] using SASL/PLAIN
18:35:15.128 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=25738d17842d46a38a6a374a71afdb3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:35:15.143 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false, responseScanTimestamp = 7305362287652864001) for scanner KuduScanner(table=replication_test_table, tablet=04a712669e0b47419a4fcec8d7685a67, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:35:15.144 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [d6ab62cfed0fae0e4b06dbb6a07ee39ea6fdac90c2e31c8a538ab0813c9a5bb7]
18:35:15.145 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
18:35:15.160 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:15.160 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:15.160 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:15.160 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:15.160 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:15.160 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:15.160 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:15.160 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:15.160 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:15.161 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:15.161 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:15.161 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:15.161 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:15.168 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 25738d17842d46a38a6a374a71afdb3a for table 'replication_test_table' with partition [<start>, <end>)
18:35:15.168 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=25738d17842d46a38a6a374a71afdb3a@[39ef161cd5894a1b981405d458a84b3c(127.10.26.193:37959),98a8eded6bca4187b80c3aa15ab74cb7(127.10.26.195:33405)[L],9b9757a0654c4616bbce35ab01010513(127.10.26.194:34279)]}]
18:35:15.192 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=25738d17842d46a38a6a374a71afdb3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:35:15.201 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d6ab62cfed0fae0e4b06dbb6a07ee39ea6fdac90c2e31c8a538ab0813c9a5bb7]
18:35:15.203 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:35:15.203 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:35:15.203 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d6ab62cfed0fae0e4b06dbb6a07ee39ea6fdac90c2e31c8a538ab0813c9a5bb7 finished by subtask 1; deferring removal (restored in pending)
18:35:15.204 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] disconnecting while in state READY
18:35:15.205 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:35:15.205 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:15.205 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:15.205 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:15.206 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:15.206 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:15.206 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:15.206 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:15.206 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:15.206 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:15.207 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:15.207 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:15.207 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:15.207 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:15.232 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:35:15.232 [DEBUG - kudu-nio-0] (Connection.java:239) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] handling channelInactive
18:35:15.232 [DEBUG - kudu-nio-0] (Connection.java:709) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] cleaning up while in state READY due to: connection closed
18:35:15.233 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
18:35:15.243 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:15.249 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=25738d17842d46a38a6a374a71afdb3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:35:15.303 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:15.306 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=25738d17842d46a38a6a374a71afdb3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:35:15.377 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=25738d17842d46a38a6a374a71afdb3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:35:15.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:15.414 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:15.430 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:15.431 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:15.431 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:15.431 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:15.431 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:15.431 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:15.432 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:15.432 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:15.432 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:15.432 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:15.432 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:15.432 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:15.432 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:15.435 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=25738d17842d46a38a6a374a71afdb3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:35:15.444 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:15.461 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535715460 for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:15.465 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=10, operationSize=1800, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6a78479b, flushNotification=Deferred@1780857087(state=PENDING, result=null, callback=<none>, errback=<none>)}
18:35:15.466 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 98a8eded6bca4187b80c3aa15ab74cb7(127.10.26.195:33405)] connecting to peer
18:35:15.471 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 98a8eded6bca4187b80c3aa15ab74cb7(127.10.26.195:33405)] Successfully connected to peer
18:35:15.483 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:15.484 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:15.484 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:15.485 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:15.485 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:15.485 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:15.485 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:15.485 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:15.485 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:15.485 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:15.485 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:15.485 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:15.485 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:15.485 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:15.485 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xa258a43a, L:/127.0.0.1:51442 - R:/127.10.26.195:33405] using TOKEN/null
18:35:15.492 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=25738d17842d46a38a6a374a71afdb3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:35:15.516 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:15.516 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:15.516 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:15.516 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:15.516 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:15.516 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:15.517 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:15.517 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:15.517 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:15.516 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:15.517 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:15.517 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:15.517 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:15.520 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:15.520 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:15.520 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:15.520 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:15.520 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:15.520 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:15.520 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:15.520 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:15.520 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:15.521 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:15.521 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:15.521 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:15.521 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:15.550 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=25738d17842d46a38a6a374a71afdb3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:35:15.577 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:15.577 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:15.577 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:15.578 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:15.578 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:15.578 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:15.578 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:15.578 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:15.578 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:15.578 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:15.578 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:15.578 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:15.578 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:15.610 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:15.610 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:15.610 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:15.611 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:15.611 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:15.611 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:15.611 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:15.611 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:15.611 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:15.611 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:15.611 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:15.611 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:15.611 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:15.612 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=25738d17842d46a38a6a374a71afdb3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:35:15.631 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 44da982c06b461d5d727b866dc4fd1ed (1955 bytes, checkpointDuration=170 ms, finalizationTime=1 ms).
18:35:15.633 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
18:35:15.633 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split d6ab62cfed0fae0e4b06dbb6a07ee39ea6fdac90c2e31c8a538ab0813c9a5bb7 from pending
18:35:15.633 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 1 finished splits from enumerator state
18:35:15.672 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=25738d17842d46a38a6a374a71afdb3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:35:15.679 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 644dfa4bfb534206927890c17fbcab2f
18:35:15.693 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (fa73e37017778341a79e5b3ef3d55eb9) switched from state RESTARTING to RUNNING.
18:35:15.694 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job fa73e37017778341a79e5b3ef3d55eb9 from Checkpoint 69 @ 1783535448409 for fa73e37017778341a79e5b3ef3d55eb9 located at file:/tmp/junit12731664100414606042/checkpoints/fa73e37017778341a79e5b3ef3d55eb9/chk-69.
18:35:15.694 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
18:35:15.694 [INFO - flink-pekko.actor.default-dispatcher-9] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
18:35:15.695 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_9) switched from CREATED to SCHEDULED.
18:35:15.696 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_9) switched from SCHEDULED to DEPLOYING.
18:35:15.696 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #9) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_9 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 1623ba59e704d1676486c6f13d60068c
18:35:15.696 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_9) switched from CREATED to SCHEDULED.
18:35:15.696 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_9) switched from SCHEDULED to DEPLOYING.
18:35:15.696 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #9) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_9 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 409256c48f07c3602c01f545df4e7b3c
18:35:15.697 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from CREATED to SCHEDULED.
18:35:15.697 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from SCHEDULED to DEPLOYING.
18:35:15.697 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #8) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_8 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id 120c9de24dd4d7d83c84cb1a65b36252
18:35:15.697 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_9) switched from CREATED to SCHEDULED.
18:35:15.697 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_9) switched from SCHEDULED to DEPLOYING.
18:35:15.698 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #9) with attempt id 1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_9 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to f1f388f3-5c60-48a0-b809-2d78ad8f082e @ 127.0.0.1 (dataPort=-1) with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d
18:35:15.698 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:35:15.699 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 1623ba59e704d1676486c6f13d60068c.
18:35:15.699 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#9 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_9), deploy into slot with allocation id 1623ba59e704d1676486c6f13d60068c.
18:35:15.700 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:35:15.700 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:35:15.700 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job fa73e37017778341a79e5b3ef3d55eb9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
18:35:15.701 [INFO - Thread-81] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
18:35:15.701 [DEBUG - Thread-81] (Connection.java:575) [peer master-127.28.68.190:40429(127.28.68.190:40429)] disconnecting while in state TERMINATED
18:35:15.701 [DEBUG - Thread-81] (Connection.java:575) [peer master-127.28.68.188:38393(127.28.68.188:38393)] disconnecting while in state TERMINATED
18:35:15.701 [DEBUG - Thread-81] (Connection.java:575) [peer master-127.28.68.189:33753(127.28.68.189:33753)] disconnecting while in state TERMINATED
18:35:15.702 [DEBUG - Thread-81] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:35:15.703 [INFO - Thread-81] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
18:35:15.703 [INFO - Thread-81] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
18:35:15.704 [DEBUG - Thread-81] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:15.705 [INFO - Thread-81] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
18:35:15.707 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 409256c48f07c3602c01f545df4e7b3c.
18:35:15.707 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#9 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_9), deploy into slot with allocation id 409256c48f07c3602c01f545df4e7b3c.
18:35:15.708 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:35:15.708 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:35:15.708 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:35:15.708 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
18:35:15.708 [INFO - Source: KuduSource -> Sink: Writer (1/4)#9] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#9 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_9) switched from CREATED to DEPLOYING.
18:35:15.708 [INFO - Source: KuduSource -> Sink: Writer (1/4)#9] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#9 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_9) [DEPLOYING].
18:35:15.709 [INFO - Source: KuduSource -> Sink: Writer (1/4)#9] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@64f4b65a
18:35:15.709 [INFO - Source: KuduSource -> Sink: Writer (1/4)#9] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:15.709 [INFO - Source: KuduSource -> Sink: Writer (1/4)#9] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:35:15.709 [INFO - Source: KuduSource -> Sink: Writer (1/4)#9] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#9 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_9) switched from DEPLOYING to INITIALIZING.
18:35:15.709 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_0_9) switched from DEPLOYING to INITIALIZING.
18:35:15.710 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:15.710 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:15.710 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:15.710 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:15.710 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:15.710 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:15.711 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:15.711 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:15.711 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:15.711 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:15.711 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:15.711 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:15.711 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:15.718 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=04a712669e0b47419a4fcec8d7685a67, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:35:15.719 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 120c9de24dd4d7d83c84cb1a65b36252.
18:35:15.719 [INFO - Source: KuduSource -> Sink: Writer (2/4)#9] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#9 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_9) switched from CREATED to DEPLOYING.
18:35:15.720 [INFO - Source: KuduSource -> Sink: Writer (2/4)#9] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#9 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_9) [DEPLOYING].
18:35:15.720 [INFO - Source: KuduSource -> Sink: Writer (2/4)#9] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7099b504
18:35:15.720 [INFO - Source: KuduSource -> Sink: Writer (2/4)#9] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:15.720 [INFO - Source: KuduSource -> Sink: Writer (2/4)#9] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:35:15.721 [INFO - Source: KuduSource -> Sink: Writer (2/4)#9] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#9 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_9) switched from DEPLOYING to INITIALIZING.
18:35:15.721 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_1_9) switched from DEPLOYING to INITIALIZING.
18:35:15.721 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_8), deploy into slot with allocation id 120c9de24dd4d7d83c84cb1a65b36252.
18:35:15.722 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 716932bc7b984d3e9e9cffe98fdc8066
18:35:15.724 [INFO - Source: KuduSource -> Sink: Writer (1/4)#9] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@60baae1f
18:35:15.726 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#9] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:15.728 [INFO - Source: KuduSource -> Sink: Writer (2/4)#9] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6bc7f29d
18:35:15.729 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#9] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:15.743 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:15.751 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot fe2a3c24d55fce5c8d5a55c4e880b53d.
18:35:15.752 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#9 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_9), deploy into slot with allocation id fe2a3c24d55fce5c8d5a55c4e880b53d.
18:35:15.753 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from CREATED to DEPLOYING.
18:35:15.753 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_8) [DEPLOYING].
18:35:15.754 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@69778db
18:35:15.754 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:15.755 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:35:15.755 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#8 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from DEPLOYING to INITIALIZING.
18:35:15.757 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=25738d17842d46a38a6a374a71afdb3a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:35:15.758 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#9] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:15.760 [DEBUG - main] (Connection.java:575) [peer master-127.10.26.253:36107(127.10.26.253:36107)] disconnecting while in state READY
18:35:15.760 [DEBUG - main] (Connection.java:575) [peer master-127.10.26.252:40435(127.10.26.252:40435)] disconnecting while in state READY
18:35:15.760 [DEBUG - main] (Connection.java:575) [peer master-127.10.26.254:36869(127.10.26.254:36869)] disconnecting while in state READY
18:35:15.760 [DEBUG - main] (Connection.java:575) [peer 98a8eded6bca4187b80c3aa15ab74cb7(127.10.26.195:33405)] disconnecting while in state READY
18:35:15.760 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.10.26.252:40435(127.10.26.252:40435)] handling channelInactive
18:35:15.760 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.26.252:40435(127.10.26.252:40435)] cleaning up while in state READY due to: connection closed
18:35:15.761 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.10.26.253:36107(127.10.26.253:36107)] handling channelInactive
18:35:15.761 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.26.253:36107(127.10.26.253:36107)] cleaning up while in state READY due to: connection closed
18:35:15.761 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.10.26.254:36869(127.10.26.254:36869)] handling channelInactive
18:35:15.761 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.26.254:36869(127.10.26.254:36869)] cleaning up while in state READY due to: connection closed
18:35:15.762 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:35:15.763 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
18:35:15.763 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
18:35:15.763 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
18:35:15.764 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#9] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:15.765 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_2_8) switched from DEPLOYING to INITIALIZING.
18:35:15.768 [INFO - Source: KuduSource -> Sink: Writer (3/4)#8] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3fb57470
18:35:15.769 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:15.772 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:15.778 [INFO - Source: KuduSource -> Sink: Writer (4/4)#9] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#9 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_9) switched from CREATED to DEPLOYING.
18:35:15.778 [INFO - Source: KuduSource -> Sink: Writer (4/4)#9] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#9 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_9) [DEPLOYING].
18:35:15.779 [INFO - Source: KuduSource -> Sink: Writer (4/4)#9] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@61784708
18:35:15.779 [INFO - Source: KuduSource -> Sink: Writer (4/4)#9] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
18:35:15.779 [INFO - Source: KuduSource -> Sink: Writer (4/4)#9] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12731664100414606042/checkpoints")
18:35:15.780 [INFO - Source: KuduSource -> Sink: Writer (4/4)#9] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#9 (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_9) switched from DEPLOYING to INITIALIZING.
18:35:15.782 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#9] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:15.783 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (1db490f2f195494a299cf69ae106c36d_cbc357ccb763df2852fee8c4fc7d55f2_3_9) switched from DEPLOYING to INITIALIZING.
18:35:15.782 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.783 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.783 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.786 [INFO - Source: KuduSource -> Sink: Writer (4/4)#9] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@928221a
18:35:15.796 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#9] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:15.803 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:15.813 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#9] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:15.815 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.815 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.815 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.821 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.821 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.821 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.821 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:15.839 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:15.843 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#9] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:15.844 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.844 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.846 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.847 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#9] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:15.852 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.852 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.852 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.856 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.856 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.856 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.856 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:15.863 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#9] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:15.864 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:15.873 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 98a8eded6bca4187b80c3aa15ab74cb7(127.10.26.195:33405)] handling channelInactive
18:35:15.873 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 98a8eded6bca4187b80c3aa15ab74cb7(127.10.26.195:33405)] cleaning up while in state READY due to: connection closed
18:35:15.873 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 28 thread-local buffer(s) from thread: kudu-nio-3
18:35:15.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:15.874488 10347 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 10721
18:35:15.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:15.905 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:15.906 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.906 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.906 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.911 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#8] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:15.914 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:15.917 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:15.918 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:15.918 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:15.918 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:15.923 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:15.924 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:15.924 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:15.924 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:15.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:15.929195 10347 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 10950
18:35:15.932 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:15.932 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:15.932 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:15.932 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:15.938 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:15.942 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:15.943 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.943 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.943 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.943 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.943 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.943 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.943 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:15.944 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:15.951 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#9] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:15.952 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.952 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.952 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.952 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#9] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:15.952 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:15.959 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:15.963 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535715963 for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:15.964 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.964 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.964 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.969 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.970 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.970 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.970 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:15.976 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:15.976 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.977 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.977 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.981 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 44da982c06b461d5d727b866dc4fd1ed (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
18:35:15.984 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
18:35:15.984 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:15.991 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#8] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:15.992 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.992 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.992 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:15.992 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#8] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:15.993 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.993 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.993 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.994 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.994 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.994 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.994 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:15.994 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:15.995 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.995 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.995 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:15.996 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.996 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.997 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:15.997 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:15.997 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:15.997 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:15.997 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:15.997 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:15.998 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:15.998 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:15.998 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:15.998 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:15.999 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:15.999 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:15.999 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:15.999 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:15.999 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:15.999 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:16.000 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:16.000 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:16.000 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:16.000 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:16.000 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:16.000 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:16.000 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:15.999 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.000 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.000 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.001 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:16.001 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.001 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.001 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.002 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.003 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.003 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.003 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.003 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.003 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.003 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.003 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.003 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.004 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.007 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.007 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.007 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.007 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.007 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.008 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.008 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.008 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.011 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.012 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:16.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:16.015244 10347 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 11103
18:35:16.017 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.017 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.018 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.018 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.018 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.018 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.018 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.018 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.018 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.018 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.019 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.019 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.019 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.019 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.019 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.020 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.020 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.020 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.020 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.020 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.020 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.020 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.020 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.020 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.020 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.022 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.022 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.022 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.022 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.030 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:16.030 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.030 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.030 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.030 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.031 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.031 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.031 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.035 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:16.035 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.035 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.035 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.035 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.035 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.035 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.036 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:16.039 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.039 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.039 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.039 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.039 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.039 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.039 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.039 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.039 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.039 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.039 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.039 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.040 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.043 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.043 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.043 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.043 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.043 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.044 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.044 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.044 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.044 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.044 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.044 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.044 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.045 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.045 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.045 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.045 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.045 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.045 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.045 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.045 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.045 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.045 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.051 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.051 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.051 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.051 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.052 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.052 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.052 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:16.052 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.052 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.052 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.052 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.052 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.052 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.053 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.053 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.053 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.053 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.052 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:16.053 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:16.053 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.053 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.053 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.054 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.054 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.054 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.054 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:16.054 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.054 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.054 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.054 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.055 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.055 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.055 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.055 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.055 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.055 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.055 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.055 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.059 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.059 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.059 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.059 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.059 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.060 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.060 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.060 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.060 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.060 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.060 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.060 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.060 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.063 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.063 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.063 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.064 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.064 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.064 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.064 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.064 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.064 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.064 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 98a8eded6bca4187b80c3aa15ab74cb7(127.10.26.195:33405)] handling channelInactive
18:35:16.064 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 98a8eded6bca4187b80c3aa15ab74cb7(127.10.26.195:33405)] cleaning up while in state READY due to: connection closed
18:35:16.064 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.064 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.065 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.065 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.065 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.065 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.065 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.065 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.065 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.065 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.065 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.065 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.065 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.066 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.066 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.066 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.066 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.066 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:16.066 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:16.066 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:16.066 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:16.066 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:16.066 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:16.067 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:16.067 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:16.067 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:16.067 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:16.067 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:16.067 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:16.067 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:16.071 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.071 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.071 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.071 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.071 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.071 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.071 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.071 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.071 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.072 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.072 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.072 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.072 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.072 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:16.073 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:16.073 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:16.073 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.073 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.073 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.073 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.073 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.073 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.073 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.073 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.073 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.073 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:16.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:16.074491 10347 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 10359
18:35:16.084 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.084 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.084 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.084 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.084 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.084 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.084 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.085 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.085 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.085 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.085 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.085 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.085 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.085 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.085 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.085 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.085 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.085 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.085 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.085 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.085 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.085 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.085 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.085 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.085 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.086 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.091 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.092 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.092 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.092 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.092 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.092 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.092 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.092 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.092 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.092 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:16.092 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:16.092 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:16.093 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.093 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.093 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.093 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.093 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.093 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.093 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.093 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.093 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.093 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:16.093 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.093 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.093 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.093 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.099 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.099 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.099 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.099 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.099 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.099 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.099 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.100 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.100 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.100 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.100 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.100 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.100 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.104 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.104 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.104 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.104 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.104 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.104 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.105 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.105 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.105 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.104 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.105 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.105 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.105 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.110 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.10.26.254:36869(127.10.26.254:36869)] handling channelInactive
18:35:16.110 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.10.26.254:36869(127.10.26.254:36869)] handling channelInactive
18:35:16.110 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.26.254:36869(127.10.26.254:36869)] cleaning up while in state READY due to: connection closed
18:35:16.110 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.26.254:36869(127.10.26.254:36869)] cleaning up while in state READY due to: connection closed
18:35:16.110 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.10.26.254:36869(127.10.26.254:36869)] handling channelInactive
18:35:16.110 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.26.254:36869(127.10.26.254:36869)] cleaning up while in state READY due to: connection closed
18:35:16.111 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.10.26.254:36869(127.10.26.254:36869)] handling channelInactive
18:35:16.111 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.26.254:36869(127.10.26.254:36869)] cleaning up while in state READY due to: connection closed
18:35:16.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:16.114087 10347 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 10494
18:35:16.124 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.124 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.124 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.124 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.124 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.124 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.124 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.124 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.124 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.125 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.125 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.125 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.125 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.131 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.131 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.131 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.132 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.132 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.132 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.132 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.132 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.132 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.132 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.132 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.132 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.132 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.132 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:16.133 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:16.133 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:16.133 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.133 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.133 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.133 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.133 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.133 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.133 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.133 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.133 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.133 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:16.144 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.145 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.145 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.145 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.145 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.145 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.145 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.145 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.145 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.145 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.145 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.146 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.146 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.155 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.10.26.253:36107(127.10.26.253:36107)] handling channelInactive
18:35:16.155 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.26.253:36107(127.10.26.253:36107)] cleaning up while in state READY due to: connection closed
18:35:16.155 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.10.26.253:36107(127.10.26.253:36107)] handling channelInactive
18:35:16.156 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.26.253:36107(127.10.26.253:36107)] cleaning up while in state READY due to: connection closed
18:35:16.156 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.10.26.253:36107(127.10.26.253:36107)] handling channelInactive
18:35:16.156 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.26.253:36107(127.10.26.253:36107)] cleaning up while in state READY due to: connection closed
18:35:16.157 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.10.26.253:36107(127.10.26.253:36107)] handling channelInactive
18:35:16.157 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.26.253:36107(127.10.26.253:36107)] cleaning up while in state READY due to: connection closed
18:35:16.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:16.159628 10605 connection.cc:573] client connection to 127.10.26.253:36107 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:35:16.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:16.160076 10605 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:35:16.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:16.161545 10347 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 10573
18:35:16.174 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.174 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.174 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.174 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.175 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.175 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:16.175 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.175 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:16.175 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:16.176 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.176 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.176 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.176 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.177 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.177 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.177 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.177 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.177 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.177 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.177 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.177 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.177 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.178 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.178 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.178 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.178 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:16.199 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.199 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.199 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.200 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.200 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.200 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.200 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.200 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.200 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.200 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.200 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.201 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.201 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.203 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.203 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.203 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.203 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.203 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.203 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.203 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.203 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.203 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.10.26.252:40435(127.10.26.252:40435)] handling channelInactive
18:35:16.203 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.203 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.26.252:40435(127.10.26.252:40435)] cleaning up while in state READY due to: connection closed
18:35:16.204 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.204 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.204 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.204 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.10.26.252:40435(127.10.26.252:40435)] handling channelInactive
18:35:16.204 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.204 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.10.26.252:40435(127.10.26.252:40435)] handling channelInactive
18:35:16.204 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.26.252:40435(127.10.26.252:40435)] cleaning up while in state READY due to: connection closed
18:35:16.204 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.10.26.252:40435(127.10.26.252:40435)] handling channelInactive
18:35:16.204 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.26.252:40435(127.10.26.252:40435)] cleaning up while in state READY due to: connection closed
18:35:16.204 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.26.252:40435(127.10.26.252:40435)] cleaning up while in state READY due to: connection closed
18:35:16.243 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:16.251 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.252 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.252 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.252 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.252 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.252 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.252 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.252 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.252 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.253 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.253 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.253 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.253 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.282 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:16.282 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:16.282 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:16.283 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:16.283 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:16.283 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:16.283 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:16.283 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:16.283 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:16.284 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:16.283 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:16.284 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:16.284 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:16.303 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:16.305 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.305 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.306 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.306 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.306 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.307 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.307 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.307 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.307 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.307 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.307 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.308 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.308 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.353 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:16.353 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:16.353 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:16.354 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.354 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.354 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.354 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.354 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.354 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.355 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.355 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.355 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.355 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:16.364 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.364 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.365 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.365 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.365 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.365 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.366 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.366 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.366 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.366 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.366 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.366 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.366 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:16.415 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:16.423 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.424 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.424 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.424 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.424 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.424 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.424 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.424 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.424 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.425 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.425 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.425 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.425 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.437 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:16.445 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:16.452 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.452 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.452 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.452 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.453 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.453 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.453 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.453 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.453 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.453 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.453 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.453 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.453 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.458 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.458 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.459 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.459 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.459 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.459 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.459 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.460 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.460 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.460 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.460 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.460 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.460 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.461 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535716460 for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:16.472 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 44da982c06b461d5d727b866dc4fd1ed (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:35:16.473 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
18:35:16.495 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:16.495 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:16.495 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:16.496 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:16.496 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:16.496 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:16.496 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:16.496 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:16.496 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:16.496 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:16.496 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:16.496 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:16.496 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:16.597 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:16.597 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:16.597 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:16.598 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:16.598 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:16.598 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:16.598 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:16.598 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:16.598 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:16.598 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:16.598 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:16.598 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:16.599 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:16.599 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.599 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.599 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.600 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.600 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.600 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.600 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.600 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.600 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.601 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.601 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.601 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.601 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.643 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.643 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.643 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.644 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.644 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.644 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.644 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.644 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.644 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.644 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.644 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.644 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.644 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.657 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:16.657 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:16.657 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:16.657 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:16.657 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:16.657 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:16.658 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:16.658 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:16.658 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:16.658 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:16.658 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:16.658 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:16.658 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:16.665 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:16.666 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:16.666 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:16.666 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:16.666 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:16.666 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:16.666 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:16.666 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:16.666 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:16.666 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:16.666 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:16.667 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:16.667 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:16.697 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:16.697 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:16.697 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:16.698 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:16.698 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:16.698 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:16.698 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:16.698 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:16.699 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:16.699 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:16.699 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:16.699 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:16.699 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:16.743 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:16.751 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.751 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.751 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.752 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.752 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.752 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.752 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.752 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.752 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.752 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.752 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.753 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.753 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.763 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 644dfa4bfb534206927890c17fbcab2f
18:35:16.766 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='2aa96e9ca083a13472731f5d17d1a965544b710a201c69257db153a78da2ec1e'}]
18:35:16.769 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:16.771 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:35:16.772 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=298089, tablet=04a712669e0b47419a4fcec8d7685a67@[1efcebc990364b10942ae70571022125(127.9.79.194:36053),7574f138ca2d45388a7343688d429edf(127.9.79.193:42499),dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)[L]]}]
18:35:16.802 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:16.811 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] connecting to peer
18:35:16.820 [DEBUG - kudu-nio-0] (Connection.java:757) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] Successfully connected to peer
18:35:16.833 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:16.834 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:16.834 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:16.834 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.834 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.834 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.834 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.834 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:16.834 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:16.835 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.835 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.835 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:16.835 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:16.863 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.863 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.863 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.864 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.864 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.864 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.865 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.865 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.865 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.865 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.865 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.865 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.865 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.866 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:16.868 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:16.868 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:16.868 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.868 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.868 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:16.869 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.869 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.869 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:16.869 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.869 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.869 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:16.869 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:16.891 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:16.891 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:16.891 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:16.891 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:16.891 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:16.892 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:16.892 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:16.892 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:16.892 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:16.892 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:16.892 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:16.892 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:16.892 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:16.897 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.79.195
18:35:16.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:16.909 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:16.909 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:16.910 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:16.910 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:16.910 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:16.910 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:16.910 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:16.910 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:16.910 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:16.910 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:16.910 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:16.911 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:16.911 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:16.914 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:16.915 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:16.919 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xefa451de, L:/127.0.0.1:42646 - R:/127.9.79.195:41625] using SASL/PLAIN
18:35:16.935 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:16.935 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:16.935 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:16.936 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:16.936 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:16.936 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:16.936 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:16.936 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:16.936 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:16.937 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:16.937 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305362295828480001) for scanner KuduScanner(table=replication_test_table, tablet=04a712669e0b47419a4fcec8d7685a67, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:35:16.938 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [2aa96e9ca083a13472731f5d17d1a965544b710a201c69257db153a78da2ec1e]
18:35:16.938 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [2aa96e9ca083a13472731f5d17d1a965544b710a201c69257db153a78da2ec1e]
18:35:16.939 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:16.939 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:16.939 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:16.939 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:16.943 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 2aa96e9ca083a13472731f5d17d1a965544b710a201c69257db153a78da2ec1e finished by subtask 3; deferring removal (restored in pending)
18:35:16.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:16.948 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
18:35:16.948 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
18:35:16.948 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] disconnecting while in state READY
18:35:16.949 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:35:16.961 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535716960 for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:16.972 [DEBUG - kudu-nio-0] (Connection.java:239) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] handling channelInactive
18:35:16.972 [DEBUG - kudu-nio-0] (Connection.java:709) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] cleaning up while in state READY due to: connection closed
18:35:16.972 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
18:35:16.972 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
18:35:16.976 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 44da982c06b461d5d727b866dc4fd1ed (1965 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
18:35:16.979 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
18:35:16.979 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split 2aa96e9ca083a13472731f5d17d1a965544b710a201c69257db153a78da2ec1e from pending
18:35:16.979 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 4 complete: removed 1 finished splits from enumerator state
18:35:16.983 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:16.983 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:16.983 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:16.983 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:16.983 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:16.983 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:16.985 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:16.985 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:16.985 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:16.985 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:16.985 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:16.986 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:16.986 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:17.023 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:17.023 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:17.023 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:17.023 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:17.023 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:17.024 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:17.024 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:17.024 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:17.024 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:17.024 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:17.024 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:17.024 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:17.024 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:17.144 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:17.145 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:17.145 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:17.145 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:17.145 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:17.145 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:17.146 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:17.146 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:17.146 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:17.146 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:17.147 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:17.147 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:17.147 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:17.182 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:17.183 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:17.183 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:17.183 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:17.183 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:17.183 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:17.184 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:17.184 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:17.184 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:17.184 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:17.184 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:17.184 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:17.185 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:17.232 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:17.232 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:17.232 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:17.233 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:17.233 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:17.233 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:17.233 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:17.233 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:17.233 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:17.233 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:17.233 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:17.234 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:17.234 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:17.242 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:17.270 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:17.271 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:17.271 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:17.271 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:17.271 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:17.271 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:17.272 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:17.272 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:17.272 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:17.272 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:17.272 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:17.272 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:17.272 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:17.302 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:17.371 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:17.372 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:17.372 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:17.372 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:17.372 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:17.372 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:17.372 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:17.372 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:17.372 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:17.373 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:17.373 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:17.373 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:17.373 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:17.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:17.415 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:17.437 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:17.445 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:17.461 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535717460 for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:17.473 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 44da982c06b461d5d727b866dc4fd1ed (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
18:35:17.474 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
18:35:17.479 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:17.479 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:17.479 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:17.479 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:17.479 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:17.480 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:17.480 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:17.480 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:17.480 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:17.480 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:17.480 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:17.480 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:17.480 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:17.582 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:17.582 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:17.582 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:17.582 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:17.582 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:17.583 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:17.583 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:17.583 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:17.583 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:17.583 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:17.583 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:17.583 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:17.583 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:17.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:35:17Z chronyd exiting
18:35:17.654 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:17.655 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:17.655 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:17.655 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:17.655 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:17.655 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:17.655 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:17.655 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:17.655 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:17.655 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:17.655 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:17.655 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:17.656 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:17.685 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:17.685 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:17.685 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:17.685 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:17.685 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:17.685 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:17.686 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:17.686 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:17.686 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:17.685 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:17.686 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:17.686 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:17.686 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:17.712 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:17.712 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:17.712 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:17.713 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:17.713 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:17.713 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:17.713 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:17.713 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:17.713 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:17.713 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:17.713 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:17.713 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:17.714 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:17.737 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:17.737 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:17.737 [DEBUG - pool-572-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:17.737 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:17.737 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:17.737 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:17.737 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:17.738 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:17.738 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:17.738 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:17.738 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:17.738 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:17.738 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:17.742 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:17.745 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:17.745 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:17.746 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:17.746 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:17.746 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:17.746 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.254:32967(127.0.106.254:32967)] connecting to peer
18:35:17.746 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:17.746 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:17.746 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:17.746 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.253:45189(127.0.106.253:45189)] connecting to peer
18:35:17.746 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:17.746 [DEBUG - pool-552-thread-1] (Connection.java:748) [peer master-127.0.106.252:46705(127.0.106.252:46705)] connecting to peer
18:35:17.746 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:17.746 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.106.253:45189(127.0.106.253:45189)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:17.746 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.253:45189: Failed to connect to peer master-127.0.106.253:45189(127.0.106.253:45189): Connection refused: /127.0.106.253:45189
18:35:17.746 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:17.747 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:17.747 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.106.252:46705(127.0.106.252:46705)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:17.747 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.252:46705: Failed to connect to peer master-127.0.106.252:46705(127.0.106.252:46705): Connection refused: /127.0.106.252:46705
18:35:17.747 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:17.747 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.106.254:32967(127.0.106.254:32967)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:17.747 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.106.254:32967: Failed to connect to peer master-127.0.106.254:32967(127.0.106.254:32967): Connection refused: /127.0.106.254:32967
18:35:17.747 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.0.106.254:32967,127.0.106.253:45189,127.0.106.252:46705; will retry
18:35:17.747 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:17.747 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:17.747 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:17.802 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:17.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:17.915 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:17.919 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:17.920 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:17.920 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:17.920 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:17.920 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:17.920 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:17.920 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:17.920 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:17.920 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:17.920 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:17.920 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:17.920 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:17.920 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:17.936 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:17.944 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:17.957 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:17.957 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:17.957 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:17.957 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:17.957 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:17.957 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:17.957 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:17.958 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:17.958 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:17.958 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:17.958 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:17.957 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:17.958 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:17.961 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535717960 for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:17.965 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:17.965 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:17.965 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:17.965 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:17.965 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:17.965 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:17.965 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:17.965 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:17.965 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:17.965 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:17.966 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:17.966 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:17.966 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:17.972 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 44da982c06b461d5d727b866dc4fd1ed (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
18:35:17.972 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
18:35:18.043 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:18.043 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:18.043 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:18.044 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:18.044 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:18.044 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:18.044 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:18.044 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:18.044 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:18.044 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:18.044 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:18.044 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:18.044 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:18.085 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:18.085 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:18.085 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:18.085 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:18.085 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:18.085 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:18.085 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:18.085 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:18.085 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:18.085 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:18.085 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:18.085 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:18.085 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:18.100 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.61:44495(127.6.245.61:44495)] connecting to peer
18:35:18.100 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.60:46787(127.6.245.60:46787)] connecting to peer
18:35:18.100 [DEBUG - pool-538-thread-1] (Connection.java:748) [peer master-127.6.245.62:36853(127.6.245.62:36853)] connecting to peer
18:35:18.100 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:18.100 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.6.245.61:44495(127.6.245.61:44495)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:18.100 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:18.100 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.61:44495: Failed to connect to peer master-127.6.245.61:44495(127.6.245.61:44495): Connection refused: /127.6.245.61:44495
18:35:18.100 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.6.245.60:46787(127.6.245.60:46787)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:18.100 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.60:46787: Failed to connect to peer master-127.6.245.60:46787(127.6.245.60:46787): Connection refused: /127.6.245.60:46787
18:35:18.101 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:18.101 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.6.245.62:36853(127.6.245.62:36853)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:18.101 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.6.245.62:36853: Failed to connect to peer master-127.6.245.62:36853(127.6.245.62:36853): Connection refused: /127.6.245.62:36853
18:35:18.101 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.6.245.61:44495,127.6.245.60:46787,127.6.245.62:36853; will retry
18:35:18.111 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:18.111 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:18.111 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:18.111 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:18.111 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:18.111 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:18.111 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:18.111 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:18.111 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:18.111 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:18.111 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:18.111 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:18.112 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:18.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:18.219060  9841 debug-util.cc:398] Leaking SignalData structure 0x7b0800070260 after lost signal to thread 9773
18:35:18.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:18.219774  9841 debug-util.cc:398] Leaking SignalData structure 0x7b080007c900 after lost signal to thread 9844
18:35:18.243 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:18.243 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:18.244 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:18.244 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:18.244 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:18.244 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:18.244 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:18.244 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:18.244 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:18.244 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:18.244 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:18.244 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:18.245 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:18.245 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:18.272 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.190:40429(127.28.68.190:40429)] connecting to peer
18:35:18.273 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.189:33753(127.28.68.189:33753)] connecting to peer
18:35:18.273 [DEBUG - pool-590-thread-1] (Connection.java:748) [peer master-127.28.68.188:38393(127.28.68.188:38393)] connecting to peer
18:35:18.273 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:18.273 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.68.190:40429(127.28.68.190:40429)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:18.273 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.190:40429: Failed to connect to peer master-127.28.68.190:40429(127.28.68.190:40429): Connection refused: /127.28.68.190:40429
18:35:18.273 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:18.273 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.68.189:33753(127.28.68.189:33753)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:18.273 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.189:33753: Failed to connect to peer master-127.28.68.189:33753(127.28.68.189:33753): Connection refused: /127.28.68.189:33753
18:35:18.274 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:18.274 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.68.188:38393(127.28.68.188:38393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:18.274 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.68.188:38393: Failed to connect to peer master-127.28.68.188:38393(127.28.68.188:38393): Connection refused: /127.28.68.188:38393
18:35:18.274 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.68.190:40429,127.28.68.189:33753,127.28.68.188:38393; will retry
18:35:18.298 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:18.298 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:18.299 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:18.299 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:18.299 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:18.299 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:18.299 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:18.299 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:18.299 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:18.299 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:18.299 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:18.299 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:18.299 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:18.302 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:18.401 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:18.405 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:18.405 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:18.405 [DEBUG - pool-558-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:18.405 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:18.405 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:18.405 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:18.406 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:18.406 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:18.406 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:18.406 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:18.406 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:18.406 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:18.406 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:18.415 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:18.436 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:18.445 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:18.461 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535718460 for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:18.465 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:18.465 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:18.466 [DEBUG - pool-594-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:18.466 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:18.466 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:18.466 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:18.466 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:18.466 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:18.466 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:18.467 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:18.467 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:18.467 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:18.467 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:18.471 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 44da982c06b461d5d727b866dc4fd1ed (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:35:18.472 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
18:35:18.653 [DEBUG - main] (Connection.java:575) [peer master-127.9.79.254:42669(127.9.79.254:42669)] disconnecting while in state READY
18:35:18.653 [DEBUG - main] (Connection.java:575) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] disconnecting while in state READY
18:35:18.653 [DEBUG - main] (Connection.java:575) [peer master-127.9.79.253:36577(127.9.79.253:36577)] disconnecting while in state READY
18:35:18.653 [DEBUG - main] (Connection.java:575) [peer master-127.9.79.252:38727(127.9.79.252:38727)] disconnecting while in state READY
18:35:18.653 [DEBUG - kudu-nio-3] (Connection.java:239) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] handling channelInactive
18:35:18.654 [DEBUG - kudu-nio-3] (Connection.java:709) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] cleaning up while in state READY due to: connection closed
18:35:18.654 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.79.252:38727(127.9.79.252:38727)] handling channelInactive
18:35:18.654 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.79.252:38727(127.9.79.252:38727)] cleaning up while in state READY due to: connection closed
18:35:18.656 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:35:18.658 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
18:35:18.658 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-3
18:35:18.653 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.79.254:42669(127.9.79.254:42669)] handling channelInactive
18:35:18.658 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.79.254:42669(127.9.79.254:42669)] cleaning up while in state READY due to: connection closed
18:35:18.659 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
18:35:18.671 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.79.253:36577(127.9.79.253:36577)] handling channelInactive
18:35:18.671 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.79.253:36577(127.9.79.253:36577)] cleaning up while in state READY due to: connection closed
18:35:18.672 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
18:35:18.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:18.673061  9535 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 9907
18:35:18.697 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:18.697 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:18.697 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:18.697 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:18.697 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:18.697 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:18.700 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:18.700 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:18.700 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:18.700 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:18.700 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:18.700 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:18.700 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:18.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:18.731904  9535 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 10048
18:35:18.744 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:18.761 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 644dfa4bfb534206927890c17fbcab2f
18:35:18.768 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a17e9053d873c901c36c3a2a2a4fc57c84876d1b117f93879ec59abe7efd60db'}]
18:35:18.769 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:35:18.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:18.785030 10227 connection.cc:573] client connection to 127.9.79.194:36053 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:35:18.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:35:18.785614 10227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:35:18.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:18.798273  9535 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 10198
18:35:18.801 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
18:35:18.802 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=296092, tablet=04a712669e0b47419a4fcec8d7685a67@[1efcebc990364b10942ae70571022125(127.9.79.194:36053),7574f138ca2d45388a7343688d429edf(127.9.79.193:42499),dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)[L]]}]
18:35:18.802 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:18.819 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] connecting to peer
18:35:18.828 [DEBUG - kudu-nio-0] (Connection.java:757) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] Successfully connected to peer
18:35:18.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:18.863013  9535 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 9547
18:35:18.863 [ERROR - kudu-nio-0] (Connection.java:452) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] unexpected exception from downstream on [id: 0x4ed158c0, L:/127.0.0.1:42662 - R:/127.9.79.195:41625]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:35:18.863 [DEBUG - kudu-nio-0] (Connection.java:709) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] cleaning up while in state NEGOTIATING due to: [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] unexpected exception from downstream on [id: 0x4ed158c0, L:/127.0.0.1:42662 - R:/127.9.79.195:41625]
18:35:18.864 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625) for tablet 04a712669e0b47419a4fcec8d7685a67: [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] unexpected exception from downstream on [id: 0x4ed158c0, L:/127.0.0.1:42662 - R:/127.9.79.195:41625]
18:35:18.864 [DEBUG - kudu-nio-0] (Connection.java:239) [peer dd6b79d156f3425f9339508e1f01df9c(127.9.79.195:41625)] handling channelInactive
18:35:18.870 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:18.870 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:18.871 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:18.871 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:18.871 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:18.871 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:18.871 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:18.871 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:18.872 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:18.872 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:18.872 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:18.872 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:18.872 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:18.883 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer 7574f138ca2d45388a7343688d429edf(127.9.79.193:42499)] connecting to peer
18:35:18.890 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 7574f138ca2d45388a7343688d429edf(127.9.79.193:42499): Connection refused: /127.9.79.193:42499
18:35:18.890 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 7574f138ca2d45388a7343688d429edf(127.9.79.193:42499)] cleaning up while in state CONNECTING due to: Failed to connect to peer 7574f138ca2d45388a7343688d429edf(127.9.79.193:42499): Connection refused: /127.9.79.193:42499
18:35:18.890 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 7574f138ca2d45388a7343688d429edf(127.9.79.193:42499) for tablet 04a712669e0b47419a4fcec8d7685a67: Failed to connect to peer 7574f138ca2d45388a7343688d429edf(127.9.79.193:42499): Connection refused: /127.9.79.193:42499
18:35:18.899 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer 1efcebc990364b10942ae70571022125(127.9.79.194:36053)] connecting to peer
18:35:18.900 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 1efcebc990364b10942ae70571022125(127.9.79.194:36053): Connection refused: /127.9.79.194:36053
18:35:18.901 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 1efcebc990364b10942ae70571022125(127.9.79.194:36053)] cleaning up while in state CONNECTING due to: Failed to connect to peer 1efcebc990364b10942ae70571022125(127.9.79.194:36053): Connection refused: /127.9.79.194:36053
18:35:18.901 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 1efcebc990364b10942ae70571022125(127.9.79.194:36053) for tablet 04a712669e0b47419a4fcec8d7685a67: Failed to connect to peer 1efcebc990364b10942ae70571022125(127.9.79.194:36053): Connection refused: /127.9.79.194:36053
18:35:18.901 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:18.915 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:18.920 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.252:38727(127.9.79.252:38727)] connecting to peer
18:35:18.924 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.253:36577(127.9.79.253:36577)] connecting to peer
18:35:18.924 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.79.254:42669(127.9.79.254:42669)] handling channelInactive
18:35:18.924 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.79.254:42669(127.9.79.254:42669)] cleaning up while in state READY due to: connection closed
18:35:18.926 [DEBUG - kudu-nio-3] (Connection.java:757) [peer master-127.9.79.252:38727(127.9.79.252:38727)] Successfully connected to peer
18:35:18.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:18.926029  9535 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 9671
18:35:18.927 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.254:42669(127.9.79.254:42669)] connecting to peer
18:35:18.927 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.9.79.253:36577(127.9.79.253:36577)] Successfully connected to peer
18:35:18.928 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:18.928 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.79.254:42669(127.9.79.254:42669)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:18.928 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.254:42669: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:18.940 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:18.942 [DEBUG - kudu-nio-3] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.79.252
18:35:18.945 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:18.952 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
18:35:18.957 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x8959071d, L:/127.0.0.1:60428 - R:/127.9.79.252:38727] using SASL/PLAIN
18:35:18.962 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535718961 for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:18.972 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 44da982c06b461d5d727b866dc4fd1ed (1965 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
18:35:18.973 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
18:35:18.992 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.79.253:36577(127.9.79.253:36577)] handling channelInactive
18:35:18.993 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.79.253:36577(127.9.79.253:36577)] cleaning up while in state READY due to: connection closed
18:35:18.994 [ERROR - kudu-nio-4] (Connection.java:452) [peer master-127.9.79.253:36577(127.9.79.253:36577)] unexpected exception from downstream on [id: 0x65be6aee, L:/127.0.0.1:54714 - R:/127.9.79.253:36577]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:35:18.994 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.79.253:36577(127.9.79.253:36577)] cleaning up while in state NEGOTIATING due to: [peer master-127.9.79.253:36577(127.9.79.253:36577)] unexpected exception from downstream on [id: 0x65be6aee, L:/127.0.0.1:54714 - R:/127.9.79.253:36577]
18:35:18.994 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.253:36577: [peer master-127.9.79.253:36577(127.9.79.253:36577)] unexpected exception from downstream on [id: 0x65be6aee, L:/127.0.0.1:54714 - R:/127.9.79.253:36577]
18:35:18.994 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.79.252:38727,127.9.79.253:36577,127.9.79.254:42669; will retry
18:35:18.994 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.9.79.253:36577(127.9.79.253:36577)] handling channelInactive
18:35:19.000 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.253:36577(127.9.79.253:36577)] connecting to peer
18:35:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:35:19.006213  9535 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSwO0Je/build/tsan/bin/kudu with pid 9768
18:35:19.011 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.254:42669(127.9.79.254:42669)] connecting to peer
18:35:19.011 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.011 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.79.253:36577(127.9.79.253:36577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.012 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.253:36577: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.019 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.019 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.79.254:42669(127.9.79.254:42669)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.020 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.254:42669: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.020 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.79.252:38727,127.9.79.253:36577,127.9.79.254:42669; will retry
18:35:19.039 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.253:36577(127.9.79.253:36577)] connecting to peer
18:35:19.040 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.254:42669(127.9.79.254:42669)] connecting to peer
18:35:19.040 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.040 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.79.253:36577(127.9.79.253:36577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.040 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.253:36577: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.040 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.040 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.79.254:42669(127.9.79.254:42669)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.040 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.254:42669: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.041 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:19.041 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:19.041 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:19.041 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:19.041 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:19.041 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:19.041 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:19.041 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:19.042 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:19.042 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:19.042 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:19.042 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:19.042 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:19.057 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.79.252:38727(127.9.79.252:38727)] handling channelInactive
18:35:19.057 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.79.252:38727(127.9.79.252:38727)] cleaning up while in state READY due to: connection closed
18:35:19.057 [ERROR - kudu-nio-3] (Connection.java:452) [peer master-127.9.79.252:38727(127.9.79.252:38727)] unexpected exception from downstream on [id: 0x8959071d, L:/127.0.0.1:60428 - R:/127.9.79.252:38727]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:35:19.057 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.79.252:38727(127.9.79.252:38727)] cleaning up while in state READY due to: [peer master-127.9.79.252:38727(127.9.79.252:38727)] unexpected exception from downstream on [id: 0x8959071d, L:/127.0.0.1:60428 - R:/127.9.79.252:38727]
18:35:19.057 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.252:38727: [peer master-127.9.79.252:38727(127.9.79.252:38727)] unexpected exception from downstream on [id: 0x8959071d, L:/127.0.0.1:60428 - R:/127.9.79.252:38727]
18:35:19.057 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.79.252:38727,127.9.79.253:36577,127.9.79.254:42669; will retry
18:35:19.058 [DEBUG - kudu-nio-3] (Connection.java:239) [peer master-127.9.79.252:38727(127.9.79.252:38727)] handling channelInactive
18:35:19.080 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.252:38727(127.9.79.252:38727)] connecting to peer
18:35:19.080 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.253:36577(127.9.79.253:36577)] connecting to peer
18:35:19.080 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.254:42669(127.9.79.254:42669)] connecting to peer
18:35:19.080 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.080 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.080 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.79.252:38727(127.9.79.252:38727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.080 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.79.254:42669(127.9.79.254:42669)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.080 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.252:38727: Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.080 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.254:42669: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.081 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.081 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.79.253:36577(127.9.79.253:36577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.081 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.253:36577: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.081 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.79.252:38727,127.9.79.253:36577,127.9.79.254:42669; will retry
18:35:19.091 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:19.091 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:19.091 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:19.091 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:19.091 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:19.091 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:19.091 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:19.091 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:19.091 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:19.092 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:19.092 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:19.092 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:19.092 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:19.099 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.252:38727(127.9.79.252:38727)] connecting to peer
18:35:19.099 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.253:36577(127.9.79.253:36577)] connecting to peer
18:35:19.099 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.254:42669(127.9.79.254:42669)] connecting to peer
18:35:19.099 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.100 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.79.252:38727(127.9.79.252:38727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.100 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.252:38727: Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.100 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.100 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.79.253:36577(127.9.79.253:36577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.100 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.253:36577: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.100 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.100 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.79.254:42669(127.9.79.254:42669)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.100 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.254:42669: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.100 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.9.79.252:38727,127.9.79.253:36577,127.9.79.254:42669; will retry
18:35:19.140 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.252:38727(127.9.79.252:38727)] connecting to peer
18:35:19.140 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.253:36577(127.9.79.253:36577)] connecting to peer
18:35:19.140 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.254:42669(127.9.79.254:42669)] connecting to peer
18:35:19.140 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.141 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.79.252:38727(127.9.79.252:38727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.141 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.141 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.252:38727: Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.141 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.79.253:36577(127.9.79.253:36577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.141 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.253:36577: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.141 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.141 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.79.254:42669(127.9.79.254:42669)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.141 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.254:42669: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.141 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.79.252:38727,127.9.79.253:36577,127.9.79.254:42669; will retry
18:35:19.160 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.252:38727(127.9.79.252:38727)] connecting to peer
18:35:19.160 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.253:36577(127.9.79.253:36577)] connecting to peer
18:35:19.160 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.254:42669(127.9.79.254:42669)] connecting to peer
18:35:19.160 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.160 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.79.253:36577(127.9.79.253:36577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.160 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.253:36577: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.160 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.161 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.79.252:38727(127.9.79.252:38727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.161 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.252:38727: Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.161 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.161 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.79.254:42669(127.9.79.254:42669)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.161 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.254:42669: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.161 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.9.79.252:38727,127.9.79.253:36577,127.9.79.254:42669; will retry
18:35:19.200 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.252:38727(127.9.79.252:38727)] connecting to peer
18:35:19.200 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.253:36577(127.9.79.253:36577)] connecting to peer
18:35:19.200 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.254:42669(127.9.79.254:42669)] connecting to peer
18:35:19.200 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.200 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.79.252:38727(127.9.79.252:38727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.200 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.252:38727: Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.201 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.201 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.201 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.79.253:36577(127.9.79.253:36577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.201 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.79.254:42669(127.9.79.254:42669)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.201 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.253:36577: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.201 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.254:42669: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.201 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.79.252:38727,127.9.79.253:36577,127.9.79.254:42669; will retry
18:35:19.216 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:19.216 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:19.216 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:19.216 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:19.216 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:19.216 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:19.216 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:19.216 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:19.216 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:19.216 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:19.217 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:19.217 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:19.217 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:19.242 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:19.257 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:19.257 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:19.257 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:19.257 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:19.257 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:19.257 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:19.257 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:19.257 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:19.258 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:19.257 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:19.258 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:19.258 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:19.258 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:19.303 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:19.372 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:19.372 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:19.372 [DEBUG - pool-596-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:19.372 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:19.372 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:19.372 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:19.372 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:19.373 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:19.373 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:19.373 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:19.373 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:19.373 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:19.373 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:19.402 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 9de81db54be40687a2a82164db1dc50b since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 9de81db54be40687a2a82164db1dc50b is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:19.415 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:19.437 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:19.440 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.252:38727(127.9.79.252:38727)] connecting to peer
18:35:19.440 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.253:36577(127.9.79.253:36577)] connecting to peer
18:35:19.440 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.254:42669(127.9.79.254:42669)] connecting to peer
18:35:19.440 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.441 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.79.252:38727(127.9.79.252:38727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.441 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.252:38727: Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.441 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.441 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.79.254:42669(127.9.79.254:42669)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.441 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.254:42669: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.441 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.441 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.79.253:36577(127.9.79.253:36577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.441 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.253:36577: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.441 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.79.252:38727,127.9.79.253:36577,127.9.79.254:42669; will retry
18:35:19.445 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:19.461 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535719460 for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:19.469 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 44da982c06b461d5d727b866dc4fd1ed (1965 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:35:19.470 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
18:35:19.543 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:19.543 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:19.543 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:19.543 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:19.543 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:19.544 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:19.544 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:19.544 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:19.544 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:19.544 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:19.544 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:19.544 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:19.544 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:19.627 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:19.627 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:19.627 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:19.627 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:19.627 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:19.627 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:19.628 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:19.628 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:19.628 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:19.628 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:19.628 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:19.628 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:19.628 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:19.634 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:19.635 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:19.635 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:19.635 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.635 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.635 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.635 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.635 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.635 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.635 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.635 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.636 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.636 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:19.637 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28022), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [10ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [13ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [18ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [18ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [52ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [58ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [60ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [60ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [84ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [121ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [143ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [181ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [262ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [301ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [301ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [304ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [305ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [322ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [322ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [322ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [323ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [702ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [702ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [702ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [702ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [900ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [902ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [902ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [903ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [903ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [3460ms] refreshing cache from master, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [3462ms] too many traces: truncated at 100 traces, deferred=Deferred@1505536021(state=PENDING, result=null, callback=(continuation of Deferred@1974431439 after retry RPC after error@399780312) -> (continuation of Deferred@1370173526 after retry RPC after error@1844168310) -> (continuation of Deferred@1664881682 after retry RPC after error@1435532100) -> (continuation of Deferred@1571932192 after retry RPC after error@1859812758) -> (continuation of Deferred@1833265371 after retry RPC after error@995718252) -> (continuation of Deferred@1761233903 after retry RPC after error@1433517483) -> (continuation of Deferred@322180206 after retry RPC after error@1665067120) -> (continuation of Deferred@1495364299 after retry RPC after error@31789217) -> (continuation of Deferred@843182999 after retry RPC after error@648605895) -> (continuation of Deferred@1959619059 after retry RPC after error@1560547283) -> (continuation of Deferred@1617203887 after retry RPC after error@19622060) -> (continuation of Deferred@506858379 after retry RPC after error@1664214281) -> (continuation of Deferred@654635562 after retry RPC after error@2108719214) -> (continuation of Deferred@1400157696 after retry RPC after error@1065425098) -> (continuation of Deferred@1066674354 after retry RPC after error@1188986078) -> (continuation of Deferred@812385971 after retry RPC after error@119279420) -> (continuation of Deferred@433284821 after retry RPC after error@744411581) -> (continuation of Deferred@2086077211 after retry RPC after error@466982466) -> (continuation of Deferred@431144483 after retry RPC after error@1127958417) -> (continuation of Deferred@120638262 after retry RPC after error@820001300) -> (continuation of Deferred@1018157453 after retry RPC after error@632362566) -> (continuation of Deferred@618201277 after retry RPC after error@366522024) -> (continuation of Deferred@1475968559 after retry RPC after error@2052542896) -> (continuation of Deferred@375880367 after retry RPC after error@1176124197) -> (continuation of Deferred@1519267279 after retry RPC after error@437530111) -> (continuation of Deferred@931896848 after retry RPC after error@543115479) -> (continuation of Deferred@194312518 after retry RPC after error@810833438), errback=(continuation of Deferred@1974431439 after retry RPC after error@399780312) -> (continuation of Deferred@1370173526 after retry RPC after error@1844168310) -> (continuation of Deferred@1664881682 after retry RPC after error@1435532100) -> (continuation of Deferred@1571932192 after retry RPC after error@1859812758) -> (continuation of Deferred@1833265371 after retry RPC after error@995718252) -> (continuation of Deferred@1761233903 after retry RPC after error@1433517483) -> (continuation of Deferred@322180206 after retry RPC after error@1665067120) -> (continuation of Deferred@1495364299 after retry RPC after error@31789217) -> (continuation of Deferred@843182999 after retry RPC after error@648605895) -> (continuation of Deferred@1959619059 after retry RPC after error@1560547283) -> (continuation of Deferred@1617203887 after retry RPC after error@19622060) -> (continuation of Deferred@506858379 after retry RPC after error@1664214281) -> (continuation of Deferred@654635562 after retry RPC after error@2108719214) -> (continuation of Deferred@1400157696 after retry RPC after error@1065425098) -> (continuation of Deferred@1066674354 after retry RPC after error@1188986078) -> (continuation of Deferred@812385971 after retry RPC after error@119279420) -> (continuation of Deferred@433284821 after retry RPC after error@744411581) -> (continuation of Deferred@2086077211 after retry RPC after error@466982466) -> (continuation of Deferred@431144483 after retry RPC after error@1127958417) -> (continuation of Deferred@120638262 after retry RPC after error@820001300) -> (continuation of Deferred@1018157453 after retry RPC after error@632362566) -> (continuation of Deferred@618201277 after retry RPC after error@366522024) -> (continuation of Deferred@1475968559 after retry RPC after error@2052542896) -> (continuation of Deferred@375880367 after retry RPC after error@1176124197) -> (continuation of Deferred@1519267279 after retry RPC after error@437530111) -> (continuation of Deferred@931896848 after retry RPC after error@543115479) -> (continuation of Deferred@194312518 after retry RPC after error@810833438)))
18:35:19.638 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:19.638 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:19.638 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:19.638 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.638 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28022), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [10ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [13ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [18ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [18ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [52ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [58ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [60ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [60ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [84ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [121ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [143ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [181ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [262ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [301ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [301ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [304ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [305ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [322ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [322ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [322ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [323ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [702ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [702ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [702ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [702ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [900ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [902ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [902ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [903ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [903ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [3460ms] refreshing cache from master, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [3462ms] too many traces: truncated at 100 traces, deferred=Deferred@1505536021(state=PENDING, result=null, callback=(continuation of Deferred@1974431439 after retry RPC after error@399780312) -> (continuation of Deferred@1370173526 after retry RPC after error@1844168310) -> (continuation of Deferred@1664881682 after retry RPC after error@1435532100) -> (continuation of Deferred@1571932192 after retry RPC after error@1859812758) -> (continuation of Deferred@1833265371 after retry RPC after error@995718252) -> (continuation of Deferred@1761233903 after retry RPC after error@1433517483) -> (continuation of Deferred@322180206 after retry RPC after error@1665067120) -> (continuation of Deferred@1495364299 after retry RPC after error@31789217) -> (continuation of Deferred@843182999 after retry RPC after error@648605895) -> (continuation of Deferred@1959619059 after retry RPC after error@1560547283) -> (continuation of Deferred@1617203887 after retry RPC after error@19622060) -> (continuation of Deferred@506858379 after retry RPC after error@1664214281) -> (continuation of Deferred@654635562 after retry RPC after error@2108719214) -> (continuation of Deferred@1400157696 after retry RPC after error@1065425098) -> (continuation of Deferred@1066674354 after retry RPC after error@1188986078) -> (continuation of Deferred@812385971 after retry RPC after error@119279420) -> (continuation of Deferred@433284821 after retry RPC after error@744411581) -> (continuation of Deferred@2086077211 after retry RPC after error@466982466) -> (continuation of Deferred@431144483 after retry RPC after error@1127958417) -> (continuation of Deferred@120638262 after retry RPC after error@820001300) -> (continuation of Deferred@1018157453 after retry RPC after error@632362566) -> (continuation of Deferred@618201277 after retry RPC after error@366522024) -> (continuation of Deferred@1475968559 after retry RPC after error@2052542896) -> (continuation of Deferred@375880367 after retry RPC after error@1176124197) -> (continuation of Deferred@1519267279 after retry RPC after error@437530111) -> (continuation of Deferred@931896848 after retry RPC after error@543115479) -> (continuation of Deferred@194312518 after retry RPC after error@810833438), errback=(continuation of Deferred@1974431439 after retry RPC after error@399780312) -> (continuation of Deferred@1370173526 after retry RPC after error@1844168310) -> (continuation of Deferred@1664881682 after retry RPC after error@1435532100) -> (continuation of Deferred@1571932192 after retry RPC after error@1859812758) -> (continuation of Deferred@1833265371 after retry RPC after error@995718252) -> (continuation of Deferred@1761233903 after retry RPC after error@1433517483) -> (continuation of Deferred@322180206 after retry RPC after error@1665067120) -> (continuation of Deferred@1495364299 after retry RPC after error@31789217) -> (continuation of Deferred@843182999 after retry RPC after error@648605895) -> (continuation of Deferred@1959619059 after retry RPC after error@1560547283) -> (continuation of Deferred@1617203887 after retry RPC after error@19622060) -> (continuation of Deferred@506858379 after retry RPC after error@1664214281) -> (continuation of Deferred@654635562 after retry RPC after error@2108719214) -> (continuation of Deferred@1400157696 after retry RPC after error@1065425098) -> (continuation of Deferred@1066674354 after retry RPC after error@1188986078) -> (continuation of Deferred@812385971 after retry RPC after error@119279420) -> (continuation of Deferred@433284821 after retry RPC after error@744411581) -> (continuation of Deferred@2086077211 after retry RPC after error@466982466) -> (continuation of Deferred@431144483 after retry RPC after error@1127958417) -> (continuation of Deferred@120638262 after retry RPC after error@820001300) -> (continuation of Deferred@1018157453 after retry RPC after error@632362566) -> (continuation of Deferred@618201277 after retry RPC after error@366522024) -> (continuation of Deferred@1475968559 after retry RPC after error@2052542896) -> (continuation of Deferred@375880367 after retry RPC after error@1176124197) -> (continuation of Deferred@1519267279 after retry RPC after error@437530111) -> (continuation of Deferred@931896848 after retry RPC after error@543115479) -> (continuation of Deferred@194312518 after retry RPC after error@810833438)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28022), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [10ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [13ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [18ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [18ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [52ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [58ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [60ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [60ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [84ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [121ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [143ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [181ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [262ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [301ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [301ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [304ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [305ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [322ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [322ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [322ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [323ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [702ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [702ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [702ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [702ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [900ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [902ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [902ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [903ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [903ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [3460ms] refreshing cache from master, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [3462ms] too many traces: truncated at 100 traces, deferred=Deferred@1505536021(state=PENDING, result=null, callback=(continuation of Deferred@1974431439 after retry RPC after error@399780312) -> (continuation of Deferred@1370173526 after retry RPC after error@1844168310) -> (continuation of Deferred@1664881682 after retry RPC after error@1435532100) -> (continuation of Deferred@1571932192 after retry RPC after error@1859812758) -> (continuation of Deferred@1833265371 after retry RPC after error@995718252) -> (continuation of Deferred@1761233903 after retry RPC after error@1433517483) -> (continuation of Deferred@322180206 after retry RPC after error@1665067120) -> (continuation of Deferred@1495364299 after retry RPC after error@31789217) -> (continuation of Deferred@843182999 after retry RPC after error@648605895) -> (continuation of Deferred@1959619059 after retry RPC after error@1560547283) -> (continuation of Deferred@1617203887 after retry RPC after error@19622060) -> (continuation of Deferred@506858379 after retry RPC after error@1664214281) -> (continuation of Deferred@654635562 after retry RPC after error@2108719214) -> (continuation of Deferred@1400157696 after retry RPC after error@1065425098) -> (continuation of Deferred@1066674354 after retry RPC after error@1188986078) -> (continuation of Deferred@812385971 after retry RPC after error@119279420) -> (continuation of Deferred@433284821 after retry RPC after error@744411581) -> (continuation of Deferred@2086077211 after retry RPC after error@466982466) -> (continuation of Deferred@431144483 after retry RPC after error@1127958417) -> (continuation of Deferred@120638262 after retry RPC after error@820001300) -> (continuation of Deferred@1018157453 after retry RPC after error@632362566) -> (continuation of Deferred@618201277 after retry RPC after error@366522024) -> (continuation of Deferred@1475968559 after retry RPC after error@2052542896) -> (continuation of Deferred@375880367 after retry RPC after error@1176124197) -> (continuation of Deferred@1519267279 after retry RPC after error@437530111) -> (continuation of Deferred@931896848 after retry RPC after error@543115479) -> (continuation of Deferred@194312518 after retry RPC after error@810833438), errback=(continuation of Deferred@1974431439 after retry RPC after error@399780312) -> (continuation of Deferred@1370173526 after retry RPC after error@1844168310) -> (continuation of Deferred@1664881682 after retry RPC after error@1435532100) -> (continuation of Deferred@1571932192 after retry RPC after error@1859812758) -> (continuation of Deferred@1833265371 after retry RPC after error@995718252) -> (continuation of Deferred@1761233903 after retry RPC after error@1433517483) -> (continuation of Deferred@322180206 after retry RPC after error@1665067120) -> (continuation of Deferred@1495364299 after retry RPC after error@31789217) -> (continuation of Deferred@843182999 after retry RPC after error@648605895) -> (continuation of Deferred@1959619059 after retry RPC after error@1560547283) -> (continuation of Deferred@1617203887 after retry RPC after error@19622060) -> (continuation of Deferred@506858379 after retry RPC after error@1664214281) -> (continuation of Deferred@654635562 after retry RPC after error@2108719214) -> (continuation of Deferred@1400157696 after retry RPC after error@1065425098) -> (continuation of Deferred@1066674354 after retry RPC after error@1188986078) -> (continuation of Deferred@812385971 after retry RPC after error@119279420) -> (continuation of Deferred@433284821 after retry RPC after error@744411581) -> (continuation of Deferred@2086077211 after retry RPC after error@466982466) -> (continuation of Deferred@431144483 after retry RPC after error@1127958417) -> (continuation of Deferred@120638262 after retry RPC after error@820001300) -> (continuation of Deferred@1018157453 after retry RPC after error@632362566) -> (continuation of Deferred@618201277 after retry RPC after error@366522024) -> (continuation of Deferred@1475968559 after retry RPC after error@2052542896) -> (continuation of Deferred@375880367 after retry RPC after error@1176124197) -> (continuation of Deferred@1519267279 after retry RPC after error@437530111) -> (continuation of Deferred@931896848 after retry RPC after error@543115479) -> (continuation of Deferred@194312518 after retry RPC after error@810833438)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.96.188:32989
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:35:19.639 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.639 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.639 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.639 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.639 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.640 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.640 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.641 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.641 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:19.674 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:19.674 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:19.675 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:19.675 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.675 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.676 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.676 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.676 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.676 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.678 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28022), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [10ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [13ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [18ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [18ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [52ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [58ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [60ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [60ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [84ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [121ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [143ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [181ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [262ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [301ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [301ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [304ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [305ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [322ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [322ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [322ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [323ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [702ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [702ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [702ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [702ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [900ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [902ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [902ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [903ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [903ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [3460ms] refreshing cache from master, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [3462ms] too many traces: truncated at 100 traces, deferred=Deferred@1505536021(state=PENDING, result=null, callback=(continuation of Deferred@1974431439 after retry RPC after error@399780312) -> (continuation of Deferred@1370173526 after retry RPC after error@1844168310) -> (continuation of Deferred@1664881682 after retry RPC after error@1435532100) -> (continuation of Deferred@1571932192 after retry RPC after error@1859812758) -> (continuation of Deferred@1833265371 after retry RPC after error@995718252) -> (continuation of Deferred@1761233903 after retry RPC after error@1433517483) -> (continuation of Deferred@322180206 after retry RPC after error@1665067120) -> (continuation of Deferred@1495364299 after retry RPC after error@31789217) -> (continuation of Deferred@843182999 after retry RPC after error@648605895) -> (continuation of Deferred@1959619059 after retry RPC after error@1560547283) -> (continuation of Deferred@1617203887 after retry RPC after error@19622060) -> (continuation of Deferred@506858379 after retry RPC after error@1664214281) -> (continuation of Deferred@654635562 after retry RPC after error@2108719214) -> (continuation of Deferred@1400157696 after retry RPC after error@1065425098) -> (continuation of Deferred@1066674354 after retry RPC after error@1188986078) -> (continuation of Deferred@812385971 after retry RPC after error@119279420) -> (continuation of Deferred@433284821 after retry RPC after error@744411581) -> (continuation of Deferred@2086077211 after retry RPC after error@466982466) -> (continuation of Deferred@431144483 after retry RPC after error@1127958417) -> (continuation of Deferred@120638262 after retry RPC after error@820001300) -> (continuation of Deferred@1018157453 after retry RPC after error@632362566) -> (continuation of Deferred@618201277 after retry RPC after error@366522024) -> (continuation of Deferred@1475968559 after retry RPC after error@2052542896) -> (continuation of Deferred@375880367 after retry RPC after error@1176124197) -> (continuation of Deferred@1519267279 after retry RPC after error@437530111) -> (continuation of Deferred@931896848 after retry RPC after error@543115479) -> (continuation of Deferred@194312518 after retry RPC after error@810833438), errback=(continuation of Deferred@1974431439 after retry RPC after error@399780312) -> (continuation of Deferred@1370173526 after retry RPC after error@1844168310) -> (continuation of Deferred@1664881682 after retry RPC after error@1435532100) -> (continuation of Deferred@1571932192 after retry RPC after error@1859812758) -> (continuation of Deferred@1833265371 after retry RPC after error@995718252) -> (continuation of Deferred@1761233903 after retry RPC after error@1433517483) -> (continuation of Deferred@322180206 after retry RPC after error@1665067120) -> (continuation of Deferred@1495364299 after retry RPC after error@31789217) -> (continuation of Deferred@843182999 after retry RPC after error@648605895) -> (continuation of Deferred@1959619059 after retry RPC after error@1560547283) -> (continuation of Deferred@1617203887 after retry RPC after error@19622060) -> (continuation of Deferred@506858379 after retry RPC after error@1664214281) -> (continuation of Deferred@654635562 after retry RPC after error@2108719214) -> (continuation of Deferred@1400157696 after retry RPC after error@1065425098) -> (continuation of Deferred@1066674354 after retry RPC after error@1188986078) -> (continuation of Deferred@812385971 after retry RPC after error@119279420) -> (continuation of Deferred@433284821 after retry RPC after error@744411581) -> (continuation of Deferred@2086077211 after retry RPC after error@466982466) -> (continuation of Deferred@431144483 after retry RPC after error@1127958417) -> (continuation of Deferred@120638262 after retry RPC after error@820001300) -> (continuation of Deferred@1018157453 after retry RPC after error@632362566) -> (continuation of Deferred@618201277 after retry RPC after error@366522024) -> (continuation of Deferred@1475968559 after retry RPC after error@2052542896) -> (continuation of Deferred@375880367 after retry RPC after error@1176124197) -> (continuation of Deferred@1519267279 after retry RPC after error@437530111) -> (continuation of Deferred@931896848 after retry RPC after error@543115479) -> (continuation of Deferred@194312518 after retry RPC after error@810833438)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28022), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [10ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [13ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [18ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [18ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [52ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [58ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [60ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [60ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [82ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [84ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [84ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [101ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [101ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [121ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [142ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [143ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [181ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [261ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [262ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [301ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [301ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [304ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [305ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [322ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [322ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [322ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [323ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [702ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [702ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [702ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [702ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [900ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [902ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.190:44161: Network error: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161, [902ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.189:33339: Network error: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339, [903ms] Sub RPC ConnectToMaster: received response from server master-127.2.96.188:32989: Network error: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [903ms] delaying RPC due to: Service unavailable: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989, [3460ms] refreshing cache from master, [3460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.190:44161, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.189:33339, [3461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.96.188:32989, [3462ms] too many traces: truncated at 100 traces, deferred=Deferred@1505536021(state=PENDING, result=null, callback=(continuation of Deferred@1974431439 after retry RPC after error@399780312) -> (continuation of Deferred@1370173526 after retry RPC after error@1844168310) -> (continuation of Deferred@1664881682 after retry RPC after error@1435532100) -> (continuation of Deferred@1571932192 after retry RPC after error@1859812758) -> (continuation of Deferred@1833265371 after retry RPC after error@995718252) -> (continuation of Deferred@1761233903 after retry RPC after error@1433517483) -> (continuation of Deferred@322180206 after retry RPC after error@1665067120) -> (continuation of Deferred@1495364299 after retry RPC after error@31789217) -> (continuation of Deferred@843182999 after retry RPC after error@648605895) -> (continuation of Deferred@1959619059 after retry RPC after error@1560547283) -> (continuation of Deferred@1617203887 after retry RPC after error@19622060) -> (continuation of Deferred@506858379 after retry RPC after error@1664214281) -> (continuation of Deferred@654635562 after retry RPC after error@2108719214) -> (continuation of Deferred@1400157696 after retry RPC after error@1065425098) -> (continuation of Deferred@1066674354 after retry RPC after error@1188986078) -> (continuation of Deferred@812385971 after retry RPC after error@119279420) -> (continuation of Deferred@433284821 after retry RPC after error@744411581) -> (continuation of Deferred@2086077211 after retry RPC after error@466982466) -> (continuation of Deferred@431144483 after retry RPC after error@1127958417) -> (continuation of Deferred@120638262 after retry RPC after error@820001300) -> (continuation of Deferred@1018157453 after retry RPC after error@632362566) -> (continuation of Deferred@618201277 after retry RPC after error@366522024) -> (continuation of Deferred@1475968559 after retry RPC after error@2052542896) -> (continuation of Deferred@375880367 after retry RPC after error@1176124197) -> (continuation of Deferred@1519267279 after retry RPC after error@437530111) -> (continuation of Deferred@931896848 after retry RPC after error@543115479) -> (continuation of Deferred@194312518 after retry RPC after error@810833438), errback=(continuation of Deferred@1974431439 after retry RPC after error@399780312) -> (continuation of Deferred@1370173526 after retry RPC after error@1844168310) -> (continuation of Deferred@1664881682 after retry RPC after error@1435532100) -> (continuation of Deferred@1571932192 after retry RPC after error@1859812758) -> (continuation of Deferred@1833265371 after retry RPC after error@995718252) -> (continuation of Deferred@1761233903 after retry RPC after error@1433517483) -> (continuation of Deferred@322180206 after retry RPC after error@1665067120) -> (continuation of Deferred@1495364299 after retry RPC after error@31789217) -> (continuation of Deferred@843182999 after retry RPC after error@648605895) -> (continuation of Deferred@1959619059 after retry RPC after error@1560547283) -> (continuation of Deferred@1617203887 after retry RPC after error@19622060) -> (continuation of Deferred@506858379 after retry RPC after error@1664214281) -> (continuation of Deferred@654635562 after retry RPC after error@2108719214) -> (continuation of Deferred@1400157696 after retry RPC after error@1065425098) -> (continuation of Deferred@1066674354 after retry RPC after error@1188986078) -> (continuation of Deferred@812385971 after retry RPC after error@119279420) -> (continuation of Deferred@433284821 after retry RPC after error@744411581) -> (continuation of Deferred@2086077211 after retry RPC after error@466982466) -> (continuation of Deferred@431144483 after retry RPC after error@1127958417) -> (continuation of Deferred@120638262 after retry RPC after error@820001300) -> (continuation of Deferred@1018157453 after retry RPC after error@632362566) -> (continuation of Deferred@618201277 after retry RPC after error@366522024) -> (continuation of Deferred@1475968559 after retry RPC after error@2052542896) -> (continuation of Deferred@375880367 after retry RPC after error@1176124197) -> (continuation of Deferred@1519267279 after retry RPC after error@437530111) -> (continuation of Deferred@931896848 after retry RPC after error@543115479) -> (continuation of Deferred@194312518 after retry RPC after error@810833438)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.2.96.188:32989
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
18:35:19.679 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
18:35:19.679 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.679 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (9de81db54be40687a2a82164db1dc50b) switched from state RUNNING to RESTARTING.
18:35:19.679 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.679 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.680 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:19.680 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to CANCELING.
18:35:19.680 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#4) of source Source: KuduSource.
18:35:19.680 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#4) of source Source: KuduSource.
18:35:19.681 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to CANCELING.
18:35:19.681 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
18:35:19.681 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#5) of source Source: KuduSource.
18:35:19.681 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to CANCELING.
18:35:19.681 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to CANCELING.
18:35:19.681 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#4) of source Source: KuduSource.
18:35:19.681 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
18:35:19.681 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to CANCELING.
18:35:19.682 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
18:35:19.683 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CANCELING to CANCELED.
18:35:19.683 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
18:35:19.686 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
18:35:19.686 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to CANCELING.
18:35:19.686 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
18:35:19.688 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
18:35:19.688 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CANCELING to CANCELED.
18:35:19.688 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
18:35:19.688 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#5 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
18:35:19.688 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to CANCELING.
18:35:19.688 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#5 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
18:35:19.689 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
18:35:19.690 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
18:35:19.690 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to CANCELING.
18:35:19.690 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
18:35:19.690 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CANCELING to CANCELED.
18:35:19.690 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#5 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
18:35:19.691 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
18:35:19.691 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CANCELING to CANCELED.
18:35:19.691 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#4 (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
18:35:19.692 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#4 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
18:35:19.692 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#4 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
18:35:19.693 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#5 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
18:35:19.693 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CANCELING to CANCELED.
18:35:19.693 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#4 3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
18:35:19.724 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:19.725 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:19.725 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:19.725 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:19.725 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:19.725 [DEBUG - pool-566-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:19.726 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:19.726 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:19.726 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.726 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:19.726 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:19.726 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.726 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.726 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:19.726 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:19.726 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.727 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.727 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.726 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.727 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.727 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CANCELING to CANCELED.
18:35:19.726 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:19.729 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:19.729 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:19.729 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:19.726 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.729 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:19.729 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CANCELING to CANCELED.
18:35:19.730 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
18:35:19.730 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
18:35:19.730 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (3e207c8473346af65b0f563311ef3e51_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CANCELING to CANCELED.
18:35:19.730 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 9de81db54be40687a2a82164db1dc50b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
18:35:19.731 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 9de81db54be40687a2a82164db1dc50b
18:35:19.743 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:19.754 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:19.755 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:19.755 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:19.755 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.755 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.755 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.755 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.755 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.755 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.755 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.755 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.755 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.755 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:19.774 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:19.775 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:19.775 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:19.775 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.775 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.775 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.775 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.775 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.775 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.775 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.775 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.775 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.776 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:19.780 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.252:38727(127.9.79.252:38727)] connecting to peer
18:35:19.780 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.253:36577(127.9.79.253:36577)] connecting to peer
18:35:19.780 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.254:42669(127.9.79.254:42669)] connecting to peer
18:35:19.781 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.781 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.781 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.79.252:38727(127.9.79.252:38727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.781 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.79.253:36577(127.9.79.253:36577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.781 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.253:36577: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:19.781 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.781 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.79.254:42669(127.9.79.254:42669)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.781 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.254:42669: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:19.781 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.252:38727: Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:19.781 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.9.79.252:38727,127.9.79.253:36577,127.9.79.254:42669; will retry
18:35:19.794 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:19.794 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:19.794 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:19.795 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.795 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.795 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.795 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.795 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.795 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.795 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.795 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.795 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.795 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:19.803 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:19.815 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:19.815 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:19.815 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:19.816 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.816 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.816 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.816 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.816 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.816 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.816 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.816 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.816 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.816 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:19.823 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:19.823 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:19.823 [DEBUG - pool-556-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:19.823 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:19.823 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:19.823 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:19.823 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:19.823 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:19.824 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:19.824 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:19.824 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:19.824 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:19.824 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:19.914 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:19.915 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:19.915 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:19.915 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.915 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:19.915 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.916 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:19.916 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:19.916 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:19.916 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:19.916 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:19.916 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.916 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:19.916 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:19.916 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:19.916 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.916 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:19.917 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:19.917 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:19.917 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:19.917 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:19.917 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:19.916 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.917 [INFO - pool-526-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:19.917 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.917 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:19.917 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:19.937 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:19.945 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:19.961 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535719960 for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:19.972 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 44da982c06b461d5d727b866dc4fd1ed (1965 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
18:35:19.973 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
18:35:20.135 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:20.136 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:20.136 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:20.136 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:20.136 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:20.136 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:20.136 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:20.136 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:20.136 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:20.136 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:20.136 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:20.136 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:20.137 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:20.164 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:20.164 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:20.164 [DEBUG - pool-598-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:20.164 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:20.164 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:20.165 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:20.165 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:20.165 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:20.165 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:20.165 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:20.165 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:20.165 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:20.165 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:20.243 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:20.277 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:20.277 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:20.278 [DEBUG - pool-568-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:20.278 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:20.278 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:20.278 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:20.278 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:20.278 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:20.278 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:20.278 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:20.278 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:20.278 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:20.278 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:20.294 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:20.294 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:20.295 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:20.295 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:20.295 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:20.295 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:20.295 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:20.295 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:20.295 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:20.295 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:20.295 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:20.295 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:20.295 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:20.303 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:20.305 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:20.306 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:20.306 [DEBUG - pool-536-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:20.306 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:20.306 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:20.306 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:20.306 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:20.306 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:20.306 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:20.306 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:20.306 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:20.306 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:20.306 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:20.321 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:20.322 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:20.322 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:20.322 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:20.322 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:20.322 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:20.322 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:20.322 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:20.322 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:20.322 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:20.322 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:20.322 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:20.322 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:20.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:35:20Z chronyd exiting
18:35:20.395 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:20.395 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:20.395 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:20.395 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:20.395 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:20.395 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:20.395 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:20.395 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:20.395 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:20.395 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:20.395 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:20.395 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:20.396 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:20.414 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:20.437 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:20.445 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:20.461 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535720460 for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:20.469 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 44da982c06b461d5d727b866dc4fd1ed (1965 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
18:35:20.470 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
18:35:20.520 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.252:38727(127.9.79.252:38727)] connecting to peer
18:35:20.520 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.253:36577(127.9.79.253:36577)] connecting to peer
18:35:20.520 [DEBUG - pool-602-thread-1] (Connection.java:748) [peer master-127.9.79.254:42669(127.9.79.254:42669)] connecting to peer
18:35:20.521 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:20.521 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:20.521 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:20.521 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.79.254:42669(127.9.79.254:42669)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:20.521 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.79.253:36577(127.9.79.253:36577)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:20.521 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.79.252:38727(127.9.79.252:38727)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:20.521 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.253:36577: Failed to connect to peer master-127.9.79.253:36577(127.9.79.253:36577): Connection refused: /127.9.79.253:36577
18:35:20.521 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.252:38727: Failed to connect to peer master-127.9.79.252:38727(127.9.79.252:38727): Connection refused: /127.9.79.252:38727
18:35:20.521 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.79.254:42669: Failed to connect to peer master-127.9.79.254:42669(127.9.79.254:42669): Connection refused: /127.9.79.254:42669
18:35:20.521 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.79.252:38727,127.9.79.253:36577,127.9.79.254:42669; will retry
18:35:20.556 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:20.556 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:20.557 [DEBUG - pool-542-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:20.557 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:20.557 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:20.557 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:20.557 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:20.557 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:20.557 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:20.557 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:20.557 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:20.557 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:20.557 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:20.649 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:20.649 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:20.649 [DEBUG - pool-546-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:20.650 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:20.650 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:20.650 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:20.650 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:20.650 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:20.650 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:20.650 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:20.650 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:20.650 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:20.650 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:20.680 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:20.680 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:20.680 [DEBUG - pool-528-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:20.680 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:20.680 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:20.681 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:20.681 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:20.681 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:20.681 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:20.681 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:20.681 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:20.681 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:20.681 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:20.682 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29091), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [21ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [23ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [32ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [32ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [68ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [74ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [75ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [75ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [83ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [83ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [84ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [84ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [100ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [101ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [122ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [122ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [162ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [162ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [221ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [221ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [221ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [441ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [441ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [442ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [442ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [641ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [641ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [642ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [642ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1660ms] refreshing cache from master, [1660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1661ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1663ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2840ms] refreshing cache from master, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2841ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2841ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2841ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2842ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [3783ms] refreshing cache from master, [3783ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [3783ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [3783ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [3785ms] too many traces: truncated at 100 traces, deferred=Deferred@1722207174(state=PENDING, result=null, callback=(continuation of Deferred@1587400824 after retry RPC after error@1212608452) -> (continuation of Deferred@920462375 after retry RPC after error@1727345089) -> (continuation of Deferred@1448817527 after retry RPC after error@698146487) -> (continuation of Deferred@1983855551 after retry RPC after error@965441408) -> (continuation of Deferred@910437197 after retry RPC after error@2044867156) -> (continuation of Deferred@1989090324 after retry RPC after error@341459506) -> (continuation of Deferred@64167351 after retry RPC after error@1808527115) -> (continuation of Deferred@1697259994 after retry RPC after error@598193311) -> (continuation of Deferred@948059129 after retry RPC after error@210053205) -> (continuation of Deferred@949353710 after retry RPC after error@638104623) -> (continuation of Deferred@268177124 after retry RPC after error@706627790) -> (continuation of Deferred@1039905775 after retry RPC after error@1588707763) -> (continuation of Deferred@836071343 after retry RPC after error@1767184739) -> (continuation of Deferred@156351341 after retry RPC after error@1497194413) -> (continuation of Deferred@1133509426 after retry RPC after error@47217697) -> (continuation of Deferred@115221957 after retry RPC after error@892191364) -> (continuation of Deferred@164096376 after retry RPC after error@142060821) -> (continuation of Deferred@2146451923 after retry RPC after error@605193547) -> (continuation of Deferred@313009304 after retry RPC after error@662846685) -> (continuation of Deferred@1510022951 after retry RPC after error@1787425265) -> (continuation of Deferred@961971420 after retry RPC after error@251929599) -> (continuation of Deferred@1571745055 after retry RPC after error@2014152994) -> (continuation of Deferred@1970311835 after retry RPC after error@1539660817) -> (continuation of Deferred@1906938979 after retry RPC after error@1710835693) -> (continuation of Deferred@351069571 after retry RPC after error@1698170587) -> (continuation of Deferred@1477414035 after retry RPC after error@2003201616), errback=(continuation of Deferred@1587400824 after retry RPC after error@1212608452) -> (continuation of Deferred@920462375 after retry RPC after error@1727345089) -> (continuation of Deferred@1448817527 after retry RPC after error@698146487) -> (continuation of Deferred@1983855551 after retry RPC after error@965441408) -> (continuation of Deferred@910437197 after retry RPC after error@2044867156) -> (continuation of Deferred@1989090324 after retry RPC after error@341459506) -> (continuation of Deferred@64167351 after retry RPC after error@1808527115) -> (continuation of Deferred@1697259994 after retry RPC after error@598193311) -> (continuation of Deferred@948059129 after retry RPC after error@210053205) -> (continuation of Deferred@949353710 after retry RPC after error@638104623) -> (continuation of Deferred@268177124 after retry RPC after error@706627790) -> (continuation of Deferred@1039905775 after retry RPC after error@1588707763) -> (continuation of Deferred@836071343 after retry RPC after error@1767184739) -> (continuation of Deferred@156351341 after retry RPC after error@1497194413) -> (continuation of Deferred@1133509426 after retry RPC after error@47217697) -> (continuation of Deferred@115221957 after retry RPC after error@892191364) -> (continuation of Deferred@164096376 after retry RPC after error@142060821) -> (continuation of Deferred@2146451923 after retry RPC after error@605193547) -> (continuation of Deferred@313009304 after retry RPC after error@662846685) -> (continuation of Deferred@1510022951 after retry RPC after error@1787425265) -> (continuation of Deferred@961971420 after retry RPC after error@251929599) -> (continuation of Deferred@1571745055 after retry RPC after error@2014152994) -> (continuation of Deferred@1970311835 after retry RPC after error@1539660817) -> (continuation of Deferred@1906938979 after retry RPC after error@1710835693) -> (continuation of Deferred@351069571 after retry RPC after error@1698170587) -> (continuation of Deferred@1477414035 after retry RPC after error@2003201616)))
18:35:20.710 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:20.710 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:20.710 [DEBUG - pool-554-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:20.711 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:20.711 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:20.711 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:20.711 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:20.711 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:20.711 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:20.711 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:20.711 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:20.711 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:20.711 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:20.743 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:20.776 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:20.776 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:20.776 [DEBUG - pool-534-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:20.777 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:20.777 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:20.777 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:20.777 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:20.777 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:20.777 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:20.777 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:20.777 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:20.777 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:20.777 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:20.778 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29153), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [18ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [20ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [28ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [28ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [41ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [42ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [44ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [64ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [80ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [81ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [81ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [141ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [181ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [261ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [262ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [262ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [262ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [382ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [383ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [383ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [384ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [401ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [402ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [402ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [402ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1404ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1404ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1721ms] refreshing cache from master, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1722ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1724ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [5801ms] refreshing cache from master, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [5802ms] too many traces: truncated at 100 traces, deferred=Deferred@1995037013(state=PENDING, result=null, callback=(continuation of Deferred@1253360440 after retry RPC after error@60493246) -> (continuation of Deferred@1946079616 after retry RPC after error@1264950747) -> (continuation of Deferred@665074316 after retry RPC after error@2080978235) -> (continuation of Deferred@2038340075 after retry RPC after error@512907354) -> (continuation of Deferred@417624414 after retry RPC after error@762396564) -> (continuation of Deferred@541936144 after retry RPC after error@747734731) -> (continuation of Deferred@398748806 after retry RPC after error@871201909) -> (continuation of Deferred@2033892818 after retry RPC after error@1497222112) -> (continuation of Deferred@1839803421 after retry RPC after error@897575689) -> (continuation of Deferred@419894361 after retry RPC after error@777170514) -> (continuation of Deferred@171947585 after retry RPC after error@1087517612) -> (continuation of Deferred@1641435699 after retry RPC after error@1523400805) -> (continuation of Deferred@766998723 after retry RPC after error@2091479434) -> (continuation of Deferred@792585190 after retry RPC after error@532889612) -> (continuation of Deferred@161763927 after retry RPC after error@1043748808) -> (continuation of Deferred@2127868219 after retry RPC after error@2064801229) -> (continuation of Deferred@1343196690 after retry RPC after error@1552620492) -> (continuation of Deferred@118301711 after retry RPC after error@1847131414) -> (continuation of Deferred@1112248793 after retry RPC after error@1176155943) -> (continuation of Deferred@685362871 after retry RPC after error@25192183) -> (continuation of Deferred@526121543 after retry RPC after error@208393476) -> (continuation of Deferred@1788943944 after retry RPC after error@1746168373) -> (continuation of Deferred@677199026 after retry RPC after error@2051805000), errback=(continuation of Deferred@1253360440 after retry RPC after error@60493246) -> (continuation of Deferred@1946079616 after retry RPC after error@1264950747) -> (continuation of Deferred@665074316 after retry RPC after error@2080978235) -> (continuation of Deferred@2038340075 after retry RPC after error@512907354) -> (continuation of Deferred@417624414 after retry RPC after error@762396564) -> (continuation of Deferred@541936144 after retry RPC after error@747734731) -> (continuation of Deferred@398748806 after retry RPC after error@871201909) -> (continuation of Deferred@2033892818 after retry RPC after error@1497222112) -> (continuation of Deferred@1839803421 after retry RPC after error@897575689) -> (continuation of Deferred@419894361 after retry RPC after error@777170514) -> (continuation of Deferred@171947585 after retry RPC after error@1087517612) -> (continuation of Deferred@1641435699 after retry RPC after error@1523400805) -> (continuation of Deferred@766998723 after retry RPC after error@2091479434) -> (continuation of Deferred@792585190 after retry RPC after error@532889612) -> (continuation of Deferred@161763927 after retry RPC after error@1043748808) -> (continuation of Deferred@2127868219 after retry RPC after error@2064801229) -> (continuation of Deferred@1343196690 after retry RPC after error@1552620492) -> (continuation of Deferred@118301711 after retry RPC after error@1847131414) -> (continuation of Deferred@1112248793 after retry RPC after error@1176155943) -> (continuation of Deferred@685362871 after retry RPC after error@25192183) -> (continuation of Deferred@526121543 after retry RPC after error@208393476) -> (continuation of Deferred@1788943944 after retry RPC after error@1746168373) -> (continuation of Deferred@677199026 after retry RPC after error@2051805000)))
18:35:20.802 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:20.831 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.125:40423(127.30.195.125:40423)] connecting to peer
18:35:20.831 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.124:38627(127.30.195.124:38627)] connecting to peer
18:35:20.831 [DEBUG - pool-574-thread-1] (Connection.java:748) [peer master-127.30.195.126:33747(127.30.195.126:33747)] connecting to peer
18:35:20.832 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:20.832 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.195.125:40423(127.30.195.125:40423)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:20.832 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:20.832 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.195.126:33747(127.30.195.126:33747)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:20.832 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.125:40423: Failed to connect to peer master-127.30.195.125:40423(127.30.195.125:40423): Connection refused: /127.30.195.125:40423
18:35:20.832 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.126:33747: Failed to connect to peer master-127.30.195.126:33747(127.30.195.126:33747): Connection refused: /127.30.195.126:33747
18:35:20.832 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:20.832 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.195.124:38627(127.30.195.124:38627)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:20.832 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.195.124:38627: Failed to connect to peer master-127.30.195.124:38627(127.30.195.124:38627): Connection refused: /127.30.195.124:38627
18:35:20.832 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.30.195.125:40423,127.30.195.124:38627,127.30.195.126:33747; will retry
18:35:20.915 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:20.937 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:20.944 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:20.961 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783535720960 for job 44da982c06b461d5d727b866dc4fd1ed.
18:35:20.970 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 44da982c06b461d5d727b866dc4fd1ed (1965 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
18:35:20.970 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
18:35:21.004 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:21.004 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:21.004 [DEBUG - pool-540-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:21.005 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:21.005 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:21.005 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:21.005 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:21.005 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:21.005 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:21.005 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:21.005 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:21.005 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:21.005 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:21.183 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:21.183 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:21.183 [DEBUG - pool-530-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:21.184 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:21.184 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:21.184 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:21.184 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:21.184 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:21.184 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:21.184 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:21.184 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:21.184 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:21.184 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:21.185 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29566), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [57ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [59ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [60ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [83ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [83ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [121ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [121ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [142ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [161ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [161ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [262ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [262ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [262ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [262ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [422ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [422ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [422ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [423ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [742ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [742ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1660ms] refreshing cache from master, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1663ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1663ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2281ms] refreshing cache from master, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2283ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [2283ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [2283ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [5661ms] refreshing cache from master, [5661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [5662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [5662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [5662ms] too many traces: truncated at 100 traces, deferred=Deferred@192397006(state=PENDING, result=null, callback=(continuation of Deferred@1915403458 after retry RPC after error@1633743520) -> (continuation of Deferred@525009446 after retry RPC after error@696012495) -> (continuation of Deferred@236403598 after retry RPC after error@1753496862) -> (continuation of Deferred@798578714 after retry RPC after error@1691902224) -> (continuation of Deferred@1403317582 after retry RPC after error@444684009) -> (continuation of Deferred@2134742059 after retry RPC after error@1481288253) -> (continuation of Deferred@745595623 after retry RPC after error@1020710814) -> (continuation of Deferred@802785507 after retry RPC after error@575657063) -> (continuation of Deferred@159612179 after retry RPC after error@52685186) -> (continuation of Deferred@1616832405 after retry RPC after error@1013906197) -> (continuation of Deferred@773288558 after retry RPC after error@845472215) -> (continuation of Deferred@621922881 after retry RPC after error@1860971429) -> (continuation of Deferred@2080219156 after retry RPC after error@1854049509) -> (continuation of Deferred@1164578998 after retry RPC after error@1255451325) -> (continuation of Deferred@1547656947 after retry RPC after error@639636533) -> (continuation of Deferred@869945319 after retry RPC after error@1555339875) -> (continuation of Deferred@2061148096 after retry RPC after error@1560132882) -> (continuation of Deferred@1027171357 after retry RPC after error@1168541275) -> (continuation of Deferred@1806443952 after retry RPC after error@1510473978) -> (continuation of Deferred@753376810 after retry RPC after error@1568817587) -> (continuation of Deferred@1468624406 after retry RPC after error@1302113229) -> (continuation of Deferred@1562012314 after retry RPC after error@316290899) -> (continuation of Deferred@247403200 after retry RPC after error@643105305) -> (continuation of Deferred@680911603 after retry RPC after error@1798711325) -> (continuation of Deferred@493424297 after retry RPC after error@321032919) -> (continuation of Deferred@338131002 after retry RPC after error@1309396067) -> (continuation of Deferred@465739597 after retry RPC after error@485561032), errback=(continuation of Deferred@1915403458 after retry RPC after error@1633743520) -> (continuation of Deferred@525009446 after retry RPC after error@696012495) -> (continuation of Deferred@236403598 after retry RPC after error@1753496862) -> (continuation of Deferred@798578714 after retry RPC after error@1691902224) -> (continuation of Deferred@1403317582 after retry RPC after error@444684009) -> (continuation of Deferred@2134742059 after retry RPC after error@1481288253) -> (continuation of Deferred@745595623 after retry RPC after error@1020710814) -> (continuation of Deferred@802785507 after retry RPC after error@575657063) -> (continuation of Deferred@159612179 after retry RPC after error@52685186) -> (continuation of Deferred@1616832405 after retry RPC after error@1013906197) -> (continuation of Deferred@773288558 after retry RPC after error@845472215) -> (continuation of Deferred@621922881 after retry RPC after error@1860971429) -> (continuation of Deferred@2080219156 after retry RPC after error@1854049509) -> (continuation of Deferred@1164578998 after retry RPC after error@1255451325) -> (continuation of Deferred@1547656947 after retry RPC after error@639636533) -> (continuation of Deferred@869945319 after retry RPC after error@1555339875) -> (continuation of Deferred@2061148096 after retry RPC after error@1560132882) -> (continuation of Deferred@1027171357 after retry RPC after error@1168541275) -> (continuation of Deferred@1806443952 after retry RPC after error@1510473978) -> (continuation of Deferred@753376810 after retry RPC after error@1568817587) -> (continuation of Deferred@1468624406 after retry RPC after error@1302113229) -> (continuation of Deferred@1562012314 after retry RPC after error@316290899) -> (continuation of Deferred@247403200 after retry RPC after error@643105305) -> (continuation of Deferred@680911603 after retry RPC after error@1798711325) -> (continuation of Deferred@493424297 after retry RPC after error@321032919) -> (continuation of Deferred@338131002 after retry RPC after error@1309396067) -> (continuation of Deferred@465739597 after retry RPC after error@485561032)))
18:35:21.195 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.190:44161(127.2.96.190:44161)] connecting to peer
18:35:21.195 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.189:33339(127.2.96.189:33339)] connecting to peer
18:35:21.195 [DEBUG - pool-526-thread-1] (Connection.java:748) [peer master-127.2.96.188:32989(127.2.96.188:32989)] connecting to peer
18:35:21.195 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:21.195 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.96.190:44161(127.2.96.190:44161)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:21.195 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.190:44161: Failed to connect to peer master-127.2.96.190:44161(127.2.96.190:44161): Connection refused: /127.2.96.190:44161
18:35:21.195 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:21.195 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:21.195 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.96.189:33339(127.2.96.189:33339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:21.195 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.96.188:32989(127.2.96.188:32989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:21.195 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.189:33339: Failed to connect to peer master-127.2.96.189:33339(127.2.96.189:33339): Connection refused: /127.2.96.189:33339
18:35:21.195 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.96.188:32989: Failed to connect to peer master-127.2.96.188:32989(127.2.96.188:32989): Connection refused: /127.2.96.188:32989
18:35:21.195 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.2.96.190:44161,127.2.96.189:33339,127.2.96.188:32989; will retry
18:35:21.243 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 41f18052e8363382138bde77e16b10c3 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 41f18052e8363382138bde77e16b10c3 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:21.291 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.189:42349(127.7.200.189:42349)] connecting to peer
18:35:21.291 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.190:40077(127.7.200.190:40077)] connecting to peer
18:35:21.292 [DEBUG - pool-544-thread-1] (Connection.java:748) [peer master-127.7.200.188:38999(127.7.200.188:38999)] connecting to peer
18:35:21.292 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:21.292 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:21.292 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.7.200.189:42349(127.7.200.189:42349)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:21.292 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.7.200.190:40077(127.7.200.190:40077)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:21.292 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.189:42349: Failed to connect to peer master-127.7.200.189:42349(127.7.200.189:42349): Connection refused: /127.7.200.189:42349
18:35:21.292 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.190:40077: Failed to connect to peer master-127.7.200.190:40077(127.7.200.190:40077): Connection refused: /127.7.200.190:40077
18:35:21.292 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:21.292 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.7.200.188:38999(127.7.200.188:38999)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:21.292 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.7.200.188:38999: Failed to connect to peer master-127.7.200.188:38999(127.7.200.188:38999): Connection refused: /127.7.200.188:38999
18:35:21.292 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.7.200.189:42349,127.7.200.190:40077,127.7.200.188:38999; will retry
18:35:21.302 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 4cd649562a0f5305571102b5c888c5a9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 4cd649562a0f5305571102b5c888c5a9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:21.306 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.254:41811(127.30.11.254:41811)] connecting to peer
18:35:21.306 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.252:39405(127.30.11.252:39405)] connecting to peer
18:35:21.307 [DEBUG - pool-570-thread-1] (Connection.java:748) [peer master-127.30.11.253:35677(127.30.11.253:35677)] connecting to peer
18:35:21.307 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:21.307 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:21.307 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.11.254:41811(127.30.11.254:41811)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:21.307 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.11.252:39405(127.30.11.252:39405)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:21.307 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.254:41811: Failed to connect to peer master-127.30.11.254:41811(127.30.11.254:41811): Connection refused: /127.30.11.254:41811
18:35:21.307 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:21.307 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.252:39405: Failed to connect to peer master-127.30.11.252:39405(127.30.11.252:39405): Connection refused: /127.30.11.252:39405
18:35:21.307 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.11.253:35677(127.30.11.253:35677)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:21.307 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.11.253:35677: Failed to connect to peer master-127.30.11.253:35677(127.30.11.253:35677): Connection refused: /127.30.11.253:35677
18:35:21.307 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.11.254:41811,127.30.11.252:39405,127.30.11.253:35677; will retry
18:35:21.377 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.60:39171(127.5.136.60:39171)] connecting to peer
18:35:21.378 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.62:42905(127.5.136.62:42905)] connecting to peer
18:35:21.378 [DEBUG - pool-548-thread-1] (Connection.java:748) [peer master-127.5.136.61:43625(127.5.136.61:43625)] connecting to peer
18:35:21.378 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:21.378 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.5.136.60:39171(127.5.136.60:39171)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:21.378 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:21.378 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.5.136.62:42905(127.5.136.62:42905)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:21.378 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.60:39171: Failed to connect to peer master-127.5.136.60:39171(127.5.136.60:39171): Connection refused: /127.5.136.60:39171
18:35:21.378 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.62:42905: Failed to connect to peer master-127.5.136.62:42905(127.5.136.62:42905): Connection refused: /127.5.136.62:42905
18:35:21.378 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:21.378 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.5.136.61:43625(127.5.136.61:43625)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:21.378 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.5.136.61:43625: Failed to connect to peer master-127.5.136.61:43625(127.5.136.61:43625): Connection refused: /127.5.136.61:43625
18:35:21.378 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.5.136.60:39171,127.5.136.62:42905,127.5.136.61:43625; will retry
18:35:21.399 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.125:38957(127.28.250.125:38957)] connecting to peer
18:35:21.399 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.124:38123(127.28.250.124:38123)] connecting to peer
18:35:21.399 [DEBUG - pool-592-thread-1] (Connection.java:748) [peer master-127.28.250.126:43415(127.28.250.126:43415)] connecting to peer
18:35:21.399 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:21.399 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:21.399 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.28.250.125:38957(127.28.250.125:38957)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:21.399 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:21.399 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.125:38957: Failed to connect to peer master-127.28.250.125:38957(127.28.250.125:38957): Connection refused: /127.28.250.125:38957
18:35:21.399 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.250.124:38123(127.28.250.124:38123)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:21.399 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.28.250.126:43415(127.28.250.126:43415)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:21.399 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.124:38123: Failed to connect to peer master-127.28.250.124:38123(127.28.250.124:38123): Connection refused: /127.28.250.124:38123
18:35:21.400 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.28.250.126:43415: Failed to connect to peer master-127.28.250.126:43415(127.28.250.126:43415): Connection refused: /127.28.250.126:43415
18:35:21.400 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.28.250.125:38957,127.28.250.124:38123,127.28.250.126:43415; will retry
18:35:21.415 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 2f0efe0c81addbcaea565a6248e4a915 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (2/4) of job 2f0efe0c81addbcaea565a6248e4a915 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..

Time: 350.704

OK (7 tests)

18:35:21.427 [INFO - PermanentBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
18:35:21.428 [INFO - BlobServer shutdown hook] (BlobServer.java:401) Stopped BLOB server at 0.0.0.0:34301
18:35:21.434 [INFO - FileCache shutdown hook] (FileCache.java:160) removed file cache directory /tmp/flink-dist-cache-ee2528ad-2b42-49eb-90e4-8a2ee513dbbd
18:35:21.436 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job fa73e37017778341a79e5b3ef3d55eb9 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job fa73e37017778341a79e5b3ef3d55eb9 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:21.437 [INFO - FileChannelManagerImpl-netty-shuffle shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-22963432-2c59-4026-bd85-ea5c7c444138
18:35:21.441 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.190:46863(127.1.59.190:46863)] connecting to peer
18:35:21.441 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.189:42073(127.1.59.189:42073)] connecting to peer
18:35:21.442 [DEBUG - pool-560-thread-1] (Connection.java:748) [peer master-127.1.59.188:33901(127.1.59.188:33901)] connecting to peer
18:35:21.442 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:21.442 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.59.190:46863(127.1.59.190:46863)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:21.442 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:21.442 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.59.189:42073(127.1.59.189:42073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:21.442 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.190:46863: Failed to connect to peer master-127.1.59.190:46863(127.1.59.190:46863): Connection refused: /127.1.59.190:46863
18:35:21.442 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.189:42073: Failed to connect to peer master-127.1.59.189:42073(127.1.59.189:42073): Connection refused: /127.1.59.189:42073
18:35:21.442 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:21.442 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.59.188:33901(127.1.59.188:33901)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:21.442 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.59.188:33901: Failed to connect to peer master-127.1.59.188:33901(127.1.59.188:33901): Connection refused: /127.1.59.188:33901
18:35:21.442 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.1.59.190:46863,127.1.59.189:42073,127.1.59.188:33901; will retry
18:35:21.443 [INFO - TaskExecutorFileMergingManager shutdown hook] (TaskExecutorFileMergingManager.java:126) Shutting down TaskExecutorFileMergingManager.
18:35:21.444 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job f6e63683f34d031c5da392b08baea20c since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job f6e63683f34d031c5da392b08baea20c is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
18:35:21.446 [INFO - FileCache shutdown hook] (FileCache.java:160) removed file cache directory /tmp/flink-dist-cache-f4004e1f-dbcb-4759-8d6a-40a5680c2dec
18:35:21.447 [INFO - PermanentBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
18:35:21.447 [INFO - FileChannelManagerImpl-io shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-2a11d994-0f19-494d-a7fb-941cd5779e0f
18:35:21.448 [INFO - TaskExecutorLocalStateStoresManager shutdown hook] (TaskExecutorLocalStateStoresManager.java:314) Shutting down TaskExecutorLocalStateStoresManager.
18:35:21.448 [INFO - TaskExecutorLocalStateStoresManager shutdown hook] (TaskExecutorLocalStateStoresManager.java:314) Shutting down TaskExecutorLocalStateStoresManager.
18:35:21.448 [INFO - FileChannelManagerImpl-io shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-73220d93-0007-4744-8559-4cb70a8f6b0e
18:35:21.448 [INFO - TaskExecutorStateChangelogStoragesManager shutdown hook] (TaskExecutorStateChangelogStoragesManager.java:234) Shutting down TaskExecutorStateChangelogStoragesManager.
18:35:21.450 [INFO - FileCache shutdown hook] (FileCache.java:160) removed file cache directory /tmp/flink-dist-cache-a2982c9b-b3f8-4207-88c2-a9c1f964a73f
18:35:21.450 [INFO - FileChannelManagerImpl-io shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-acf1a867-99cb-4169-afe7-7041959c9264
18:35:21.451 [INFO - BlobServer shutdown hook] (BlobServer.java:401) Stopped BLOB server at 0.0.0.0:33513
18:35:21.451 [INFO - FileCache shutdown hook] (FileCache.java:160) removed file cache directory /tmp/flink-dist-cache-1b689f62-6bbf-4187-95c9-956da254e8c8
18:35:21.452 [INFO - IOManagerAsync shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-acfbcaad-cb57-4377-acce-7d0ae4c86bbb
18:35:21.453 [INFO - TransientBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
18:35:21.453 [INFO - PermanentBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
18:35:21.455 [INFO - FileChannelManagerImpl-io shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-5fd41e96-3eb4-477a-9571-728734392aee
18:35:21.455 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.188:36795(127.3.43.188:36795)] connecting to peer
18:35:21.455 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.189:32951(127.3.43.189:32951)] connecting to peer
18:35:21.455 [DEBUG - pool-531-thread-1] (Connection.java:748) [peer master-127.3.43.190:40613(127.3.43.190:40613)] connecting to peer
18:35:21.455 [INFO - FileChannelManagerImpl-netty-shuffle shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-025d1e8d-505c-44a3-bd11-8e4c55e5159e
18:35:21.456 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:21.456 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.43.188:36795(127.3.43.188:36795)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:21.456 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.188:36795: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795
18:35:21.456 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:21.456 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.43.190:40613(127.3.43.190:40613)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:21.456 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.190:40613: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613
18:35:21.456 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:21.456 [INFO - BlobServer shutdown hook] (BlobServer.java:401) Stopped BLOB server at 0.0.0.0:43561
18:35:21.456 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.43.189:32951(127.3.43.189:32951)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:21.456 [INFO - FileChannelManagerImpl-netty-shuffle shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-471e4013-fba1-4dcd-9dcd-810dadebce40
18:35:21.456 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.43.189:32951: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951
18:35:21.456 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613; will retry
18:35:21.457 [INFO - FileChannelManagerImpl-io shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-3cea3ef9-8b6b-4edd-9b11-f626254ca5af
18:35:21.457 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29839), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [31ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [32ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [36ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [36ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [46ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [47ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [48ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [48ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [65ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [66ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [66ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [82ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [82ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [101ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [102ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [152ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [152ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [182ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [182ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [221ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [221ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [222ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [222ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [261ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [262ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [262ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [262ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [601ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [602ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [602ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [602ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1400ms] refreshing cache from master, [1400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1402ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1900ms] refreshing cache from master, [1900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [1901ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.190:40613: Network error: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.189:32951: Network error: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951, [1902ms] Sub RPC ConnectToMaster: received response from server master-127.3.43.188:36795: Network error: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [1902ms] delaying RPC due to: Service unavailable: Master config (127.3.43.188:36795,127.3.43.189:32951,127.3.43.190:40613) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.190:40613(127.3.43.190:40613): Connection refused: /127.3.43.190:40613,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.189:32951(127.3.43.189:32951): Connection refused: /127.3.43.189:32951,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.43.188:36795(127.3.43.188:36795): Connection refused: /127.3.43.188:36795, [2520ms] refreshing cache from master, [2520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.188:36795, [2520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.189:32951, [2521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.43.190:40613, [2521ms] too many traces: truncated at 100 traces, deferred=Deferred@846102694(state=PENDING, result=null, callback=(continuation of Deferred@618366905 after retry RPC after error@1231252566) -> (continuation of Deferred@1206105065 after retry RPC after error@21913603) -> (continuation of Deferred@2035341788 after retry RPC after error@721619836) -> (continuation of Deferred@1898285326 after retry RPC after error@60404049) -> (continuation of Deferred@2096629447 after retry RPC after error@1335081679) -> (continuation of Deferred@312682442 after retry RPC after error@1560154102) -> (continuation of Deferred@1619850384 after retry RPC after error@840658828) -> (continuation of Deferred@965575538 after retry RPC after error@362854922) -> (continuation of Deferred@303035482 after retry RPC after error@2072092312) -> (continuation of Deferred@776078473 after retry RPC after error@1050839969) -> (continuation of Deferred@1398932747 after retry RPC after error@618669217) -> (continuation of Deferred@439884536 after retry RPC after error@820864413) -> (continuation of Deferred@1944351958 after retry RPC after error@1451528999) -> (continuation of Deferred@212974805 after retry RPC after error@1462497619) -> (continuation of Deferred@121208228 after retry RPC after error@1977011151) -> (continuation of Deferred@1946195636 after retry RPC after error@2091470862) -> (continuation of Deferred@816961122 after retry RPC after error@1937439496) -> (continuation of Deferred@62875365 after retry RPC after error@899710908) -> (continuation of Deferred@194817452 after retry RPC after error@790275436) -> (continuation of Deferred@1474983460 after retry RPC after error@1627500282) -> (continuation of Deferred@262053563 after retry RPC after error@1976921057) -> (continuation of Deferred@1896507433 after retry RPC after error@487620236) -> (continuation of Deferred@1719681235 after retry RPC after error@953460097) -> (continuation of Deferred@440261010 after retry RPC after error@80158791), errback=(continuation of Deferred@618366905 after retry RPC after error@1231252566) -> (continuation of Deferred@1206105065 after retry RPC after error@21913603) -> (continuation of Deferred@2035341788 after retry RPC after error@721619836) -> (continuation of Deferred@1898285326 after retry RPC after error@60404049) -> (continuation of Deferred@2096629447 after retry RPC after error@1335081679) -> (continuation of Deferred@312682442 after retry RPC after error@1560154102) -> (continuation of Deferred@1619850384 after retry RPC after error@840658828) -> (continuation of Deferred@965575538 after retry RPC after error@362854922) -> (continuation of Deferred@303035482 after retry RPC after error@2072092312) -> (continuation of Deferred@776078473 after retry RPC after error@1050839969) -> (continuation of Deferred@1398932747 after retry RPC after error@618669217) -> (continuation of Deferred@439884536 after retry RPC after error@820864413) -> (continuation of Deferred@1944351958 after retry RPC after error@1451528999) -> (continuation of Deferred@212974805 after retry RPC after error@1462497619) -> (continuation of Deferred@121208228 after retry RPC after error@1977011151) -> (continuation of Deferred@1946195636 after retry RPC after error@2091470862) -> (continuation of Deferred@816961122 after retry RPC after error@1937439496) -> (continuation of Deferred@62875365 after retry RPC after error@899710908) -> (continuation of Deferred@194817452 after retry RPC after error@790275436) -> (continuation of Deferred@1474983460 after retry RPC after error@1627500282) -> (continuation of Deferred@262053563 after retry RPC after error@1976921057) -> (continuation of Deferred@1896507433 after retry RPC after error@487620236) -> (continuation of Deferred@1719681235 after retry RPC after error@953460097) -> (continuation of Deferred@440261010 after retry RPC after error@80158791)))
18:35:21.458 [INFO - FileChannelManagerImpl-netty-shuffle shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-29a0abf4-3261-4f57-9aab-7b022df2f0e4
18:35:21.458 [INFO - TaskExecutorStateChangelogStoragesManager shutdown hook] (TaskExecutorStateChangelogStoragesManager.java:234) Shutting down TaskExecutorStateChangelogStoragesManager.
18:35:21.459 [INFO - TaskExecutorLocalStateStoresManager shutdown hook] (TaskExecutorLocalStateStoresManager.java:314) Shutting down TaskExecutorLocalStateStoresManager.
18:35:21.459 [INFO - FileChannelManagerImpl-netty-shuffle shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-cb93e1d4-68e0-449c-8378-872cb743bc14
18:35:21.460 [INFO - TransientBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
